Commit Graph

365 Commits

Author SHA1 Message Date
Marcus Boerger
42a83a6fc9 - Add --[keep|show]-[all|skip|php] switches 2005-12-21 22:23:47 +00:00
Antony Dovgal
410e15a1c7 MFB: fix notice 2005-12-20 16:18:07 +00:00
Marcus Boerger
8b74d53c61 - Fix --version 2005-12-18 15:46:51 +00:00
Marcus Boerger
9ea6f06711 - WS
- End test script when detecting '===DONE===' that way showing memleaks
2005-12-18 14:50:06 +00:00
Marcus Boerger
6f34dbfa78 - Increase timeut for -m testing 2005-12-18 12:11:54 +00:00
Ilia Alshanetsky
b211d8cc3c MFB51: Added token for capturing arbitrary whitespace blocks inside text. 2005-12-17 16:33:53 +00:00
foobar
4e328517df use right tag here 2005-12-10 18:26:08 +00:00
Marcus Boerger
cd4842781c - Make -U mode play nicely with redirected tests 2005-12-10 17:37:29 +00:00
Marcus Boerger
80a2f09c82 - Add missing global variable 2005-12-10 16:58:35 +00:00
Marcus Boerger
39cf99ed36 - Readd -u and -U
# Removed those accidentially, the diff was obviously too big
2005-12-09 17:59:50 +00:00
Marcus Boerger
ed7797098d - Section FILE does not exist for redirection tests 2005-12-09 09:49:58 +00:00
Marcus Boerger
983b8f570d - Add missing newline 2005-12-09 00:30:05 +00:00
Marcus Boerger
cbf1e913e2 - MFH (Ilia's changes)
- Add ability to create temp files in separate dir and keep them.
- Add ability to generate html file with results as table and links to
  generated files.
2005-12-08 22:48:42 +00:00
foobar
8f45f83124 - Made tests that require CGI skipped if it is not available 2005-12-07 11:28:20 +00:00
foobar
e14cdc034e - Fix file_put_contents() usage: it returns bytes written and it can be 0. 2005-12-07 11:11:01 +00:00
foobar
3b66cc9c37 - Fixed error messages 2005-12-07 10:08:07 +00:00
Dmitry Stogov
4855a3ba08 Fixed incorrect basename() usage 2005-12-07 09:06:30 +00:00
Marcus Boerger
e3e2d33c79 - Show list of leaked files in summary if any
- Use basename correct
2005-12-07 00:01:51 +00:00
Marcus Boerger
826f39b013 - Do not show leak summary if not tested 2005-12-06 23:24:38 +00:00
Marcus Boerger
f2a9649f03 - Fix summaries again 2005-12-06 09:34:44 +00:00
Marcus Boerger
d5ee5c5b0f - Support for '--' style switches
- Modularize output
- Better valgrind integration (valgrind 3.0.0+ required now) (-m)
- Ability to generate an additional html style output log (--html)
- Ability to test unicode + native tests in one go (-U)
2005-12-06 01:51:17 +00:00
Marcus Boerger
507942a34e - Use putenv() correct 2005-12-01 09:59:59 +00:00
Marcus Boerger
885a80dabc - Fix warnings 2005-12-01 08:49:57 +00:00
Marcus Boerger
a015502926 - New environment TEST_PHP_ARGS to allow appending args to run-tests.php
- New mode -q (quiet)
- New mode -s <file> (save output to a file)
2005-12-01 01:26:20 +00:00
Marcus Boerger
ed0b0d1f33 - White space fixes 2005-12-01 00:57:29 +00:00
Marcus Boerger
20c56bd378 - Add support for valgrind testing (Nuno) 2005-12-01 00:26:44 +00:00
Marcus Boerger
0619c8c66c - Output modularization, 1st step 2005-11-26 18:07:49 +00:00
Marcus Boerger
6e4bcd3a5d - Bug 35382 was nit fixed but the test system was not capable for this kind
of tests
2005-11-26 16:33:08 +00:00
Marcus Boerger
ed2043353f - Show whether we execute unicode or native tests 2005-10-06 19:51:03 +00:00
Marcus Boerger
d376ba48ea - WS 2005-10-06 09:39:32 +00:00
Marcus Boerger
8fc1043685 - Fix redir tests, test count, faillog
# Everything should work again now
2005-10-06 09:29:32 +00:00
Marcus Boerger
ea2f242df1 - MFB use new functions 2005-10-06 00:38:55 +00:00
Marcus Boerger
2e2ba68d81 - Fix faillog and make it understand/handle redirected tests 2005-10-06 00:35:08 +00:00
Marcus Boerger
83a8e3d2a8 - Add easy way to test in unicode mode 2005-10-03 18:15:54 +00:00
Derick Rethans
0f391bb0b3 - Add E_RECOVERABLE.
#- Thought I did this before already actually...
2005-09-15 16:19:48 +00:00
foobar
58168205d4 This is like a virus..spread everywhere :) 2005-08-15 22:34:37 +00:00
foobar
077e356572 Goodbye PEAR 2005-08-15 22:30:40 +00:00
Dmitry Stogov
08fe0d1da3 Test engine is improved to support unicode mode 2005-08-15 14:37:55 +00:00
Andrei Zmievski
264cec8be6 Unicode support. 2005-08-11 23:36:07 +00:00
foobar
23e671a51e - Bumber up year 2005-08-03 14:08:58 +00:00
Hartmut Holzgraefe
46a669b7fa make skipif test use ini options specified by -d command line options 2005-08-02 17:05:01 +00:00
Marcus Boerger
ea71e02c7a - Add ENV support (mike) 2005-07-29 17:25:38 +00:00
Marcus Boerger
ef4931f627 - Show end of relay testing block 2005-07-18 00:19:28 +00:00
Jon Parise
6f1261c70c Removing the automake-related output. The build no longer uses automake.
While I'm here, rewrite the PHP_AUTOCONF-related code to more closely
match the conventions used elsewhere in this section.  The result should
be functionally the same as before.
2005-07-11 06:32:02 +00:00
foobar
60ce60d395 show ugly full path for failed redirected tests 2005-07-09 02:41:19 +00:00
foobar
c0d7215b81 Sanitazione 2005-07-08 21:46:23 +00:00
Wez Furlong
626d318f07 sort redirected tests 2005-07-07 13:58:02 +00:00
Wez Furlong
6253c6c5e1 Fix 2 bugs:
- summary is only displayed if 2 or more tests were detected
- error out of a bogus test name is passed in
2005-07-07 12:58:47 +00:00
Wez Furlong
5b84ae26ab Add a new kind of test to the test harness. REDIRECTTEST sections allow an
extension to piggy-back on the tests defined under another dir and run those.

Example of its use follows shortly with pdo tests.
2005-07-06 06:06:23 +00:00
Jon Parise
901419d028 If the PHP_AUTOCONF and PHP_AUTOMAKE environmental variables are set, use
them when describing the build environment.

Support for these variables was originally added to build/build2.mk:1.36.

As a side note, the build system uses PHP_AUTOHEADER.  Perhaps it should
be listed on its own in the build environment for completeness, despite it
being a component of the autoconf package.
2005-07-04 20:37:07 +00:00
foobar
9d14b408cf fix typo 2005-06-20 07:26:46 +00:00
foobar
34e0ba1f92 silence notices 2005-06-16 17:12:26 +00:00
foobar
97666ab4ef Show borked tests in the summary 2005-06-15 09:21:15 +00:00
foobar
ce36ef5787 - Reword the send-report-part a bit. (bug #32624) 2005-04-07 20:22:55 +00:00
foobar
7adac251e3 - Not every OS has ldd.. 2005-04-06 22:14:27 +00:00
foobar
7f4e28d2bd - Fixed bug #32504 (shtool problem on make test) 2005-04-01 13:40:46 +00:00
Ilia Alshanetsky
978f50c046 Detect shtool properly when build-dir != php source dir. 2005-03-20 19:47:13 +00:00
Marcus Boerger
23b3d1ca24 - Readd revised version of Jani's fix:
'errors with -d having a check for invalid ini entries'
- Add -v for verbose mode
2005-03-18 22:43:40 +00:00
foobar
bbe98a88f3 revert 2005-03-18 22:09:31 +00:00
foobar
1524d4890f Fix stupid typos 2005-03-18 21:59:59 +00:00
foobar
ebb8d72d88 Fix errors with -d having a check for invalid ini entries 2005-03-18 21:59:06 +00:00
Magnus M��tt�
27c43d5991 Since in_array is case sensitive we need to convert the names to lowercase
otherwise it won't run tests for extensions where the case of the name differ from the
extension name.
2005-03-09 04:23:02 +00:00
Wez Furlong
b38f21b99c let the test-suite run from an alternate build dir 2005-02-26 15:23:10 +00:00
Marcus Boerger
d02a2df3f0 - Use PHP not C semantics 2005-02-23 01:16:21 +00:00
foobar
91ea475f4d - Fixed bug #29136 (make test - libtool failure on MacOSX) 2005-01-19 01:30:23 +00:00
foobar
ce742b08b0 - Fix typo (avaliable -> available). (bug #28725) 2004-12-16 12:34:32 +00:00
Ilia Alshanetsky
35540fdee6 Added -d option which allows ini options to be specified via command line.
Patch by: Sean Coates
2004-12-06 23:37:20 +00:00
Ilia Alshanetsky
0e46666591 Save test result file inside the build directory. 2004-11-28 20:40:16 +00:00
Ilia Alshanetsky
479af1e75d Fixed bug #30249 (Incorrect timeout check). 2004-09-27 17:30:46 +00:00
Christian Stocker
7b292e2fba Fix for Bug 29010 "make test does not wait to email address" (by Sebastian Nohn) 2004-07-21 11:19:09 +00:00
Ilia Alshanetsky
190227899a Turn off session.auto_start to prevent test failures. 2004-05-26 18:23:21 +00:00
Marcus Boerger
6f699cea5f Bugfix #28229 (PATCH run-tests tripped up by spaces in names) 2004-04-30 08:18:54 +00:00
Ilia Alshanetsky
8ecdc90763 Fixed generate_array_diff(). 2004-03-30 23:58:47 +00:00
Jan Lehnardt
775387e32d - be more verbose 2004-03-29 07:49:32 +00:00
Marcus Boerger
4da754e868 Add ability to pass -n to the executed php 2004-03-28 23:04:53 +00:00
Marcus Boerger
0019c60902 Show progress 2004-03-28 14:12:14 +00:00
Marcus Boerger
e1127cb514 Make run-tests.php work with xdebug being loaded.
# Lots of ppl use that as a built-in extension already.
2004-03-09 14:39:35 +00:00
Ilia Alshanetsky
a0664d54d1 Fixed division by zero warning. 2004-01-16 15:17:37 +00:00
foobar
ccfc46b0aa - Happy new year and PHP 5 for rest of the files too..
# Should the LICENSE and Zend/LICENSE dates be updated too?
2004-01-08 17:33:29 +00:00
Marcus Boerger
a572d79e0a Fix data source 2003-12-29 22:18:40 +00:00
Marcus Boerger
d001928aa2 Align output if one section shows 100% and display percentages when not
counting skipped tests.
2003-12-29 16:07:08 +00:00
Ilia Alshanetsky
bdc30961d0 Properly detect bundled libtool when PHP is built in a separate directory.
Detect version of system libtool, which is used by phpize.
2003-12-23 18:20:46 +00:00
Derick Rethans
f7b3e30fe1 - Remove debug info :) 2003-12-16 15:00:24 +00:00
Derick Rethans
76ec811b35 - Added %e modifier which gets replaced by the current value of
DIRECTORY_SEPARATOR.
2003-12-16 14:53:43 +00:00
Wez Furlong
c92a2219ef Add optional array argument to proc_open() to specify additional
options for the child process.
The first option is "suppress_errors" which will disable any
dialog boxes that arise from missing DLL's and suppress the
GPF dialog.
Use this new feature in the test suite, so that crashing tests don't block the test run; useful for un-attended execution.
2003-12-05 13:45:00 +00:00
Marcus Boerger
c3fddcab62 Fix tests for E_STRICT and check for E_STRICT in run-tests.php. 2003-11-30 13:57:20 +00:00
Marcus Boerger
3cb67f1719 This check is no longer needed (Andrei) 2003-10-02 18:11:10 +00:00
Marcus Boerger
3658ad4c3f Update necessary test INIs 2003-09-04 14:41:10 +00:00
Moriyoshi Koizumi
8fe4a53877 Ensure CGI binary works like CLI.
# This kind of mess should be removed if other better way is found.
2003-08-11 20:02:05 +00:00
Marcus Boerger
2a13d3f9f7 Simplify 2003-08-10 11:46:03 +00:00
foobar
726eb46767 CS fix 2003-08-10 04:23:02 +00:00
Marcus Boerger
e62926dd5b Better diffing 2003-08-09 20:02:02 +00:00
Marcus Boerger
06b089d63b Complain about borked tests instead of spitting out errors 2003-08-09 17:21:19 +00:00
Marcus Boerger
fe37ce8f66 Don't show matching regex as different 2003-08-09 11:57:02 +00:00
Zeev Suraski
9ff7dff10d Shorten output to prevent messup 2003-08-05 08:39:01 +00:00
Zeev Suraski
fec3fc9331 Remove non-standard vim6 option 2003-08-05 08:32:58 +00:00
Zeev Suraski
0770772385 Display the currently running test 2003-08-05 08:31:56 +00:00
Moriyoshi Koizumi
9fe5094d77 Fix run-test.php so it can correctly handle skip conditions. 2003-07-25 05:51:57 +00:00
Ilia Alshanetsky
64d6421885 When encountering a test that users GET/POST make run-tests.php use CGI
sapi if it is avaliable.
If CLI sapi is not avaliable print a clear error when make test is executed.
2003-07-24 17:44:16 +00:00
James Cox
f68c7ff249 updating license information in the headers. 2003-06-10 20:04:29 +00:00
Marcus Boerger
070803a482 Allow optional directories 2003-06-01 18:34:03 +00:00
Marcus Boerger
7ad9732a94 MFB: This is needed though 2003-05-31 14:10:27 +00:00
Marcus Boerger
aa87c89d35 MFB: Showing info/warning once is enough 2003-05-31 12:14:41 +00:00
Marcus Boerger
bbc3c6089b Add php_uname() to output 2003-05-30 12:41:51 +00:00
Marcus Boerger
23e5004132 Execute --SKIPIF-- like --FILE-- 2003-05-29 19:11:51 +00:00
Marcus Boerger
4980461081 Executing tests once is enough 2003-05-23 22:35:15 +00:00
Marcus Boerger
2537e01c77 Allow writing a list of failed tests.
# use php run-tests.php -h for more.
2003-05-23 22:01:38 +00:00
Marcus Boerger
8cd4933d31 Add warning level for tests.
# You set a test to warning by return "warn <description>" from
# the --SKIPIF-- section. But this only works when you supply
# a reason why it is only a warning.
# Warnings are not called for FAILed tests of corse and hence a
# test result with not FAIL but SKIP/PASS/WARN results is mailed
# as a PASS.
2003-05-23 20:51:09 +00:00
Marcus Boerger
57046f4e3e MFB: info in mail too 2003-05-17 23:58:03 +00:00
Marcus Boerger
1939d27aca The env-var TEST_PHP_EXECUTABLE is needed in tests 2003-04-19 17:22:53 +00:00
Marcus Boerger
f97f219fa7 Include ldd output 2003-04-05 12:16:29 +00:00
Marcus Boerger
d94c98c3f2 if TEST_PHP_EXECUTABLE=auto then use ./sapi/cli/php 2003-03-30 14:38:48 +00:00
Derick Rethans
56a172cc04 - Add the exponent to the float modifier 2003-03-28 21:04:45 +00:00
James Cox
485ee3914a updating for new list 2003-03-21 17:17:54 +00:00
Stig Bakken
0e6fca4f22 * email address change 2003-03-18 12:06:09 +00:00
foobar
9f3a46a12e Be sure we get the correct version.. 2003-03-17 12:43:29 +00:00
foobar
908a942a38 added the version info to be send as-is to buildtest-process 2003-03-17 12:24:09 +00:00
Marcus Boerger
9a6db15d21 summary for selective tests if more than one
# maybe i'll change to present summary only when at least one dir selected
2003-03-08 16:28:35 +00:00
Marcus Boerger
3981be30a8 do not use $GLOBAL[] 2003-03-04 19:32:06 +00:00
Marcus Boerger
cbb3e6fd2f fix problem in current HEAD
# strange why on earth does $GLOBALS['cwd'] produce a warning here?
# however we already have a global declarations so we use it for cwd, too.
2003-03-02 15:12:12 +00:00
Derick Rethans
0799d2db84 - Add check for proc_open() being available 2003-02-18 20:07:59 +00:00
Wez Furlong
0a18a9d744 A add much more useful select(2) implementation than is provided by
windows sockets.  The winsock implementation will only work with sockets;
our implementation works with sockets and file descriptors.
By association, stream_select() will now operate correctly with files, pipes and sockets.

This change required linking against the winsock2 library.  In terms of
compatibility, only older versions of windows 95 do not have winsock2
installed by default.  It is available as a redistributable file, and is most likely installed by any OS patches (eg: Internet Explorer) applied by the user.

Also, add a win32 compatible pipe test when opening a stream from a pipe.  This test will only work on NT, win2k and XP platforms.  Without this test, interleaved fread() and select() calls would cause the read buffer to be clobbered.  I will be working on a fix for this issue for win9x.
2003-02-16 03:48:49 +00:00
Wez Furlong
e035fe14e0 If a test does not have any data after 60 seconds of waiting, assume that
it died a horrible death and kill it.
This is useful on windows when a message box is popped-up during an automated
test-run.
2003-02-15 18:09:52 +00:00
Derick Rethans
db0897161c - Make VIM highlighting happy 2003-02-03 12:14:13 +00:00
Melvyn Sopacua
c4eecf9199 Make it easier to diff results of several runs in one day. 2003-02-01 13:28:32 +00:00
Marcus Boerger
494bec466b Simplify 2003-01-26 17:17:44 +00:00
Marcus Boerger
a7d10f8aa4 Bug #21751: Part one never let this happen again... 2003-01-25 19:45:11 +00:00
Jan Lehnardt
c98f4e9f32 - fix typo 2003-01-12 11:42:29 +00:00
Ilia Alshanetsky
b1fab873c2 Added a check for availability of PCRE extension needed by test-suite. 2003-01-07 15:21:34 +00:00
Melvyn Sopacua
e03bccb1ad Delete some security related env variables 2002-12-22 12:48:49 +00:00
Melvyn Sopacua
a4d56067e2 MFB: libtool detection 2002-12-20 00:28:08 +00:00
Derick Rethans
8507eb00f6 - Also send reports when there are no failed tests 2002-12-17 19:07:15 +00:00
Ilia Alshanetsky
2d8945247b Fix a possible E_NOTICE warning message. 2002-12-12 16:14:32 +00:00
Derick Rethans
c4342de561 - MFB 2002-12-11 20:13:43 +00:00
Ilia Alshanetsky
30f83207fe Ask the user for their e-mail address so that we can contact them if need be. 2002-12-11 16:49:00 +00:00
Marcus Boerger
c7dc6c0e00 Move up general tests
# if MFH is needed should be decided by QA team: because the output # sequence changes
2002-11-23 16:57:25 +00:00
Marcus Boerger
d3e095004c Revert that unwanted debug thing - thanks to Sander Robol 2002-11-21 16:48:39 +00:00
Marcus Boerger
64e45b1287 Force showing the question 2002-11-21 15:09:45 +00:00
Marcus Boerger
b7cd48efdd Make it possible to test language features like newly introduced 'abstract'
independantly from debug mode.
2002-11-21 14:56:06 +00:00
Marcus Boerger
7ba0d505af Use eregi is better (noticed by Jon) 2002-11-15 16:33:05 +00:00
Marcus Boerger
0f66b352e9 -Allow skip in upper letters.
-Add 'info' result to --SKIPIF-- -> see following dba commits
2002-11-15 15:57:00 +00:00
Marcus Boerger
ea971db849 Show Zend version 2002-11-15 14:23:40 +00:00
Sander Roobol
8fb395bb9e Move the build-environment stuff down or the test results up, so you
don't need to scroll down to see the failed tests.
2002-11-15 10:37:41 +00:00
Marcus Boerger
5ad332f846 Add magic_quotes_runtime which affects several tests 2002-11-14 21:02:24 +00:00
Marcus Boerger
6048db9005 Only set the overwrites once 2002-11-14 20:12:36 +00:00
Ilia Alshanetsky
eef51c3d6b Disable safe_mode as it interferes with just about every test that needs
to access the file system, set enviroment variables or execute commands.
2002-11-14 18:38:19 +00:00
Melvyn Sopacua
138a1695f5 - Make it possible for people to save results and/or remove unwanted ENV
data.
- Use more options for the CC 'version' flag
2002-11-10 08:56:28 +00:00
Ilia Alshanetsky
7a552596a4 This option is needed if we need to track errors inside the skip condition. 2002-11-08 01:11:05 +00:00
Marcus Boerger
a71f734dec move the run-test tests to the top
#if one of these fails there is no need for further testing
2002-11-04 10:45:41 +00:00
Marcus Boerger
abdf302599 sort them 2002-11-04 10:09:42 +00:00