Commit Graph

317 Commits

Author SHA1 Message Date
Marcus Boerger
a71f734dec move the run-test tests to the top
#if one of these fails there is no need for further testing
2002-11-04 10:45:41 +00:00
Marcus Boerger
abdf302599 sort them 2002-11-04 10:09:42 +00:00
Marcus Boerger
604f333113 better use 'Off' here
#thx to Moriyoshi
2002-11-03 20:28:35 +00:00
Marcus Boerger
b0dac08dff without these nearly all tests fail if for example php.ini contains
output_handler=mb_string
mbstring.http_output=UCS-2LE
2002-11-03 17:43:24 +00:00
Marcus Boerger
388bf9f542 force showing progress of test 2002-11-03 17:40:34 +00:00
Ilia Alshanetsky
a078f6ecc6 Fixed ini argument parsing. We now support ini options with = in the argument,
such as the one being used in session test #21, which is once again working
properly.
2002-11-03 15:42:59 +00:00
Marcus Boerger
ee7f37ae58 pass params used for info call to skipif also
#try php.ini with
#output_handler=mb_string
#mbstring.http_output=UCS-2LE
2002-11-03 10:52:19 +00:00
Marcus Boerger
9e73bcaa33 copy paste error
#all these different versions here....
2002-11-02 22:06:03 +00:00
Marcus Boerger
29e8b92f22 -allow parameters to be directories
-"${dir}" -> $dir
2002-11-02 21:48:05 +00:00
Marcus Boerger
8b80515659 older versions do not have this functions 2002-11-02 12:55:06 +00:00
Marcus Boerger
22375de5e6 ws 2002-11-02 12:44:36 +00:00
Marcus Boerger
524994d9e2 this would break tests by modifying EXPECT sections
#it took a LONG time to realize that tests were ok but failed due to this ini
2002-11-02 12:33:24 +00:00
Marcus Boerger
ad414f28a9 -move -d stuff into function and update settings for info call 2002-11-01 13:03:30 +00:00
Derick Rethans
55a7590f3d Discuss first! 2002-10-31 14:01:58 +00:00
Yasuo Ohgaki
1fb8331fc0 Fixed more ini settings.
# Derick. Be responsible to your change and opinion.
# These are settings I know that should be set.
# There may be other settingis must be set to make
# run-tests.php work as expected.
2002-10-31 13:52:58 +00:00
Ilia Alshanetsky
6514fac1c0 Corrected my email address. 2002-10-30 18:36:39 +00:00
Marcus Boerger
fde7dffabd Enough discussion on display_erros it seems 2002-10-30 12:18:48 +00:00
Marcus Boerger
b968f90580 Get infos from php running tests not from php running run-test.php 2002-10-30 10:42:55 +00:00
Marcus Boerger
02d35d26cd better use array_diff_assoc
the old way resulted in erroneus .diff
2002-10-29 14:13:11 +00:00
Ilia Alshanetsky
47e1163e01 This patch addresses the bogus test failures due to error logging/reporting
confusion.
2002-10-28 18:48:07 +00:00
Marcus Boerger
e816c8b176 remove last line commited by error
revert log_errors
2002-10-28 18:21:09 +00:00
Marcus Boerger
35a3b071ad forgot 'error_log=' and 'report_memleaks=1'
#commenting on php-dev
2002-10-28 18:19:38 +00:00
Marcus Boerger
4440188510 forgot 'error_log=' and 'report_memleaks=1'
#commenting on php-dev
2002-10-28 17:17:50 +00:00
Shane Caraveo
3034c31934 windows will not have these, so dont bother, but add an OS to the stuff so that it makes sense why they are N/A 2002-10-28 02:00:56 +00:00
Shane Caraveo
c82c6263e8 fix getting ini values that contain the char =
fix command line quoting.  windows requires double quotes in order to handle & (in ini values) correctly
2002-10-28 01:43:54 +00:00
Marcus Boerger
4a2efd53bf allow default ini overwrites to be overwritten themselves in --INI--
#see followup on dev list
2002-10-28 00:07:11 +00:00
Marcus Boerger
cc4c0634fe -introduce EXPECTREGEX
-add %c for EXPECTF
#i think we must escape the special characters for EXPECTF: ".()" and such
2002-10-26 16:54:30 +00:00
Ilia Alshanetsky
ebd4182b2c The log_errors=1 breaks a number of tests and is useless for our purposes,
removing.
2002-10-25 17:24:09 +00:00
Marcus Boerger
0718785076 -improoved number detection
-display every error/warning only once
2002-10-24 18:14:39 +00:00
Ilia Alshanetsky
26617f8b5f Added failed test summary. 2002-10-24 13:13:23 +00:00
Jan Lehnardt
b2a8031144 - gcc prints -v information on stderr, make sure that we catch it anyway.
- I hope this does not cause problems with other compilers or shells. IMHO we
 - already rely on /bin/sh anyway, right?
2002-10-24 09:06:31 +00:00
Melvyn Sopacua
1de45a050c Implement 'no interaction' for automated tests
Implement exit status 1 to make actions for automated testing selectable

# Sorry Derick, was already working on this and the docs, see next commit
# and forthcoming email
2002-10-23 20:53:20 +00:00
Derick Rethans
6a1f477be9 [0.05]
- Disable html_errors in info sent
2002-10-23 20:13:42 +00:00
Jan Lehnardt
e96e0ae002 - use the cc that was detected by ./configure when determining version
information in run-tests.php
2002-10-23 17:56:42 +00:00
Marcus Boerger
69ce017d28 remove *.php file for EXPECTF tests, too. 2002-10-23 12:54:57 +00:00
Jan Lehnardt
70251bcac0 - be more verbose 2002-10-23 08:51:17 +00:00
Stefan Esser
e83ca7dc85 fix make test for an external build dir setup 2002-10-22 18:53:56 +00:00
Marcus Boerger
8312f1443c Give back the php file and leave it in case test fails. 2002-10-22 08:54:23 +00:00
Moriyoshi Koizumi
a26a849bb3 Fixed typo. 2002-10-21 10:23:31 +00:00
Moriyoshi Koizumi
cd410cbf9f \s cannot be used with ereg() 2002-10-21 10:22:41 +00:00
Sander Roobol
988c355720 The results of each test should go on a single line 2002-10-21 09:04:56 +00:00
Derick Rethans
8e9f83add2 - Stijl polizei 2002-10-21 08:55:49 +00:00
Melvyn Sopacua
7bb87c31f8 Adds a 'reason' for skipping a test.
# See modifications on ext/xml/tests/007.phpt for example
2002-10-21 08:52:45 +00:00
Derick Rethans
ca1e7301ab - Added %x for HEX chars
- Added %d as alias for %i (too much C here :)
- Added beginning and end markers to regexp
2002-10-18 20:34:41 +00:00
Derick Rethans
03cc839d90 - Removing debugging info 2002-10-17 14:07:32 +00:00
Ilia Alshanetsky
8c6a49f001 Fixed a bug in the calculation of the POST request length. 2002-10-15 16:46:57 +00:00
Yasuo Ohgaki
e6bcb07c75 Fixed warnings 2002-10-14 09:32:36 +00:00
Derick Rethans
2b34f26b33 - Added the TEST_PHP_USER environment variable with which you can specify
additional directories with tests to run. This is ideal for having your own
  test suite on your system. You can specify more directories by seperating them
  with a ",", for example:

  TEST_PHP_USER=/dat/dev/xdebug/tests,/dat/dev/srm/tests make test
2002-10-14 07:18:23 +00:00
Derick Rethans
e17d6518b1 - woohooo! Automatic build test submits! 2002-10-12 19:29:56 +00:00
Melvyn Sopacua
b5676a5b3e When you say string, match at least one char in EXPECTF section
Plus a little protection against globbing like ext/foo/tests/* or worse.

# yes, I've done that
2002-10-10 16:08:15 +00:00
Derick Rethans
4fcc3df5eb - Fix .exp output 2002-10-08 17:51:57 +00:00
Derick Rethans
f830c481f3 - Show easier parseable and greppable output 2002-10-08 08:53:51 +00:00
Derick Rethans
ede9bd58b7 - Use getenv, as $_ENV is not available when variables_order= in php.ini
does not include "E".
2002-10-08 08:39:10 +00:00
Derick Rethans
d53dd88854 - Drop requirement for php.ini-dist
- Adjust test script to hard code ini settings
2002-10-08 07:49:36 +00:00
foobar
9a010becf1 ws fixes 2002-10-08 03:00:06 +00:00
Sander Roobol
35dc97df3b Temporary (?) workaround (?) for is_executable() on Windows. 2002-10-07 15:16:47 +00:00
Melvyn Sopacua
bcddd58a92 Add --EXPECTF-- section: 'sprintf' for EXPECT sections. See for usage
example ext/xslt/tests/009.phpt.
# To aid debugging, a little commented section is left in, this can be
# stripped in due time, or properly integrated with some --debugging flag.
# But it's quite useful, when you make such tests.
2002-10-07 00:05:20 +00:00
Rasmus Lerdorf
f32d63a3b3 Add php_ini_scanned_files() so "make test" can tell you when you have
additional .ini files that are scanned.
2002-10-06 17:04:10 +00:00
Marcus Boerger
2e90bbe3c2 Return to old counting where every test is counted (even those of skipped
extensions). Inform about the number of extensions tested and skipped.
This makes the test summary more compareable.

Maybe i'll add a parameter/env-var to skip extension tests. That way we
could fasten tests for changes in the core. But it has to wait some days.
2002-10-04 21:19:51 +00:00
Marcus Boerger
ad120d2e28 $val not in first param to sprintf 2002-10-03 18:25:30 +00:00
foobar
ac1254a59c unify these files to conform with the new files created by run-tests.php 2002-10-02 22:31:37 +00:00
foobar
fc721174c8 - Run ext/* tests only for those modules that are actually compiled
into the php binary. (faster)
- Skip search of .phpt files if they are passed as parameters
2002-10-02 01:52:25 +00:00
Marcus Boerger
54e066b20b Unlink output files even if test is skipped. 2002-09-11 19:42:59 +00:00
Marcus Boerger
9ede240057 -reimplemented old style output (.exp, .out)
-implemented diff format output
-delete error logs on success
@Changed regression tests produce selectable error reports. The tests now
@recognize environment variable TEST_PHP_LOG_FORMAT which can
@contain O and E for old style .out and .exp files, L for new .log format and
@D for an internal diff format that does not require systems diff. (Marcus)
#diff output makes it easier to detect the failure on huge or combined tests.
#It was discussed that the php function's diff output has the advantage that
#it is available on every system. Everyone insisting on systems diff may
#use diff on .exp and .out files.
2002-08-26 23:26:46 +00:00
Marcus Boerger
28ebb82c41 Added ARGS section to allow passing arguments to CLI tests 2002-08-21 23:06:38 +00:00
Sander Roobol
ef9014d95d Don't know what this line was supposed to DO!?!? 2002-08-19 19:42:20 +00:00
Marcus Boerger
02a12b57e9 -additional section INI that allows to set special ini settings on call
by adding '-c foo=bar' strings to php call. Each line must have format
 foo=bar. This of cause only works for cli version.
-made sections SKIPIF,INI,GET,POST optional
2002-08-03 11:44:12 +00:00
Marcus Boerger
6ff0a9ee4a -make it run again 2002-06-23 00:37:16 +00:00
Sander Roobol
fcb692a75d Made the tests (and not only run-tests.php) actually use php.ini-dist, and
removed unused php.ini file.
2002-06-16 10:58:54 +00:00
foobar
dc26e8d8f5 Skip POST data if it is empty. 2002-05-22 23:40:29 +00:00
Sander Roobol
3f156fe6f9 Fix php.ini-related stuff in run-tests.php 2002-05-19 14:48:27 +00:00
Sander Roobol
e3490f1429 Fix temporary filename problems, and update .cvsignores with new extensions 2002-05-19 13:54:37 +00:00
Sander Roobol
f3a8a7d6bb Fix make test and remove a warning 2002-05-19 13:24:38 +00:00
Sander Roobol
c9872c9199 Cleaned up run-tests.php, and fixed it on linux/unix
# and probably broke it on windows :)
2002-05-19 13:16:03 +00:00
Preston L. Bannister
3d1d6022cd Updated to run cleanly on Win32, and perform a more controlled test. 2002-05-16 21:48:28 +00:00
Stig Bakken
fdb724bffc * try the installed cli binary if everything else fails (I'm starting
to agree that looking too hard for a php binary is wrong)
2002-05-09 06:39:05 +00:00
Markus Fischer
1a3c8e6289 - Add a warning if running with safe_mode enabled. 2002-05-08 07:23:54 +00:00
Yasuo Ohgaki
734899e615 Enable CGI binary for testing. CGI binary should be used when it's
available, since some tests cannot be performed by CLI. (And
many of them are just failing now)
Fixed SAPI and VERSION output.
2002-04-12 01:34:06 +00:00
Yasuo Ohgaki
68f63a012f WS fix 2002-03-19 02:59:15 +00:00
Wez Furlong
b98074ee86 fix problems with cgi/cli sapi when running tests 2002-03-17 13:16:35 +00:00
Yasuo Ohgaki
7f8b2a6533 Fix PHP version and sapi printed so that it does not print bogus
version and sapi name.
2002-03-12 06:43:15 +00:00
Yasuo Ohgaki
270a907bad Do not search php binary in search path, since we are not testing older builds.
Print SAPI used.
2002-03-12 05:33:03 +00:00
Yasuo Ohgaki
7457b8a7ed Use CGI binary when CGI SAPI is there.
Make "php run-tests.php" work with cli SAPI.
# Anyone mind if I change spaces to tabs?
# Currently, it is using spaces and it's should use
# tabs just like C source.
2002-03-12 05:18:25 +00:00
Stig Bakken
8802148fcd * work with sapi/cli 2002-03-02 02:37:13 +00:00
Sebastian Bergmann
90613d2282 Maintain headers. 2002-02-28 08:29:35 +00:00
Sebastian Bergmann
38933514e1 Update headers. 2001-12-11 15:32:16 +00:00
foobar
76fcdc1afb Fix these to give correct results even if register_globals=off or
register_argc_argv=off.
2001-10-23 11:11:29 +00:00
Stig Bakken
5cd46bb2e0 * typo 2001-08-27 20:37:06 +00:00
Stig Bakken
fb610787ff * add the directory where php.exe was found to PATH to help Windows
find its DLLs
2001-08-27 20:29:33 +00:00
Stig Bakken
d1d848c171 * Windows fix 2001-08-27 20:17:36 +00:00
Stig Bakken
2186ced3a6 * MTH (merge _to_ head) 2001-08-27 16:39:49 +00:00
Hartmut Holzgraefe
800b863310 once again, make test would not work right with error_reporting=E_ALL 2001-07-11 13:19:07 +00:00
Stig Bakken
48c02a2e93 * use ereg functions instead of preg
* send stderr to the bit bucket
2001-05-27 09:09:00 +00:00
Daniel Beulshausen
3d5b27d46a make run-tests work under win32 too
# this whole thing is pretty ugly...
2001-05-02 16:39:04 +00:00
Stig Bakken
0edbf4242f * using CGI -C option, you no longer have to specify "full" path to tests 2001-04-16 23:28:58 +00:00
James Moore
af02c17d9f Output php version at end of tests. 2001-03-29 12:07:37 +00:00
André Langhorst
ec31b454d5 I don't like to commit this over and over either, but this client definitely seems to dislike branches 2001-03-21 16:01:52 +00:00
André Langhorst
f438554953 fighting against the cvs client, it does not want to let the win32 binary safe change go in... 2001-03-21 13:00:33 +00:00
André Langhorst
3d9871dcf4 win32 fixes again 2001-03-21 12:52:32 +00:00
Sebastian Bergmann
b132c36325 Disable maximum execution time for tests. 2001-03-21 06:33:00 +00:00
André Langhorst
3ec4aa11d1 1) fixed tests on *both* win32+linux
2) made tests more sophisticated (checking against compiled in modules)
3) minor changes
4) win32 improvements
2001-03-21 06:04:36 +00:00
Andi Gutmans
eb6ba01d1c - Fix copyright notices with 2001 2001-02-26 06:11:02 +00:00
Sascha Schumann
14c195a6d8 Fix "make test" in VPATH environments 2000-12-24 14:24:04 +00:00
Hartmut Holzgraefe
a0acd8054a removed a warning when testing against a single .phpt file 2000-12-15 23:18:50 +00:00
Stig Bakken
73155d10c4 * run-tests.php: fixed a few bugs, including the POST/GET problem reported by
Stas
2000-12-15 02:57:11 +00:00
Stig Bakken
a70b01b96e * rename write* to dowrite* to avoid clash with ext/sockets
* sapi/cgi seems to ignore command-line options when running in "real"
  CGI mode, need to find a way to pass include_path to it...
2000-12-13 14:24:15 +00:00
Stig Bakken
fe9290e4a9 * output fix for skipped tests 2000-12-08 12:57:11 +00:00
Stig Bakken
749ed8568a added TODO comment 2000-12-08 00:21:09 +00:00
Andre Langhorst
5604ae2de4 made run-tests.php windows compatible 2000-12-06 18:29:03 +00:00
Hartmut Holzgraefe
5f683e7d78 changed run-tests.php to use 'php -q' instead of 'php -f' 2000-12-03 10:45:53 +00:00
Stig Bakken
fc4b704fca Test descriptions showed up blank, fixed. 2000-10-29 07:19:35 +00:00
Hartmut Holzgraefe
86c0d81253 have you ever tried to run the regression tests with error_reporting=E_ALL ?
now it will run smoothly without all theese 'undefined ...' warnings
2000-10-23 07:40:05 +00:00
Stig Bakken
e2cb8ec02c * don't require "POST" section to be present (TEST, FILE and EXPECT
are enough)
2000-09-09 00:37:39 +00:00
Stanislav Malyshev
f34430de8a Remove deprecated call-time reference 2000-09-03 09:37:20 +00:00
Stig Bakken
1bb90f5805 * all tests should pass now (expect for the interbase stuff that I haven't
had the chance to test)
2000-08-31 22:21:47 +00:00
Stig Bakken
fad9bab629 * Added "test" make target so you can do "make test" in any directory.
* Added copyright header to run-test.php
2000-08-29 09:12:44 +00:00
Stig Bakken
315f4f5658 @PHP 3 regression testing framework re-born (Stig)
Took the old PHP 3 regression testing framework and rewrote it in PHP.
Should work on both Windows and UNIX, however I have not tested it on
Windows.  See tests/README for how to write tests.  Added the PHP 3
tests and converted most of them.
2000-08-27 19:46:06 +00:00