cpython/Lib/test
2004-06-05 12:33:27 +00:00
..
output Port the dictionary tests from test_types.py to unittest. Collect as much 2004-05-31 16:29:04 +00:00
__init__.py
185test.db Data file for bsddb185 test 2003-05-06 20:37:25 +00:00
audiotest.au
autotest.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
badsyntax_future3.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_future4.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_future5.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_future6.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_future7.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_future8.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_future9.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_nocaret.py Fix compileall.py so that it fails on SyntaxErrors 2001-04-18 01:19:28 +00:00
cfgparser.1 ConfigParser: 2004-05-18 04:24:02 +00:00
cjkencodings_test.py Add CJK codecs support as discussed on python-dev. (SF #873597) 2004-01-17 14:29:29 +00:00
double_const.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
greyrgb.uue
list_tests.py For whatever reason, these files had \r\r\n line endings on Windows, 2004-01-18 21:03:23 +00:00
mapping_tests.py Rename class attribute containing the class to be tested, so the name is the 2004-06-02 18:42:25 +00:00
pickletester.py Deleting cyclic object comparison. 2003-10-28 12:05:48 +00:00
pydocfodder.py SF bug [#472347] pydoc and properties. 2001-10-18 19:56:17 +00:00
pystone.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
re_tests.py More work on bug #672491 and patch #712900. 2003-04-20 07:35:44 +00:00
README Flesh out test_support docs. 2003-04-30 01:42:35 +00:00
regex_tests.py
regrtest.py Patch #868499, adds -T option for code coverage. The implementation is a 2004-02-07 22:43:03 +00:00
reperf.py SF patch #701494: more apply removals 2003-04-06 09:01:11 +00:00
seq_tests.py Move list and tuple tests from test_types.py to their own scripts: 2003-12-08 11:38:45 +00:00
sortperf.py New test %sort. This takes a sorted list, picks 1% of the list positions 2002-08-02 05:46:09 +00:00
string_tests.py Add iswide() and width() method for UserString according as the 2004-06-04 03:18:12 +00:00
test___all__.py * Migrate set() and frozenset() from the sandbox. 2003-11-16 16:17:49 +00:00
test___future__.py Allow both string and Unicode objects in levels. 2002-11-09 20:19:12 +00:00
test__locale.py Enable some unittests on FreeBSD. 2003-12-19 01:16:03 +00:00
test_aepack.py Whitespace normalization. 2003-02-19 02:35:07 +00:00
test_al.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_anydbm.py Massive changes from SF 589982 (tempfile.py rewrite, by Zack 2002-08-09 16:38:32 +00:00
test_applesingle.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_array.py Add weakref support to array.array and file objects. 2004-05-31 00:35:52 +00:00
test_asynchat.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_atexit.py sys.executable can contain spaces, cater for this when passing it to 2003-02-24 15:26:39 +00:00
test_audioop.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_augassign.py Fiddle test_augassign so it passes under -Qnew. 2001-12-11 19:20:15 +00:00
test_base64.py More complete code coverage, including testing the new RFC 3548 support. 2004-01-04 01:13:02 +00:00
test_bastion.py Disable the Bastion test now that Bastion is out of grace. 2003-01-06 15:45:11 +00:00
test_binascii.py Port test_binascii.py to PyUnit and enhance tests. 2004-03-15 12:07:38 +00:00
test_binhex.py Massive changes from SF 589982 (tempfile.py rewrite, by Zack 2002-08-09 16:38:32 +00:00
test_binop.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_bisect.py * Move collections.deque() in from the sandbox 2004-01-29 06:37:52 +00:00
test_bool.py Whitespace normalization. 2003-06-29 05:46:54 +00:00
test_bsddb3.py Add some missing tests. Should now test everything that pybsddb's 2002-12-30 20:53:18 +00:00
test_bsddb185.py simpler temp dir cleanup 2003-05-17 02:54:11 +00:00
test_bsddb.py * Use weakref's of DBCursor objects for the iterator cursors to avoid a 2003-11-03 01:04:41 +00:00
test_bufio.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_builtin.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_bz2.py Patch #734231: Update RiscOS support. In particular, correct 2003-05-10 07:36:56 +00:00
test_calendar.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_call.py SF #904720: dict.update should take a 2-tuple sequence like dict.__init_ 2004-03-04 08:25:44 +00:00
test_capi.py Whitespace normalization. 2003-04-24 16:02:54 +00:00
test_cd.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_cfgparser.py ConfigParser: 2004-05-18 04:24:02 +00:00
test_cgi.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_charmapcodec.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_cl.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_class.py Fix a bunch of typos in documentation, docstrings and comments. 2003-10-20 14:01:56 +00:00
test_cmath.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_codeccallbacks.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_codecencodings_cn.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_codecencodings_jp.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_codecencodings_kr.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_codecencodings_tw.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_codecmaps_cn.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_codecmaps_jp.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_codecmaps_kr.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_codecmaps_tw.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_codecs.py Add test case for unicode(somestring, "idna"). 2004-03-24 16:48:24 +00:00
test_codeop.py Whitespace normalization. 2003-06-15 23:26:30 +00:00
test_coercion.py Make test_coercion.py less sensitive to platform fp quirks. Closes 2004-03-10 17:30:03 +00:00
test_colorsys.py Add a test script for the colorsys module. 2004-04-28 17:07:50 +00:00
test_commands.py CommandTests.testgetoutput(): 2003-03-25 18:50:19 +00:00
test_compare.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_compile.py - Removed FutureWarnings related to hex/oct literals and conversions 2003-11-29 23:52:13 +00:00
test_complex.py Remove useless import. 2003-08-05 15:55:38 +00:00
test_contains.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_cookie.py Exercise sorted() where possible 2004-01-04 11:14:51 +00:00
test_cookielib.py Patch #963318: Add support for client-side cookie management. 2004-05-31 18:22:40 +00:00
test_copy_reg.py cPickle: exempt two_tuple from GC -- it's a speed hack, and doesn't 2003-02-04 21:47:44 +00:00
test_copy.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_cpickle.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_crypt.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_csv.py Make the fieldnames argument optional in the DictReader. If self.fieldnames 2003-10-03 14:03:01 +00:00
test_curses.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_datetime.py SF bug 847019 datetime.datetime initialization needs more strict checking 2004-03-21 23:38:41 +00:00
test_dbm.py Skip test_dbm if we can't write to the file 2002-11-02 18:25:08 +00:00
test_deque.py Make sets and deques weak referencable. 2004-05-30 07:26:47 +00:00
test_descr.py Ensure super() lookup of descriptor from classmethod works (SF #743627) 2004-03-25 02:19:34 +00:00
test_descrtut.py Guido grants a Christmas wish: 2003-12-17 20:43:33 +00:00
test_difflib.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_dircache.py Patch #707167: Pass dircache exceptions to the caller. Fixes #682813. 2003-09-20 15:52:21 +00:00
test_dis.py Delete comment my last checkin rendered obsolete. 2003-04-30 08:42:19 +00:00
test_dl.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_doctest2.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_doctest.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_dumbdbm.py Make close() identical to __del__() for a dumbdbm database. Make 2003-07-13 17:21:10 +00:00
test_dummy_thread.py Whitespace normalization. 2003-06-15 23:26:30 +00:00
test_dummy_threading.py Make time.sleep calls go to 0 for common testing. 2003-04-30 03:03:37 +00:00
test_email_codecs.py Shut the test up and add a missing import 2002-07-19 22:44:23 +00:00
test_email.py Make sure the email test suite can be run both stand-alone and under 2002-10-06 14:37:11 +00:00
test_enumerate.py Tidied up the implementations of reversed (including the custom ones 2004-03-10 10:10:42 +00:00
test_eof.py forgot the best part - the new tests... 2002-08-15 01:28:54 +00:00
test_errno.py Fix a bunch of typos in documentation, docstrings and comments. 2003-10-20 14:01:56 +00:00
test_exceptions.py Patch #734231: Update RiscOS support. In particular, correct 2003-05-10 07:36:56 +00:00
test_extcall.py adding passing test. testing for g(*Nothing()) where Nothing is a user-defined iterator. 2004-02-21 21:03:30 +00:00
test_fcntl.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_file.py Add weakref support to array.array and file objects. 2004-05-31 00:35:52 +00:00
test_filecmp.py Only apply case-insensitivity test on appropriate platforms.' test_filecmp.py 2003-09-02 06:59:21 +00:00
test_fileinput.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_fnmatch.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_fork1.py Oops, missed an import of test_support. 2002-07-23 19:23:22 +00:00
test_format.py Fix a bug discovered by Kalle Svensson: comparing sys.maxint to 2003-11-29 23:55:09 +00:00
test_fpformat.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_frozen.py n the Mac the frozen import that should fail actually succeeds, and we know it, so skip the test in stead of confusing the end user. 2003-01-08 16:30:54 +00:00
test_funcattrs.py Provide __module__ attributes for functions defined in C and Python. 2003-01-31 18:33:18 +00:00
test_future1.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
test_future2.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
test_future3.py Fixed test and converted to unittest format. 2003-07-15 20:57:35 +00:00
test_future.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
test_gc.py New tests identical to boom and boom2, except using new-style classes. 2003-04-08 19:44:13 +00:00
test_gdbm.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_generators.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_genexps.py Add a test to verify an early call to iter() on the outermost for 2004-05-20 23:04:13 +00:00
test_getargs2.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_getargs.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_getopt.py Use test_support.run_doctest() 2003-05-17 01:08:35 +00:00
test_gettext.py Added a test for the fix of SF bug #658233, where continuation lines 2003-05-20 17:28:54 +00:00
test_gl.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_glob.py * Migrate set() and frozenset() from the sandbox. 2003-11-16 16:17:49 +00:00
test_global.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_grammar.py SF patch #872326: Generator expression implementation 2004-05-19 08:20:33 +00:00
test_grp.py On Mac OS X pwd.getpwall() might return the tuples 2003-05-05 20:37:33 +00:00
test_gzip.py Massive changes from SF 589982 (tempfile.py rewrite, by Zack 2002-08-09 16:38:32 +00:00
test_hash.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_heapq.py Add another test which exercises the whole suite with a 2002-12-07 10:33:42 +00:00
test_hexoct.py - Removed FutureWarnings related to hex/oct literals and conversions 2003-11-29 23:52:13 +00:00
test_hmac.py Add more tests from RFC 2202. 2003-05-27 16:16:41 +00:00
test_hotshot.py check_events(): This was failing under -O, due to not expecting any 2002-08-16 02:27:15 +00:00
test_htmllib.py Patch #545300: Support marked sections. 2003-03-30 14:25:40 +00:00
test_htmlparser.py Add test that demonstrates SGML-style handling of processing 2003-04-17 22:19:26 +00:00
test_httplib.py Fix SF bug 764095: Don't use network in test_httplib. 2003-07-08 12:36:58 +00:00
test_imageop.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_imaplib.py I don't know what's going on with this test, but the last change from 2002-08-04 06:53:18 +00:00
test_imgfile.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_imp.py Rewrote. As reported on c.l.py, when the test suite is run via 2003-04-26 14:31:24 +00:00
test_import.py Patch #734231: Update RiscOS support. In particular, correct 2003-05-10 07:36:56 +00:00
test_importhooks.py Actually run these tests from regrtest.py. 2003-02-17 14:51:41 +00:00
test_inspect.py Patch #830858: Correct the number of is-functions. Backported to 2.3 and 2.2. 2003-10-31 15:35:53 +00:00
test_ioctl.py Skip the ioctl test if we can't open /dev/tty. This happens on 2003-03-20 04:33:16 +00:00
test_isinstance.py Limit the nesting depth of a tuple passed as the second argument to 2004-03-20 22:52:14 +00:00
test_iter.py As discussed on python-dev, changed builtin.zip() to handle zero arguments 2003-08-02 07:42:57 +00:00
test_iterlen.py * Add unittests for iterators that report their length 2004-04-12 18:10:01 +00:00
test_itertools.py SF #950057: itertools.chain doesn't "process" exceptions as they occur 2004-05-08 19:49:42 +00:00
test_largefile.py test_largefile can leave its temp file open if one of many tests fail. On 2003-08-26 11:59:27 +00:00
test_linuxaudiodev.py - The audio driver tests (test_ossaudiodev.py and 2003-02-14 19:29:22 +00:00
test_list.py Move list and tuple tests from test_types.py to their own scripts: 2003-12-08 11:38:45 +00:00
test_locale.py Enable some unittests on FreeBSD. 2003-12-19 01:16:03 +00:00
test_logging.py Copyright year changed 2004-06-02 10:51:05 +00:00
test_long_future.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_long.py test_float_overflow(): make shuge (added last week) a little less 2003-02-03 15:25:01 +00:00
test_longexp.py SF patch #736962: Port tests to unittest 2003-08-30 22:54:55 +00:00
test_macfs.py Whitespace normalization. 2003-04-24 16:02:54 +00:00
test_macostools.py Getting rid of macfs. 2003-02-27 23:18:46 +00:00
test_macpath.py Whitespace normalization. 2002-12-24 18:31:27 +00:00
test_mailbox.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_marshal.py Marshal clean-up (SF patch #873224) 2004-03-26 15:09:27 +00:00
test_math.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_md5.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_mhlib.py We don't really need the name of the test in the "test skipped" msg, and 2002-08-04 22:55:35 +00:00
test_mimetools.py Whitespace normalization. 2003-06-15 23:26:30 +00:00
test_mimetypes.py test_guess_all_types(): Use a more robust test for checking that 2003-11-23 16:21:55 +00:00
test_MimeWriter.py
test_minidom.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_mmap.py A new test here was failing on Windows, because the test before it never 2003-01-13 21:38:45 +00:00
test_module.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_mpz.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_multibytecodec_support.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_multibytecodec.py Test not the standard utf-8 codec but gb18030 which is the most complex 2004-01-20 09:11:48 +00:00
test_multifile.py Actually run these tests from regrtest.py. 2003-02-17 14:51:41 +00:00
test_mutants.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_netrc.py Unconditionally opening the temp file in text mode causes this test to fail 2003-08-11 12:13:14 +00:00
test_new.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_nis.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_normalization.py Overallocate target buffer for normalization more early. Fixes #834676. 2003-11-06 20:47:57 +00:00
test_ntpath.py Whitespace normalization. 2002-12-24 18:31:27 +00:00
test_opcodes.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_openpty.py Remove bogus test; the master is not a terminal on Solaris and HP-UX. 2002-12-31 18:05:15 +00:00
test_operations.py BadDictKey test: The output file expected "raising error" to be printed 2001-05-29 21:14:32 +00:00
test_operator.py Guido grants a Christmas wish: 2003-12-17 20:43:33 +00:00
test_optparse.py Fix support for the "prog" keyword to the OptionParser constructor, as well 2004-04-01 07:40:35 +00:00
test_os.py Rename class attribute containing the class to be tested, so the name is the 2004-06-02 18:42:25 +00:00
test_ossaudiodev.py On those systems lacking the AFMT_S16_NE symbol, the test was failing 2003-07-02 14:05:08 +00:00
test_parser.py SF patch #872326: Generator expression implementation 2004-05-19 08:20:33 +00:00
test_pep247.py Whitespace normalization. 2001-11-13 21:51:26 +00:00
test_pep263.py SF patch #736962: Port tests to unittest 2003-08-30 22:54:55 +00:00
test_pep277.py Patch #790000: Allow os.access to handle Unicode file name. 2003-09-12 16:25:38 +00:00
test_pickle.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_pickletools.py Moving pickletools.py from the sandbox into the std library. I started 2003-01-27 18:51:48 +00:00
test_pkg.py tempfile's mkstemp(): Changed last argument from 2002-08-14 15:41:26 +00:00
test_pkgimport.py Massive changes from SF 589982 (tempfile.py rewrite, by Zack 2002-08-09 16:38:32 +00:00
test_plistlib.py - added (c)StringIO tests; cStringIO usage failed in the previous 2003-07-01 20:22:30 +00:00
test_poll.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_popen2.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_popen.py Don't quote the path to Python unless the path contains an embedded space. 2003-03-07 21:10:21 +00:00
test_posix.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_posixpath.py Fix SF #763362, test_posixpath failed 2003-07-01 03:33:31 +00:00
test_pow.py SF bug 705231: Assertion failed, python aborts. 2003-05-24 20:18:24 +00:00
test_pprint.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_profile.py Added global runctx function to profile to fix SF Bug #716587 2004-03-22 20:12:56 +00:00
test_profilehooks.py Enable the profiling of C functions (builtins and extensions) 2004-03-24 21:57:10 +00:00
test_pty.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_pwd.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_pyclbr.py * Migrate set() and frozenset() from the sandbox. 2003-11-16 16:17:49 +00:00
test_pyexpat.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_queue.py Style guide reformats. I saw this test fail on a very heavily loaded 2002-11-15 19:08:50 +00:00
test_quopri.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_random.py * Migrate set() and frozenset() from the sandbox. 2003-11-16 16:17:49 +00:00
test_re.py Add weakref support to sockets and re pattern objects. 2004-05-31 03:09:25 +00:00
test_regex.py Continue to work even though the test can be named test.test_regex 2002-10-17 22:13:28 +00:00
test_repr.py * teach repr.repr() about collections.deque() 2004-05-21 23:01:18 +00:00
test_resource.py Patch #551960: Add check for setrlimit() support 2002-12-12 18:13:36 +00:00
test_rfc822.py test_quote_unquote(): Added a test for the rfc822.unquote() patch 2002-09-11 02:32:57 +00:00
test_rgbimg.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_richcmp.py Deleting cyclic object comparison. 2003-10-28 12:05:48 +00:00
test_robotparser.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_rotor.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_sax.py [Bug #962631] Fix typo reported by Bryan Blackburn 2004-06-01 12:48:19 +00:00
test_scope.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_scriptpackages.py Whitespace normalization. 2003-04-24 16:02:54 +00:00
test_select.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_set.py Make sets and deques weak referencable. 2004-05-30 07:26:47 +00:00
test_sets.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_sgmllib.py Allow "@" in unquoted attribute values. 2003-04-29 22:12:55 +00:00
test_sha.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_shelve.py Rename class attribute containing the class to be tested, so the name is the 2004-06-02 18:42:25 +00:00
test_shlex.py Whitespace normalization. 2003-04-24 16:02:54 +00:00
test_shutil.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_signal.py Whitespace normalization. 2003-04-24 16:02:54 +00:00
test_site.py Refactored site.py into functions. Also moved over to using sets. 2004-06-05 01:12:51 +00:00
test_slice.py SF bug #800796: Difference between hash() and __hash__() 2003-09-05 14:27:30 +00:00
test_socket_ssl.py connector(): You can't use an empty string as an argument to connect() 2003-07-01 14:49:32 +00:00
test_socket.py Add weakref support to sockets and re pattern objects. 2004-05-31 03:09:25 +00:00
test_socketserver.py Fixes for AF_UNIX support on OS/2: 2004-04-11 12:03:57 +00:00
test_softspace.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_sort.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_str.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_strftime.py Deal with case of when locale time values has characters that can be mistaken 2004-03-20 23:09:40 +00:00
test_string.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_StringIO.py SF bug #770485: cStringIO does not set closed attr 2003-08-08 12:20:03 +00:00
test_stringprep.py Fix a bunch of typos in documentation, docstrings and comments. 2003-10-20 14:01:56 +00:00
test_strop.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_strptime.py * Migrate set() and frozenset() from the sandbox. 2003-11-16 16:17:49 +00:00
test_struct.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_structseq.py SF patch #736962: Port tests to unittest 2003-08-30 22:54:55 +00:00
test_sunaudiodev.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_sundry.py Remove pre module 2004-06-02 17:40:14 +00:00
test_support.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
test_symtable.py SF patch 763201: handling of SyntaxErrors in symbol table build 2003-07-15 20:24:27 +00:00
test_syntax.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_sys.py New function sys.getcheckinterval(), to complement setcheckinterval(). 2003-07-06 18:36:54 +00:00
test_tarfile.py When calling tarname with an argument (and thus not use testtar.tar) return a 2003-06-12 19:16:58 +00:00
test_tcl.py Fix test failure for test_tcl on OS/X and Windows if a 2004-03-26 15:10:25 +00:00
test_tempfile.py When /tmp has certain sticky bits set, newly created subdirectories 2004-03-31 18:53:29 +00:00
test_textwrap.py SF #965425: fix so hyphenated words surrounded by punctuation are 2004-06-03 01:59:41 +00:00
test_thread.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_threaded_import.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_threadedtempfile.py SF bug 613233: test_threadedtempfile hangs 2002-09-25 20:32:28 +00:00
test_threading.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_time.py Have strftime() check its time tuple argument to make sure the tuple's values 2004-03-02 04:38:10 +00:00
test_timeout.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_timing.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_tokenize.py Effectively renamed tokenize_tests.py to have a txt extension instead. 2003-05-12 19:42:04 +00:00
test_trace.py The fix in ceval.c 2.386 allows iteration-by-iteration line tracing even in 2004-03-22 19:30:39 +00:00
test_traceback.py Skip the test_nocaret test when running as jython. Jython happens to add 2002-11-06 11:45:15 +00:00
test_tuple.py test_hash(): The test here is different enough from the one in the bug 2004-06-01 18:58:04 +00:00
test_types.py Port the dictionary tests from test_types.py to unittest. Collect as much 2004-05-31 16:29:04 +00:00
test_ucn.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_unary.py Get rid of relative imports in all unittests. Now anything that 2002-07-23 19:04:11 +00:00
test_unicode_file.py Normalized files in test_unicode_file to eliminate failure on OSX 2004-03-21 20:55:47 +00:00
test_unicode.py Reuse width/iswide tests from strings_test. (Suggested by Walter Dörwald) 2004-06-04 04:24:54 +00:00
test_unicodedata.py Special case normalization of empty strings. Fixes #924361. 2004-04-17 19:36:48 +00:00
test_univnewlines.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_unpack.py Complete the absolute import patch for the test suite. All relative 2002-07-30 23:27:12 +00:00
test_urllib2.py Patch #963318: Add support for client-side cookie management. 2004-05-31 18:22:40 +00:00
test_urllib.py Whitespace normalization. 2003-05-12 20:19:37 +00:00
test_urllibnet.py SF patch 809915: Fix bogus address to hopefully always break. 2003-09-20 22:16:26 +00:00
test_urlparse.py see rev. 1.13 for log message 2003-10-12 04:29:10 +00:00
test_userdict.py Rename class attribute containing the class to be tested, so the name is the 2004-06-02 18:42:25 +00:00
test_userlist.py Move list and tuple tests from test_types.py to their own scripts: 2003-12-08 11:38:45 +00:00
test_userstring.py Add iswide() and width() method for UserString according as the 2004-06-04 03:18:12 +00:00
test_uu.py Port test_uu.py to PyUnit. From SF patch #662807. 2003-05-06 08:57:41 +00:00
test_warnings.py Reworked test_warnings.py: 2003-07-13 08:37:40 +00:00
test_wave.py Massive changes from SF 589982 (tempfile.py rewrite, by Zack 2002-08-09 16:38:32 +00:00
test_weakref.py Rename class attribute containing the class to be tested, so the name is the 2004-06-02 18:42:25 +00:00
test_whichdb.py Treat empty dat/dir pairs as dumbdbm. Fixes #744687. 2003-06-14 08:16:34 +00:00
test_winreg.py Reduce the size of Big String and Big Binary tests to 2**14 (minus one 2003-12-03 15:24:02 +00:00
test_winsound.py test_alias_nofallback(): Someone broke this test, after 2.3, by 2004-05-16 05:36:30 +00:00
test_xmllib.py Do not use the default namespace for attributes. 2004-05-02 20:37:13 +00:00
test_xmlrpc.py [Bug #841757] Exercise handling of Unicode strings 2004-06-05 12:33:27 +00:00
test_xpickle.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_xreadline.py Mark xreadlines deprecated. Don't use f.xreadlines() in test_iter.py. 2002-08-06 17:14:04 +00:00
test_zipfile.py SF patch #756996: Bare except in ZipFile.testzip() 2003-06-27 22:25:03 +00:00
test_zipimport.py Fix for [ 765456 ]: testAFakeZlib failed on platforms that use a 2003-11-18 23:00:55 +00:00
test_zlib.py SF bug #785222: zlib monotonic test 2003-08-31 04:35:24 +00:00
test.xml
test.xml.out
testall.py
testcodec.py
testimg.uue
testimgr.uue
testrgb.uue
testtar.tar SF #651082, tarfile module implementation from Lars Gustäbel 2003-01-05 23:19:43 +00:00
tf_inherit_check.py Patch by Zack W to make test_noinherit() more robust: spawn a Python 2002-08-17 11:41:01 +00:00
tokenize_tests.txt Effectively renamed tokenize_tests.py to have a txt extension instead. 2003-05-12 19:42:04 +00:00
xmltests.py Suppress the variable verbose output from test.xmltests; the inclusion of 2002-06-26 15:16:16 +00:00

+++++++++++++++++++++++++++++++
Writing Python Regression Tests
+++++++++++++++++++++++++++++++

:Author: Skip Montanaro
:Contact: skip@mojam.com

Introduction
============

If you add a new module to Python or modify the functionality of an existing
module, you should write one or more test cases to exercise that new
functionality.  There are different ways to do this within the regression
testing facility provided with Python; any particular test should use only
one of these options.  Each option requires writing a test module using the
conventions of the selected option:

    - PyUnit_ based tests
    - doctest_ based tests
    - "traditional" Python test modules

Regardless of the mechanics of the testing approach you choose,
you will be writing unit tests (isolated tests of functions and objects
defined by the module) using white box techniques.  Unlike black box
testing, where you only have the external interfaces to guide your test case
writing, in white box testing you can see the code being tested and tailor
your test cases to exercise it more completely.  In particular, you will be
able to refer to the C and Python code in the CVS repository when writing
your regression test cases.

.. _PyUnit:
.. _unittest: http://www.python.org/doc/current/lib/module-unittest.html
.. _doctest: http://www.python.org/doc/current/lib/module-doctest.html

PyUnit based tests
------------------
The PyUnit_ framework is based on the ideas of unit testing as espoused
by Kent Beck and the `Extreme Programming`_ (XP) movement.  The specific
interface provided by the framework is tightly based on the JUnit_
Java implementation of Beck's original SmallTalk test framework.  Please
see the documentation of the unittest_ module for detailed information on
the interface and general guidelines on writing PyUnit based tests.

The test_support helper module provides two functions for use by
PyUnit based tests in the Python regression testing framework:

- ``run_unittest()`` takes a ``unittest.TestCase`` derived class as a
  parameter and runs the tests defined in that class
   
- ``run_suite()`` takes a populated ``TestSuite`` instance and runs the
  tests
   
``run_suite()`` is preferred because unittest files typically grow multiple
test classes, and you might as well be prepared.

All test methods in the Python regression framework have names that
start with "``test_``" and use lower-case names with words separated with
underscores.

Test methods should *not* have docstrings!  The unittest module prints
the docstring if there is one, but otherwise prints the function name
and the full class name.  When there's a problem with a test, the
latter information makes it easier to find the source for the test
than the docstring.

All PyUnit-based tests in the Python test suite use boilerplate that
looks like this (with minor variations)::

    import unittest
    from test import test_support

    class MyTestCase1(unittest.TestCase):

        # Define setUp and tearDown only if needed

        def setUp(self):
            unittest.TestCase.setUp(self)
            ... additional initialization...

        def tearDown(self):
            ... additional finalization...
            unittest.TestCase.tearDown(self)

        def test_feature_one(self):
            # Testing feature one
            ...unit test for feature one...

        def test_feature_two(self):
            # Testing feature two
            ...unit test for feature two...

        ...etc...

    class MyTestCase2(unittest.TestCase):
        ...same structure as MyTestCase1...

    ...etc...

    def test_main():
        suite = unittest.TestSuite()
        suite.addTest(unittest.makeSuite(MyTestCase1))
        suite.addTest(unittest.makeSuite(MyTestCase2))
        ...add more suites...
        test_support.run_suite(suite)

    if __name__ == "__main__":
        test_main()

This has the advantage that it allows the unittest module to be used
as a script to run individual tests as well as working well with the
regrtest framework.

.. _Extreme Programming: http://www.extremeprogramming.org/
.. _JUnit: http://www.junit.org/

doctest based tests
-------------------
Tests written to use doctest_ are actually part of the docstrings for
the module being tested.  Each test is written as a display of an
interactive session, including the Python prompts, statements that would
be typed by the user, and the output of those statements (including
tracebacks, although only the exception msg needs to be retained then).
The module in the test package is simply a wrapper that causes doctest
to run over the tests in the module.  The test for the difflib module
provides a convenient example::

    import difflib
    from test import test_support
    test_support.run_doctest(difflib)

If the test is successful, nothing is written to stdout (so you should not
create a corresponding output/test_difflib file), but running regrtest
with -v will give a detailed report, the same as if passing -v to doctest.

A second argument can be passed to run_doctest to tell doctest to search
``sys.argv`` for -v instead of using test_support's idea of verbosity.  This
is useful for writing doctest-based tests that aren't simply running a
doctest'ed Lib module, but contain the doctests themselves.  Then at
times you may want to run such a test directly as a doctest, independent
of the regrtest framework.  The tail end of test_descrtut.py is a good
example::

    def test_main(verbose=None):
        from test import test_support, test_descrtut
        test_support.run_doctest(test_descrtut, verbose)

    if __name__ == "__main__":
        test_main(1)

If run via regrtest, ``test_main()`` is called (by regrtest) without
specifying verbose, and then test_support's idea of verbosity is used.  But
when run directly, ``test_main(1)`` is called, and then doctest's idea of
verbosity is used.

See the documentation for the doctest module for information on
writing tests using the doctest framework.

"traditional" Python test modules
---------------------------------
The mechanics of how the "traditional" test system operates are fairly
straightforward.  When a test case is run, the output is compared with the
expected output that is stored in .../Lib/test/output.  If the test runs to
completion and the actual and expected outputs match, the test succeeds, if
not, it fails.  If an ``ImportError`` or ``test_support.TestSkipped`` error
is raised, the test is not run.

Executing Test Cases
====================
If you are writing test cases for module spam, you need to create a file
in .../Lib/test named test_spam.py.  In addition, if the tests are expected
to write to stdout during a successful run, you also need to create an
expected output file in .../Lib/test/output named test_spam ("..."
represents the top-level directory in the Python source tree, the directory
containing the configure script).  If needed, generate the initial version
of the test output file by executing::

    ./python Lib/test/regrtest.py -g test_spam.py

from the top-level directory.

Any time you modify test_spam.py you need to generate a new expected
output file.  Don't forget to desk check the generated output to make sure
it's really what you expected to find!  All in all it's usually better
not to have an expected-out file (note that doctest- and unittest-based
tests do not).

To run a single test after modifying a module, simply run regrtest.py
without the -g flag::

    ./python Lib/test/regrtest.py test_spam.py

While debugging a regression test, you can of course execute it
independently of the regression testing framework and see what it prints::

    ./python Lib/test/test_spam.py

To run the entire test suite:

- [UNIX, + other platforms where "make" works] Make the "test" target at the
  top level::

    make test

- [WINDOWS] Run rt.bat from your PCBuild directory.  Read the comments at
  the top of rt.bat for the use of special -d, -O and -q options processed
  by rt.bat.

- [OTHER] You can simply execute the two runs of regrtest (optimized and
  non-optimized) directly::

    ./python Lib/test/regrtest.py
    ./python -O Lib/test/regrtest.py

But note that this way picks up whatever .pyc and .pyo files happen to be
around.  The makefile and rt.bat ways run the tests twice, the first time
removing all .pyc and .pyo files from the subtree rooted at Lib/.

Test cases generate output based upon values computed by the test code.
When executed, regrtest.py compares the actual output generated by executing
the test case with the expected output and reports success or failure.  It
stands to reason that if the actual and expected outputs are to match, they
must not contain any machine dependencies.  This means your test cases
should not print out absolute machine addresses (e.g. the return value of
the id() builtin function) or floating point numbers with large numbers of
significant digits (unless you understand what you are doing!).


Test Case Writing Tips
======================
Writing good test cases is a skilled task and is too complex to discuss in
detail in this short document.  Many books have been written on the subject.
I'll show my age by suggesting that Glenford Myers' `"The Art of Software
Testing"`_, published in 1979, is still the best introduction to the subject
available.  It is short (177 pages), easy to read, and discusses the major
elements of software testing, though its publication predates the
object-oriented software revolution, so doesn't cover that subject at all.
Unfortunately, it is very expensive (about $100 new).  If you can borrow it
or find it used (around $20), I strongly urge you to pick up a copy.

The most important goal when writing test cases is to break things.  A test
case that doesn't uncover a bug is much less valuable than one that does.
In designing test cases you should pay attention to the following:

    * Your test cases should exercise all the functions and objects defined
      in the module, not just the ones meant to be called by users of your
      module.  This may require you to write test code that uses the module
      in ways you don't expect (explicitly calling internal functions, for
      example - see test_atexit.py).

    * You should consider any boundary values that may tickle exceptional
      conditions (e.g. if you were writing regression tests for division,
      you might well want to generate tests with numerators and denominators
      at the limits of floating point and integer numbers on the machine
      performing the tests as well as a denominator of zero).

    * You should exercise as many paths through the code as possible.  This
      may not always be possible, but is a goal to strive for.  In
      particular, when considering if statements (or their equivalent), you
      want to create test cases that exercise both the true and false
      branches.  For loops, you should create test cases that exercise the
      loop zero, one and multiple times.

    * You should test with obviously invalid input.  If you know that a
      function requires an integer input, try calling it with other types of
      objects to see how it responds.

    * You should test with obviously out-of-range input.  If the domain of a
      function is only defined for positive integers, try calling it with a
      negative integer.

    * If you are going to fix a bug that wasn't uncovered by an existing
      test, try to write a test case that exposes the bug (preferably before
      fixing it).

    * If you need to create a temporary file, you can use the filename in
      ``test_support.TESTFN`` to do so.  It is important to remove the file
      when done; other tests should be able to use the name without cleaning
      up after your test.

.. _"The Art of Software Testing": 
        http://www.amazon.com/exec/obidos/ISBN=0471043281

Regression Test Writing Rules
=============================
Each test case is different.  There is no "standard" form for a Python
regression test case, though there are some general rules (note that
these mostly apply only to the "classic" tests; unittest_- and doctest_-
based tests should follow the conventions natural to those frameworks)::

    * If your test case detects a failure, raise ``TestFailed`` (found in
      ``test.test_support``).

    * Import everything you'll need as early as possible.

    * If you'll be importing objects from a module that is at least
      partially platform-dependent, only import those objects you need for
      the current test case to avoid spurious ``ImportError`` exceptions
      that prevent the test from running to completion.

    * Print all your test case results using the ``print`` statement.  For
      non-fatal errors, print an error message (or omit a successful
      completion print) to indicate the failure, but proceed instead of
      raising ``TestFailed``.

    * Use ``assert`` sparingly, if at all.  It's usually better to just print
      what you got, and rely on regrtest's got-vs-expected comparison to
      catch deviations from what you expect.  ``assert`` statements aren't
      executed at all when regrtest is run in -O mode; and, because they
      cause the test to stop immediately, can lead to a long & tedious
      test-fix, test-fix, test-fix, ... cycle when things are badly broken
      (and note that "badly broken" often includes running the test suite
      for the first time on new platforms or under new implementations of
      the language).

Miscellaneous
=============
There is a test_support module in the test package you can import for
your test case.  Import this module using either::

    import test.test_support

or::

    from test import test_support

test_support provides the following useful objects:

    * ``TestFailed`` - raise this exception when your regression test detects
      a failure.

    * ``TestSkipped`` - raise this if the test could not be run because the
      platform doesn't offer all the required facilities (like large
      file support), even if all the required modules are available.

    * ``ResourceDenied`` - this is raised when a test requires a resource that
      is not available.  Primarily used by 'requires'.

    * ``verbose`` - you can use this variable to control print output.  Many
      modules use it.  Search for "verbose" in the test_*.py files to see
      lots of examples.

    * ``forget(module_name)`` - attempts to cause Python to "forget" that it
      loaded a module and erase any PYC files.

    * ``is_resource_enabled(resource)`` - Returns a boolean based on whether
      the resource is enabled or not.

    * ``requires(resource [, msg])`` - if the required resource is not
      available the ResourceDenied exception is raised.
    
    * ``verify(condition, reason='test failed')``.  Use this instead of::

          assert condition[, reason]

      ``verify()`` has two advantages over ``assert``:  it works even in -O
      mode, and it raises ``TestFailed`` on failure instead of
      ``AssertionError``.

    * ``have_unicode`` - true if Unicode is available, false otherwise.

    * ``is_jython`` - true if the interpreter is Jython, false otherwise.

    * ``TESTFN`` - a string that should always be used as the filename when
      you need to create a temp file.  Also use ``try``/``finally`` to
      ensure that your temp files are deleted before your test completes.
      Note that you cannot unlink an open file on all operating systems, so
      also be sure to close temp files before trying to unlink them.

    * ``sortdict(dict)`` - acts like ``repr(dict.items())``, but sorts the
      items first.  This is important when printing a dict value, because
      the order of items produced by ``dict.items()`` is not defined by the
      language.

    * ``findfile(file)`` - you can call this function to locate a file
      somewhere along sys.path or in the Lib/test tree - see
      test_linuxaudiodev.py for an example of its use.

    * ``fcmp(x,y)`` - you can call this function to compare two floating
      point numbers when you expect them to only be approximately equal
      withing a fuzz factor (``test_support.FUZZ``, which defaults to 1e-6).

    * ``check_syntax(statement)`` - make sure that the statement is *not*
      correct Python syntax.


Python and C statement coverage results are currently available at

    http://www.musi-cal.com/~skip/python/Python/dist/src/

As of this writing (July, 2000) these results are being generated nightly.
You can refer to the summaries and the test coverage output files to see
where coverage is adequate or lacking and write test cases to beef up the
coverage.

Some Non-Obvious regrtest Features
==================================
    * Automagic test detection:  When you create a new test file
      test_spam.py, you do not need to modify regrtest (or anything else)
      to advertise its existence.  regrtest searches for and runs all
      modules in the test directory with names of the form test_xxx.py.

    * Miranda output:  If, when running test_spam.py, regrtest does not
      find an expected-output file test/output/test_spam, regrtest
      pretends that it did find one, containing the single line

      test_spam

      This allows new tests that don't expect to print anything to stdout
      to not bother creating expected-output files.

    * Two-stage testing:  To run test_spam.py, regrtest imports test_spam
      as a module.  Most tests run to completion as a side-effect of
      getting imported.  After importing test_spam, regrtest also executes
      ``test_spam.test_main()``, if test_spam has a ``test_main`` attribute.
      This is rarely required with the "traditional" Python tests, and
      you shouldn't create a module global with name test_main unless
      you're specifically exploiting this gimmick.  This usage does
      prove useful with PyUnit-based tests as well, however; defining
      a ``test_main()`` which is run by regrtest and a script-stub in the
      test module ("``if __name__ == '__main__': test_main()``") allows
      the test to be used like any other Python test and also work
      with the unittest.py-as-a-script approach, allowing a developer
      to run specific tests from the command line.