2000-03-31 22:58:54 +08:00
|
|
|
#
|
|
|
|
# Secret Labs' Regular Expression Engine
|
|
|
|
#
|
|
|
|
# re-compatible interface for the sre matching engine
|
|
|
|
#
|
2001-01-14 23:06:11 +08:00
|
|
|
# Copyright (c) 1998-2001 by Secret Labs AB. All rights reserved.
|
2000-03-31 22:58:54 +08:00
|
|
|
#
|
2000-08-02 02:20:07 +08:00
|
|
|
# This version of the SRE library can be redistributed under CNRI's
|
|
|
|
# Python 1.6 license. For any other use, please contact Secret Labs
|
|
|
|
# AB (info@pythonware.com).
|
|
|
|
#
|
2000-03-31 22:58:54 +08:00
|
|
|
# Portions of this engine have been developed in cooperation with
|
2000-08-02 02:20:07 +08:00
|
|
|
# CNRI. Hewlett-Packard provided funding for 1.6 integration and
|
2000-03-31 22:58:54 +08:00
|
|
|
# other compatibility work.
|
|
|
|
#
|
|
|
|
|
2001-09-05 03:20:06 +08:00
|
|
|
r"""Support for regular expressions (RE).
|
2001-09-05 03:10:20 +08:00
|
|
|
|
|
|
|
This module provides regular expression matching operations similar to
|
2001-10-22 05:48:30 +08:00
|
|
|
those found in Perl. It supports both 8-bit and Unicode strings; both
|
|
|
|
the pattern and the strings being processed can contain null bytes and
|
|
|
|
characters outside the US ASCII range.
|
|
|
|
|
|
|
|
Regular expressions can contain both special and ordinary characters.
|
|
|
|
Most ordinary characters, like "A", "a", or "0", are the simplest
|
|
|
|
regular expressions; they simply match themselves. You can
|
2001-09-05 03:10:20 +08:00
|
|
|
concatenate ordinary characters, so last matches the string 'last'.
|
|
|
|
|
|
|
|
The special characters are:
|
|
|
|
"." Matches any character except a newline.
|
|
|
|
"^" Matches the start of the string.
|
Merged revisions 60151-60159,60161-60168,60170,60172-60173,60175 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r60151 | christian.heimes | 2008-01-21 14:11:15 +0100 (Mon, 21 Jan 2008) | 1 line
A bunch of header files were not listed as dependencies for object files. Changes to files like Parser/parser.h weren't picked up by make.
........
r60152 | georg.brandl | 2008-01-21 15:16:46 +0100 (Mon, 21 Jan 2008) | 3 lines
#1087741: make mmap.mmap the type of mmap objects, not a
factory function. Allow it to be subclassed.
........
r60153 | georg.brandl | 2008-01-21 15:18:14 +0100 (Mon, 21 Jan 2008) | 2 lines
mmap is an extension module.
........
r60154 | georg.brandl | 2008-01-21 17:28:13 +0100 (Mon, 21 Jan 2008) | 2 lines
Fix example.
........
r60155 | georg.brandl | 2008-01-21 17:34:07 +0100 (Mon, 21 Jan 2008) | 2 lines
#1555501: document plistlib and move it to the general library.
........
r60156 | georg.brandl | 2008-01-21 17:36:00 +0100 (Mon, 21 Jan 2008) | 2 lines
Add a stub for bundlebuilder documentation.
........
r60157 | georg.brandl | 2008-01-21 17:46:58 +0100 (Mon, 21 Jan 2008) | 2 lines
Removing bundlebuilder docs again -- it's not to be used anymore (see #779825).
........
r60158 | georg.brandl | 2008-01-21 17:51:51 +0100 (Mon, 21 Jan 2008) | 2 lines
#997912: acknowledge nested scopes in tutorial.
........
r60159 | vinay.sajip | 2008-01-21 18:02:26 +0100 (Mon, 21 Jan 2008) | 1 line
Fix: #1836: Off-by-one bug in TimedRotatingFileHandler rollover calculation. Patch thanks to Kathryn M. Kowalski.
........
r60161 | georg.brandl | 2008-01-21 18:13:03 +0100 (Mon, 21 Jan 2008) | 2 lines
Adapt pydoc to new doc URLs.
........
r60162 | georg.brandl | 2008-01-21 18:17:00 +0100 (Mon, 21 Jan 2008) | 2 lines
Fix old link.
........
r60163 | georg.brandl | 2008-01-21 18:22:06 +0100 (Mon, 21 Jan 2008) | 2 lines
#1726198: replace while 1: fp.readline() with file iteration.
........
r60164 | georg.brandl | 2008-01-21 18:29:23 +0100 (Mon, 21 Jan 2008) | 2 lines
Clarify $ behavior in re docstring. #1631394.
........
r60165 | vinay.sajip | 2008-01-21 18:39:22 +0100 (Mon, 21 Jan 2008) | 1 line
Minor documentation change - hyperlink tidied up.
........
r60166 | georg.brandl | 2008-01-21 18:42:40 +0100 (Mon, 21 Jan 2008) | 2 lines
#1530959: change distutils build dir for --with-pydebug python builds.
........
r60167 | vinay.sajip | 2008-01-21 19:16:05 +0100 (Mon, 21 Jan 2008) | 1 line
Updated to include news on recent logging fixes and documentation changes.
........
r60168 | georg.brandl | 2008-01-21 19:35:49 +0100 (Mon, 21 Jan 2008) | 3 lines
Issue #1882: when compiling code from a string, encoding cookies in the
second line of code were not always recognized correctly.
........
r60170 | georg.brandl | 2008-01-21 19:36:51 +0100 (Mon, 21 Jan 2008) | 2 lines
Add NEWS entry for #1882.
........
r60172 | georg.brandl | 2008-01-21 19:41:24 +0100 (Mon, 21 Jan 2008) | 2 lines
Use original location of document, which has translations.
........
r60173 | walter.doerwald | 2008-01-21 21:18:04 +0100 (Mon, 21 Jan 2008) | 2 lines
Follow PEP 8 in module docstring.
........
r60175 | georg.brandl | 2008-01-21 21:20:53 +0100 (Mon, 21 Jan 2008) | 2 lines
Adapt to latest doctools refactoring.
........
2008-01-22 04:36:10 +08:00
|
|
|
"$" Matches the end of the string or just before the newline at
|
|
|
|
the end of the string.
|
2001-09-05 03:10:20 +08:00
|
|
|
"*" Matches 0 or more (greedy) repetitions of the preceding RE.
|
|
|
|
Greedy means that it will match as many repetitions as possible.
|
|
|
|
"+" Matches 1 or more (greedy) repetitions of the preceding RE.
|
|
|
|
"?" Matches 0 or 1 (greedy) of the preceding RE.
|
|
|
|
*?,+?,?? Non-greedy versions of the previous three special characters.
|
|
|
|
{m,n} Matches from m to n repetitions of the preceding RE.
|
|
|
|
{m,n}? Non-greedy version of the above.
|
Merged revisions 60284-60349 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r60286 | christian.heimes | 2008-01-25 15:54:23 +0100 (Fri, 25 Jan 2008) | 1 line
setup.py doesn't pick up changes to a header file
........
r60287 | christian.heimes | 2008-01-25 16:52:11 +0100 (Fri, 25 Jan 2008) | 2 lines
Added the Python core headers Include/*.h and pyconfig.h as dependencies for the extensions in Modules/
It forces a rebuild of all extensions when a header files has been modified
........
r60291 | raymond.hettinger | 2008-01-25 20:24:46 +0100 (Fri, 25 Jan 2008) | 4 lines
Changes 54857 and 54840 broke code and were reverted in Py2.5 just before
it was released, but that reversion never made it to the Py2.6 head.
........
r60296 | guido.van.rossum | 2008-01-25 20:50:26 +0100 (Fri, 25 Jan 2008) | 2 lines
Rewrite the list_inline_repeat overflow check slightly differently.
........
r60301 | thomas.wouters | 2008-01-25 22:09:34 +0100 (Fri, 25 Jan 2008) | 4 lines
Use the right (portable) definition of the max of a Py_ssize_t.
........
r60303 | thomas.wouters | 2008-01-26 02:47:05 +0100 (Sat, 26 Jan 2008) | 5 lines
Make 'testall' work again when building in a separate directory.
test_distutils still fails when doing that.
........
r60305 | neal.norwitz | 2008-01-26 06:54:48 +0100 (Sat, 26 Jan 2008) | 3 lines
Prevent this test from failing if there are transient network problems
by retrying the host for up to 3 times.
........
r60306 | neal.norwitz | 2008-01-26 08:26:12 +0100 (Sat, 26 Jan 2008) | 12 lines
Use a condition variable (threading.Event) rather than sleeps and checking a
global to determine when the server is ready to be used. This slows the test
down, but should make it correct. There was a race condition before where the
server could have assigned a port, yet it wasn't ready to serve requests. If
the client sent a request before the server was completely ready, it would get
an exception. There was machinery to try to handle this condition. All of
that should be unnecessary and removed if this change works. A NOTE was
added as a comment about what needs to be fixed.
The buildbots will tell us if there are more errors or
if this test is now stable.
........
r60307 | neal.norwitz | 2008-01-26 08:38:03 +0100 (Sat, 26 Jan 2008) | 3 lines
Fix exception in tearDown on ppc buildbot. If there's no directory,
that shouldn't cause the test to fail. Just like it setUp.
........
r60308 | raymond.hettinger | 2008-01-26 09:19:06 +0100 (Sat, 26 Jan 2008) | 3 lines
Make PySet_Add() work with frozensets. Works like PyTuple_SetItem() to build-up values in a brand new frozenset.
........
r60309 | neal.norwitz | 2008-01-26 09:26:00 +0100 (Sat, 26 Jan 2008) | 1 line
The OS X buildbot had errors with the unavailable exceptions disabled. Restore it.
........
r60310 | raymond.hettinger | 2008-01-26 09:37:28 +0100 (Sat, 26 Jan 2008) | 4 lines
Let marshal build-up sets and frozensets one element at a time.
Saves the unnecessary creation of a tuple as intermediate container.
........
r60311 | raymond.hettinger | 2008-01-26 09:41:13 +0100 (Sat, 26 Jan 2008) | 1 line
Update test code for change to PySet_Add().
........
r60312 | raymond.hettinger | 2008-01-26 10:31:11 +0100 (Sat, 26 Jan 2008) | 1 line
Revert PySet_Add() changes.
........
r60314 | georg.brandl | 2008-01-26 10:43:35 +0100 (Sat, 26 Jan 2008) | 2 lines
#1934: fix os.path.isabs docs.
........
r60316 | georg.brandl | 2008-01-26 12:00:18 +0100 (Sat, 26 Jan 2008) | 2 lines
Add missing things in re docstring.
........
r60317 | georg.brandl | 2008-01-26 12:02:22 +0100 (Sat, 26 Jan 2008) | 2 lines
Slashes allowed on Windows.
........
r60319 | georg.brandl | 2008-01-26 14:41:21 +0100 (Sat, 26 Jan 2008) | 2 lines
Fix markup again.
........
r60320 | andrew.kuchling | 2008-01-26 14:50:51 +0100 (Sat, 26 Jan 2008) | 1 line
Add some items
........
r60321 | georg.brandl | 2008-01-26 15:02:38 +0100 (Sat, 26 Jan 2008) | 2 lines
Clarify "b" mode under Unix.
........
r60322 | georg.brandl | 2008-01-26 15:03:47 +0100 (Sat, 26 Jan 2008) | 3 lines
#1940: make it possible to use curses.filter() before curses.initscr()
as the documentation says.
........
r60324 | georg.brandl | 2008-01-26 15:14:20 +0100 (Sat, 26 Jan 2008) | 3 lines
#1473257: add generator.gi_code attribute that refers to
the original code object backing the generator. Patch by Collin Winter.
........
r60325 | georg.brandl | 2008-01-26 15:19:22 +0100 (Sat, 26 Jan 2008) | 2 lines
Move C API entries to the corresponding section.
........
r60326 | christian.heimes | 2008-01-26 17:43:35 +0100 (Sat, 26 Jan 2008) | 1 line
Unit test fix from Giampaolo Rodola, #1938
........
r60327 | gregory.p.smith | 2008-01-26 19:51:05 +0100 (Sat, 26 Jan 2008) | 2 lines
Update docs for new callpack params added in r60188
........
r60329 | neal.norwitz | 2008-01-26 21:24:36 +0100 (Sat, 26 Jan 2008) | 3 lines
Cleanup the code a bit. test_rfind is failing on PPC and PPC64 buildbots,
this might fix the problem.
........
r60330 | neal.norwitz | 2008-01-26 22:02:45 +0100 (Sat, 26 Jan 2008) | 1 line
Always try to remove the test file even if close raises an exception
........
r60331 | neal.norwitz | 2008-01-26 22:21:59 +0100 (Sat, 26 Jan 2008) | 3 lines
Reduce the race condition by signalling when the server is ready
and not trying to connect before.
........
r60334 | neal.norwitz | 2008-01-27 00:13:46 +0100 (Sun, 27 Jan 2008) | 5 lines
On some systems (e.g., Ubuntu on hppa) the flush()
doesn't cause the exception, but the close() does.
Will backport.
........
r60335 | neal.norwitz | 2008-01-27 00:14:17 +0100 (Sun, 27 Jan 2008) | 2 lines
Consistently use tempfile.tempdir for the db_home directory.
........
r60338 | neal.norwitz | 2008-01-27 02:44:05 +0100 (Sun, 27 Jan 2008) | 4 lines
Eliminate the sleeps that assume the server will start in .5 seconds.
This should make the test less flaky. It also speeds up the test
by about 75% on my box (20+ seconds -> ~4 seconds).
........
r60342 | neal.norwitz | 2008-01-27 06:02:34 +0100 (Sun, 27 Jan 2008) | 6 lines
Try to prevent this test from being flaky. We might need a sleep in here
which isn't as bad as it sounds. The close() *should* raise an exception,
so if it didn't we should give more time to sync and really raise it.
Will backport.
........
r60344 | jeffrey.yasskin | 2008-01-27 06:40:35 +0100 (Sun, 27 Jan 2008) | 3 lines
Make rational.gcd() public and allow Rational to take decimal strings, per
Raymond's advice.
........
r60345 | neal.norwitz | 2008-01-27 08:36:03 +0100 (Sun, 27 Jan 2008) | 3 lines
Mostly reformat. Also set an error and return NULL if neither MS_WINDOWS
nor UNIX is defined. This may have caused problems on cygwin.
........
r60346 | neal.norwitz | 2008-01-27 08:37:38 +0100 (Sun, 27 Jan 2008) | 3 lines
Use int for the sign rather than a char. char can be signed or unsigned.
It's system dependent. This might fix the problem with test_rfind failing.
........
r60347 | neal.norwitz | 2008-01-27 08:41:33 +0100 (Sun, 27 Jan 2008) | 1 line
Add stdarg include for va_list to get this to compile on cygwin
........
r60348 | raymond.hettinger | 2008-01-27 11:13:57 +0100 (Sun, 27 Jan 2008) | 1 line
Docstring nit
........
r60349 | raymond.hettinger | 2008-01-27 11:47:55 +0100 (Sun, 27 Jan 2008) | 1 line
Removed an unnecessary and confusing paragraph from the namedtuple docs.
........
2008-01-27 23:18:18 +08:00
|
|
|
"\\" Either escapes special characters or signals a special sequence.
|
2001-09-05 03:10:20 +08:00
|
|
|
[] Indicates a set of characters.
|
|
|
|
A "^" as the first character indicates a complementing set.
|
|
|
|
"|" A|B, creates an RE that will match either A or B.
|
|
|
|
(...) Matches the RE inside the parentheses.
|
|
|
|
The contents can be retrieved or matched later in the string.
|
2008-08-20 01:56:33 +08:00
|
|
|
(?aiLmsux) Set the A, I, L, M, S, U, or X flag for the RE (see below).
|
2001-09-05 03:10:20 +08:00
|
|
|
(?:...) Non-grouping version of regular parentheses.
|
|
|
|
(?P<name>...) The substring matched by the group is accessible by name.
|
|
|
|
(?P=name) Matches the text matched earlier by the group named name.
|
|
|
|
(?#...) A comment; ignored.
|
|
|
|
(?=...) Matches if ... matches next, but doesn't consume the string.
|
|
|
|
(?!...) Matches if ... doesn't match next.
|
Merged revisions 60284-60349 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r60286 | christian.heimes | 2008-01-25 15:54:23 +0100 (Fri, 25 Jan 2008) | 1 line
setup.py doesn't pick up changes to a header file
........
r60287 | christian.heimes | 2008-01-25 16:52:11 +0100 (Fri, 25 Jan 2008) | 2 lines
Added the Python core headers Include/*.h and pyconfig.h as dependencies for the extensions in Modules/
It forces a rebuild of all extensions when a header files has been modified
........
r60291 | raymond.hettinger | 2008-01-25 20:24:46 +0100 (Fri, 25 Jan 2008) | 4 lines
Changes 54857 and 54840 broke code and were reverted in Py2.5 just before
it was released, but that reversion never made it to the Py2.6 head.
........
r60296 | guido.van.rossum | 2008-01-25 20:50:26 +0100 (Fri, 25 Jan 2008) | 2 lines
Rewrite the list_inline_repeat overflow check slightly differently.
........
r60301 | thomas.wouters | 2008-01-25 22:09:34 +0100 (Fri, 25 Jan 2008) | 4 lines
Use the right (portable) definition of the max of a Py_ssize_t.
........
r60303 | thomas.wouters | 2008-01-26 02:47:05 +0100 (Sat, 26 Jan 2008) | 5 lines
Make 'testall' work again when building in a separate directory.
test_distutils still fails when doing that.
........
r60305 | neal.norwitz | 2008-01-26 06:54:48 +0100 (Sat, 26 Jan 2008) | 3 lines
Prevent this test from failing if there are transient network problems
by retrying the host for up to 3 times.
........
r60306 | neal.norwitz | 2008-01-26 08:26:12 +0100 (Sat, 26 Jan 2008) | 12 lines
Use a condition variable (threading.Event) rather than sleeps and checking a
global to determine when the server is ready to be used. This slows the test
down, but should make it correct. There was a race condition before where the
server could have assigned a port, yet it wasn't ready to serve requests. If
the client sent a request before the server was completely ready, it would get
an exception. There was machinery to try to handle this condition. All of
that should be unnecessary and removed if this change works. A NOTE was
added as a comment about what needs to be fixed.
The buildbots will tell us if there are more errors or
if this test is now stable.
........
r60307 | neal.norwitz | 2008-01-26 08:38:03 +0100 (Sat, 26 Jan 2008) | 3 lines
Fix exception in tearDown on ppc buildbot. If there's no directory,
that shouldn't cause the test to fail. Just like it setUp.
........
r60308 | raymond.hettinger | 2008-01-26 09:19:06 +0100 (Sat, 26 Jan 2008) | 3 lines
Make PySet_Add() work with frozensets. Works like PyTuple_SetItem() to build-up values in a brand new frozenset.
........
r60309 | neal.norwitz | 2008-01-26 09:26:00 +0100 (Sat, 26 Jan 2008) | 1 line
The OS X buildbot had errors with the unavailable exceptions disabled. Restore it.
........
r60310 | raymond.hettinger | 2008-01-26 09:37:28 +0100 (Sat, 26 Jan 2008) | 4 lines
Let marshal build-up sets and frozensets one element at a time.
Saves the unnecessary creation of a tuple as intermediate container.
........
r60311 | raymond.hettinger | 2008-01-26 09:41:13 +0100 (Sat, 26 Jan 2008) | 1 line
Update test code for change to PySet_Add().
........
r60312 | raymond.hettinger | 2008-01-26 10:31:11 +0100 (Sat, 26 Jan 2008) | 1 line
Revert PySet_Add() changes.
........
r60314 | georg.brandl | 2008-01-26 10:43:35 +0100 (Sat, 26 Jan 2008) | 2 lines
#1934: fix os.path.isabs docs.
........
r60316 | georg.brandl | 2008-01-26 12:00:18 +0100 (Sat, 26 Jan 2008) | 2 lines
Add missing things in re docstring.
........
r60317 | georg.brandl | 2008-01-26 12:02:22 +0100 (Sat, 26 Jan 2008) | 2 lines
Slashes allowed on Windows.
........
r60319 | georg.brandl | 2008-01-26 14:41:21 +0100 (Sat, 26 Jan 2008) | 2 lines
Fix markup again.
........
r60320 | andrew.kuchling | 2008-01-26 14:50:51 +0100 (Sat, 26 Jan 2008) | 1 line
Add some items
........
r60321 | georg.brandl | 2008-01-26 15:02:38 +0100 (Sat, 26 Jan 2008) | 2 lines
Clarify "b" mode under Unix.
........
r60322 | georg.brandl | 2008-01-26 15:03:47 +0100 (Sat, 26 Jan 2008) | 3 lines
#1940: make it possible to use curses.filter() before curses.initscr()
as the documentation says.
........
r60324 | georg.brandl | 2008-01-26 15:14:20 +0100 (Sat, 26 Jan 2008) | 3 lines
#1473257: add generator.gi_code attribute that refers to
the original code object backing the generator. Patch by Collin Winter.
........
r60325 | georg.brandl | 2008-01-26 15:19:22 +0100 (Sat, 26 Jan 2008) | 2 lines
Move C API entries to the corresponding section.
........
r60326 | christian.heimes | 2008-01-26 17:43:35 +0100 (Sat, 26 Jan 2008) | 1 line
Unit test fix from Giampaolo Rodola, #1938
........
r60327 | gregory.p.smith | 2008-01-26 19:51:05 +0100 (Sat, 26 Jan 2008) | 2 lines
Update docs for new callpack params added in r60188
........
r60329 | neal.norwitz | 2008-01-26 21:24:36 +0100 (Sat, 26 Jan 2008) | 3 lines
Cleanup the code a bit. test_rfind is failing on PPC and PPC64 buildbots,
this might fix the problem.
........
r60330 | neal.norwitz | 2008-01-26 22:02:45 +0100 (Sat, 26 Jan 2008) | 1 line
Always try to remove the test file even if close raises an exception
........
r60331 | neal.norwitz | 2008-01-26 22:21:59 +0100 (Sat, 26 Jan 2008) | 3 lines
Reduce the race condition by signalling when the server is ready
and not trying to connect before.
........
r60334 | neal.norwitz | 2008-01-27 00:13:46 +0100 (Sun, 27 Jan 2008) | 5 lines
On some systems (e.g., Ubuntu on hppa) the flush()
doesn't cause the exception, but the close() does.
Will backport.
........
r60335 | neal.norwitz | 2008-01-27 00:14:17 +0100 (Sun, 27 Jan 2008) | 2 lines
Consistently use tempfile.tempdir for the db_home directory.
........
r60338 | neal.norwitz | 2008-01-27 02:44:05 +0100 (Sun, 27 Jan 2008) | 4 lines
Eliminate the sleeps that assume the server will start in .5 seconds.
This should make the test less flaky. It also speeds up the test
by about 75% on my box (20+ seconds -> ~4 seconds).
........
r60342 | neal.norwitz | 2008-01-27 06:02:34 +0100 (Sun, 27 Jan 2008) | 6 lines
Try to prevent this test from being flaky. We might need a sleep in here
which isn't as bad as it sounds. The close() *should* raise an exception,
so if it didn't we should give more time to sync and really raise it.
Will backport.
........
r60344 | jeffrey.yasskin | 2008-01-27 06:40:35 +0100 (Sun, 27 Jan 2008) | 3 lines
Make rational.gcd() public and allow Rational to take decimal strings, per
Raymond's advice.
........
r60345 | neal.norwitz | 2008-01-27 08:36:03 +0100 (Sun, 27 Jan 2008) | 3 lines
Mostly reformat. Also set an error and return NULL if neither MS_WINDOWS
nor UNIX is defined. This may have caused problems on cygwin.
........
r60346 | neal.norwitz | 2008-01-27 08:37:38 +0100 (Sun, 27 Jan 2008) | 3 lines
Use int for the sign rather than a char. char can be signed or unsigned.
It's system dependent. This might fix the problem with test_rfind failing.
........
r60347 | neal.norwitz | 2008-01-27 08:41:33 +0100 (Sun, 27 Jan 2008) | 1 line
Add stdarg include for va_list to get this to compile on cygwin
........
r60348 | raymond.hettinger | 2008-01-27 11:13:57 +0100 (Sun, 27 Jan 2008) | 1 line
Docstring nit
........
r60349 | raymond.hettinger | 2008-01-27 11:47:55 +0100 (Sun, 27 Jan 2008) | 1 line
Removed an unnecessary and confusing paragraph from the namedtuple docs.
........
2008-01-27 23:18:18 +08:00
|
|
|
(?<=...) Matches if preceded by ... (must be fixed length).
|
|
|
|
(?<!...) Matches if not preceded by ... (must be fixed length).
|
|
|
|
(?(id/name)yes|no) Matches yes pattern if the group with id/name matched,
|
|
|
|
the (optional) no pattern otherwise.
|
2001-09-05 03:10:20 +08:00
|
|
|
|
|
|
|
The special sequences consist of "\\" and a character from the list
|
2001-10-22 05:48:30 +08:00
|
|
|
below. If the ordinary character is not on the list, then the
|
2001-09-05 03:10:20 +08:00
|
|
|
resulting RE will match the second character.
|
2001-09-05 03:20:06 +08:00
|
|
|
\number Matches the contents of the group of the same number.
|
|
|
|
\A Matches only at the start of the string.
|
|
|
|
\Z Matches only at the end of the string.
|
|
|
|
\b Matches the empty string, but only at the start or end of a word.
|
|
|
|
\B Matches the empty string, but not at the start or end of a word.
|
2008-08-20 01:56:33 +08:00
|
|
|
\d Matches any decimal digit; equivalent to the set [0-9] in
|
|
|
|
bytes patterns or string patterns with the ASCII flag.
|
|
|
|
In string patterns without the ASCII flag, it will match the whole
|
|
|
|
range of Unicode digits.
|
|
|
|
\D Matches any non-digit character; equivalent to [^\d].
|
2012-04-29 13:23:25 +08:00
|
|
|
\s Matches any whitespace character; equivalent to [ \t\n\r\f\v] in
|
|
|
|
bytes patterns or string patterns with the ASCII flag.
|
|
|
|
In string patterns without the ASCII flag, it will match the whole
|
|
|
|
range of Unicode whitespace characters.
|
2012-04-29 18:35:55 +08:00
|
|
|
\S Matches any non-whitespace character; equivalent to [^\s].
|
2008-08-20 01:56:33 +08:00
|
|
|
\w Matches any alphanumeric character; equivalent to [a-zA-Z0-9_]
|
|
|
|
in bytes patterns or string patterns with the ASCII flag.
|
|
|
|
In string patterns without the ASCII flag, it will match the
|
|
|
|
range of Unicode alphanumeric characters (letters plus digits
|
|
|
|
plus underscore).
|
2001-09-05 03:10:20 +08:00
|
|
|
With LOCALE, it will match the set [0-9_] plus characters defined
|
|
|
|
as letters for the current locale.
|
2001-09-05 03:20:06 +08:00
|
|
|
\W Matches the complement of \w.
|
|
|
|
\\ Matches a literal backslash.
|
2001-09-05 03:10:20 +08:00
|
|
|
|
|
|
|
This module exports the following functions:
|
2013-11-24 05:20:30 +08:00
|
|
|
match Match a regular expression pattern to the beginning of a string.
|
|
|
|
fullmatch Match a regular expression pattern to all of a string.
|
|
|
|
search Search a string for the presence of a pattern.
|
|
|
|
sub Substitute occurrences of a pattern found in a string.
|
|
|
|
subn Same as sub, but also return the number of substitutions made.
|
|
|
|
split Split a string by the occurrences of a pattern.
|
|
|
|
findall Find all occurrences of a pattern in a string.
|
|
|
|
finditer Return an iterator yielding a match object for each match.
|
|
|
|
compile Compile a pattern into a RegexObject.
|
|
|
|
purge Clear the regular expression cache.
|
|
|
|
escape Backslash all non-alphanumerics in a string.
|
2001-09-05 03:10:20 +08:00
|
|
|
|
|
|
|
Some of the functions in this module takes flags as optional parameters:
|
2008-08-20 01:56:33 +08:00
|
|
|
A ASCII For string patterns, make \w, \W, \b, \B, \d, \D
|
|
|
|
match the corresponding ASCII character categories
|
|
|
|
(rather than the whole Unicode categories, which is the
|
|
|
|
default).
|
|
|
|
For bytes patterns, this flag is the only available
|
|
|
|
behaviour and needn't be specified.
|
2001-09-05 03:10:20 +08:00
|
|
|
I IGNORECASE Perform case-insensitive matching.
|
|
|
|
L LOCALE Make \w, \W, \b, \B, dependent on the current locale.
|
Merged revisions 60151-60159,60161-60168,60170,60172-60173,60175 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r60151 | christian.heimes | 2008-01-21 14:11:15 +0100 (Mon, 21 Jan 2008) | 1 line
A bunch of header files were not listed as dependencies for object files. Changes to files like Parser/parser.h weren't picked up by make.
........
r60152 | georg.brandl | 2008-01-21 15:16:46 +0100 (Mon, 21 Jan 2008) | 3 lines
#1087741: make mmap.mmap the type of mmap objects, not a
factory function. Allow it to be subclassed.
........
r60153 | georg.brandl | 2008-01-21 15:18:14 +0100 (Mon, 21 Jan 2008) | 2 lines
mmap is an extension module.
........
r60154 | georg.brandl | 2008-01-21 17:28:13 +0100 (Mon, 21 Jan 2008) | 2 lines
Fix example.
........
r60155 | georg.brandl | 2008-01-21 17:34:07 +0100 (Mon, 21 Jan 2008) | 2 lines
#1555501: document plistlib and move it to the general library.
........
r60156 | georg.brandl | 2008-01-21 17:36:00 +0100 (Mon, 21 Jan 2008) | 2 lines
Add a stub for bundlebuilder documentation.
........
r60157 | georg.brandl | 2008-01-21 17:46:58 +0100 (Mon, 21 Jan 2008) | 2 lines
Removing bundlebuilder docs again -- it's not to be used anymore (see #779825).
........
r60158 | georg.brandl | 2008-01-21 17:51:51 +0100 (Mon, 21 Jan 2008) | 2 lines
#997912: acknowledge nested scopes in tutorial.
........
r60159 | vinay.sajip | 2008-01-21 18:02:26 +0100 (Mon, 21 Jan 2008) | 1 line
Fix: #1836: Off-by-one bug in TimedRotatingFileHandler rollover calculation. Patch thanks to Kathryn M. Kowalski.
........
r60161 | georg.brandl | 2008-01-21 18:13:03 +0100 (Mon, 21 Jan 2008) | 2 lines
Adapt pydoc to new doc URLs.
........
r60162 | georg.brandl | 2008-01-21 18:17:00 +0100 (Mon, 21 Jan 2008) | 2 lines
Fix old link.
........
r60163 | georg.brandl | 2008-01-21 18:22:06 +0100 (Mon, 21 Jan 2008) | 2 lines
#1726198: replace while 1: fp.readline() with file iteration.
........
r60164 | georg.brandl | 2008-01-21 18:29:23 +0100 (Mon, 21 Jan 2008) | 2 lines
Clarify $ behavior in re docstring. #1631394.
........
r60165 | vinay.sajip | 2008-01-21 18:39:22 +0100 (Mon, 21 Jan 2008) | 1 line
Minor documentation change - hyperlink tidied up.
........
r60166 | georg.brandl | 2008-01-21 18:42:40 +0100 (Mon, 21 Jan 2008) | 2 lines
#1530959: change distutils build dir for --with-pydebug python builds.
........
r60167 | vinay.sajip | 2008-01-21 19:16:05 +0100 (Mon, 21 Jan 2008) | 1 line
Updated to include news on recent logging fixes and documentation changes.
........
r60168 | georg.brandl | 2008-01-21 19:35:49 +0100 (Mon, 21 Jan 2008) | 3 lines
Issue #1882: when compiling code from a string, encoding cookies in the
second line of code were not always recognized correctly.
........
r60170 | georg.brandl | 2008-01-21 19:36:51 +0100 (Mon, 21 Jan 2008) | 2 lines
Add NEWS entry for #1882.
........
r60172 | georg.brandl | 2008-01-21 19:41:24 +0100 (Mon, 21 Jan 2008) | 2 lines
Use original location of document, which has translations.
........
r60173 | walter.doerwald | 2008-01-21 21:18:04 +0100 (Mon, 21 Jan 2008) | 2 lines
Follow PEP 8 in module docstring.
........
r60175 | georg.brandl | 2008-01-21 21:20:53 +0100 (Mon, 21 Jan 2008) | 2 lines
Adapt to latest doctools refactoring.
........
2008-01-22 04:36:10 +08:00
|
|
|
M MULTILINE "^" matches the beginning of lines (after a newline)
|
|
|
|
as well as the string.
|
|
|
|
"$" matches the end of lines (before a newline) as well
|
|
|
|
as the end of the string.
|
2001-09-05 03:10:20 +08:00
|
|
|
S DOTALL "." matches any character at all, including the newline.
|
|
|
|
X VERBOSE Ignore whitespace and comments for nicer looking RE's.
|
2008-08-20 01:56:33 +08:00
|
|
|
U UNICODE For compatibility only. Ignored for string patterns (it
|
|
|
|
is the default), and forbidden for bytes patterns.
|
2001-09-05 03:10:20 +08:00
|
|
|
|
|
|
|
This module also defines an exception 'error'.
|
|
|
|
|
|
|
|
"""
|
2001-09-19 02:47:09 +08:00
|
|
|
|
2001-10-25 06:16:30 +08:00
|
|
|
import sys
|
2000-03-31 22:58:54 +08:00
|
|
|
import sre_compile
|
2000-06-29 16:58:44 +08:00
|
|
|
import sre_parse
|
2000-03-31 22:58:54 +08:00
|
|
|
|
2001-02-18 20:05:16 +08:00
|
|
|
# public symbols
|
2013-11-24 05:20:30 +08:00
|
|
|
__all__ = [ "match", "fullmatch", "search", "sub", "subn", "split", "findall",
|
2008-08-20 01:56:33 +08:00
|
|
|
"compile", "purge", "template", "escape", "A", "I", "L", "M", "S", "X",
|
|
|
|
"U", "ASCII", "IGNORECASE", "LOCALE", "MULTILINE", "DOTALL", "VERBOSE",
|
2001-02-18 20:05:16 +08:00
|
|
|
"UNICODE", "error" ]
|
|
|
|
|
2001-10-22 00:47:57 +08:00
|
|
|
__version__ = "2.2.1"
|
2001-03-22 23:50:10 +08:00
|
|
|
|
2000-06-02 01:39:12 +08:00
|
|
|
# flags
|
2008-08-20 01:56:33 +08:00
|
|
|
A = ASCII = sre_compile.SRE_FLAG_ASCII # assume ascii "locale"
|
2001-01-14 23:06:11 +08:00
|
|
|
I = IGNORECASE = sre_compile.SRE_FLAG_IGNORECASE # ignore case
|
|
|
|
L = LOCALE = sre_compile.SRE_FLAG_LOCALE # assume current 8-bit locale
|
2008-08-20 01:56:33 +08:00
|
|
|
U = UNICODE = sre_compile.SRE_FLAG_UNICODE # assume unicode "locale"
|
2001-01-14 23:06:11 +08:00
|
|
|
M = MULTILINE = sre_compile.SRE_FLAG_MULTILINE # make anchors look for newline
|
|
|
|
S = DOTALL = sre_compile.SRE_FLAG_DOTALL # make dot match newline
|
|
|
|
X = VERBOSE = sre_compile.SRE_FLAG_VERBOSE # ignore whitespace and comments
|
2000-06-02 01:39:12 +08:00
|
|
|
|
2001-01-14 23:06:11 +08:00
|
|
|
# sre extensions (experimental, don't rely on these)
|
|
|
|
T = TEMPLATE = sre_compile.SRE_FLAG_TEMPLATE # disable backtracking
|
|
|
|
DEBUG = sre_compile.SRE_FLAG_DEBUG # dump pattern after compilation
|
2000-06-29 16:58:44 +08:00
|
|
|
|
|
|
|
# sre exception
|
2000-06-30 00:57:40 +08:00
|
|
|
error = sre_compile.error
|
2000-06-29 16:58:44 +08:00
|
|
|
|
2000-03-31 22:58:54 +08:00
|
|
|
# --------------------------------------------------------------------
|
|
|
|
# public interface
|
|
|
|
|
|
|
|
def match(pattern, string, flags=0):
|
2001-01-14 23:06:11 +08:00
|
|
|
"""Try to apply the pattern at the start of the string, returning
|
|
|
|
a match object, or None if no match was found."""
|
2000-06-02 01:39:12 +08:00
|
|
|
return _compile(pattern, flags).match(string)
|
2000-03-31 22:58:54 +08:00
|
|
|
|
2013-11-24 05:20:30 +08:00
|
|
|
def fullmatch(pattern, string, flags=0):
|
|
|
|
"""Try to apply the pattern to all of the string, returning
|
|
|
|
a match object, or None if no match was found."""
|
|
|
|
return _compile(pattern, flags).fullmatch(string)
|
|
|
|
|
2000-03-31 22:58:54 +08:00
|
|
|
def search(pattern, string, flags=0):
|
2001-01-14 23:06:11 +08:00
|
|
|
"""Scan through string looking for a match to the pattern, returning
|
|
|
|
a match object, or None if no match was found."""
|
2000-06-02 01:39:12 +08:00
|
|
|
return _compile(pattern, flags).search(string)
|
|
|
|
|
2009-03-02 13:21:55 +08:00
|
|
|
def sub(pattern, repl, string, count=0, flags=0):
|
2001-01-14 23:06:11 +08:00
|
|
|
"""Return the string obtained by replacing the leftmost
|
|
|
|
non-overlapping occurrences of the pattern in string by the
|
2004-08-08 01:41:54 +08:00
|
|
|
replacement repl. repl can be either a string or a callable;
|
Merged revisions 68116-68119,68121,68123-68127 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r68116 | georg.brandl | 2009-01-01 05:46:51 -0600 (Thu, 01 Jan 2009) | 2 lines
#4100: note that element children are not necessarily present on "start" events.
........
r68117 | georg.brandl | 2009-01-01 05:53:55 -0600 (Thu, 01 Jan 2009) | 2 lines
#4156: make clear that "protocol" is to be replaced with the protocol name.
........
r68118 | georg.brandl | 2009-01-01 06:00:19 -0600 (Thu, 01 Jan 2009) | 2 lines
#4185: clarify escape behavior of replacement strings.
........
r68119 | georg.brandl | 2009-01-01 06:09:40 -0600 (Thu, 01 Jan 2009) | 3 lines
#4222: document dis.findlabels() and dis.findlinestarts() and
put them into dis.__all__.
........
r68121 | georg.brandl | 2009-01-01 06:43:33 -0600 (Thu, 01 Jan 2009) | 2 lines
Point to types module in new module deprecation notice.
........
r68123 | georg.brandl | 2009-01-01 06:52:29 -0600 (Thu, 01 Jan 2009) | 2 lines
#4784: ... on three counts ...
........
r68124 | georg.brandl | 2009-01-01 06:53:19 -0600 (Thu, 01 Jan 2009) | 2 lines
#4782: Fix markup error that hid load() and loads().
........
r68125 | georg.brandl | 2009-01-01 07:02:09 -0600 (Thu, 01 Jan 2009) | 2 lines
#4776: add data_files and package_dir arguments.
........
r68126 | georg.brandl | 2009-01-01 07:05:13 -0600 (Thu, 01 Jan 2009) | 2 lines
Handlers are in the `logging.handlers` module.
........
r68127 | georg.brandl | 2009-01-01 07:14:49 -0600 (Thu, 01 Jan 2009) | 2 lines
#4767: Use correct submodules for all MIME classes.
........
2009-01-01 23:05:06 +08:00
|
|
|
if a string, backslash escapes in it are processed. If it is
|
|
|
|
a callable, it's passed the match object and must return
|
2004-08-08 01:41:54 +08:00
|
|
|
a replacement string to be used."""
|
2009-03-02 13:21:55 +08:00
|
|
|
return _compile(pattern, flags).sub(repl, string, count)
|
2000-06-02 01:39:12 +08:00
|
|
|
|
2009-03-02 13:21:55 +08:00
|
|
|
def subn(pattern, repl, string, count=0, flags=0):
|
2001-01-14 23:06:11 +08:00
|
|
|
"""Return a 2-tuple containing (new_string, number).
|
|
|
|
new_string is the string obtained by replacing the leftmost
|
|
|
|
non-overlapping occurrences of the pattern in the source
|
|
|
|
string by the replacement repl. number is the number of
|
2004-08-08 01:41:54 +08:00
|
|
|
substitutions that were made. repl can be either a string or a
|
Merged revisions 68116-68119,68121,68123-68127 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r68116 | georg.brandl | 2009-01-01 05:46:51 -0600 (Thu, 01 Jan 2009) | 2 lines
#4100: note that element children are not necessarily present on "start" events.
........
r68117 | georg.brandl | 2009-01-01 05:53:55 -0600 (Thu, 01 Jan 2009) | 2 lines
#4156: make clear that "protocol" is to be replaced with the protocol name.
........
r68118 | georg.brandl | 2009-01-01 06:00:19 -0600 (Thu, 01 Jan 2009) | 2 lines
#4185: clarify escape behavior of replacement strings.
........
r68119 | georg.brandl | 2009-01-01 06:09:40 -0600 (Thu, 01 Jan 2009) | 3 lines
#4222: document dis.findlabels() and dis.findlinestarts() and
put them into dis.__all__.
........
r68121 | georg.brandl | 2009-01-01 06:43:33 -0600 (Thu, 01 Jan 2009) | 2 lines
Point to types module in new module deprecation notice.
........
r68123 | georg.brandl | 2009-01-01 06:52:29 -0600 (Thu, 01 Jan 2009) | 2 lines
#4784: ... on three counts ...
........
r68124 | georg.brandl | 2009-01-01 06:53:19 -0600 (Thu, 01 Jan 2009) | 2 lines
#4782: Fix markup error that hid load() and loads().
........
r68125 | georg.brandl | 2009-01-01 07:02:09 -0600 (Thu, 01 Jan 2009) | 2 lines
#4776: add data_files and package_dir arguments.
........
r68126 | georg.brandl | 2009-01-01 07:05:13 -0600 (Thu, 01 Jan 2009) | 2 lines
Handlers are in the `logging.handlers` module.
........
r68127 | georg.brandl | 2009-01-01 07:14:49 -0600 (Thu, 01 Jan 2009) | 2 lines
#4767: Use correct submodules for all MIME classes.
........
2009-01-01 23:05:06 +08:00
|
|
|
callable; if a string, backslash escapes in it are processed.
|
|
|
|
If it is a callable, it's passed the match object and must
|
2004-08-08 01:41:54 +08:00
|
|
|
return a replacement string to be used."""
|
2009-03-02 13:21:55 +08:00
|
|
|
return _compile(pattern, flags).subn(repl, string, count)
|
2000-06-02 01:39:12 +08:00
|
|
|
|
2009-03-02 13:21:55 +08:00
|
|
|
def split(pattern, string, maxsplit=0, flags=0):
|
2001-01-14 23:06:11 +08:00
|
|
|
"""Split the source string by the occurrences of the pattern,
|
2012-03-10 16:26:53 +08:00
|
|
|
returning a list containing the resulting substrings. If
|
|
|
|
capturing parentheses are used in pattern, then the text of all
|
|
|
|
groups in the pattern are also returned as part of the resulting
|
|
|
|
list. If maxsplit is nonzero, at most maxsplit splits occur,
|
|
|
|
and the remainder of the string is returned as the final element
|
|
|
|
of the list."""
|
2009-03-02 13:21:55 +08:00
|
|
|
return _compile(pattern, flags).split(string, maxsplit)
|
2000-03-31 22:58:54 +08:00
|
|
|
|
2004-09-24 11:41:05 +08:00
|
|
|
def findall(pattern, string, flags=0):
|
2001-01-14 23:06:11 +08:00
|
|
|
"""Return a list of all non-overlapping matches in the string.
|
|
|
|
|
2012-03-10 16:26:53 +08:00
|
|
|
If one or more capturing groups are present in the pattern, return
|
|
|
|
a list of groups; this will be a list of tuples if the pattern
|
2001-01-14 23:06:11 +08:00
|
|
|
has more than one group.
|
|
|
|
|
|
|
|
Empty matches are included in the result."""
|
2004-09-24 11:41:05 +08:00
|
|
|
return _compile(pattern, flags).findall(string)
|
2000-06-02 01:39:12 +08:00
|
|
|
|
2001-10-25 06:16:30 +08:00
|
|
|
if sys.hexversion >= 0x02020000:
|
2002-10-14 20:22:17 +08:00
|
|
|
__all__.append("finditer")
|
2004-09-24 11:41:05 +08:00
|
|
|
def finditer(pattern, string, flags=0):
|
2001-10-29 04:15:40 +08:00
|
|
|
"""Return an iterator over all non-overlapping matches in the
|
|
|
|
string. For each match, the iterator returns a match object.
|
2001-10-25 06:16:30 +08:00
|
|
|
|
|
|
|
Empty matches are included in the result."""
|
2004-09-24 11:41:05 +08:00
|
|
|
return _compile(pattern, flags).finditer(string)
|
2001-10-25 06:16:30 +08:00
|
|
|
|
2000-06-02 01:39:12 +08:00
|
|
|
def compile(pattern, flags=0):
|
2001-01-14 23:06:11 +08:00
|
|
|
"Compile a regular expression pattern, returning a pattern object."
|
2000-06-02 01:39:12 +08:00
|
|
|
return _compile(pattern, flags)
|
|
|
|
|
2000-07-24 05:46:17 +08:00
|
|
|
def purge():
|
2010-08-14 00:27:38 +08:00
|
|
|
"Clear the regular expression caches"
|
2013-03-17 04:52:09 +08:00
|
|
|
_cache.clear()
|
|
|
|
_cache_repl.clear()
|
2000-07-24 05:46:17 +08:00
|
|
|
|
2000-06-29 16:58:44 +08:00
|
|
|
def template(pattern, flags=0):
|
2001-01-14 23:06:11 +08:00
|
|
|
"Compile a template pattern, returning a pattern object"
|
2000-06-29 16:58:44 +08:00
|
|
|
return _compile(pattern, flags|T)
|
|
|
|
|
2008-09-11 01:44:35 +08:00
|
|
|
_alphanum_str = frozenset(
|
2011-04-10 17:59:16 +08:00
|
|
|
"_abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890")
|
2008-09-11 01:44:35 +08:00
|
|
|
_alphanum_bytes = frozenset(
|
2011-04-10 17:59:16 +08:00
|
|
|
b"_abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890")
|
2005-09-13 06:50:37 +08:00
|
|
|
|
2000-06-02 01:39:12 +08:00
|
|
|
def escape(pattern):
|
2011-04-10 17:59:16 +08:00
|
|
|
"""
|
|
|
|
Escape all the characters in pattern except ASCII letters, numbers and '_'.
|
|
|
|
"""
|
2008-09-11 01:44:35 +08:00
|
|
|
if isinstance(pattern, str):
|
|
|
|
alphanum = _alphanum_str
|
|
|
|
s = list(pattern)
|
2011-03-25 20:19:30 +08:00
|
|
|
for i, c in enumerate(pattern):
|
2008-09-11 01:44:35 +08:00
|
|
|
if c not in alphanum:
|
|
|
|
if c == "\000":
|
|
|
|
s[i] = "\\000"
|
|
|
|
else:
|
|
|
|
s[i] = "\\" + c
|
|
|
|
return "".join(s)
|
|
|
|
else:
|
|
|
|
alphanum = _alphanum_bytes
|
|
|
|
s = []
|
|
|
|
esc = ord(b"\\")
|
|
|
|
for c in pattern:
|
|
|
|
if c in alphanum:
|
|
|
|
s.append(c)
|
2000-06-02 01:39:12 +08:00
|
|
|
else:
|
2008-09-11 01:44:35 +08:00
|
|
|
if c == 0:
|
|
|
|
s.extend(b"\\000")
|
|
|
|
else:
|
|
|
|
s.append(esc)
|
|
|
|
s.append(c)
|
|
|
|
return bytes(s)
|
2000-03-31 22:58:54 +08:00
|
|
|
|
|
|
|
# --------------------------------------------------------------------
|
2000-06-02 01:39:12 +08:00
|
|
|
# internals
|
|
|
|
|
2013-03-17 04:52:09 +08:00
|
|
|
_cache = {}
|
|
|
|
_cache_repl = {}
|
|
|
|
|
2001-10-19 03:30:16 +08:00
|
|
|
_pattern_type = type(sre_compile.compile("", 0))
|
|
|
|
|
2013-03-17 04:52:09 +08:00
|
|
|
_MAXCACHE = 512
|
2010-08-15 05:17:48 +08:00
|
|
|
def _compile(pattern, flags):
|
2000-06-02 01:39:12 +08:00
|
|
|
# internal: compile pattern
|
2014-02-04 03:59:59 +08:00
|
|
|
bypass_cache = flags & DEBUG
|
|
|
|
if not bypass_cache:
|
|
|
|
try:
|
|
|
|
return _cache[type(pattern), pattern, flags]
|
|
|
|
except KeyError:
|
|
|
|
pass
|
2003-07-03 04:03:04 +08:00
|
|
|
if isinstance(pattern, _pattern_type):
|
Merged revisions 59565-59594 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r59568 | facundo.batista | 2007-12-19 13:53:01 +0100 (Wed, 19 Dec 2007) | 3 lines
Some minor cleanups. Thanks Mark Dickinson.
........
r59573 | raymond.hettinger | 2007-12-19 19:13:31 +0100 (Wed, 19 Dec 2007) | 1 line
Fix issue 1661: Flags argument silently ignored in re functions with compiled regexes.
........
r59574 | guido.van.rossum | 2007-12-19 20:41:06 +0100 (Wed, 19 Dec 2007) | 7 lines
Patch #1583 by Adam Olsen.
This adds signal.set_wakeup_fd(fd) which sets a file descriptor to
which a zero byte will be written whenever a C exception handler runs.
I added a simple C API as well, PySignal_SetWakeupFd(fd).
........
r59575 | raymond.hettinger | 2007-12-19 23:14:34 +0100 (Wed, 19 Dec 2007) | 1 line
Bigger range for non-extended opargs.
........
r59576 | guido.van.rossum | 2007-12-19 23:51:13 +0100 (Wed, 19 Dec 2007) | 5 lines
Patch #1549 by Thomas Herve.
This changes the rules for when __hash__ is inherited slightly,
by allowing it to be inherited when one or more of __lt__, __le__,
__gt__, __ge__ are overridden, as long as __eq__ and __ne__ aren't.
........
r59577 | raymond.hettinger | 2007-12-20 02:25:05 +0100 (Thu, 20 Dec 2007) | 1 line
Add comments
........
r59578 | brett.cannon | 2007-12-20 11:09:52 +0100 (Thu, 20 Dec 2007) | 3 lines
Add tests for the warnings module; specifically formatwarning and showwarning.
Still need tests for warn_explicit and simplefilter.
........
r59582 | guido.van.rossum | 2007-12-20 18:28:10 +0100 (Thu, 20 Dec 2007) | 2 lines
Patch #1672 by Joseph Armbruster. Use tempdir() to get a temporary directory.
........
r59584 | georg.brandl | 2007-12-20 22:03:02 +0100 (Thu, 20 Dec 2007) | 2 lines
Fix refleak introduced in r59576.
........
r59586 | guido.van.rossum | 2007-12-21 00:48:28 +0100 (Fri, 21 Dec 2007) | 4 lines
Improve performance of built-in any()/all() by avoiding PyIter_Next() --
using a trick found in ifilter().
Feel free to backport to 2.5.
........
r59591 | andrew.kuchling | 2007-12-22 18:27:02 +0100 (Sat, 22 Dec 2007) | 1 line
Add item
........
2007-12-24 16:52:31 +08:00
|
|
|
if flags:
|
2008-09-11 01:44:35 +08:00
|
|
|
raise ValueError(
|
|
|
|
"Cannot process flags argument with a compiled pattern")
|
2000-06-02 01:39:12 +08:00
|
|
|
return pattern
|
2003-07-03 05:37:16 +08:00
|
|
|
if not sre_compile.isstring(pattern):
|
2007-08-30 09:19:48 +08:00
|
|
|
raise TypeError("first argument must be string or compiled pattern")
|
2013-03-17 04:52:09 +08:00
|
|
|
p = sre_compile.compile(pattern, flags)
|
2014-02-04 03:59:59 +08:00
|
|
|
if not bypass_cache:
|
|
|
|
if len(_cache) >= _MAXCACHE:
|
|
|
|
_cache.clear()
|
|
|
|
_cache[type(pattern), pattern, flags] = p
|
2013-03-17 04:52:09 +08:00
|
|
|
return p
|
2000-06-02 01:39:12 +08:00
|
|
|
|
2010-08-15 05:17:48 +08:00
|
|
|
def _compile_repl(repl, pattern):
|
2001-03-22 23:50:10 +08:00
|
|
|
# internal: compile replacement pattern
|
2013-03-17 04:52:09 +08:00
|
|
|
try:
|
|
|
|
return _cache_repl[repl, pattern]
|
|
|
|
except KeyError:
|
|
|
|
pass
|
|
|
|
p = sre_parse.parse_template(repl, pattern)
|
|
|
|
if len(_cache_repl) >= _MAXCACHE:
|
|
|
|
_cache_repl.clear()
|
|
|
|
_cache_repl[repl, pattern] = p
|
|
|
|
return p
|
2001-03-22 23:50:10 +08:00
|
|
|
|
2000-09-22 01:03:25 +08:00
|
|
|
def _expand(pattern, match, template):
|
|
|
|
# internal: match.expand implementation hook
|
|
|
|
template = sre_parse.parse_template(template, pattern)
|
|
|
|
return sre_parse.expand_template(template, match)
|
|
|
|
|
2001-10-22 00:47:57 +08:00
|
|
|
def _subx(pattern, template):
|
|
|
|
# internal: pattern.sub/subn implementation helper
|
2001-10-22 05:48:30 +08:00
|
|
|
template = _compile_repl(template, pattern)
|
|
|
|
if not template[0] and len(template[1]) == 1:
|
2001-10-22 00:47:57 +08:00
|
|
|
# literal replacement
|
2001-10-22 05:48:30 +08:00
|
|
|
return template[1][0]
|
|
|
|
def filter(match, template=template):
|
|
|
|
return sre_parse.expand_template(template, match)
|
|
|
|
return filter
|
2000-06-30 21:55:15 +08:00
|
|
|
|
|
|
|
# register myself for pickling
|
|
|
|
|
2008-05-11 16:55:36 +08:00
|
|
|
import copyreg
|
2000-06-30 21:55:15 +08:00
|
|
|
|
|
|
|
def _pickle(p):
|
|
|
|
return _compile, (p.pattern, p.flags)
|
|
|
|
|
2008-05-11 16:55:36 +08:00
|
|
|
copyreg.pickle(_pattern_type, _pickle, _compile)
|
2000-07-03 01:33:27 +08:00
|
|
|
|
|
|
|
# --------------------------------------------------------------------
|
|
|
|
# experimental stuff (see python-dev discussions for details)
|
|
|
|
|
|
|
|
class Scanner:
|
2001-10-22 02:04:11 +08:00
|
|
|
def __init__(self, lexicon, flags=0):
|
2000-08-02 02:20:07 +08:00
|
|
|
from sre_constants import BRANCH, SUBPATTERN
|
2000-07-03 01:33:27 +08:00
|
|
|
self.lexicon = lexicon
|
2000-07-24 05:46:17 +08:00
|
|
|
# combine phrases into a compound pattern
|
2000-07-03 01:33:27 +08:00
|
|
|
p = []
|
2000-07-24 05:46:17 +08:00
|
|
|
s = sre_parse.Pattern()
|
2001-10-22 02:04:11 +08:00
|
|
|
s.flags = flags
|
2000-07-03 01:33:27 +08:00
|
|
|
for phrase, action in lexicon:
|
2000-07-24 05:46:17 +08:00
|
|
|
p.append(sre_parse.SubPattern(s, [
|
2001-10-22 02:04:11 +08:00
|
|
|
(SUBPATTERN, (len(p)+1, sre_parse.parse(phrase, flags))),
|
2000-07-24 05:46:17 +08:00
|
|
|
]))
|
Merged revisions 60481,60485,60489-60492,60494-60496,60498-60499,60501-60503,60505-60506,60508-60509,60523-60524,60532,60543,60545,60547-60548,60552,60554,60556-60559,60561-60562,60568-60598,60600-60616 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r60568 | christian.heimes | 2008-02-04 19:48:38 +0100 (Mon, 04 Feb 2008) | 1 line
Increase debugging to investige failing tests on some build bots
........
r60570 | christian.heimes | 2008-02-04 20:30:05 +0100 (Mon, 04 Feb 2008) | 1 line
Small adjustments for test compact freelist test. It's no passing on Windows as well.
........
r60573 | amaury.forgeotdarc | 2008-02-04 21:53:14 +0100 (Mon, 04 Feb 2008) | 2 lines
Correct quotes in NEWS file
........
r60575 | amaury.forgeotdarc | 2008-02-04 22:45:05 +0100 (Mon, 04 Feb 2008) | 13 lines
#1750076: Debugger did not step on every iteration of a while statement.
The mapping between bytecode offsets and source lines (lnotab) did not contain
an entry for the beginning of the loop.
Now it does, and the lnotab can be a bit larger:
in particular, several statements on the same line generate several entries.
However, this does not bother the settrace function, which will trigger only
one 'line' event.
The lnotab seems to be exactly the same as with python2.4.
........
r60584 | amaury.forgeotdarc | 2008-02-05 01:26:21 +0100 (Tue, 05 Feb 2008) | 3 lines
Change r60575 broke test_compile:
there is no need to emit co_lnotab item when both offsets are zeros.
........
r60587 | skip.montanaro | 2008-02-05 03:32:16 +0100 (Tue, 05 Feb 2008) | 1 line
sync with most recent version from python-mode sf project
........
r60588 | lars.gustaebel | 2008-02-05 12:51:40 +0100 (Tue, 05 Feb 2008) | 5 lines
Issue #2004: Use mode 0700 for temporary directories and default
permissions for missing directories.
(will backport to 2.5)
........
r60590 | georg.brandl | 2008-02-05 13:01:24 +0100 (Tue, 05 Feb 2008) | 2 lines
Convert external links to internal links. Fixes #2010.
........
r60592 | marc-andre.lemburg | 2008-02-05 15:50:40 +0100 (Tue, 05 Feb 2008) | 3 lines
Keep distutils Python 2.1 compatible (or even Python 2.4 in this case).
........
r60593 | andrew.kuchling | 2008-02-05 17:06:57 +0100 (Tue, 05 Feb 2008) | 5 lines
Update PEP URL.
(This code is duplicated between pydoc and DocXMLRPCServer; maybe it
should be refactored as a GHOP project.)
2.5.2 backport candidate.
........
r60596 | guido.van.rossum | 2008-02-05 18:32:15 +0100 (Tue, 05 Feb 2008) | 2 lines
In the experimental 'Scanner' feature, the group count was set wrong.
........
r60602 | facundo.batista | 2008-02-05 20:03:32 +0100 (Tue, 05 Feb 2008) | 3 lines
Issue 1951. Converts wave test cases to unittest.
........
r60603 | georg.brandl | 2008-02-05 20:07:10 +0100 (Tue, 05 Feb 2008) | 2 lines
Actually run the test.
........
r60604 | skip.montanaro | 2008-02-05 20:24:30 +0100 (Tue, 05 Feb 2008) | 2 lines
correct object name
........
r60605 | georg.brandl | 2008-02-05 20:58:17 +0100 (Tue, 05 Feb 2008) | 7 lines
* Use the same code to profile for test_profile and test_cprofile.
* Convert both to unittest.
* Use the same unit testing code.
* Include the expected output in both test files.
* Make it possible to regenerate the expected output by running
the file as a script with an '-r' argument.
........
r60613 | raymond.hettinger | 2008-02-06 02:49:00 +0100 (Wed, 06 Feb 2008) | 1 line
Sync-up with Py3k work.
........
r60614 | christian.heimes | 2008-02-06 13:44:34 +0100 (Wed, 06 Feb 2008) | 1 line
Limit free list of method and builtin function objects to 256 entries each.
........
r60616 | christian.heimes | 2008-02-06 14:33:44 +0100 (Wed, 06 Feb 2008) | 7 lines
Unified naming convention for free lists and their limits. All free lists
in Object/ are named ``free_list``, the counter ``numfree`` and the upper
limit is a macro ``PyName_MAXFREELIST`` inside an #ifndef block.
The chances should make it easier to adjust Python for platforms with
less memory, e.g. mobile phones.
........
2008-02-06 22:31:34 +08:00
|
|
|
s.groups = len(p)+1
|
2000-07-24 05:46:17 +08:00
|
|
|
p = sre_parse.SubPattern(s, [(BRANCH, (None, p))])
|
|
|
|
self.scanner = sre_compile.compile(p)
|
2000-07-03 01:33:27 +08:00
|
|
|
def scan(self, string):
|
|
|
|
result = []
|
|
|
|
append = result.append
|
2001-10-22 02:04:11 +08:00
|
|
|
match = self.scanner.scanner(string).match
|
2000-07-03 01:33:27 +08:00
|
|
|
i = 0
|
|
|
|
while 1:
|
2001-10-22 02:04:11 +08:00
|
|
|
m = match()
|
2000-07-03 01:33:27 +08:00
|
|
|
if not m:
|
|
|
|
break
|
|
|
|
j = m.end()
|
|
|
|
if i == j:
|
|
|
|
break
|
2001-10-22 02:04:11 +08:00
|
|
|
action = self.lexicon[m.lastindex-1][1]
|
2011-10-28 20:45:05 +08:00
|
|
|
if callable(action):
|
2001-01-14 23:06:11 +08:00
|
|
|
self.match = m
|
2000-07-03 01:33:27 +08:00
|
|
|
action = action(self, m.group())
|
|
|
|
if action is not None:
|
|
|
|
append(action)
|
|
|
|
i = j
|
|
|
|
return result, string[i:]
|