Commit Graph

101 Commits

Author SHA1 Message Date
Victor Stinner
91106cd9ff
bpo-29240: PEP 540: Add a new UTF-8 Mode (#855)
* Add -X utf8 command line option, PYTHONUTF8 environment variable
  and a new sys.flags.utf8_mode flag.
* If the LC_CTYPE locale is "C" at startup: enable automatically the
  UTF-8 mode.
* Add _winapi.GetACP(). encodings._alias_mbcs() now calls
  _winapi.GetACP() to get the ANSI code page
* locale.getpreferredencoding() now returns 'UTF-8' in the UTF-8
  mode. As a side effect, open() now uses the UTF-8 encoding by
  default in this mode.
* Py_DecodeLocale() and Py_EncodeLocale() now use the UTF-8 encoding
  in the UTF-8 Mode.
* Update subprocess._args_from_interpreter_flags() to handle -X utf8
* Skip some tests relying on the current locale if the UTF-8 mode is
  enabled.
* Add test_utf8mode.py.
* _Py_DecodeUTF8_surrogateescape() gets a new optional parameter to
  return also the length (number of wide characters).
* pymain_get_global_config() and pymain_set_global_config() now
  always copy flag values, rather than only copying if the new value
  is greater than the old value.
2017-12-13 12:29:09 +01:00
Serhiy Storchaka
81108375d9 bpo-30152: Reduce the number of imports for argparse. (#1269) 2017-09-26 00:55:55 +03:00
Serhiy Storchaka
2e576f5aec bpo-30144: Import collections ABC from collections.abc rather than collections. (#1263) 2017-04-24 09:05:00 +03:00
Serhiy Storchaka
5affd23e6f bpo-29762: More use "raise from None". (#569)
This hides unwanted implementation details from tracebacks.
2017-04-05 09:37:24 +03:00
Victor Stinner
9acc6a03f1 test_locale now ignores the DeprecationWarning (#977)
Don't fail anymore if test run with python3 -Werror.

Fix also deprecation message: add a space.
2017-04-03 18:09:55 +02:00
Garvit Khatri
1cf93a76c2 bpo-10379: add 'monetary' to format_string, deprecate format
Add the 'monetary' parameter to format_string so that all
uses of format can be converted to format_string.  Adjust
the documentation accordingly, and add a deprecation
warning when format is used.
2017-03-28 11:43:38 -04:00
Benjamin Peterson
df8280838f bpo-20087: Revert "make the glibc alias table take precedence over the X11 one (#422)" (#713)
This reverts commit 02371e0ed1.
2017-03-19 23:49:43 -07:00
Benjamin Peterson
02371e0ed1 make the glibc alias table take precedence over the X11 one (#422)
bpo-20087
2017-03-07 22:03:13 -08:00
Xavier de Gaye
6c9dcda6b4 Issue #28596: The preferred encoding is UTF-8 on Android. 2016-12-17 09:19:11 +01:00
Martin Panter
3e04d5b306 Issue #27076: Merge spelling from 3.5 2016-05-26 06:03:19 +00:00
Martin Panter
46f50726a0 Issue #27076: Doc, comment and tests spelling fixes
Most fixes to Doc/ and Lib/ directories by Ville Skyttä.
2016-05-26 05:35:26 +00:00
Senthil Kumaran
6fce35354a merge 3.5.
[minor] - Correct the docstring of locale.str. Patch by poleto.
2016-04-12 23:15:44 -07:00
Senthil Kumaran
a3c532b0ed [minor] - Correct the docstring of locale.str. Patch by poleto. 2016-04-12 23:14:14 -07:00
Victor Stinner
2753a096e0 locale.delocalize(): only call localeconv() once 2015-11-03 14:34:51 +01:00
Serhiy Storchaka
f0eeedf0d8 Issue #22681: Added support for the koi8_t encoding. 2015-05-12 23:24:19 +03:00
Serhiy Storchaka
ad8a1c3fb2 Issue #22682: Added support for the kz1048 encoding. 2015-05-12 23:16:55 +03:00
Antoine Pitrou
b64bca9852 Issue #13918: Provide a locale.delocalize() function which can remove
locale-specific number formatting from a string representing a number,
without then converting it to a specific type.  Patch by Cédric Krier.
2014-10-23 22:52:31 +02:00
Serhiy Storchaka
9e04edaf64 Issue #20079: Updated alias mapping to glibc 2.19 SUPPORTED file. 2014-10-02 10:49:26 +03:00
Serhiy Storchaka
b8cd8cf8f2 Issue #20076: Remove just added the sr_rs.utf8@latn alias because it is
derived from sr_rs@latin.
2014-10-02 10:19:29 +03:00
Serhiy Storchaka
1de0ba2cf5 Issue #20076: Added non derived UTF-8 aliases to locale aliases table. 2014-10-02 00:09:37 +03:00
Serhiy Storchaka
99cb41d423 Issue #20079: Added locales supported in glibc 2.18 to locale alias table. 2014-10-01 23:43:35 +03:00
Serhiy Storchaka
8c4f57d1d5 Issue #20046: Locale alias table no longer contains entities which can be
calculated.  Generalized support of the euro modifier.
2013-12-27 00:56:53 +02:00
Serhiy Storchaka
e190fac5f9 Issue #20027: Fixed locale aliases for devanagari locales. 2013-12-26 21:21:52 +02:00
Serhiy Storchaka
5eb01530b2 Issue #20027: Fixed locale aliases for devanagari locales. 2013-12-26 21:20:59 +02:00
Serhiy Storchaka
6e6ec50f82 Issue #20034: Updated alias mapping to most recent locale.alias file
from X.org distribution using makelocalealias.py.
2013-12-20 18:50:32 +02:00
Serhiy Storchaka
715233c3cd Issue #20034: Updated alias mapping to most recent locale.alias file
from X.org distribution using makelocalealias.py.
2013-12-20 18:23:26 +02:00
Serhiy Storchaka
16f02d2b06 Issue #5815: Fixed support for locales with modifiers. Fixed support for
locale encodings with hyphens.
2013-12-19 21:21:40 +02:00
Serhiy Storchaka
c8cc42edf4 Issue #5815: Fixed support for locales with modifiers. Fixed support for
locale encodings with hyphens.
2013-12-19 21:21:25 +02:00
Antoine Pitrou
fd4722cacf Issue #9548: Add a minimal "_bootlocale" module that is imported by the _io module instead of the full locale module. 2013-10-12 00:13:50 +02:00
Brett Cannon
cd171c8e92 Issue #18200: Back out usage of ModuleNotFoundError (8d28d44f3a9a) 2013-07-04 17:43:24 -04:00
Brett Cannon
0a140668fa Issue #18200: Update the stdlib (except tests) to use
ModuleNotFoundError.
2013-06-13 20:57:26 -04:00
Éric Araujo
a2b89e364f Fix last remaining references to ex-devguide 2011-11-29 16:36:17 +01:00
Petri Lehtinen
395ca72380 Issue #3067: Enhance the documentation and docstring of locale.setlocale() 2011-11-05 10:21:16 +02:00
Petri Lehtinen
3c85fe07f4 Issue #3067: Fix the error raised by locale.setlocale() 2011-11-04 22:21:07 +02:00
Jesus Cea
5032292f9e Closes #13283: removal of two unused variable in locale.py 2011-10-31 16:03:34 +01:00
Ronald Oussoren
6edd8c1faf (merge) Fix #10154 and #10090: locale normalizes the UTF-8 encoding to "UTF-8" instead of "UTF8"
On MacOSX and OpenBSD (and possibly other BSDs) "en_US.UTF-8" is a valid locale
while "en_US.UTF8" is not. As the former works on Linux as well it is better
to normalize to that value.
2011-05-17 13:03:54 +02:00
Ronald Oussoren
02a67ac72b Fix #10154 and #10090: locale normalizes the UTF-8 encoding to "UTF-8" instead of "UTF8"
On MacOSX and OpenBSD (and possibly other BSDs) "en_US.UTF-8" is a valid locale
while "en_US.UTF8" is not. As the former works on Linux as well it is better
to normalize to that value.
2011-05-17 12:44:54 +02:00
R. David Murray
7e00ef0974 Merged revisions 80521 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/branches/py3k

................
  r80521 | r.david.murray | 2010-04-26 22:45:53 -0400 (Mon, 26 Apr 2010) | 13 lines

  Merged revisions 80512 via svnmerge from
  svn+ssh://pythondev@svn.python.org/python/trunk

  ........
    r80512 | r.david.murray | 2010-04-26 17:17:14 -0400 (Mon, 26 Apr 2010) | 7 lines

    Issue #6656: fix locale.format_string to handle escaped percents and mappings.

    Refactors format_string.  Includes tests for the two problems noted in
    the issue, but as far as I can see there are no other tests that confirm
    that format_string conforms to normal % formatting rules.
  ........
................
2010-09-05 22:40:41 +00:00
R. David Murray
ad78d15acc Merged revisions 80512 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk

........
  r80512 | r.david.murray | 2010-04-26 17:17:14 -0400 (Mon, 26 Apr 2010) | 7 lines

  Issue #6656: fix locale.format_string to handle escaped percents and mappings.

  Refactors format_string.  Includes tests for the two problems noted in
  the issue, but as far as I can see there are no other tests that confirm
  that format_string conforms to normal % formatting rules.
........
2010-04-27 02:45:53 +00:00
Antoine Pitrou
0c70d2d144 Merged revisions 79977 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk

........
  r79977 | antoine.pitrou | 2010-04-12 00:32:39 +0200 (lun., 12 avril 2010) | 4 lines

  Issue #8374: Update the internal alias table in the :mod:`locale` module
  to cover recent locale changes and additions.
........
2010-04-11 22:35:34 +00:00
Antoine Pitrou
eda95e9db3 Merged revisions 75537,75539 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/branches/py3k

........
  r75537 | antoine.pitrou | 2009-10-19 21:37:25 +0200 (lun., 19 oct. 2009) | 3 lines

  egreen is Derk Drukker + fix NEWS formatting
........
  r75539 | antoine.pitrou | 2009-10-19 21:43:09 +0200 (lun., 19 oct. 2009) | 4 lines

  Issue #7080: locale.strxfrm() raises a MemoryError on 64-bit non-Windows
  platforms, and assorted locale fixes by Derk Drukker.
........
2009-10-19 19:47:59 +00:00
Antoine Pitrou
6a448d4c2e Issue #7080: locale.strxfrm() raises a MemoryError on 64-bit non-Windows
platforms, and assorted locale fixes by Derk Drukker.
2009-10-19 19:43:09 +00:00
Ronald Oussoren
dc9bc3be97 Merged revisions 74687 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/branches/py3k

........
  r74687 | ronald.oussoren | 2009-09-06 15:59:02 +0200 (Sun, 06 Sep 2009) | 3 lines

  Fix for issue 6393: Python crashes on OSX when $LANG is set to some (but
  not all) invalid values due to an invalid result from nl_langinfo
........
2009-09-06 14:01:46 +00:00
Ronald Oussoren
6d77e07196 Fix for issue 6393: Python crashes on OSX when $LANG is set to some (but
not all) invalid values due to an invalid result from nl_langinfo
2009-09-06 13:59:02 +00:00
Mark Dickinson
bbffb25c69 Merged revisions 74312 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk

........
  r74312 | mark.dickinson | 2009-08-04 22:56:04 +0100 (Tue, 04 Aug 2009) | 4 lines

  Issue #6620: Slightly safer code for _grouping_intervals in the locale
  module.  Fixes a 'possible use before assignment' warning from pylint.
  Thanks Vincent Legoll.
........
2009-08-04 21:57:18 +00:00
Ronald Oussoren
fe8a3d6eeb Fix for issue 6202 2009-06-07 15:29:46 +00:00
Jeroen Ruigrok van der Werven
0a866947c9 Merged revisions 72469 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk

........
  r72469 | jeroen.ruigrok | 2009-05-08 16:11:23 +0200 (vr, 08 mei 2009) | 2 lines

  Update the Windows locale mapping with the ones introduced with Vista.
........
2009-05-08 14:18:00 +00:00
Jeroen Ruigrok van der Werven
4072ff3e93 Merged revisions 72468 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk

........
  r72468 | jeroen.ruigrok | 2009-05-08 15:07:39 +0200 (vr, 08 mei 2009) | 2 lines

  Add ISO-8859-16.
........
2009-05-08 14:17:00 +00:00
Jeroen Ruigrok van der Werven
6ca2e0ac5b Merged revisions 72399 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk

........
  r72399 | jeroen.ruigrok | 2009-05-06 15:16:36 +0200 (wo, 06 mei 2009) | 4 lines

  Be more explicit about the error we are catching.

  Requested by: Antoine Pitrou
........
2009-05-06 13:18:35 +00:00
Jeroen Ruigrok van der Werven
bcf8506dcd Merged revisions 72375 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk

........
  r72375 | jeroen.ruigrok | 2009-05-06 07:25:42 +0200 (wo, 06 mei 2009) | 5 lines

  Wrap getpreferredencoding()'s use of setlocale in a try/except to prevent
  us from raising an exception when the locale is invalid.

  Issue #1443504
........
2009-05-06 05:33:24 +00:00