mirrors/cpython
0
0
Fork 0
mirror of https://github.com/python/cpython.git synced 2024-12-12 19:33:52 +08:00
Code Issues Packages Projects Releases Wiki Activity
116,859 Commits 6 Branches 598 Tags 2.5 GiB
7a7eaff95c
Commit Graph

639 Commits

Author SHA1 Message Date
INADA Naoki
4856b0f34a
bpo-32402: io: Add missing NULL check. (GH-4971) 
_PyUnicode_FromId() may return NULL.

Reported by coverity scan: CID 1426868, 1426867.
 2017-12-24 10:29:19 +09:00
INADA Naoki
507434fd50
bpo-15216: io: TextIOWrapper.reconfigure() accepts encoding, errors and newline (GH-2343) 2017-12-21 09:59:53 +09:00
Serhiy Storchaka
a5552f023e
bpo-32240: Add the const qualifier to declarations of PyObject* array arguments. (#4746) 2017-12-15 13:11:11 +02:00
Antoine Pitrou
317def9fdb bpo-17852: Revert incorrect fix based on misunderstanding of _Py_PyAtExit() semantics (#4826) 2017-12-13 01:39:26 +01:00
Nir Soffer
6a89481680 bpo-32186: Release the GIL during lseek and fstat (#4652) 
In _io_FileIO_readall_impl(), lseek() and _Py_fstat_noraise() were called
without releasing the GIL. This can cause all threads to hang for
unlimited time when calling FileIO.read() and the NFS server is not
accessible.
 2017-12-01 02:18:58 +01:00
benfogle
9703f092ab bpo-31976: Fix race condition when flushing a file is slow. (#4331) 2017-11-10 22:03:40 +01:00
Victor Stinner
8c663fd60e
Replace KB unit with KiB (#4293) 
kB (*kilo* byte) unit means 1000 bytes, whereas KiB ("kibibyte")
means 1024 bytes. KB was misused: replace kB or KB with KiB when
appropriate.

Same change for MB and GB which become MiB and GiB.

Change the output of Tools/iobench/iobench.py.

Round also the size of the documentation from 5.5 MB to 5 MiB.
 2017-11-08 14:44:44 -08:00
Serhiy Storchaka
d6238a76c6 bpo-25359: Add missed "goto error" after setting an exception. (#3712) 2017-09-24 02:49:58 +03:00
Neil Schemenauer
0a1ff24acf bpo-17852: Maintain a list of BufferedWriter objects. Flush them on exit. (#3372) 
* Maintain a list of BufferedWriter objects.  Flush them on exit.

In Python 3, the buffer and the underlying file object are separate
and so the order in which objects are finalized matters.  This is
unlike Python 2 where the file and buffer were a single object and
finalization was done for both at the same time.  In Python 3, if
the file is finalized and closed before the buffer then the data in
the buffer is lost.

This change adds a doubly linked list of open file buffers.  An atexit
hook ensures they are flushed before proceeding with interpreter
shutdown.  This is addition does not remove the need to properly close
files as there are other reasons why buffered data could get lost during
finalization.

Initial patch by Armin Rigo.

* Use weakref.WeakSet instead of WeakKeyDictionary.

* Simplify buffered double-linked list types.

* In _flush_all_writers(), suppress errors from flush().

* Remove NEWS entry, use blurb.

* Take more care when flushing file buffers from atexit.

The previous implementation was not careful enough to avoid
causing issues in multi-threaded cases.  Check for buf->ok
and buf->finalizing before actually doing the flush.  Also,
increase the refcnt to ensure the object does not disappear.
 2017-09-22 10:17:30 -07:00
Eric Snow
2ebc5ce42a bpo-30860: Consolidate stateful runtime globals. (#3397) 
* group the (stateful) runtime globals into various topical structs
* consolidate the topical structs under a single top-level _PyRuntimeState struct
* add a check-c-globals.py script that helps identify runtime globals

Other globals are excluded (see globals.txt and check-c-globals.py).
 2017-09-07 23:51:28 -06:00
Antoine Pitrou
a6a4dc816d bpo-31370: Remove support for threads-less builds (#3385) 
* Remove Setup.config
* Always define WITH_THREAD for compatibility.
 2017-09-07 18:56:24 +02:00
Eric Snow
05351c1bd8 Revert "bpo-30860: Consolidate stateful runtime globals." (#3379) 
Windows buildbots started failing due to include-related errors.
 2017-09-05 21:43:08 -07:00
Eric Snow
76d5abc868 bpo-30860: Consolidate stateful runtime globals. (#2594) 
* group the (stateful) runtime globals into various topical structs
* consolidate the topical structs under a single top-level _PyRuntimeState struct
* add a check-c-globals.py script that helps identify runtime globals

Other globals are excluded (see globals.txt and check-c-globals.py).
 2017-09-05 18:26:16 -07:00
Neil Schemenauer
db564238db Revert "bpo-17852: Maintain a list of BufferedWriter objects. Flush them on exit. (#1908)" (#3337) 
This reverts commit e38d12ed34.
 2017-09-04 22:13:17 -07:00
Neil Schemenauer
e38d12ed34 bpo-17852: Maintain a list of BufferedWriter objects. Flush them on exit. (#1908) 
* Maintain a list of BufferedWriter objects.  Flush them on exit.

In Python 3, the buffer and the underlying file object are separate
and so the order in which objects are finalized matters.  This is
unlike Python 2 where the file and buffer were a single object and
finalization was done for both at the same time.  In Python 3, if
the file is finalized and closed before the buffer then the data in
the buffer is lost.

This change adds a doubly linked list of open file buffers.  An atexit
hook ensures they are flushed before proceeding with interpreter
shutdown.  This is addition does not remove the need to properly close
files as there are other reasons why buffered data could get lost during
finalization.

Initial patch by Armin Rigo.

* Use weakref.WeakSet instead of WeakKeyDictionary.

* Simplify buffered double-linked list types.

* In _flush_all_writers(), suppress errors from flush().

* Remove NEWS entry, use blurb.
 2017-09-04 20:18:38 -07:00
Oren Milman
ba7d736521 bpo-31243: Fixed PyArg_ParseTuple failure checks. (#3171) 2017-08-29 11:58:27 +03:00
Oren Milman
a5b4ea15b6 bpo-31271: Fix an assertion failure in io.TextIOWrapper.write. (#3201) 2017-08-25 21:14:54 +03:00
Oren Milman
13614e375c bpo-28261: fix err msgs where PyArg_ParseTuple is used to parse normal tuples (leftovers) (#3198) 2017-08-24 19:51:24 +03:00
INADA Naoki
a6296d34a4 bpo-31095: fix potential crash during GC (GH-2974) 2017-08-24 14:55:17 +09:00
Oren Milman
1d1d3e9db8 bpo-28261: Fixed err msgs where PyArg_ParseTuple is used to parse normal tuples. (#3119) 2017-08-20 18:35:36 +03:00
Serhiy Storchaka
6969eaf468 bpo-29464: Rename METH_FASTCALL to METH_FASTCALL|METH_KEYWORDS and make (#1955) 
the bare METH_FASTCALL be used for functions with positional-only
parameters.
 2017-07-03 21:20:15 +03:00
Serhiy Storchaka
f7eae0adfc [security] bpo-13617: Reject embedded null characters in wchar* strings. (#2302) 
Based on patch by Victor Stinner.

Add private C API function _PyUnicode_AsUnicode() which is similar to
PyUnicode_AsUnicode(), but checks for null characters.
 2017-06-28 08:30:06 +03:00
Serhiy Storchaka
e613e6add5 bpo-30708: Check for null characters in PyUnicode_AsWideCharString(). (#2285) 
Raise a ValueError if the second argument is NULL and the wchar_t\*
string contains null characters.
 2017-06-27 16:03:14 +03:00
Sylvain
7445381c60 bpo-30600: Fix error messages (condition order in Argument Clinic) (#2051) 
The function '_PyArg_ParseStack()' and
'_PyArg_UnpackStack' were failing (with error
"XXX() takes Y argument (Z given)") before
the function '_PyArg_NoStackKeywords()' was called.
Thus, the latter did not raise its more meaningful
error : "XXX() takes no keyword arguments".
 2017-06-10 07:51:48 +03:00
Victor Stinner
29adc13bd7 bpo-30601: Fix a refleak in WindowsConsoleIO (#2003) 
Fix a reference leak in _io._WindowsConsoleIO: PyUnicode_FSDecoder()
always initialize decodedname when it succeed and it doesn't clear
input decodedname object.
 2017-06-08 18:19:25 +02:00
Antoine Pitrou
3c2817b688 Fix bpo-30526: Add TextIOWrapper.reconfigure() and a TextIOWrapper.write_through attribute (#1922) 
* Fix bpo-30526: Add TextIOWrapper.reconfigure()

* Apply Nick's improved wording

* Update Misc/NEWS
 2017-06-03 12:32:28 +02:00
Segev Finer
523776c341 bpo-30544: _io._WindowsConsoleIO.write raises the wrong error when WriteConsoleW fails (#1912) 
* bpo-30544: _io._WindowsConsoleIO.write raises the wrong error when WriteConsoleW fails

* bpo-30544: _io._WindowsConsoleIO.write raises the wrong error when WriteConsoleW fails
 2017-06-02 09:26:01 -07:00
Victor Stinner
9997073736 bpo-30228: FileIO seek() and tell() set seekable (#1384) 
FileIO.seek() and FileIO.tell() method now set the internal seekable
attribute to avoid one syscall on open() (in buffered or text mode).

The seekable property is now also more reliable since its value is
set correctly on memory allocation failure.
 2017-05-02 15:10:39 +02:00
Serhiy Storchaka
bf623ae884 bpo-30061: Check if PyObject_Size()/PySequence_Size()/PyMapping_Size() (#1096) 
raised an error.

Replace them with using concrete types API that never fails if appropriate.
 2017-04-19 20:03:52 +03:00
Serhiy Storchaka
55fe1ae970 bpo-30022: Get rid of using EnvironmentError and IOError (except test… (#1051) 2017-04-16 10:46:38 +03:00
Xiang Zhang
026435ce49 bpo-30068: add missing iter(self) in _io._IOBase.readlines when hint is present (#1130) 2017-04-15 12:47:28 +08:00
Serhiy Storchaka
762bf40438 bpo-29852: Argument Clinic Py_ssize_t converter now supports None (#716) 
if pass `accept={int, NoneType}`.
 2017-03-30 09:15:31 +03:00
Serhiy Storchaka
ba85d69a3e bpo-29878: Add global instances of int for 0 and 1. (#852) 2017-03-30 09:09:41 +03:00
Serhiy Storchaka
aefa7ebf0f bpo-6532: Make the thread id an unsigned integer. (#781) 
* bpo-6532: Make the thread id an unsigned integer.

From C API side the type of results of PyThread_start_new_thread() and
PyThread_get_thread_ident(), the id parameter of
PyThreadState_SetAsyncExc(), and the thread_id field of PyThreadState
changed from "long" to "unsigned long".

* Restore a check in thread_get_ident().
 2017-03-23 14:48:39 +01:00
Serhiy Storchaka
fff9a31a91 bpo-29865: Use PyXXX_GET_SIZE macros rather than Py_SIZE for concrete types. (#748) 2017-03-21 08:53:25 +02:00
Serhiy Storchaka
a5af6e1af7 bpo-25455: Fixed crashes in repr of recursive buffered file-like objects. (#514) 2017-03-19 19:25:29 +02:00
Oren Milman
004251059b bpo-29730: replace some calls to PyNumber_Check and improve some error messages (#650) 2017-03-13 00:37:05 +02:00
Serhiy Storchaka
202fda55c2 bpo-24037: Add Argument Clinic converter bool(accept={int}). (#485) 2017-03-12 10:10:47 +02:00
orenmn
740025478d bpo-29741: Clean up C implementations of BytesIO and StringIO. (#606) 
Some BytesIO methods now accept not just int subclasses but other int-like types.
 2017-03-11 00:52:01 +02:00
Steve Dower
8c67fdd24b Merge from 3.6 2017-02-04 17:37:00 -08:00
Steve Dower
a7e164881e Adds precheck for console filename to fix Windows 7. 2017-02-04 17:36:47 -08:00
Steve Dower
43fec9b419 Merge issue #28164 and issue #29409 2017-02-04 15:14:18 -08:00
Steve Dower
722e3e2705 Issue #28164: Correctly handle special console filenames (patch by Eryk Sun) 2017-02-04 15:07:46 -08:00
Steve Dower
eacee98679 Issue #29409: Implement PEP 529 for io.FileIO (Patch by Eryk Sun) 2017-02-04 14:38:11 -08:00
Serhiy Storchaka
228b12edcc Issue #28999: Use Py_RETURN_NONE, Py_RETURN_TRUE and Py_RETURN_FALSE wherever 
possible.  Patch is writen with Coccinelle.
 2017-01-23 09:47:21 +02:00
Victor Stinner
0c4a828cad Run Argument Clinic: METH_VARARGS=>METH_FASTCALL 
Issue #29286. Run Argument Clinic to get the new faster METH_FASTCALL calling
convention for functions using "boring" positional arguments.

Manually fix _elementtree: _elementtree_XMLParser_doctype() must remain
consistent with the clinic code.
 2017-01-17 02:21:47 +01:00
Victor Stinner
259f0e4437 Run Argument Clinic: METH_VARARGS=>METH_FASTCALL 
Issue #29286. Run Argument Clinic to get the new faster METH_FASTCALL calling
convention for functions using only positional arguments.
 2017-01-17 01:35:17 +01:00
Victor Stinner
3e1fad6913 Rename _PyArg_ParseStack to _PyArg_ParseStackAndKeywords 
Issue #29286.
 2017-01-17 01:29:01 +01:00
Martin Panter
446a498a63 Merge doc fixes from 3.6 2017-01-14 09:56:00 +00:00
Martin Panter
4659ddc433 Merge doc fixes from 3.5 2017-01-14 09:54:57 +00:00
Martin Panter
536d70ed33 Fix grammar, typos and markup in documentation and code comments 
* Indent versionchanged at method level, not class level
* Mark up ``--help`` to avoid generating an en dash
* Use forward slash in Unix command line with a dollar sign ($) prompt
 2017-01-14 08:23:08 +00:00
Steve Dower
280408bf1c Issue #28768: Fix implicit declaration of function _setmode. Patch by Masayuki Yamamoto 2016-12-28 15:41:53 -08:00
Steve Dower
bfce0f977d Issue #28768: Fix implicit declaration of function _setmode. Patch by Masayuki Yamamoto 2016-12-28 15:41:09 -08:00
Victor Stinner
61bdb0d319 Use _PyObject_CallMethodIdObjArgs() in _io 
Issue #28915: Replace _PyObject_CallMethodId() with
_PyObject_CallMethodIdObjArgs() when the format string was only made of "O"
formats, PyObject* arguments.

_PyObject_CallMethodIdObjArgs() avoids the creation of a temporary tuple and
doesn't have to parse a format string.
 2016-12-09 15:39:28 +01:00
Victor Stinner
7e42541d08 Use _PyObject_CallMethodIdObjArgs() 
Issue #28915: Replace _PyObject_CallMethodId() with
_PyObject_CallMethodIdObjArgs() when the format string only use the format 'O'
for objects, like "(O)".

_PyObject_CallMethodIdObjArgs() avoids the code to parse a format string and
avoids the creation of a temporary tuple.
 2016-12-09 00:36:19 +01:00
Serhiy Storchaka
d7d266c113 Merge from 3.6. 2016-12-07 13:32:09 +02:00
Serhiy Storchaka
427f10b442 Merge from 3.5. 2016-12-07 13:31:47 +02:00
Serhiy Storchaka
606ab86c0e Change order of io.UnsupportedOperation base classes. 
This makes tests passing after changes by issue #5322.
 2016-12-07 13:31:20 +02:00
Serhiy Storchaka
85b0f5beb1 Added the const qualifier to char* variables that refer to readonly internal 
UTF-8 represenatation of Unicode objects.
 2016-11-20 10:16:47 +02:00
Serhiy Storchaka
a98c4a984b Replaced outdated macros _PyUnicode_AsString and _PyUnicode_AsStringAndSize 
with PyUnicode_AsUTF8 and PyUnicode_AsUTF8AndSize.
 2016-11-20 09:13:40 +02:00
Serhiy Storchaka
06515833fe Replaced outdated macros _PyUnicode_AsString and _PyUnicode_AsStringAndSize 
with PyUnicode_AsUTF8 and PyUnicode_AsUTF8AndSize.
 2016-11-20 09:13:07 +02:00
Serhiy Storchaka
1a73bf365e Issue #28701: Replace PyUnicode_CompareWithASCIIString with _PyUnicode_EqualToASCIIString. 
The latter function is more readable, faster and doesn't raise exceptions.
 2016-11-16 10:19:57 +02:00
Serhiy Storchaka
3b73ea1278 Issue #28701: Replace PyUnicode_CompareWithASCIIString with _PyUnicode_EqualToASCIIString. 
The latter function is more readable, faster and doesn't raise exceptions.
 2016-11-16 10:19:20 +02:00
Serhiy Storchaka
f4934ea77d Issue #28701: Replace PyUnicode_CompareWithASCIIString with _PyUnicode_EqualToASCIIString. 
The latter function is more readable, faster and doesn't raise exceptions.
 2016-11-16 10:17:58 +02:00
Serhiy Storchaka
5f548a24a4 Issue #28387: Fixed possible crash in _io.TextIOWrapper deallocator when 
the garbage collector is invoked in other thread.
Based on patch by Sebastian Cufre.
 2016-11-03 15:38:17 +02:00
Serhiy Storchaka
a7c972e03b Issue #28387: Fixed possible crash in _io.TextIOWrapper deallocator when 
the garbage collector is invoked in other thread.
Based on patch by Sebastian Cufre.
 2016-11-03 15:37:01 +02:00
Serhiy Storchaka
d63f1f757c Issue #28387: Fixed possible crash in _io.TextIOWrapper deallocator when 
the garbage collector is invoked in other thread.
Based on patch by Sebastian Cufre.
 2016-11-03 15:38:58 +02:00
Martin Panter
ccb2c0e310 Issue #23214: Implement optional BufferedReader, BytesIO read1() argument 2016-10-20 23:48:14 +00:00
Steve Dower
c6f9b2b7f5 Issue #28162: Fixes Ctrl+Z handling in console readall() 2016-10-08 12:37:33 -07:00
Steve Dower
312cef7452 Issue #28217: Adds _testconsole module to test console input. Fixes some issues found by the tests. 2016-10-03 09:04:58 -07:00
Christian Heimes
9df89d06a0 Issue #28277: remove linefeed character from iomodule.h. Patch by Michael Felt 2016-09-26 14:08:47 +02:00
Benjamin Peterson
e2e792d98f merge 3.5 (#28184) 2016-09-19 22:17:16 -07:00
Steve Dower
27f26ad962 Issue #28161: Opening CON for write access fails 
Issue #28162: WindowsConsoleIO readall() fails if first line starts with Ctrl+Z
Issue #28163: WindowsConsoleIO fileno() passes wrong flags to _open_osfhandle
Issue #28164: _PyIO_get_console_type fails for various paths
 2016-09-17 13:51:23 -07:00
Serhiy Storchaka
ec406fed16 Issue #27810: Regenerate Argument Clinic. 2016-09-11 21:25:45 +03:00
Martin Panter
0be894b2f6 Issue #27895: Spelling fixes (Contributed by Ville Skyttä). 2016-09-07 12:03:06 +00:00
Steve Dower
3929499914 Issue #1602: Windows console doesn't input or print Unicode (PEP 528) 
Closes #17602: Adds a readline implementation for the Windows console
 2016-08-30 21:22:36 -07:00
Steve Dower
940f33a50f Issue #23524: Finish removing _PyVerify_fd from sources 2016-09-08 11:21:54 -07:00
Benjamin Peterson
47ff0734b8 more PY_LONG_LONG to long long 2016-09-08 09:15:54 -07:00
Benjamin Peterson
ed4aa83ff7 require a long long data type (closes #27961) 2016-09-05 17:44:18 -07:00
Raymond Hettinger
15f44ab043 Issue #27895: Spelling fixes (Contributed by Ville Skyttä). 2016-08-30 10:47:49 -07:00
Serhiy Storchaka
9171a8b4ce Issue #27574: Decreased an overhead of parsing keyword arguments in functions 
implemented with using Argument Clinic.
 2016-08-14 10:52:18 +03:00
Serhiy Storchaka
2954f83999 - Issue #27332: Fixed the type of the first argument of module-level functions 
generated by Argument Clinic.  Patch by Petr Viktorin.
 2016-07-07 18:20:03 +03:00
Serhiy Storchaka
1a2b24f02d Issue #27332: Fixed the type of the first argument of module-level functions 
generated by Argument Clinic.  Patch by Petr Viktorin.
 2016-07-07 17:35:15 +03:00
Serhiy Storchaka
5dee6551e2 Issue #26305: Argument Clinic now uses braces in C code as required by PEP 7. 2016-06-09 16:16:06 +03:00
Barry Warsaw
118598a072 Issue #27066: Fixed SystemError if a custom opener (for open()) returns a 
negative number without setting an exception.
 2016-06-08 17:54:43 -04:00
Barry Warsaw
480e28538d Issue #27066: Fixed SystemError if a custom opener (for open()) returns 
a negative number without setting an exception.
 2016-06-08 17:47:26 -04:00
Ethan Furman
d62548afed issue27186: add open/io.open; patch by Jelle Zijlstra 2016-06-04 14:38:43 -07:00
Barry Warsaw
efe7256083 Fix a comment. 2016-06-08 17:55:49 -04:00
Martin Panter
c249221dfd Issue #20699: Merge io bytes-like fixes from 3.5 2016-05-28 01:07:08 +00:00
Martin Panter
6bb91f3b6e Issue #20699: Document that “io” methods accept bytes-like objects 
This matches the usage of ZipFile and BufferedWriter. This still requires
return values to be bytes() objects.

Also document and test that the write() methods should only access their
argument before they return.
 2016-05-28 00:41:57 +00:00
Martin Panter
abe4d52a1a Merge doc and comment fixes from 3.5 2016-04-19 23:23:16 +00:00
Martin Panter
8f26565ba9 Fix spelling (inital), grammar (may translates) in documentation, comments 2016-04-19 04:03:41 +00:00
Serhiy Storchaka
b6a9c9761c Issue #26778: Fixed "a/an/and" typos in code comment, documentation and error 
messages.
 2016-04-17 09:39:28 +03:00
Martin Panter
8b04a945ef Merge typo fixes from 3.5 2016-04-16 09:29:17 +00:00
Martin Panter
119e502277 Fix typos in code comments and documentation 2016-04-16 09:28:57 +00:00
Serhiy Storchaka
f01e408c16 Issue #26200: Added Py_SETREF and replaced Py_XSETREF with Py_SETREF 
in places where Py_DECREF was used.
 2016-04-10 18:12:01 +03:00
Serhiy Storchaka
ec39756960 Issue #22570: Renamed Py_SETREF to Py_XSETREF. 2016-04-06 09:50:03 +03:00
Serhiy Storchaka
48842714b9 Issue #22570: Renamed Py_SETREF to Py_XSETREF. 2016-04-06 09:45:48 +03:00
Martin Panter
047f3b7376 Issue #22854: Merge UnsupportedOperation fixes from 3.5 2016-03-31 08:25:59 +00:00
Martin Panter
754aab28ed Issue #22854: Clarify documentation about UnsupportedOperation and add tests 
Also change BufferedReader.writable() and BufferedWriter.readable() to always
return False.
 2016-03-31 07:21:56 +00:00
Victor Stinner
928bff0b26 cleanup iobase.c 
casting iobase_finalize to destructor is not needed
 2016-03-19 10:36:36 +01:00
Victor Stinner
914cde89d4 On ResourceWarning, log traceback where the object was allocated 
Issue #26567:

* Add a new function PyErr_ResourceWarning() function to pass the destroyed
  object
* Add a source attribute to warnings.WarningMessage
* Add warnings._showwarnmsg() which uses tracemalloc to get the traceback where
  source object was allocated.
 2016-03-19 01:03:51 +01:00
Serhiy Storchaka
1ed017ae92 Issue #20440: Cleaning up the code by using Py_SETREF and Py_CLEAR. 
Old code is correct, but with Py_SETREF and Py_CLEAR it can be cleaner.
This patch doesn't fix bugs and hence there is no need to backport it.
 2015-12-27 15:51:32 +02:00
Serhiy Storchaka
bdb908ea54 Issue #20440: Applied yet one patch for using Py_SETREF. 
The patch is automatically generated, it replaces the code that uses Py_CLEAR.
 2015-12-27 12:38:28 +02:00
Serhiy Storchaka
4a1e70fc31 Issue #20440: Applied yet one patch for using Py_SETREF. 
The patch is automatically generated, it replaces the code that uses Py_CLEAR.
 2015-12-27 12:36:18 +02:00
Serhiy Storchaka
ef1585eb9a Issue #25923: Added more const qualifiers to signatures of static and private functions. 2015-12-25 20:01:53 +02:00
Serhiy Storchaka
2d06e84455 Issue #25923: Added the const qualifier to static constant arrays. 2015-12-25 19:53:18 +02:00
Serhiy Storchaka
f006940351 Issue #20440: Massive replacing unsafe attribute setting code with special 
macro Py_SETREF.
 2015-12-24 10:39:57 +02:00
Serhiy Storchaka
5a57ade58e Issue #20440: Massive replacing unsafe attribute setting code with special 
macro Py_SETREF.
 2015-12-24 10:35:59 +02:00
Serhiy Storchaka
a9406e77fa Issue #25421: __sizeof__ methods of builtin types now use dynamic basic size. 
This allows sys.getsize() to work correctly with their subclasses with
__slots__ defined.
 2015-12-19 20:07:11 +02:00
Serhiy Storchaka
5c4064e8bd Issue #25421: __sizeof__ methods of builtin types now use dynamic basic size. 
This allows sys.getsize() to work correctly with their subclasses with
__slots__ defined.
 2015-12-19 20:05:25 +02:00
Martin Panter
c68e723e6f Issue #25717: Merge comment from 3.5 2015-12-06 11:19:31 +00:00
Martin Panter
49d3db92a4 Issue #25717: Add comment explaining why errors are ignored 2015-12-06 11:12:15 +00:00
Martin Panter
c85110658b Issue #25717: Merge fstat() fix from 3.5 2015-12-06 03:29:54 +00:00
Martin Panter
0bb62b12a3 Issue #25717: Tolerate fstat() failures in the FileIO constructor 
This restores 3.4 behaviour, which was removed by revision 3b5279b5bfd1. The
fstat() call fails with ENOENT for a Virtual Box shared folder filesystem if
the file entry has been unlinked, e.g. for a temporary file.
 2015-12-06 03:15:05 +00:00
Martin Panter
e56a919100 Issue #25523: Merge a-to-an corrections from 3.5 2015-11-02 04:27:17 +00:00
Martin Panter
2eb819f7a8 Issue #25523: Merge "a" to "an" fixes from 3.4 into 3.5 2015-11-02 04:04:57 +00:00
Martin Panter
7462b64911 Issue #25523: Correct "a" article to "an" article 
This changes the main documentation, doc strings, source code comments, and a
couple error messages in the test suite. In some cases the word was removed
or edited some other way to fix the grammar.
 2015-11-02 03:37:02 +00:00
Martin Panter
a6d5038226 Issue #22413: Merge StringIO doc from 3.5 2015-10-10 10:20:25 +00:00
Martin Panter
f264416093 Issue #22413: Remove comment made out of date by Argument Clinic 2015-10-10 10:17:57 +00:00
Martin Panter
994815e1d7 Issue #22413: Merge StringIO doc from 3.4 into 3.5 2015-10-10 10:15:21 +00:00
Martin Panter
cfad54344f Issue #22413: Document newline effect on StringIO initializer and getvalue 
Also add to comment in the C code.
 2015-10-10 03:01:20 +00:00
Martin Panter
585a6acfef Merge typo fixes from 3.5 2015-10-07 11:13:55 +00:00
Martin Panter
3f930dcd87 Merge typo fixes from 3.4 into 3.5 2015-10-07 11:01:47 +00:00
Martin Panter
9955a373a8 Various minor typos in documentation and comments 2015-10-07 10:26:23 +00:00
Martin Panter
db4220ea09 Issue #25030: Do not document seek() as if it accepts keyword arguments 
Patch from Shiyao Ma.
 2015-09-11 03:58:30 +00:00
Serhiy Storchaka
56f6e76c68 Issue #15989: Fixed some scarcely probable integer overflows. 
It is very unlikely that they can occur in real code for now.
 2015-09-06 21:25:30 +03:00
Serhiy Storchaka
4e63f7a2b4 Issue #24989: Fixed buffer overread in BytesIO.readline() if a position is 
set beyond size.  Based on patch by John Leitch.
 2015-09-04 07:48:19 +03:00
Serhiy Storchaka
fb397790d2 Issue #24989: Fixed buffer overread in BytesIO.readline() if a position is 
set beyond size.  Based on patch by John Leitch.
 2015-09-04 01:08:54 +03:00
Serhiy Storchaka
594e54c765 Issue #24989: Fixed buffer overread in BytesIO.readline() if a position is 
set beyond size.  Based on patch by John Leitch.
 2015-09-04 01:08:03 +03:00
Robert Collins
c94a1dc4c9 - Issue #2091: error correctly on open() with mode 'U' and '+' 
open() accepted a 'U' mode string containing '+', but 'U' can only be used with
'r'. Patch from Jeff Balogh and John O'Connor.
 2015-07-26 06:43:13 +12:00
Steve Dower
6baa0f9805 Fixes cast warning in bufferedio.c 2015-05-23 08:59:25 -07:00
Antoine Pitrou
45d6156154 Issue #9858: Add missing method stubs to _io.RawIOBase. Patch by Laura Rupprecht. 2015-05-20 21:50:59 +02:00
Berker Peksag
d10d6ae2fa Issue #23796: peak and read1 methods of BufferedReader now raise ValueError 
if they called on a closed object.

Patch by John Hergenroeder.
 2015-05-12 17:01:05 +03:00
Serhiy Storchaka
008d88b462 Issue #24009: Got rid of using rare "y#" format unit in TextIOWrapper.tell(). 
Parsed value should be bytes, not general robuffer, this is required in other
places.
 2015-05-06 09:53:07 +03:00
Larry Hastings
dbfdc380df Issue #24001: Argument Clinic converters now use accept={type} 
instead of types={'type'} to specify the types the converter accepts.
 2015-05-04 06:59:46 -07:00
Serhiy Storchaka
247789cee9 Issue #24007: Argument Clinic now writes the format of PyArg_Parse*() at the 
same line as function name.
 2015-04-24 00:40:51 +03:00
Serhiy Storchaka
7e9d1d1a1b Issue #23908: os functions now reject paths with embedded null character 
on Windows instead of silently truncate them.

Removed no longer used _PyUnicode_HasNULChars().
 2015-04-20 10:12:28 +03:00
Serhiy Storchaka
2b0d2007a1 Issue #23908: os functions now reject paths with embedded null character 
on Windows instead of silently truncate them.
 2015-04-20 09:53:58 +03:00
Serhiy Storchaka
bb72c47996 Use PyArg_ParseTuple (new API) instead of PyArg_Parse (old API) for parsing tuples. 2015-04-19 20:38:19 +03:00
Christian Heimes
82adeffc13 Fix typo in assert statement 2015-04-16 17:21:54 +02:00
Serhiy Storchaka
f24131ff31 Issue #20175: Converted the _io module to Argument Clinic. 2015-04-16 11:19:43 +03:00
Antoine Pitrou
56452eea39 Issue #22982: Improve BOM handling when seeking to multiple positions of a writable text file. 2015-04-13 20:02:33 +02:00
Antoine Pitrou
85e3ee749c Issue #22982: Improve BOM handling when seeking to multiple positions of a writable text file. 2015-04-13 20:01:21 +02:00
Antoine Pitrou
cb46f0ecb0 Issue #23309: Avoid a deadlock at shutdown if a daemon thread is aborted 
while it is holding a lock to a buffered I/O object, and the main thread
tries to use the same I/O object (typically stdout or stderr).  A fatal
error is emitted instead.
 2015-04-13 19:48:19 +02:00
Antoine Pitrou
25f85d4bd5 Issue #23309: Avoid a deadlock at shutdown if a daemon thread is aborted 
while it is holding a lock to a buffered I/O object, and the main thread
tries to use the same I/O object (typically stdout or stderr).  A fatal
error is emitted instead.
 2015-04-13 19:41:47 +02:00
Steve Dower
a1c7e727c8 Issue #23668: Suppresses invalid parameter handler around chsize calls. 2015-04-12 00:26:43 -04:00
Steve Dower
8fc8980c96 Issue #23524: Replace _PyVerify_fd function with calls to _set_thread_local_invalid_parameter_handler. 2015-04-12 00:26:27 -04:00
Serhiy Storchaka
3d2279f9a8 Issue #21859: Corrected FileIO docstrings. 2015-04-10 16:08:43 +03:00
Berker Peksag
ea6d5592f2 Issue #23796: peak and read1 methods of BufferedReader now raise ValueError 
if they called on a closed object.

Patch by John Hergenroeder.
 2015-05-12 17:13:56 +03:00
Steve Dower
fe0a41aae4 Issue #23668: Adds support for os.truncate and os.ftruncate on Windows 2015-03-20 19:50:46 -07:00
Serhiy Storchaka
cd092efb16 Issue #21859: Corrected FileIO docstrings. 2015-04-10 16:09:13 +03:00
Serhiy Storchaka
5056769b36 Replaced "string" with "bytes object" in docstrings of binary I/O objects. 2015-04-10 02:19:57 +03:00
Serhiy Storchaka
b817b77a8c Replaced "string" with "bytes object" in docstrings of binary I/O objects. 2015-04-10 02:18:44 +03:00
Victor Stinner
e134a7fe36 Issue #23752: _Py_fstat() is now responsible to raise the Python exception 
Add _Py_fstat_noraise() function when a Python exception is not welcome.
 2015-03-30 10:09:31 +02:00
Serhiy Storchaka
2e1c4e5db2 Issue #23785: Fixed memory leak in TextIOWrapper.tell() in rare circumstances. 2015-03-30 10:00:40 +03:00
Serhiy Storchaka
04d09ebd39 Issue #23785: Fixed memory leak in TextIOWrapper.tell() in rare circumstances. 2015-03-30 09:58:41 +03:00
Victor Stinner
520bddf79a Issue #23752: When built from an existing file descriptor, io.FileIO() now only 
calls fstat() once. Before fstat() was called twice, which was not necessary.
 2015-03-30 03:21:06 +02:00
Serhiy Storchaka
7665be6087 Issue #21802: The reader in BufferedRWPair now is closed even when closing 
writer failed in BufferedRWPair.close().
 2015-03-24 23:21:57 +02:00
Serhiy Storchaka
8be6be427d Issue #21802: The reader in BufferedRWPair now is closed even when closing 
writer failed in BufferedRWPair.close().
 2015-03-24 23:23:28 +02:00
Victor Stinner
f329878e74 Issue #23753: Python doesn't support anymore platforms without stat() or 
fstat(), these functions are always required.

Remove HAVE_STAT and HAVE_FSTAT defines, and stop supporting DONT_HAVE_STAT and
DONT_HAVE_FSTAT.
 2015-03-24 10:27:50 +01:00
Victor Stinner
66aab0c4b5 Issue #23708: Add _Py_read() and _Py_write() functions to factorize code handle 
EINTR error and special cases for Windows.

These functions now truncate the length to PY_SSIZE_T_MAX to have a portable
and reliable behaviour. For example, read() result is undefined if counter is
greater than PY_SSIZE_T_MAX on Linux.
 2015-03-19 22:53:20 +01:00
Serhiy Storchaka
009b811d67 Removed unintentional trailing spaces in non-external and non-generated C files. 2015-03-18 21:53:15 +02:00
Steve Dower
8acde7dcce Issue #23524: Change back to using Windows errors for _Py_fstat instead of the errno shim. 2015-03-07 18:14:07 -08:00
Victor Stinner
4a7cc88472 Issue #23571: PyObject_Call(), PyCFunction_Call() and call_function() now 
raise a SystemError if a function returns a result and raises an exception.
The SystemError is chained to the previous exception.

Refactor also PyObject_Call() and PyCFunction_Call() to make them more readable.

Remove some checks which became useless (duplicate checks).

Change reviewed by Serhiy Storchaka.
 2015-03-06 23:35:27 +01:00
Steve Dower
d81431f587 Issue #23524: Replace _PyVerify_fd function with calling _set_thread_local_invalid_parameter_handler on every thread. 2015-03-06 14:47:02 -08:00
Victor Stinner
9672da7bb4 Issue #23285: Fix handling of EINTR in fileio.c 
Fix handling of EINTR: don't return None if PyErr_CheckSignals() raised an
exception.

Initialize also the length outside the loop to only initialize it once.
 2015-03-04 18:40:10 +01:00
Steve Dower
f2f373f593 Issue #23152: Implement _Py_fstat() to support files larger than 2 GB on Windows. 
fstat() may fail with EOVERFLOW on files larger than 2 GB because the file size type is an signed 32-bit integer.
 2015-02-21 08:44:05 -08:00
Serhiy Storchaka
254dd59068 Issue #5700: io.FileIO() called flush() after closing the file. 
flush() was not called in close() if closefd=False.
 2015-02-21 00:35:53 +02:00
Serhiy Storchaka
a3712a9a6c Issue #5700: io.FileIO() called flush() after closing the file. 
flush() was not called in close() if closefd=False.
 2015-02-21 00:35:09 +02:00
Serhiy Storchaka
483405bcca Issue #22883: Got rid of outdated references to PyInt and PyString in comments. 2015-02-17 10:14:30 +02:00
Charles-François Natali
6e6c59b508 Issue #23285: PEP 475 -- Retry system calls failing with EINTR. 2015-02-07 13:27:50 +00:00
Stefan Krah
650c1e818d Issue #14203: Remove obsolete support for view==NULL in bytesiobuf_getbuffer() 
and array_buffer_getbuf().
 2015-02-03 21:43:23 +01:00
Serhiy Storchaka
38c30e6c8e Issue #15381: Fixed a bug in BytesIO.write(). 
It was expected that string_size == PyBytes_GET_SIZE(buf) if the buffer is
shared, but truncate() and __setstate__() can set string_size without
unsharing the buffer.
 2015-02-03 18:51:58 +02:00
Serhiy Storchaka
b9765eec5c Issue #15381: Try to fix refcount bug. Empty and 1-byte buffers are always shared. 2015-02-03 14:57:49 +02:00
Serhiy Storchaka
87d0b45485 Issue #15381: Optimized io.BytesIO to make less allocations and copyings. 2015-02-03 11:30:10 +02:00
Serhiy Storchaka
32ca3dcb97 Issue #23099: Closing io.BytesIO with exported buffer is rejected now to 
prevent corrupting exported buffer.
 2015-02-03 09:30:51 +02:00
Serhiy Storchaka
c057c3859c Issue #23099: Closing io.BytesIO with exported buffer is rejected now to 
prevent corrupting exported buffer.
 2015-02-03 02:00:18 +02:00
Serhiy Storchaka
3dd3e26680 Issue #22896: Avoid to use PyObject_AsCharBuffer(), PyObject_AsReadBuffer() 
and PyObject_AsWriteBuffer().
 2015-02-03 01:25:42 +02:00
Serhiy Storchaka
4fdb68491e Issue #22896: Avoid to use PyObject_AsCharBuffer(), PyObject_AsReadBuffer() 
and PyObject_AsWriteBuffer().
 2015-02-03 01:21:08 +02:00
Benjamin Peterson
98beb7599e merge 3.4 (#23093) 2014-12-21 21:00:51 -06:00
Benjamin Peterson
10e76b67c9 allow more operations to work on detached streams (closes #23093) 
Patch by Martin Panter.
 2014-12-21 20:51:50 -06:00
Serhiy Storchaka
4954f9fcab Issue #17401: Output the closefd attribute as boolean. 2014-12-02 23:39:56 +02:00
Benjamin Peterson
994c7f76a3 merge 3.4 (#22849) 2014-11-12 10:23:35 -05:00
Benjamin Peterson
6c14f23100 fix possible double free in TextIOWrapper.__init__ (closes #22849) 2014-11-12 10:19:46 -05:00
Robert Collins
933430ab69 Issue #17401: document closefd in io.FileIO docs and add to repr 
closefd was documented in the open docs but not the matching FileIO
class documented. Further, closefd, part of the core state for the
object was not shown.

In review it was noted that the open docs are a little confusing about
the interaction between closefd and paths, so tweaked them at the same
time.
 2014-10-18 13:32:43 +13:00
Serhiy Storchaka
78184af9b5 Issue #21715: Extracted shared complicated code in the _io module to new 
_PyErr_ChainExceptions() function.
 2014-10-08 22:32:50 +03:00
Serhiy Storchaka
e2bd2a7186 Issue #21715: Extracted shared complicated code in the _io module to new 
_PyErr_ChainExceptions() function.
 2014-10-08 22:31:52 +03:00
Benjamin Peterson
58ee2d31ab merge 3.4 (#22517) 2014-09-29 22:49:05 -04:00
Benjamin Peterson
c44eb73473 merge 3.3 (#22517) 2014-09-29 22:48:51 -04:00
Benjamin Peterson
bbd0a323ae clear BufferedRWPair weakrefs on deallocation (closes #22517) 2014-09-29 22:46:57 -04:00
Berker Peksag
43705d76aa Issue #21860: Correct docstrings of FileIO.seek() and FileIO.truncate() methods. 
Patch by Terry Chia.
 2014-09-24 12:44:06 +03:00
Berker Peksag
b87630c273 Issue #21860: Correct docstrings of FileIO.seek() and FileIO.truncate() methods. 
Patch by Terry Chia.
 2014-09-24 12:43:29 +03:00
Serhiy Storchaka
d8a1447c99 Issue #22215: Now ValueError is raised instead of TypeError when str or bytes 
argument contains not permitted null character or byte.
 2014-09-06 20:07:17 +03:00
Victor Stinner
706768c687 Issue #22156: Fix some "comparison between signed and unsigned integers" 
compiler warnings in the Modules/ subdirectory.
 2014-08-16 01:03:39 +02:00
Serhiy Storchaka
d7728cafc5 Issue #15381: Optimized line reading in io.BytesIO. 2014-08-14 22:26:38 +03:00
Antoine Pitrou
cc66a73d27 Issue #22003: When initialized from a bytes object, io.BytesIO() now 
defers making a copy until it is mutated, improving performance and
memory use on some use cases.

Patch by David Wilson.
 2014-07-29 19:41:11 -04:00
Benjamin Peterson
e865128605 properly decref the return value of close() 2014-07-04 17:00:25 -07:00
Benjamin Peterson
4f654fbe30 properly decref the return value of close() 2014-07-04 17:00:25 -07:00
Victor Stinner
6680e9f5fd (Merge 3.4) Issue #21090: io.FileIO.readall() does not ignore I/O errors 
anymore. Before, it ignored I/O errors if at least the first C call read()
succeed.
 2014-07-02 23:00:38 +02:00