Mailman 3 May 2018 - Python-checkins

bpo-31368: Enhance os.preadv() documentation (GH-7254)
by Victor Stinner May 30, 2018

May 30, 2018

https://github.com/python/cpython/commit/02e2a085dc1740b1cbf4ba2ed77335c84c… commit: 02e2a085dc1740b1cbf4ba2ed77335c84ce8a367 branch: master author: Pablo Galindo <Pablogsal(a)gmail.com> committer: Victor Stinner <vstinner(a)redhat.com> date: 2018-05-31T01:00:04+02:00 summary: bpo-31368: Enhance os.preadv() documentation (GH-7254) files: M Doc/library/os.rst M Doc/whatsnew/3.7.rst diff --git a/Doc/library/os.rst b/Doc/library/os.rst index d5bc612f451c..c64f93211437 100644 --- a/… [View More]Doc/library/os.rst +++ b/Doc/library/os.rst @@ -1082,20 +1082,81 @@ or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windo .. versionadded:: 3.3 -.. function:: pread(fd, buffersize, offset) +.. function:: pread(fd, n, offset) - Read from a file descriptor, *fd*, at a position of *offset*. It will read up - to *buffersize* number of bytes. The file offset remains unchanged. + Read at most *n* bytes from file descriptor *fd* at a position of *offset*, + leaving the file offset unchanged. + + Return a bytestring containing the bytes read. If the end of the file + referred to by *fd* has been reached, an empty bytes object is returned. Availability: Unix. .. versionadded:: 3.3 +.. function:: preadv(fd, buffers, offset, flags=0) + + Read from a file descriptor *fd* at a position of *offset* into mutable + :term:`bytes-like objects <bytes-like object>` *buffers*, leaving the file + offset unchanged. Transfer data into each buffer until it is full and then + move on to the next buffer in the sequence to hold the rest of the data. + + The flags argument contains a bitwise OR of zero or more of the following + flags: + + - :data:`RWF_HIPRI` + - :data:`RWF_NOWAIT` + + Return the total number of bytes actually read which can be less than the + total capacity of all the objects. + + The operating system may set a limit (:func:`sysconf` value + ``'SC_IOV_MAX'``) on the number of buffers that can be used. + + Combine the functionality of :func:`os.readv` and :func:`os.pread`. + + Availability: Linux 2.6.30 and newer, FreeBSD 6.0 and newer, + OpenBSD 2.7 and newer. Using flags requires Linux 4.6 or newer. + + .. versionadded:: 3.7 + + +.. data:: RWF_NOWAIT + + Do not wait for data which is not immediately available. If this flag is + specified, the system call will return instantly if it would have to read + data from the backing storage or wait for a lock. + + If some data was successfully read, it will return the number of bytes read. + If no bytes were read, it will return ``-1`` and set errno to + :data:`errno.EAGAIN`. + + Availability: Linux 4.14 and newer. + + .. versionadded:: 3.7 + + +.. data:: RWF_HIPRI + + High priority read/write. Allows block-based filesystems to use polling + of the device, which provides lower latency, but may use additional + resources. + + Currently, on Linux, this feature is usable only on a file descriptor opened + using the :data:`O_DIRECT` flag. + + Availability: Linux 4.6 and newer. + + .. versionadded:: 3.7 + + .. function:: pwrite(fd, str, offset) - Write *bytestring* to a file descriptor, *fd*, from *offset*, - leaving the file offset unchanged. + Write the bytestring in *str* to file descriptor *fd* at position of + *offset*, leaving the file offset unchanged. + + Return the number of bytes actually written. Availability: Unix. @@ -1104,54 +1165,57 @@ or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windo .. function:: pwritev(fd, buffers, offset, flags=0) - Combines the functionality of :func:`os.writev` and :func:`os.pwrite`. It - writes the contents of *buffers* to file descriptor *fd* at offset *offset*. - *buffers* must be a sequence of :term:`bytes-like objects <bytes-like object>`. - Buffers are processed in array order. Entire contents of first buffer is written - before proceeding to second, and so on. The operating system may set a limit - (sysconf() value SC_IOV_MAX) on the number of buffers that can be used. - :func:`~os.pwritev` writes the contents of each object to the file descriptor - and returns the total number of bytes written. + Write the *buffers* contents to file descriptor *fd* at a offset *offset*, + leaving the file offset unchanged. *buffers* must be a sequence of + :term:`bytes-like objects <bytes-like object>`. Buffers are processed in + array order. Entire contents of the first buffer is written before + proceeding to the second, and so on. - The *flags* argument contains a bitwise OR of zero or more of the following + The flags argument contains a bitwise OR of zero or more of the following flags: - - RWF_DSYNC - - RWF_SYNC + - :data:`RWF_DSYNC` + - :data:`RWF_SYNC` - Using non-zero flags requires Linux 4.7 or newer. + Return the total number of bytes actually written. - Availability: Linux (version 2.6.30), FreeBSD 6.0 and newer, - OpenBSD (version 2.7 and newer). + The operating system may set a limit (:func:`sysconf` value + ``'SC_IOV_MAX'``) on the number of buffers that can be used. + + Combine the functionality of :func:`os.writev` and :func:`os.pwrite`. + + Availability: Linux 2.6.30 and newer, FreeBSD 6.0 and newer, + OpenBSD 2.7 and newer. Using flags requires Linux 4.7 or newer. .. versionadded:: 3.7 + .. data:: RWF_DSYNC - Provide a per-write equivalent of the O_DSYNC open(2) flag. This flag - is meaningful only for pwritev2(), and its effect applies only to the - data range written by the system call. + Provide a per-write equivalent of the :data:`O_DSYNC` ``open(2)`` flag. This + flag effect applies only to the data range written by the system call. - Availability: Linux (version 4.7). + Availability: Linux 4.7 and newer. .. versionadded:: 3.7 + .. data:: RWF_SYNC - Provide a per-write equivalent of the O_SYNC open(2) flag. This flag is - meaningful only for pwritev2(), and its effect applies only to the data - range written by the system call. + Provide a per-write equivalent of the :data:`O_SYNC` ``open(2)`` flag. This + flag effect applies only to the data range written by the system call. - Availability: Linux (version 4.7). + Availability: Linux 4.7 and newer. .. versionadded:: 3.7 .. function:: read(fd, n) - Read at most *n* bytes from file descriptor *fd*. Return a bytestring containing the - bytes read. If the end of the file referred to by *fd* has been reached, an - empty bytes object is returned. + Read at most *n* bytes from file descriptor *fd*. + + Return a bytestring containing the bytes read. If the end of the file + referred to by *fd* has been reached, an empty bytes object is returned. .. note:: @@ -1230,66 +1294,19 @@ or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windo .. function:: readv(fd, buffers) Read from a file descriptor *fd* into a number of mutable :term:`bytes-like - objects <bytes-like object>` *buffers*. :func:`~os.readv` will transfer data - into each buffer until it is full and then move on to the next buffer in the - sequence to hold the rest of the data. :func:`~os.readv` returns the total - number of bytes read (which may be less than the total capacity of all the - objects). + objects <bytes-like object>` *buffers*. Transfer data into each buffer until + it is full and then move on to the next buffer in the sequence to hold the + rest of the data. - Availability: Unix. - - .. versionadded:: 3.3 + Return the total number of bytes actually read which can be less than the + total capacity of all the objects. + The operating system may set a limit (:func:`sysconf` value + ``'SC_IOV_MAX'``) on the number of buffers that can be used. -.. function:: preadv(fd, buffers, offset, flags=0) - - Combines the functionality of :func:`os.readv` and :func:`os.pread`. It - reads from a file descriptor *fd* into a number of mutable :term:`bytes-like - objects <bytes-like object>` *buffers*. As :func:`os.readv`, it will transfer - data into each buffer until it is full and then move on to the next buffer in - the sequence to hold the rest of the data. Its fourth argument, *offset*, - specifies the file offset at which the input operation is to be performed. - :func:`~os.preadv` return the total number of bytes read (which can be less than - the total capacity of all the objects). - - The flags argument contains a bitwise OR of zero or more of the following - flags: - - - RWF_HIPRI - - RWF_NOWAIT - - Using non-zero flags requires Linux 4.6 or newer. - - Availability: Linux (version 2.6.30), FreeBSD 6.0 and newer, - OpenBSD (version 2.7 and newer). - - .. versionadded:: 3.7 - - -.. data:: RWF_HIPRI - - High priority read/write. Allows block-based filesystems to use polling - of the device, which provides lower latency, but may use additional - resources. (Currently, this feature is usable only on a file descriptor - opened using the O_DIRECT flag.) - - Availability: Linux (version 4.6). - - .. versionadded:: 3.7 - - -.. data:: RWF_NOWAIT - - Do not wait for data which is not immediately available. If this flag - is specified, the preadv2() system call will return instantly - if it would have to read data from the backing storage or wait for a lock. - If some data was successfully read, it will return the number of bytes - read. If no bytes were read, it will return -1 and set errno to EAGAIN. - Currently, this flag is meaningful only for preadv2(). - - Availability: Linux (version 4.14). + Availability: Unix. - .. versionadded:: 3.7 + .. versionadded:: 3.3 .. function:: tcgetpgrp(fd) @@ -1319,8 +1336,9 @@ or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windo .. function:: write(fd, str) - Write the bytestring in *str* to file descriptor *fd*. Return the number of - bytes actually written. + Write the bytestring in *str* to file descriptor *fd*. + + Return the number of bytes actually written. .. note:: @@ -1338,14 +1356,15 @@ or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windo .. function:: writev(fd, buffers) - Write the contents of *buffers* to file descriptor *fd*. *buffers* must be a - sequence of :term:`bytes-like objects <bytes-like object>`. Buffers are - processed in array order. Entire contents of first buffer is written before - proceeding to second, and so on. The operating system may set a limit - (sysconf() value SC_IOV_MAX) on the number of buffers that can be used. + Write the contents of *buffers* to file descriptor *fd*. *buffers* must be + a sequence of :term:`bytes-like objects <bytes-like object>`. Buffers are + processed in array order. Entire contents of the first buffer is written + before proceeding to the second, and so on. + + Returns the total number of bytes actually written. - :func:`~os.writev` writes the contents of each object to the file descriptor - and returns the total number of bytes written. + The operating system may set a limit (:func:`sysconf` value + ``'SC_IOV_MAX'``) on the number of buffers that can be used. Availability: Unix. diff --git a/Doc/whatsnew/3.7.rst b/Doc/whatsnew/3.7.rst index 2471989ec7b9..9989eaf5eac5 100644 --- a/Doc/whatsnew/3.7.rst +++ b/Doc/whatsnew/3.7.rst @@ -1091,9 +1091,10 @@ The new :func:`~os.register_at_fork` function allows registering Python callbacks to be executed at process fork. (Contributed by Antoine Pitrou in :issue:`16500`.) -Exposed the *preadv*, *preadv2*, *pwritev* and *pwritev2* system calls through -the new :func:`~os.preadv` and :func:`~os.pwritev` functions. -(Contributed by Pablo Galindo in :issue:`31368`.) +Added :func:`os.preadv` (combine the functionality of :func:`os.readv` and +:func:`os.pread`) and :func:`os.pwritev` functions (combine the functionality +of :func:`os.writev` and :func:`os.pwrite`). (Contributed by Pablo Galindo in +:issue:`31368`.) The mode argument of :func:`os.makedirs` no longer affects the file permission bits of newly-created intermediate-level directories. [View Less]

1 0

3.6 what's new: fix a reference to PEP 528 (#7113)
by Yury Selivanov May 30, 2018

May 30, 2018

https://github.com/python/cpython/commit/495e567a2b3bbe3b99f0c253edf12997a9… commit: 495e567a2b3bbe3b99f0c253edf12997a9ff4ee1 branch: master author: Dmitry Shachnev <mitya57(a)users.noreply.github.com> committer: Yury Selivanov <yury(a)magic.io> date: 2018-05-30T18:52:43-04:00 summary: 3.6 what's new: fix a reference to PEP 528 (#7113) files: M Doc/whatsnew/3.6.rst diff --git a/Doc/whatsnew/3.6.rst b/Doc/whatsnew/3.6.rst index cb8c53ac3b18..ed489c101c1b 100644 --- a/Doc/whatsnew/… [View More]

1 0

bpo-33692: pythoninfo detect libedit on Python 2.7 (#7246)
by Victor Stinner May 30, 2018

May 30, 2018

https://github.com/python/cpython/commit/9994eff17f943fb2c190708b12c96fef98… commit: 9994eff17f943fb2c190708b12c96fef9838a425 branch: 2.7 author: Victor Stinner <vstinner(a)redhat.com> committer: GitHub <noreply(a)github.com> date: 2018-05-30T23:36:04+02:00 summary: bpo-33692: pythoninfo detect libedit on Python 2.7 (#7246) Check which readline implementation is used based on the readline docstring. files: M Lib/test/pythoninfo.py diff --git a/Lib/test/pythoninfo.py b/Lib/test/… [View More]

1 0

bpo-33696: Install python-docs-theme even if SPHINXBUILD is defined (GH-7242)
by Miss Islington (bot) May 30, 2018

May 30, 2018

https://github.com/python/cpython/commit/7301dd91e8326e9b74932e81f400aaee76… commit: 7301dd91e8326e9b74932e81f400aaee76d3cda1 branch: 3.6 author: Miss Islington (bot) <31488909+miss-islington(a)users.noreply.github.com> committer: GitHub <noreply(a)github.com> date: 2018-05-30T10:37:52-07:00 summary: bpo-33696: Install python-docs-theme even if SPHINXBUILD is defined (GH-7242) (cherry picked from commit 05f1c8902c78dce66aed067444e2b973221bae2b) Co-authored-by: Andrés Delfino <… [View More]

1 0

bpo-33696: Install python-docs-theme even if SPHINXBUILD is defined (GH-7242)
by Miss Islington (bot) May 30, 2018

May 30, 2018

https://github.com/python/cpython/commit/ea1982a475a619500c93bc3d60c6cb63a2… commit: ea1982a475a619500c93bc3d60c6cb63a202b7ed branch: 3.7 author: Miss Islington (bot) <31488909+miss-islington(a)users.noreply.github.com> committer: GitHub <noreply(a)github.com> date: 2018-05-30T10:32:33-07:00 summary: bpo-33696: Install python-docs-theme even if SPHINXBUILD is defined (GH-7242) (cherry picked from commit 05f1c8902c78dce66aed067444e2b973221bae2b) Co-authored-by: Andrés Delfino <… [View More]

1 0

bpo-33696: Install python-docs-theme even if SPHINXBUILD is defined (GH-7242)
by Steve Dower May 30, 2018

May 30, 2018

https://github.com/python/cpython/commit/05f1c8902c78dce66aed067444e2b97322… commit: 05f1c8902c78dce66aed067444e2b973221bae2b branch: master author: Andrés Delfino <adelfino(a)gmail.com> committer: Steve Dower <steve.dower(a)microsoft.com> date: 2018-05-30T09:08:25-07:00 summary: bpo-33696: Install python-docs-theme even if SPHINXBUILD is defined (GH-7242) files: M Doc/make.bat diff --git a/Doc/make.bat b/Doc/make.bat index 7ca84979a300..0808e0cd09f5 100644 --- a/Doc/make.bat +++ … [View More]

1 0

regrtest: repeat summary after re-run (GH-7159) (GH-7245)
by Victor Stinner May 30, 2018

May 30, 2018

https://github.com/python/cpython/commit/b729af3d9dfdf215556b83488e5585331e… commit: b729af3d9dfdf215556b83488e5585331e69b994 branch: 3.6 author: Victor Stinner <vstinner(a)redhat.com> committer: GitHub <noreply(a)github.com> date: 2018-05-30T17:41:30+02:00 summary: regrtest: repeat summary after re-run (GH-7159) (GH-7245) Using -w, when failing tests are re-run in verbose mode, display again the tests results at the end. (cherry picked from commit … [View More]c6c05d0e69cd5a7d0205019c29a1236b7bf3f5b9) files: M Lib/test/libregrtest/main.py diff --git a/Lib/test/libregrtest/main.py b/Lib/test/libregrtest/main.py index 15e51525c362..0ae40ac84312 100644 --- a/Lib/test/libregrtest/main.py +++ b/Lib/test/libregrtest/main.py @@ -88,6 +88,7 @@ def __init__(self): self.skipped = [] self.resource_denieds = [] self.environment_changed = [] + self.rerun = [] self.interrupted = False # used by --slow @@ -282,8 +283,10 @@ def rerun_failed_tests(self): self.ns.verbose3 = False self.ns.match_tests = None + print() print("Re-running failed tests in verbose mode") - for test in self.bad[:]: + self.rerun = self.bad[:] + for test in self.rerun: print("Re-running test %r in verbose mode" % test, flush=True) try: self.ns.verbose = True @@ -301,22 +304,32 @@ def rerun_failed_tests(self): print(count(len(self.bad), 'test'), "failed again:") printlist(self.bad) + self.display_result() + def display_result(self): + # If running the test suite for PGO then no one cares about results. + if self.ns.pgo: + return + + print() + print("== Tests result ==") + if self.interrupted: - # print a newline after ^C print() + # print a newline after ^C print("Test suite interrupted by signal SIGINT.") executed = set(self.good) | set(self.bad) | set(self.skipped) omitted = set(self.selected) - executed print(count(len(omitted), "test"), "omitted:") printlist(omitted) - # If running the test suite for PGO then no one cares about - # results. - if self.ns.pgo: - return + if self.rerun: + print() + print(count(len(self.rerun), "test"), "re-run tests:") + printlist(self.rerun) if self.good and not self.ns.quiet: + print() if (not self.bad and not self.skipped and not self.interrupted [View Less]

1 0

bpo-29512: Rename Lib/test/bisect.py to bisect_cmd.py (#7229)
by Victor Stinner May 30, 2018

May 30, 2018

https://github.com/python/cpython/commit/823c295efa4efea93cadc640ed6122cd9d… commit: 823c295efa4efea93cadc640ed6122cd9d86cec4 branch: 2.7 author: Victor Stinner <vstinner(a)redhat.com> committer: GitHub <noreply(a)github.com> date: 2018-05-30T17:24:40+02:00 summary: bpo-29512: Rename Lib/test/bisect.py to bisect_cmd.py (#7229) Rename Lib/test/bisect.py to Lib/test/bisect_cmd.py. The old name was in conflict with Lib/bisect.py, causing test failures, depending how tests were run. … [View More]

1 0

bpo-33692: pythoninfo detect libedit on Python 3.6 (GH-7244)
by Victor Stinner May 30, 2018

May 30, 2018

https://github.com/python/cpython/commit/f7a19c28bda7b0ed3a440db80202013a86… commit: f7a19c28bda7b0ed3a440db80202013a86af6850 branch: 3.6 author: Victor Stinner <vstinner(a)redhat.com> committer: GitHub <noreply(a)github.com> date: 2018-05-30T16:49:07+02:00 summary: bpo-33692: pythoninfo detect libedit on Python 3.6 (GH-7244) Check which readline implementation is used based on the readline docstring. files: M Lib/test/pythoninfo.py diff --git a/Lib/test/pythoninfo.py b/Lib/test/… [View More]

1 0

Improve ensurepip's --help (GH-4686) (GH-7239)
by Petr Viktorin May 30, 2018

May 30, 2018

https://github.com/python/cpython/commit/be325e6132c9198f7b8e9c7da2dd0017a3… commit: be325e6132c9198f7b8e9c7da2dd0017a33212cc branch: 3.6 author: Miss Islington (bot) <31488909+miss-islington(a)users.noreply.github.com> committer: Petr Viktorin <encukou(a)gmail.com> date: 2018-05-30T13:56:19+02:00 summary: Improve ensurepip's --help (GH-4686) (GH-7239) * Add a space to ensurepip's --altinstall option * Add periods to the arguments of ensurepip that didn't have it This makes --… [View More]

1 0