[Python-checkins] bpo-42237: Fix os.sendfile() on illumos (GH-23154)

asvetlov webhook-mailer at python.org
Thu Nov 12 04:49:35 EST 2020


https://github.com/python/cpython/commit/fd4ed57674c675e05bd5d577dd5047a333c76c78
commit: fd4ed57674c675e05bd5d577dd5047a333c76c78
branch: master
author: Jakub Stasiak <jakub at stasiak.at>
committer: asvetlov <andrew.svetlov at gmail.com>
date: 2020-11-12T11:49:30+02:00
summary:

bpo-42237: Fix os.sendfile() on illumos (GH-23154)

files:
A Misc/NEWS.d/next/Library/2020-11-10-14-27-49.bpo-42237.F363jO.rst
M Modules/posixmodule.c

diff --git a/Misc/NEWS.d/next/Library/2020-11-10-14-27-49.bpo-42237.F363jO.rst b/Misc/NEWS.d/next/Library/2020-11-10-14-27-49.bpo-42237.F363jO.rst
new file mode 100644
index 0000000000000..50cab6e1f11f8
--- /dev/null
+++ b/Misc/NEWS.d/next/Library/2020-11-10-14-27-49.bpo-42237.F363jO.rst
@@ -0,0 +1 @@
+Fix `os.sendfile()` on illumos.
diff --git a/Modules/posixmodule.c b/Modules/posixmodule.c
index 70b47c475feaa..6b51d8a848eab 100644
--- a/Modules/posixmodule.c
+++ b/Modules/posixmodule.c
@@ -9873,11 +9873,26 @@ os_sendfile_impl(PyObject *module, int out_fd, int in_fd, PyObject *offobj,
     if (offset >= st.st_size) {
         return Py_BuildValue("i", 0);
     }
+
+    // On illumos specifically sendfile() may perform a partial write but
+    // return -1/an error (in one confirmed case the destination socket
+    // had a 5 second timeout set and errno was EAGAIN) and it's on the client
+    // code to check if the offset parameter was modified by sendfile().
+    //
+    // We need this variable to track said change.
+    off_t original_offset = offset;
 #endif
 
     do {
         Py_BEGIN_ALLOW_THREADS
         ret = sendfile(out_fd, in_fd, &offset, count);
+#if defined(__sun) && defined(__SVR4)
+        // This handles illumos-specific sendfile() partial write behavior,
+        // see a comment above for more details.
+        if (ret < 0 && offset != original_offset) {
+            ret = offset - original_offset;
+        }
+#endif
         Py_END_ALLOW_THREADS
     } while (ret < 0 && errno == EINTR && !(async_err = PyErr_CheckSignals()));
     if (ret < 0)



More information about the Python-checkins mailing list