Python-Dev October 2020

python-dev@python.org

108 participants
53 discussions

Drop Solaris, OpenSolaris, Illumos and OpenIndiana support in Python

by Victor Stinner

Hi, I propose to drop the Solaris support in Python to reduce the Python maintenance burden: https://bugs.python.org/issue42173 I wrote a draft PR to show how much code could be removed (around 700 lines in 65 files): https://github.com/python/cpython/pull/23002/files In 2016, I asked if we still wanted to maintain the Solaris support in Python, because Solaris buildbots were failing for longer than 6 months and nobody was able to fix them. It was requested to find a core developer volunteer to fix Solaris issues and to set up a Solaris buildbot. https://mail.python.org/archives/list/python-dev@python.org/thread/NOT2RORS… Four years later, nothing has happened. Moreover, in 2018, Oracle laid off the Solaris development engineering staff. There are around 25 open Python bugs specific to Solaris. I see 3 options: * Current best effort support (no change): changes only happen if a core dev volunteers to review and merge a change written by a contributor. * Schedule the removal in 2 Python releases (Python 3.12) and start to announce that Solaris support is going to be removed * Remove the Solaris code right now (my proposition): Solaris code will have to be maintained outside the official Python code base, as "downstream patches" Solaris has a few specific features visible at the Python level: select.devpoll, os.stat().st_fstype and stat.S_ISDOOR(). While it's unclear to me if Oracle still actively maintains Solaris (latest release in 2018, no major update since 2018), Illumos and OpenSolaris (variants or "forks") still seem to be active. In 2019, a Solaris blog post explains that Solaris 11.4 still uses Python 2.7 but plans to migrate to Python 3, and Python 3.4 is also available. These two Python versions are no longer supported. https://blogs.oracle.com/solaris/future-of-python-on-solaris The question is if the Python project has to maintain the Solaris specific code or if this code should now be maintained outside Python. What do you think? Should we wait 5 more years? Should we expect a company will offer to maintain the Solaris support? Is there a motivated core developer to fix Solaris issue? As I wrote, nothing has happened in the last 4 years... Victor -- Night gathers, and now my watch begins. It shall not end until my death.

5 months, 1 week

Speeding up CPython

by Mark Shannon

Hi everyone, CPython is slow. We all know that, yet little is done to fix it. I'd like to change that. I have a plan to speed up CPython by a factor of five over the next few years. But it needs funding. I am aware that there have been several promised speed ups in the past that have failed. You might wonder why this is different. Here are three reasons: 1. I already have working code for the first stage. 2. I'm not promising a silver bullet. I recognize that this is a substantial amount of work and needs funding. 3. I have extensive experience in VM implementation, not to mention a PhD in the subject. My ideas for possible funding, as well as the actual plan of development, can be found here: https://github.com/markshannon/faster-cpython I'd love to hear your thoughts on this. Cheers, Mark.

5 months, 1 week

Re: Pattern matching reborn: PEP 622 is dead, long live PEP 634, 635, 636

by Tin Tvrtković

Hi, first of all, I'm a big fan of the changes being proposed here since in my code I prefer the 'union' style of logic over the OO style. I was curious, though, if there are any plans for the match operator to support async stuff. I'm interested in the problem of waiting on multiple asyncio tasks concurrently, and having a branch of code execute depending on the task. Currently this can be done by using asyncio.wait, looping over the done set and executing an if-else chain there, but this is quite tiresome. Go has a select statement (https://tour.golang.org/concurrency/5) that looks like this: select { case <-ch1: fmt.Println("Received from ch1") case <-ch2: fmt.Println("Received from ch2") } Speaking personally, this is a Go feature I miss a lot when writing asyncio code. The syntax is similar to what's being proposed here. Although it could be a separate thing added later, async match, I guess. > Message: 2 > Date: Thu, 22 Oct 2020 09:48:54 -0700 > From: Guido van Rossum <guido(a)python.org> > Subject: [Python-Dev] Pattern matching reborn: PEP 622 is dead, long > live PEP 634, 635, 636 > To: Python-Dev <python-dev(a)python.org> > Message-ID: > <CAP7+vJKzn+y8gqAFUr1g= > jOCk2if496ST00Ke8Mg921Yp5ZitQ(a)mail.gmail.com> > Content-Type: multipart/alternative; > boundary="00000000000039e83905b2453edf" > > --00000000000039e83905b2453edf > Content-Type: text/plain; charset="UTF-8" > > After the pattern matching discussion died out, we discussed it with the > Steering Council. Our discussion ended fairly positive, but there were a > lot of problems with the text. We decided to abandon the old PEP 622 and > break it up into three parts: > > - PEP 634: Specification > - PEP 635: Motivation and Rationale > - PEP 636: Tutorial > > This turned out to be more work than I had expected (basically we wrote all > new material) but we've finally made it to a point where we can request > feedback and submit the new version to the SC for approval. > > While the text of the proposal is completely different, there aren't that > many substantial changes: > > - We changed walrus patterns ('v := p') to AS patterns ('p as v'). > - We changed the method of comparison for literals None, False, True to use > 'is' instead of '=='. > - SyntaxError if an irrefutable case[1] is followed by another case block. > - SyntaxError if an irrefutable pattern[1] occurs on the left of '|', e.g. > 'x | [x]'. > - We dropped the `@sealed` decorator and everything aimed at static type > checkers. > > [1] An irrefutable pattern is one that never fails, notably a wildcard or a > capture. An irrefutable case has an irrefutable pattern at the top and no > guard. Irrefutability is defined recursively, since an '|' with an > irrefutable pattern on either side is itself irrefutable, and so is an AS > pattern with an irrefutable pattern before 'as'. > > The following issues were specifically discussed with the SC: > > - Concerns about side effects and undefined behavior. There's now some > specific language about this in a few places (giving the compiler freedom > to optimize), and a section "Side Effects and Undefined Behavior". > > - Footgun if `case NAME:` is followed by another case. This is now a > SyntaxError. > > - Adding an 'else' clause. We decided not to add this; motivation in PEP > 635. > > - Alternative 'OR' symbol. Not changed; see PEP 635. > > - Alternative wildcard symbol. Not changed, but Thomas wrote PEP 640 which > proposes '?' as a general assignment target. PEP 635 has some language > against that idea. > > - Alternative indentation schemes. We decided to stick with the original > proposal; see PEP 635. > > - Marking all capture variables with a sigil. We all agreed this was a bad > idea; see PEP 635. > > -- > --Guido van Rossum (python.org/~guido) > *Pronouns: he/him **(why is my pronoun here?)* >

5 months, 1 week

Re: PEP 642: Constraint Pattern Syntax for Structural Pattern Matching

by Tobias Kohn

Hi Nick and Everyone, We had actually considered a similar idea (i.e. load sigils) during the design phase of pattern matching. In the interest of having a rule that is as simple as possible, we had proposed to use a leading dot as a universal marker. Tin's example would thus have been written as:: match r: case (src, None): ... case (.c, msg): ... case (.s, msg): ... However, this idea was met with some resistance. After briefly looking at various alternatives again, we eventually decided to defer this discussion entirely, allowing for the community to perhaps gain some experience with the basic pattern matching infrastructure and have a more in-depth discussion later on. Paul also wrote [1]: > Nice to hear that there're (high-hierarchy) people who want to do > 2nd round on intent-explicitizing sigils, thanks. While we from the PEP-622/634/635/636 team are quite adamant that stores should *not* be marked, having a second round of discussion about load sigils is quite exactly what we aimed for! However, we should consider this to be a discussion about an *extension* of the existing PEPs (634-636), rather than about modifying them: *The introduction of a load sigil (be it the dot or a question mark or anything else) can actually be discussed quite independently of the rest of pattern matching.* You might have noticed that the original PEP 622 contained a lot more than the current PEPs 634-636. This is intentional: with the current pattern matching PEPs, we boiled down the entire concept to the basic infrastructure that we need in order to get it going; a basic "starter kit" if you will. There are a lot of ideas around for extending this basic pattern matching and make it much more powerful and versatile, including load sigils as proposed by PEP 642. But let us perhaps just start with pattern matching---hopefully in 3.10 :)---and then gradually build on that. Otherwise, I am afraid we will just keep running in circles and never get it to lift off. Cheers, Tobias [[1]] https://mail.python.org/archives/list/python-dev@python.org/message/QPYBAPO…

5 months, 2 weeks

Re: Drop Solaris, OpenSolaris, Illumos and OpenIndiana support in Python

by Raymond Hettinger

I vote against removal. We have no compelling need to disrupt an entire community and ecosystem even though it it is small. To anyone chiming in to say, yes drop the support, ask whether you've consulted any of the users — they should have a say in the matter. It is better for them to be a bit neglected than to be cut it off entirely. FWIW, when the tracker issue landed with a PR, I became concerned that it would be applied without further discussion and without consulting users. So I asked on Twitter whether Solaris was being used. If you're interested in the responses, see the thread at: https://twitter.com/i/status/1321917936668340227 (Victor can't see it because he blocked my account a long time ago). Also take a look at the user comments on the tracker: https://bugs.python.org/issue42173 . For those who don't follow links, here's a sample: * "Platform genocide is both unnecessary and unwarranted." -- brett3 * "Please do not drop support." -- jm650 * "I just want to lend my voice in favor of maintaining "Solarish" support as well, and offer what help I may for resolving issues."-- robertfrench * "No no no, please don't." -- tbalbers * "Please do not drop support for SunOS." -- mariuspana * "Please continue support for Solaris/IllumOS! This is very important for us." -- marcheschi * "Please don't drop Solaris support, we still use it to this day." -- abarbu * ... and many more will the same flavor Given this kind of user response, I think it would irresponsible to drop support. Raymond

5 months, 2 weeks

Re: Drop Solaris, OpenSolaris, Illumos and OpenIndiana support in Python

by Raymond Hettinger

Here are a couple comments on the Twitter thread that warrant your attention. Apparently, this is being used by the European Space Agency on their space craft. -- https://twitter.com/nikolaivk/status/1322094167980466178 "To be clear I will put some money where my mouth is. If we need to invest resources either in the form of developers or dollars to keep the port alive we will. By we I mean RackTop and/or Staysail Systems." -- https://twitter.com/gedamore/status/1321959956199866369 Raymond

5 months, 2 weeks

Summary of Python tracker Issues

by Python tracker

ACTIVITY SUMMARY (2020-10-23 - 2020-10-30) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 7626 (+18) closed 46322 (+64) total 53948 (+82) Open issues with patches: 3063 Issues opened (60) ================== #30681: email.utils.parsedate_to_datetime() should return None when da https://bugs.python.org/issue30681 reopened by serhiy.storchaka #41919: Modify test_codecs to use the new codecs.unregister() function https://bugs.python.org/issue41919 reopened by pablogsal #42131: [zipimport] Update zipimport to use specs https://bugs.python.org/issue42131 opened by brett.cannon #42132: Use specs instead of just __loader__ in C code https://bugs.python.org/issue42132 opened by brett.cannon #42133: Update the stdlib to fall back to __spec__.parent if __loader_ https://bugs.python.org/issue42133 opened by brett.cannon #42134: Raise ImportWarning when falling back to find_module() https://bugs.python.org/issue42134 opened by brett.cannon #42135: [importlib] Deprecate find_module() implementations https://bugs.python.org/issue42135 opened by brett.cannon #42136: [importlib] deprecate module_repr() methods https://bugs.python.org/issue42136 opened by brett.cannon #42137: Raise an ImportWarning for calling module_repr() on loaders https://bugs.python.org/issue42137 opened by brett.cannon #42140: asyncio.wait function creates futures set two times https://bugs.python.org/issue42140 opened by dutradda #42142: FAIL tkinter ttk LabeledScale test_resize, and more https://bugs.python.org/issue42142 opened by terry.reedy #42146: subprocess.Popen() leaks cwd in case of uid/gid overflow https://bugs.python.org/issue42146 opened by izbyshev #42149: Python 'make test' failed inside ssh+tmux https://bugs.python.org/issue42149 opened by kmash #42151: Pure Python xml.etree.ElementTree is missing default attribute https://bugs.python.org/issue42151 opened by obfusk #42152: Use PyDict_Contains() and PyDict_SetDefault() instead of PyDic https://bugs.python.org/issue42152 opened by serhiy.storchaka #42153: doc: library imaplib a url not available https://bugs.python.org/issue42153 opened by chrisxiao #42154: Bad proxy returned immediately after BaseManager server restar https://bugs.python.org/issue42154 opened by jryan #42158: http.server doesn't guess n-quads, n-triples, notation3 and Tr https://bugs.python.org/issue42158 opened by DylanVanAssche #42159: AsyncMock restores stopped patch if same object stopped multip https://bugs.python.org/issue42159 opened by lisroach #42162: The license page for Python 3.0 is messed up https://bugs.python.org/issue42162 opened by MaT1g3R #42163: _replace() no longer works on platform.uname_result objects https://bugs.python.org/issue42163 opened by cs-shadow #42164: Python fails to compile in the Fedora Stable LTO buildbots https://bugs.python.org/issue42164 opened by pablogsal #42166: corrupted size vs. prev_size https://bugs.python.org/issue42166 opened by kannanf9t #42167: Documentation for SETUP_WITH opcode is wrong https://bugs.python.org/issue42167 opened by pxeger #42171: Add PEP 573 to the stable ABI https://bugs.python.org/issue42171 opened by petr.viktorin #42173: Drop Solaris support https://bugs.python.org/issue42173 opened by vstinner #42174: shutil.get_terminal_size() returns 0 when run in a pty https://bugs.python.org/issue42174 opened by The Compiler #42177: Improving KeyError exception https://bugs.python.org/issue42177 opened by zingero #42178: failed pickle hangs python on exit in CMD.exe only https://bugs.python.org/issue42178 opened by charles.mcmarrow.4 #42179: Clarify chaining exceptions in tutorial/errors.rst https://bugs.python.org/issue42179 opened by Vladimir Ryabtsev #42181: describe PyEval_CallObjectWithKeywords and its replacement https://bugs.python.org/issue42181 opened by j5w6 #42182: 3.10 Documentation Not Hyperlinking Some Methods https://bugs.python.org/issue42182 opened by kj #42183: Stack overflow error with asyncio.all_tasks and wait_for https://bugs.python.org/issue42183 opened by Gobot1234 #42184: pdb exits unexpectedly when calling args https://bugs.python.org/issue42184 opened by xgenadam #42185: class body bytecode uses less efficient *_NAME opcodes https://bugs.python.org/issue42185 opened by gregory.p.smith #42186: unittest overrides more serious warnings filter added before u https://bugs.python.org/issue42186 opened by yilei #42187: Deprecating / removing token.ISTERMINAL/ISNONTERMINAL https://bugs.python.org/issue42187 opened by BTaskaya #42188: forkserver not reused in child processes https://bugs.python.org/issue42188 opened by cchomey #42189: copy.deepcopy() no longer works on platform.uname_result objec https://bugs.python.org/issue42189 opened by rocallahan #42190: global declarations affect too much inside exec or compile https://bugs.python.org/issue42190 opened by Kevin Shweh #42191: lib.argparse._check_value() using repr instead of str https://bugs.python.org/issue42191 opened by avdwoude #42192: Python Windows .exe Installer ignores /TargetDir if there is a https://bugs.python.org/issue42192 opened by Martin.Gfeller #42193: Improve socket.bind error message https://bugs.python.org/issue42193 opened by flying sheep #42194: Docs for argparse.BooleanOptionalAction missing "New in versio https://bugs.python.org/issue42194 opened by shangxiao #42195: Inconsistent __args__ between typing.Callable and collections. https://bugs.python.org/issue42195 opened by Zac Hatfield-Dodds #42196: Python Windows Installation Error 0x800705aa https://bugs.python.org/issue42196 opened by shakir_juolay #42197: Disable automatic update of frame locals during tracing https://bugs.python.org/issue42197 opened by fabioz #42198: Clean up docs for Union and GenericAlias https://bugs.python.org/issue42198 opened by kj #42199: bytecode_helper assertNotInBytecode fails too eagerly https://bugs.python.org/issue42199 opened by tekknolagi #42200: Support TLS 1.3 half-closed connections https://bugs.python.org/issue42200 opened by Dima.Tisnek #42201: Priority queue realization issue https://bugs.python.org/issue42201 opened by dupeljan #42202: Optimize function annotation https://bugs.python.org/issue42202 opened by methane #42204: "import setuptools" Results in "ModuleNotFoundError: No module https://bugs.python.org/issue42204 opened by sy #42205: Add image/webp to list of non-standard mimetypes https://bugs.python.org/issue42205 opened by waicalibre #42207: Python 3.9 testing fails when building with clang and optimiza https://bugs.python.org/issue42207 opened by serge-sans-paille #42208: Using logging or warnings during Python finalization does cras https://bugs.python.org/issue42208 opened by vstinner #42209: Incorrect line reported in syntax error https://bugs.python.org/issue42209 opened by gkuhn #42210: float.hex discards sign from -nan https://bugs.python.org/issue42210 opened by sree314 #42211: CRASH https://bugs.python.org/issue42211 opened by badamesoham8 #42212: Check if generated files are up-to-date in Github Actions https://bugs.python.org/issue42212 opened by FFY00 Most recent 15 issues with no replies (15) ========================================== #42212: Check if generated files are up-to-date in Github Actions https://bugs.python.org/issue42212 #42210: float.hex discards sign from -nan https://bugs.python.org/issue42210 #42207: Python 3.9 testing fails when building with clang and optimiza https://bugs.python.org/issue42207 #42205: Add image/webp to list of non-standard mimetypes https://bugs.python.org/issue42205 #42204: "import setuptools" Results in "ModuleNotFoundError: No module https://bugs.python.org/issue42204 #42201: Priority queue realization issue https://bugs.python.org/issue42201 #42200: Support TLS 1.3 half-closed connections https://bugs.python.org/issue42200 #42199: bytecode_helper assertNotInBytecode fails too eagerly https://bugs.python.org/issue42199 #42197: Disable automatic update of frame locals during tracing https://bugs.python.org/issue42197 #42193: Improve socket.bind error message https://bugs.python.org/issue42193 #42190: global declarations affect too much inside exec or compile https://bugs.python.org/issue42190 #42188: forkserver not reused in child processes https://bugs.python.org/issue42188 #42184: pdb exits unexpectedly when calling args https://bugs.python.org/issue42184 #42182: 3.10 Documentation Not Hyperlinking Some Methods https://bugs.python.org/issue42182 #42181: describe PyEval_CallObjectWithKeywords and its replacement https://bugs.python.org/issue42181 Most recent 15 issues waiting for review (15) ============================================= #42212: Check if generated files are up-to-date in Github Actions https://bugs.python.org/issue42212 #42208: Using logging or warnings during Python finalization does cras https://bugs.python.org/issue42208 #42207: Python 3.9 testing fails when building with clang and optimiza https://bugs.python.org/issue42207 #42205: Add image/webp to list of non-standard mimetypes https://bugs.python.org/issue42205 #42199: bytecode_helper assertNotInBytecode fails too eagerly https://bugs.python.org/issue42199 #42198: Clean up docs for Union and GenericAlias https://bugs.python.org/issue42198 #42197: Disable automatic update of frame locals during tracing https://bugs.python.org/issue42197 #42194: Docs for argparse.BooleanOptionalAction missing "New in versio https://bugs.python.org/issue42194 #42189: copy.deepcopy() no longer works on platform.uname_result objec https://bugs.python.org/issue42189 #42183: Stack overflow error with asyncio.all_tasks and wait_for https://bugs.python.org/issue42183 #42173: Drop Solaris support https://bugs.python.org/issue42173 #42171: Add PEP 573 to the stable ABI https://bugs.python.org/issue42171 #42163: _replace() no longer works on platform.uname_result objects https://bugs.python.org/issue42163 #42152: Use PyDict_Contains() and PyDict_SetDefault() instead of PyDic https://bugs.python.org/issue42152 #42151: Pure Python xml.etree.ElementTree is missing default attribute https://bugs.python.org/issue42151 Top 10 most discussed issues (10) ================================= #42173: Drop Solaris support https://bugs.python.org/issue42173 30 msgs #42166: corrupted size vs. prev_size https://bugs.python.org/issue42166 11 msgs #42140: asyncio.wait function creates futures set two times https://bugs.python.org/issue42140 8 msgs #26789: logging: Trying to log during Python finalization with NameErr https://bugs.python.org/issue26789 6 msgs #41699: Potential memory leak with asyncio and run_in_executor https://bugs.python.org/issue41699 6 msgs #42164: Python fails to compile in the Fedora Stable LTO buildbots https://bugs.python.org/issue42164 6 msgs #39573: [C API] Make PyObject an opaque structure in the limited C API https://bugs.python.org/issue39573 5 msgs #41835: Speed up dict vectorcall creation using keywords https://bugs.python.org/issue41835 5 msgs #42202: Optimize function annotation https://bugs.python.org/issue42202 5 msgs #42070: Revisit IsoCalendarDate being private from pickle perspective https://bugs.python.org/issue42070 4 msgs Issues closed (57) ================== #6761: Class calling https://bugs.python.org/issue6761 closed by eric.araujo #23797: Mac OS X locale setup in thread happens sometime after run() i https://bugs.python.org/issue23797 closed by ronaldoussoren #24165: Free list for single-digits ints https://bugs.python.org/issue24165 closed by methane #24427: subclass of multiprocessing Connection segfault upon attribute https://bugs.python.org/issue24427 closed by iritkatriel #29981: Update Index for set, dict, and generator 'comprehensions' https://bugs.python.org/issue29981 closed by methane #30181: Correct the parsing of a test case docstring. https://bugs.python.org/issue30181 closed by chris.jerdonek #31484: Cache single-character strings outside of the Latin1 range https://bugs.python.org/issue31484 closed by serhiy.storchaka #32659: Solaris "stat" should support "st_fstype" https://bugs.python.org/issue32659 closed by vstinner #33557: Windows multiprocessing doesn't propagate tabcheck to children https://bugs.python.org/issue33557 closed by methane #34204: Bump the default pickle protocol in shelve https://bugs.python.org/issue34204 closed by cheryl.sabella #34394: Descriptors HowTo doesn't mention __set_name__ https://bugs.python.org/issue34394 closed by rhettinger #35823: Use vfork() in subprocess on Linux https://bugs.python.org/issue35823 closed by gregory.p.smith #38870: Expose ast.unparse in the ast module https://bugs.python.org/issue38870 closed by BTaskaya #38976: Add support for HTTP Only flag in MozillaCookieJar https://bugs.python.org/issue38976 closed by orsenthil #39101: IsolatedAsyncioTestCase freezes when exception is raised https://bugs.python.org/issue39101 closed by lisroach #39108: random needs doc for "gauss" versus "normalvariate" https://bugs.python.org/issue39108 closed by rhettinger #39189: Use io.DEFAULT_BUFFER_SIZE for filecmp BUFSIZE variable https://bugs.python.org/issue39189 closed by methane #39706: unittest.IsolatedAsyncioTestCase hangs on asyncio.CancelledErr https://bugs.python.org/issue39706 closed by lisroach #39715: Implement __repr__ methods for AST classes https://bugs.python.org/issue39715 closed by vstinner #40841: Provide mimetypes.sniff API as stdlib https://bugs.python.org/issue40841 closed by corona10 #41052: Opt out serialization/deserialization for heap type https://bugs.python.org/issue41052 closed by serhiy.storchaka #41101: Support "arm64" in Mac/Tools/pythonw https://bugs.python.org/issue41101 closed by ronaldoussoren #41474: Missing dependency on Include/cpython/frameobject.h https://bugs.python.org/issue41474 closed by vstinner #41659: PEG discrepancy on 'if {x} {a}: pass' https://bugs.python.org/issue41659 closed by lys.nikolaou #41805: types.GenericAlias and types.Union have no documentation https://bugs.python.org/issue41805 closed by gvanrossum #42058: Process not running with args https://bugs.python.org/issue42058 closed by terry.reedy #42061: Document __format__ method for IPv[46]Address https://bugs.python.org/issue42061 closed by eric.smith #42096: zipfile.is_zipfile incorrectly identifying a gzipped file as a https://bugs.python.org/issue42096 closed by serhiy.storchaka #42097: Python 3.7.9 logging/threading/fork hang https://bugs.python.org/issue42097 closed by izbyshev #42099: Fix reference to ob_type in unionobject.c and ceval https://bugs.python.org/issue42099 closed by Mark.Shannon #42121: unable to input certain Unicode characters in Text widget https://bugs.python.org/issue42121 closed by terry.reedy #42123: Run parser twice; enable invalid_* rules only on the second ru https://bugs.python.org/issue42123 closed by lys.nikolaou #42127: functools.cached_property possibly disables key-sharing instan https://bugs.python.org/issue42127 closed by rhettinger #42138: Forward port Doc/whatsnew/3.9.rst to master https://bugs.python.org/issue42138 closed by gvanrossum #42139: Synchronize What's New in 3.9 master and 3.9 https://bugs.python.org/issue42139 closed by terry.reedy #42141: Speedup various dict inits https://bugs.python.org/issue42141 closed by Marco Sulla #42143: Corruptions in func_dealloc() with partially-created function https://bugs.python.org/issue42143 closed by serhiy.storchaka #42144: A missing "goto" in the _ssl module! https://bugs.python.org/issue42144 closed by christian.heimes #42145: test_io is leaking references https://bugs.python.org/issue42145 closed by pablogsal #42147: Micro optimization for longrange iteration if step is 1 https://bugs.python.org/issue42147 closed by corona10 #42148: floating point representation issues https://bugs.python.org/issue42148 closed by eric.smith #42150: Buffer overflow in bad_single_statement (Parser/pegen.c) https://bugs.python.org/issue42150 closed by pablogsal #42155: email.utils.parsedate_to_datetime() should return None when da https://bugs.python.org/issue42155 closed by barry #42156: Currency not correct for all locales https://bugs.python.org/issue42156 closed by eric.smith #42157: Cleanup the unicodedata module https://bugs.python.org/issue42157 closed by vstinner #42160: unnecessary overhead in tempfile https://bugs.python.org/issue42160 closed by methane #42161: Remove private _PyLong_Zero and _PyLong_One variables https://bugs.python.org/issue42161 closed by vstinner #42165: closed (reopen with other issue) https://bugs.python.org/issue42165 closed by hyoxt121 #42168: Question about deserializing some numbers (bug??) https://bugs.python.org/issue42168 closed by eric.smith #42169: Apparently all documentation on @typing.overload is wrong https://bugs.python.org/issue42169 closed by gvanrossum #42170: splitdrive fails for UNC path with the "\\?\UNC\" prefix. https://bugs.python.org/issue42170 closed by eryksun #42172: Typo in test library for test_socket.py https://bugs.python.org/issue42172 closed by corona10 #42175: long lines from interactive stdin are truncated https://bugs.python.org/issue42175 closed by Anthony Sottile #42176: Valgrind reports "Conditional jump or move depends on uninitia https://bugs.python.org/issue42176 closed by methane #42180: Missing a plural in library/functions https://bugs.python.org/issue42180 closed by pablogsal #42203: Unexpected behaviour NameError: name 'open' is not defined https://bugs.python.org/issue42203 closed by vstinner #42206: Pegen: Raise errors occurred by the AST validator https://bugs.python.org/issue42206 closed by BTaskaya

5 months, 2 weeks

Site Packages under LIB folder

by rajesh.narasimhan＠gmail.com

I have installed new python version 3.9, I wanted to move all the site-packages that I have used in 3.8 to 3.9 lib. Is it possible? I also wanted to know why we need to have lib under every specific version, it would be nice if we have common lib in which I can configure those based on the version I use. Is that available already if not is that something we can implement in future version this will help most of the developers in not moving the site-packages from one version to another every time we upgrade the version. Regards Rajesh Narasimhan

5 months, 2 weeks

Accepting PEP 626

by Pablo Galindo Salgado

On behalf of the steering council, I am happy to announce that as BDFL-Delegate I am accepting PEP 626 -- Precise line numbers for debugging and other tools. I am confident this PEP will result in a better experience for debuggers, profilers and tools that rely on tracing functions. All the existing concerns regarding out-of-process debuggers and profilers have been addressed by Mark in the latest version of the PEP. The acceptance of the PEP comes with the following requests: * The PEP must be updated to explicitly state that the API functions described in the "Out of process debuggers and profilers" must remain self-contained in any potential future modifications or enhancements. * The PEP states that the "f_lineno" attribute of the code object will be updated to point to the current line being executed even if tracing is off. Also, there were some folks concerned with possible performance implications. Although in my view there is no reason to think this will impact performance negatively, I would like us to confirm that indeed this is the case before merging the implementation (with the pyperformance test suite, for example). Congratulations Mark Shannon! Thanks also to everyone else who provided feedback on this PEP! Regards from rainy London, Pablo Galindo Salgado

5 months, 2 weeks

os.scandir bug in Windows?

by Rob Cliffe

TLDR: In os.scandir directory entries, atime is always a copy of mtime rather than the actual access time. Demo program: Windows 10, Python 3.8.3: # osscandirtest.py import time, os with open('Test', 'w') as f: f.write('Anything\n') # Write to a file time.sleep(10) with open('Test', 'r') as f: f.readline() # Read the file print(os.stat('Test')) for DirEntry in os.scandir('.'): if DirEntry.name == 'Test': stat = DirEntry.stat() print(f'scandir DirEntry {stat.st_ctime=} {stat.st_mtime=} {stat.st_atime=}') Sample output: os.stat_result(st_mode=33206, st_ino=8162774324687317, st_dev=2230120362, st_nlink=1, st_uid=0, st_gid=0, st_size=10, st_atime=1600631381, st_mtime=1600631371, st_ctime=1600631262) scandir DirEntry stat.st_ctime=1600631262.951019 stat.st_mtime=1600631371.7062848 stat.st_atime=1600631371.7062848 For os.stat, atime is 10 seconds more than mtime, as would be expected. But for os.scandir, atime is a copy of mtime. ISTM that this is a bug, and in fact recently it stopped me from using os.scandir in a program where I needed the access timestamp. No big deal, but ... If it is a feature for some reason, presumably it should be documented. Best wishes Rob Cliffe

5 months, 2 weeks

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

Python-Dev October 2020