From report at bugs.python.org  Thu Oct  1 00:50:47 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 01 Oct 2020 04:50:47 +0000
Subject: [issue41870] Use PEP 590 vectorcall to speed up calls to bool()
In-Reply-To: <1601212858.37.0.301484827373.issue41870@roundup.psfhosted.org>
Message-ID: <1601527847.93.0.380624843044.issue41870@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:


New changeset fa7ce080175f65d678a7d5756c94f82887fc9803 by Dong-hee Na in branch 'master':
bpo-41870: Avoid the test when nargs=0 (GH-22462)
https://github.com/python/cpython/commit/fa7ce080175f65d678a7d5756c94f82887fc9803


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41870>
_______________________________________

From report at bugs.python.org  Thu Oct  1 00:52:35 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 01 Oct 2020 04:52:35 +0000
Subject: [issue41870] Use PEP 590 vectorcall to speed up calls to bool()
In-Reply-To: <1601212858.37.0.301484827373.issue41870@roundup.psfhosted.org>
Message-ID: <1601527955.75.0.0913711071097.issue41870@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

Now the suggestion is applied!
Thank you Pablo and Victor!!!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41870>
_______________________________________

From report at bugs.python.org  Thu Oct  1 01:51:43 2020
From: report at bugs.python.org (Patricia Timmers)
Date: Thu, 01 Oct 2020 05:51:43 +0000
Subject: [issue41859] Uncaught ValueError
In-Reply-To: <1601007125.39.0.397372093674.issue41859@roundup.psfhosted.org>
Message-ID: <1601531503.63.0.131740478309.issue41859@roundup.psfhosted.org>


Patricia Timmers <patanjalisutra666 at gmail.com> added the comment:

JRequest Id: 74c342d8-c8af-46fe-a488-837736590d01
Correlation Id: 79fac27b-d04d-4597-9bfd-ee7624927c4e
Timestamp: 2020-10-01T04:53:13Z
Message: AADSTS750054: SAMLRequest or SAMLResponse must be present as query string parameters in HTTP request for SAML Redirect binding.

----------
nosy: +patanjalisutra666
Added file: https://bugs.python.org/file49480/debian-desktop.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41859>
_______________________________________

From report at bugs.python.org  Thu Oct  1 03:29:13 2020
From: report at bugs.python.org (DanilZ)
Date: Thu, 01 Oct 2020 07:29:13 +0000
Subject: [issue37294] concurrent.futures.ProcessPoolExecutor state=finished
 raised error
In-Reply-To: <1601511101.89.0.0203326077586.issue37294@roundup.psfhosted.org>
Message-ID: <59581AED-C40A-4CE3-AAF9-C266523F75FF@me.com>


DanilZ <danil.com at me.com> added the comment:

.

> On 1 Oct 2020, at 03:11, Kyle Stanley <report at bugs.python.org> wrote:
> 
> 
> Kyle Stanley <aeros167 at gmail.com> added the comment:
> 
> DanilZ, could you take a look at the superseding issue (https://bugs.python.org/issue37297) and see if your exception raised within the job is the same?  
> 
> If it's not, I would suggest opening a separate issue (and linking to it in a comment here), as I don't think it's necessarily related to this one. "state=finished raised error" doesn't indicate the specific exception that occurred. A good format for the name would be something along the lines of:
> 
> "ProcessPoolExecutor.submit() <specific exception name here> while reading large object (4GB)"
> 
> It'd also be helpful in the separate issue to paste the full exception stack trace, specify OS, and multiprocessing start method used (spawn, fork, or forkserver). This is necessary to know for replicating the issue on our end.
> 
> In the meantime, I workaround I would suggest trying would be to use the  *chunksize* parameter (or *Iterator*) in pandas.read_csv(), and split it across several jobs (at least 4+, more if you have additional cores) instead of within a single one. It'd also be generally helpful to see if that alleviates the problem, as it could possibly indicate an issue with running out of memory when the dataframe is converted to pickle format (which often increases the total size) within the process associated with the job.
> 
> ----------
> nosy: +aeros
> 
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue37294>
> _______________________________________

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37294>
_______________________________________

From report at bugs.python.org  Thu Oct  1 03:38:09 2020
From: report at bugs.python.org (DanilZ)
Date: Thu, 01 Oct 2020 07:38:09 +0000
Subject: [issue37294] concurrent.futures.ProcessPoolExecutor state=finished
 raised error
In-Reply-To: <1601511101.89.0.0203326077586.issue37294@roundup.psfhosted.org>
Message-ID: <3B89D7EB-E61B-4AC2-B890-90B44C926B5A@me.com>


DanilZ <danil.com at me.com> added the comment:

I think you have correctly estimated the problem in the last part of your message: "as it could possibly indicate an issue with running out of memory when the dataframe is converted to pickle format (which often increases the total size) within the process associated with the job?

The function pd.read_csv performs without any problems inside a process, the error appears only when I try to extract it from the finished process via:
    for f in concurrent.futures.as_completed(results):
            data = f.result()

or

    data = results.result()

It just does not pass a large file from the results object.

I am sure that inside of a multiprocess everything works correctly for 2 reasons:
1. If I change in function inside a process to just save the file (that had been read in memory) to disk.
2. If I recuse the file size, then it gets extracted from results.result() without error.

So I guess then that my question narrows down to: 
1. Can I increase the memory allocated to a process? 
2. Or at least understand what would is the limit.

Regards,
Danil

> On 1 Oct 2020, at 03:11, Kyle Stanley <report at bugs.python.org> wrote:
> 
> 
> Kyle Stanley <aeros167 at gmail.com> added the comment:
> 
> DanilZ, could you take a look at the superseding issue (https://bugs.python.org/issue37297) and see if your exception raised within the job is the same?  
> 
> If it's not, I would suggest opening a separate issue (and linking to it in a comment here), as I don't think it's necessarily related to this one. "state=finished raised error" doesn't indicate the specific exception that occurred. A good format for the name would be something along the lines of:
> 
> "ProcessPoolExecutor.submit() <specific exception name here> while reading large object (4GB)"
> 
> It'd also be helpful in the separate issue to paste the full exception stack trace, specify OS, and multiprocessing start method used (spawn, fork, or forkserver). This is necessary to know for replicating the issue on our end.
> 
> In the meantime, I workaround I would suggest trying would be to use the  *chunksize* parameter (or *Iterator*) in pandas.read_csv(), and split it across several jobs (at least 4+, more if you have additional cores) instead of within a single one. It'd also be generally helpful to see if that alleviates the problem, as it could possibly indicate an issue with running out of memory when the dataframe is converted to pickle format (which often increases the total size) within the process associated with the job.
> 
> ----------
> nosy: +aeros
> 
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue37294>
> _______________________________________

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37294>
_______________________________________

From report at bugs.python.org  Thu Oct  1 04:00:16 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Thu, 01 Oct 2020 08:00:16 +0000
Subject: [issue41899] Poor example for Element.remove()
In-Reply-To: <1601510915.6.0.455772572055.issue41899@roundup.psfhosted.org>
Message-ID: <1601539216.68.0.926634705735.issue41899@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

Closing as duplicate of issue 41891. Let's keep the discussion there.

----------
nosy: +scoder
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41899>
_______________________________________

From report at bugs.python.org  Thu Oct  1 04:02:07 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Thu, 01 Oct 2020 08:02:07 +0000
Subject: [issue41899] Poor example for Element.remove()
In-Reply-To: <1601510915.6.0.455772572055.issue41899@roundup.psfhosted.org>
Message-ID: <1601539327.87.0.594420622663.issue41899@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

Closing as duplicate of issue 41892. Let's keep the discussion there.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41899>
_______________________________________

From report at bugs.python.org  Thu Oct  1 04:01:41 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Thu, 01 Oct 2020 08:01:41 +0000
Subject: [issue41899] Poor example for Element.remove()
In-Reply-To: <1601510915.6.0.455772572055.issue41899@roundup.psfhosted.org>
Message-ID: <1601539301.76.0.334885721611.issue41899@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
Removed message: https://bugs.python.org/msg377740

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41899>
_______________________________________

From report at bugs.python.org  Thu Oct  1 04:04:49 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Thu, 01 Oct 2020 08:04:49 +0000
Subject: [issue31256] xml.etree.ElementTree: add support for doctype in
 tostring method
In-Reply-To: <1503388868.57.0.0239596264981.issue31256@psf.upfronthosting.co.za>
Message-ID: <1601539489.62.0.284797132073.issue31256@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

Yes, it fixed already. Thanks!

----------
nosy: +scoder
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31256>
_______________________________________

From report at bugs.python.org  Thu Oct  1 04:09:31 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Thu, 01 Oct 2020 08:09:31 +0000
Subject: [issue41900] XML C14N serialisation fails with default namespace
Message-ID: <1601539771.76.0.649263421271.issue41900@roundup.psfhosted.org>


New submission from Stefan Behnel <stefan_ml at behnel.de>:

import xml.etree.ElementTree as ET
xml="""
<X xmlns="http://soap.sforce.com/2006/04/metadata">
    <Y targets="lightning__AppPage,lightning__HomePage"></Y>
</X>"""
print(ET.canonicalize(xml))

Fails with:
ValueError: Namespace "" is not declared in scope
when trying to build the QName of the unnamespaced "targets" attribute.

Originally reported for lxml here:
https://bugs.launchpad.net/lxml/+bug/1869455

----------
components: XML
messages: 377743
nosy: scoder
priority: normal
severity: normal
stage: needs patch
status: open
title: XML C14N serialisation fails with default namespace
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41900>
_______________________________________

From report at bugs.python.org  Thu Oct  1 04:47:29 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Thu, 01 Oct 2020 08:47:29 +0000
Subject: [issue41900] XML C14N serialisation fails with default namespace
In-Reply-To: <1601539771.76.0.649263421271.issue41900@roundup.psfhosted.org>
Message-ID: <1601542049.29.0.387355702827.issue41900@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
keywords: +patch
pull_requests: +21493
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22474

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41900>
_______________________________________

From report at bugs.python.org  Thu Oct  1 06:28:57 2020
From: report at bugs.python.org (E. Paine)
Date: Thu, 01 Oct 2020 10:28:57 +0000
Subject: [issue41896] Moving index with wordstart expression includes
 non-alphanumberic and underline characters if word is tagged and iat the edge
 of a text widget
In-Reply-To: <1601490490.12.0.958872838055.issue41896@roundup.psfhosted.org>
Message-ID: <1601548137.53.0.617153537386.issue41896@roundup.psfhosted.org>


Change by E. Paine <paineelisha at gmail.com>:


----------
nosy: +epaine

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41896>
_______________________________________

From report at bugs.python.org  Thu Oct  1 06:45:43 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 10:45:43 +0000
Subject: [issue41871] Add PyList_Remove() in listobject.c
In-Reply-To: <1601213406.91.0.754630281807.issue41871@roundup.psfhosted.org>
Message-ID: <1601549143.68.0.476978985633.issue41871@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> it is more convenient to just call the method

Calling a Python method in Python is not convenient nor efficient.

For example, PyObject_CallMethod() has to decode a name from UTF-8 and then needs a lookup into the type dictionary. The list.remove() raises a exception if the item is not found, whereas PyCodec_Unregister() does nothing if the codec search function is not found: the exception is ignored.

It's also about correctness, looking for an item in a list can be tricky if the list size changes during the lookup, or Python can crash if it uses a borrowed reference whereas a list item is destroyed. There were tons of such bugs in the dict implementation. list.remove() doesn't look safe, but I would prefer to avoid having to fix the same bugs in copies of similar functions.

If a public function is not justified, what about an internal function?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41871>
_______________________________________

From report at bugs.python.org  Thu Oct  1 07:23:56 2020
From: report at bugs.python.org (E. Paine)
Date: Thu, 01 Oct 2020 11:23:56 +0000
Subject: [issue41896] Moving index with wordstart expression includes
 non-alphanumberic and underline characters if word is tagged and iat the edge
 of a text widget
In-Reply-To: <1601490490.12.0.958872838055.issue41896@roundup.psfhosted.org>
Message-ID: <1601551436.44.0.171595146698.issue41896@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

Thank you for reporting this issue, however it is ultimately a Tk issue as shown by running the attached script in wish. I assume the Tk version was updated in Python 3.6, though I don't know which platform you are on so don't know which of Ned or Steve to nosy to verify this theory (you can check yourself by calling `tkinter.test.support.get_tk_patchlevel()` in both 3.5 & 3.6).

I am currently in the process of digging through the Tk source looking for the cause of the problem (so I can decide whether to report it to the Tk team - you can do so yourself if you prefer). This issue should be closed as third party, but I will link the Tk issue here if I decide to create one.

----------
Added file: https://bugs.python.org/file49481/wordstart with tag.tcl

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41896>
_______________________________________

From report at bugs.python.org  Thu Oct  1 08:06:16 2020
From: report at bugs.python.org (Christian Leichsenring)
Date: Thu, 01 Oct 2020 12:06:16 +0000
Subject: [issue22864] Add filter to multiprocessing.Pool
In-Reply-To: <1415900127.9.0.960876191139.issue22864@psf.upfronthosting.co.za>
Message-ID: <1601553976.36.0.716083151274.issue22864@roundup.psfhosted.org>


Christian Leichsenring <christian.leichsenring at googlemail.com> added the comment:

The main point the OP didn't make is exactly the issue that Pool.map returns a list which is potentially very large given that multiprocessing is used to process large amounts of data.

So IMHO either there should be the possibility to exclude elements from being saved in memory (i.e. Pool.filter) or Pool.map shouldn't return a list but just an iterable.

----------
nosy: +christian.leichsenring

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22864>
_______________________________________

From report at bugs.python.org  Thu Oct  1 08:07:50 2020
From: report at bugs.python.org (Marco Sulla)
Date: Thu, 01 Oct 2020 12:07:50 +0000
Subject: [issue41901] Added some explaining to pickle errors.
Message-ID: <1601554070.38.0.74604376475.issue41901@roundup.psfhosted.org>


New submission from Marco Sulla <launchpad.net at marco.sulla.e4ward.com>:

All pickle error messages in typeobject.c was a generic "cannot pickle 'type' object". Added some explaining for every individual error.

----------
components: Interpreter Core
messages: 377747
nosy: Marco Sulla
priority: normal
pull_requests: 21494
severity: normal
status: open
title: Added some explaining to pickle errors.
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41901>
_______________________________________

From report at bugs.python.org  Thu Oct  1 08:34:14 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 12:34:14 +0000
Subject: [issue41804] test_epoll fails test_control_and_wait() randomly on
 aarch64 RHEL8 Refleaks 3.9
In-Reply-To: <1600360940.95.0.528440416873.issue41804@roundup.psfhosted.org>
Message-ID: <1601555654.33.0.897264278805.issue41804@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The test also fails on aarch64 RHEL7 Refleaks 3.x:
https://buildbot.python.org/all/#/builders/131/builds/46

FAIL: test_control_and_wait (test.test_epoll.TestEPoll)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41804>
_______________________________________

From report at bugs.python.org  Thu Oct  1 08:36:08 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 12:36:08 +0000
Subject: [issue37224] [subinterpreters] test__xxsubinterpreters fails randomly
In-Reply-To: <1560214681.61.0.906498246375.issue37224@roundup.psfhosted.org>
Message-ID: <1601555768.3.0.957742507038.issue37224@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The test still fails randomly: AMD64 Windows8.1 Refleaks 3.8
https://buildbot.python.org/all/#/builders/200/builds/48

test_subinterpreter failed twice on Refleaks which runs tests 6 times in a row.

First run:

0:33:58 load avg: 4.78 [204/423/1] test__xxsubinterpreters failed -- running: test_multiprocessing_spawn (12 min 42 sec), test_io (7 min 28 sec), test_tarfile (39.2 sec)
beginning 6 repetitions
123456
...Exception in thread Thread-38:
Traceback (most recent call last):
  File "D:\buildarea\3.8.ware-win81-release.refleak\build\lib\threading.py", line 932, in _bootstrap_inner
    self.run()
  File "D:\buildarea\3.8.ware-win81-release.refleak\build\lib\threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "D:\buildarea\3.8.ware-win81-release.refleak\build\lib\test\test__xxsubinterpreters.py", line 51, in run
    interpreters.run_string(interp, dedent(f"""
RuntimeError: unrecognized interpreter ID 250
test test__xxsubinterpreters failed -- Traceback (most recent call last):
  File "D:\buildarea\3.8.ware-win81-release.refleak\build\lib\test\test__xxsubinterpreters.py", line 495, in test_subinterpreter
    self.assertTrue(interpreters.is_running(interp))
AssertionError: False is not true

Second run:

FAIL: test_subinterpreter (test.test__xxsubinterpreters.IsRunningTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\buildarea\3.8.ware-win81-release.refleak\build\lib\test\test__xxsubinterpreters.py", line 495, in test_subinterpreter
    self.assertTrue(interpreters.is_running(interp))
AssertionError: False is not true

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37224>
_______________________________________

From report at bugs.python.org  Thu Oct  1 09:24:47 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 13:24:47 +0000
Subject: [issue41861] Convert sqlite3 to PEP 384
In-Reply-To: <1601036291.36.0.740279655223.issue41861@roundup.psfhosted.org>
Message-ID: <1601558687.01.0.816258427069.issue41861@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 9031bd4fa42dbb0f25aee9286154ad4bf60df3f8 by Erlend Egeberg Aasland in branch 'master':
bpo-41861: Convert _sqlite3 RowType and StatementType to heap types (GH-22444)
https://github.com/python/cpython/commit/9031bd4fa42dbb0f25aee9286154ad4bf60df3f8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41861>
_______________________________________

From report at bugs.python.org  Thu Oct  1 09:26:40 2020
From: report at bugs.python.org (pyTama)
Date: Thu, 01 Oct 2020 13:26:40 +0000
Subject: [issue41896] Moving index with wordstart expression includes
 non-alphanumberic and underline characters if word is tagged and iat the edge
 of a text widget
In-Reply-To: <1601490490.12.0.958872838055.issue41896@roundup.psfhosted.org>
Message-ID: <1601558800.81.0.188198505199.issue41896@roundup.psfhosted.org>


pyTama <Tama-sama at outlook.com> added the comment:

I'm running on windows. The patch level on python 3.6 is (8, 6, 6, 'final', 0), while on python 3.5 is (8, 6, 4, 'final', 0).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41896>
_______________________________________

From report at bugs.python.org  Thu Oct  1 09:34:41 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 01 Oct 2020 13:34:41 +0000
Subject: [issue41861] Convert sqlite3 to PEP 384
In-Reply-To: <1601036291.36.0.740279655223.issue41861@roundup.psfhosted.org>
Message-ID: <1601559281.78.0.174890818199.issue41861@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +21495
pull_request: https://github.com/python/cpython/pull/22478

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41861>
_______________________________________

From report at bugs.python.org  Thu Oct  1 09:42:45 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 01 Oct 2020 13:42:45 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
Message-ID: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>


New submission from Dong-hee Na <donghee.na92 at gmail.com>:

if we declare range without setting step, we don't have to process divide operation.

here is the benchmark result both setting step and without step,

With my patch, there is no performance degrade with range.index when the step is not one and showing 19% enhancement when the step is the default value (1) .

Mean +- std dev: [range_master] 1.11 us +- 0.01 us -> [range_opt] 896 ns +- 23 ns: 1.24x faster (-19%)

Mean +- std dev: [range_step_master] 1.12 us +- 0.02 us -> [range_step_opt] 1.11 us +- 0.01 us: 1.01x faster (-1%)

----------
assignee: corona10
components: Interpreter Core
files: bench_range_index.py
messages: 377752
nosy: corona10, pablogsal, serhiy.storchaka, vstinner
priority: normal
severity: normal
status: open
title: Micro optimization for range.index if step is 1
type: performance
versions: Python 3.10
Added file: https://bugs.python.org/file49482/bench_range_index.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 09:43:05 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 01 Oct 2020 13:43:05 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601559785.6.0.0571362833829.issue41902@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


Added file: https://bugs.python.org/file49483/bench_range_step.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 09:49:07 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 01 Oct 2020 13:49:07 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601560147.64.0.920083331903.issue41902@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
keywords: +patch
pull_requests: +21496
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22479

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 09:49:49 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 01 Oct 2020 13:49:49 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601560189.52.0.124333479041.issue41902@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

For optimization case,

>>> a = range(0, 11111)
>>> a.index(3)
3

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 10:03:42 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 14:03:42 +0000
Subject: [issue41861] Convert sqlite3 to PEP 384
In-Reply-To: <1601036291.36.0.740279655223.issue41861@roundup.psfhosted.org>
Message-ID: <1601561022.34.0.472754711797.issue41861@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 256e54acdbdb26745d4bbb5cf366454151e42773 by Erlend Egeberg Aasland in branch 'master':
bpo-41861: Convert _sqlite3 CursorType and ConnectionType to heap types (GH-22478)
https://github.com/python/cpython/commit/256e54acdbdb26745d4bbb5cf366454151e42773


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41861>
_______________________________________

From report at bugs.python.org  Thu Oct  1 10:55:35 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 14:55:35 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601564135.0.0.359677849173.issue41902@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

PR 22479 avoids calling PyNumber_FloorDivide(a, b) if b == 1 (if b == _PyLong_One): it makes range.index(a, 1) call 214 ns faster. I'm surprised that PyNumber_FloorDivide(a, 1) takes 214 ns. Does it spend most time in binary_op1()? Or PyNumber_FloorDivide()?

long_div(a, 1) is quite simple:

    CHECK_BINOP(a, b);

    if (Py_ABS(Py_SIZE(a)) == 1 && Py_ABS(Py_SIZE(b)) == 1) {
        return fast_floor_div((PyLongObject*)a, (PyLongObject*)b);

with:

static PyObject *
fast_floor_div(PyLongObject *a, PyLongObject *b)
{
    sdigit left = a->ob_digit[0];
    sdigit right = b->ob_digit[0];
    sdigit div;
    if (Py_SIZE(a) == Py_SIZE(b)) {
        div = left / right;
    }
    else {
        div = -1 - (left - 1) / right;
    }
    return PyLong_FromLong(div);
}

Do we need another fast-path in long_div(a, b) when b == _PyLong_One? Just return a in this case.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 10:56:12 2020
From: report at bugs.python.org (WoodyWoo)
Date: Thu, 01 Oct 2020 14:56:12 +0000
Subject: [issue41892] use both "for in" and "ElementTree.remove" has a index
 bug
In-Reply-To: <1601475625.07.0.195514916094.issue41892@roundup.psfhosted.org>
Message-ID: <1601564172.78.0.329069559868.issue41892@roundup.psfhosted.org>


WoodyWoo <saulmatchless at 163.com> added the comment:

Could I say the mutable sequence containing not the object but the pointer like C++.
So they can changed in def functions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41892>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:03:04 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 01 Oct 2020 15:03:04 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601564584.37.0.299780958242.issue41902@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

For practical use case

>>> a = range(-2, 10)
>>> a.index(2)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:08:15 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 01 Oct 2020 15:08:15 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1601564895.93.0.935293215897.issue1635741@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
nosy: +erlendaasland
nosy_count: 17.0 -> 18.0
pull_requests: +21497
pull_request: https://github.com/python/cpython/pull/22478

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:10:02 2020
From: report at bugs.python.org (Simon Cross)
Date: Thu, 01 Oct 2020 15:10:02 +0000
Subject: [issue41903] PyNumber_InPlacePower ignores o3 if o1 implements
 __ipow__
Message-ID: <1601565002.5.0.364385542307.issue41903@roundup.psfhosted.org>


New submission from Simon Cross <hodgestar at gmail.com>:

The documentation for PyNumber_InPlacePower [1] reads:

This is the equivalent of the Python statement o1 **= o2 when o3 is Py_None, or an in-place variant of pow(o1, o2, o3) otherwise. If o3 is to be ignored, pass Py_None in its place (passing NULL for o3 would cause an illegal memory access).

However, if a class A implements __ipow__ then PyNumber_InPlacePower(o1, o2, o3) ALWAYS ignores o3 if o1 is an instance of A.

This happens because if A implements __ipow__ then PyNumber_InPlacePower always calls the nb_inplace_power slot [2] and the slot always drops the third argument [3].

This appears to have always been the case in Python, so likely a small documentation patch is all that is required. If people agree, I will open a documentation pull request.

[1] https://docs.python.org/3/c-api/number.html?highlight=pynumber_inplacepower#c.PyNumber_InPlacePower

[2] https://github.com/python/cpython/blob/master/Objects/abstract.c#L1164

[3] https://github.com/python/cpython/blob/master/Objects/typeobject.c#L6631-L6636

----------
components: C API
messages: 377758
nosy: hodgestar
priority: normal
severity: normal
status: open
title: PyNumber_InPlacePower ignores o3 if o1 implements __ipow__
type: behavior
versions: Python 3.10, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41903>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:10:33 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 15:10:33 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601565033.15.0.942305418471.issue41902@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

About your benchmark, do you build Python with PGO+LTO optimizations? What is your OS and CPU? Do you use CPU isolation on Linux? It would be good to use PGO+LTO optimizations.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:14:53 2020
From: report at bugs.python.org (Simon Cross)
Date: Thu, 01 Oct 2020 15:14:53 +0000
Subject: [issue41903] PyNumber_InPlacePower ignores o3 if o1 implements
 __ipow__
In-Reply-To: <1601565002.5.0.364385542307.issue41903@roundup.psfhosted.org>
Message-ID: <1601565293.01.0.809559094065.issue41903@roundup.psfhosted.org>


Simon Cross <hodgestar at gmail.com> added the comment:

The documentation for __ipow__ [4] suggests that the intention was to support the modulus argument, so perhaps that argues for fixing the behaviour of PyNumber_InPlacePower.

[4] https://docs.python.org/3/reference/datamodel.html#object.__ipow__

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41903>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:20:21 2020
From: report at bugs.python.org (Ammar Askar)
Date: Thu, 01 Oct 2020 15:20:21 +0000
Subject: [issue41903] PyNumber_InPlacePower ignores o3 if o1 implements
 __ipow__
In-Reply-To: <1601565002.5.0.364385542307.issue41903@roundup.psfhosted.org>
Message-ID: <1601565621.5.0.925243435419.issue41903@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

Huh, this is weird. I wonder why the data model provides the signature

  object.__ipow__(self, other[, modulo])

if the slot always seems to drop the third argument.

Adding Brett to the nosy who found another issue around the special casing of pow/** recently. See also issue38302

----------
nosy: +ammar2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41903>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:20:28 2020
From: report at bugs.python.org (Ammar Askar)
Date: Thu, 01 Oct 2020 15:20:28 +0000
Subject: [issue41903] PyNumber_InPlacePower ignores o3 if o1 implements
 __ipow__
In-Reply-To: <1601565002.5.0.364385542307.issue41903@roundup.psfhosted.org>
Message-ID: <1601565628.36.0.859486248368.issue41903@roundup.psfhosted.org>


Change by Ammar Askar <ammar at ammaraskar.com>:


----------
nosy: +brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41903>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:25:42 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 01 Oct 2020 15:25:42 +0000
Subject: [issue41901] Added some explaining to pickle errors.
In-Reply-To: <1601554070.38.0.74604376475.issue41901@roundup.psfhosted.org>
Message-ID: <1601565942.84.0.592951683976.issue41901@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It was intentionally left a generic "cannot pickle 'type' object". Because there are many ways to make an object pickleable, and it is non-pickleable in all other cases.

* "missing `__getstate__()` on variable-length object"

It creates false impression that implementing __getstate__() is the only way to solve the problem. Actually you can make that object pickleable by:

- implementing __reduce__() or __reduce_ex__()
- implementing __getnewargs__() or __getnewargs_ex__()
- implementing __getstate__()
- make it a subclass of list or dict

So more correct error message should contain "missing __reduce__(), __reduce_ex__(), __getnewargs__(), __getnewargs_ex__() and __getstate__() on variable-length object which is not a list or dict". And even this is not completely correct, because it has __reduce__() and __reduce_ex__() inherited from class object, but it is not enough. Completely correct error message can be hundreds characters long.

And this still may be misleading error message, because the root cause is not that some object is not pickleable, but that you try to pickle an object which has an unexpected non-pickleable component.

* "basic size greater than expected"

Basic size is an implementation detail, and the end user can have no guess what is it. Actually it means that an object implemented in C likely has some inner state and the pickle module does not have access to it because the object does not implement __reduce__(), __reduce_ex__(), __getnewargs__(), __getnewargs_ex__() or __getstate__().

* "object has no `__new__()`"

Every object has __new__ at Python level, even if its tp_new slot is NULL. tp_new is the C implementation detail and should not be mentioned in the error message. And the object without tp_new still can be pickleable, if it implements __reduce__() or __reduce_ex__().

It is all too complicated. It is better to omit details in error messages than provide not correct and direct user in wrong way.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41901>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:34:14 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 01 Oct 2020 15:34:14 +0000
Subject: [issue41892] use both "for in" and "ElementTree.remove" has a index
 bug
In-Reply-To: <1601475625.07.0.195514916094.issue41892@roundup.psfhosted.org>
Message-ID: <1601566454.06.0.427697921166.issue41892@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I can't say how ElementTree works without more checking, but this solution cannot work in general. Given a pointer to an object that's in a list, how would you get to the next item? Say the parent list-like object has a C array of pointers to the objects it contains, and removing one of the objects re-shuffles that list. How would keeping a pointer to the current object help you?

In any event, I don't think this behavior is going to change.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41892>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:20:24 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 01 Oct 2020 15:20:24 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601565624.88.0.81511632755.issue41902@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

> do you build Python with PGO+LTO optimizations

Nope, but I will try to run the benchmark

> What is your OS and CPU? Do you use CPU isolation on Linux?

macOS, intel i9 with 8 cores

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:39:18 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 01 Oct 2020 15:39:18 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601566758.03.0.203599888584.issue41902@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

For the record with optimization

Mean +- std dev: [range_master] 112 ns +- 3 ns -> [range_opt] 99.3 ns +- 1.8 ns: 1.13x faster (-12%)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:46:29 2020
From: report at bugs.python.org (Ammar Askar)
Date: Thu, 01 Oct 2020 15:46:29 +0000
Subject: [issue41903] PyNumber_InPlacePower ignores o3 if o1 implements
 __ipow__
In-Reply-To: <1601565002.5.0.364385542307.issue41903@roundup.psfhosted.org>
Message-ID: <1601567189.61.0.292893652018.issue41903@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

Also of note, there is actually no way to call `PyNumber_InPlacePower` from pure python from what I can tell. Even libraries like numpy don't implement the three-argument version of the nb_inplace_power slot.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41903>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:48:52 2020
From: report at bugs.python.org (Ammar Askar)
Date: Thu, 01 Oct 2020 15:48:52 +0000
Subject: [issue41903] PyNumber_InPlacePower ignores o3 if o1 implements
 __ipow__
In-Reply-To: <1601565002.5.0.364385542307.issue41903@roundup.psfhosted.org>
Message-ID: <1601567332.1.0.676221940382.issue41903@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

Whoops, forgot the numpy link: https://github.com/numpy/numpy/blob/33e1dbee8d9e11a3e96efaae822ff6f3c44e3cef/numpy/core/src/multiarray/number.c#L729-L741

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41903>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:54:18 2020
From: report at bugs.python.org (Damian Yurzola)
Date: Thu, 01 Oct 2020 15:54:18 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
Message-ID: <1601567658.27.0.420109981563.issue41904@roundup.psfhosted.org>


New submission from Damian Yurzola <damian at yurzola.net>:

Last night I discovered we have datetime.datetime.today alongside
datetime.datetime.now and datetime.date.today.

- datetime.now
- date.today

Both make semantic sense.

datetime.datetime.today returns a datetime, which make no semantic sense and causes confusion.

On further inspection of the code, this is due to the fact that datetime inherits from date.

so datetime.today is practically an implementation of datetime.now minus the "tz".

I think we should implement a datetime.today only to rise an AttributeError or some other way to stop people from using the wrong semantic mental model.
We'd also need to remove the documentation entry: 
https://docs.python.org/3/library/datetime.html#datetime.datetime.today


>From this inspection we also find that:

datetime.hour/minute/second are unnecessarily redefined.
lines Lib/datetime.py#L1606 to datetime.py#L1620

could be removed without any ill effect.






date.today:
https://github.com/python/cpython/blob/256e54acdbdb26745d4bbb5cf366454151e42773/Lib/datetime.py#L833



https://docs.python.org/3/library/datetime.html#datetime.datetime.today

----------
components: Library (Lib)
messages: 377768
nosy: yurzo
priority: normal
severity: normal
status: open
title: datetime.datetime.today makes no sense and should be removed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:54:22 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 01 Oct 2020 15:54:22 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601567662.74.0.715701079452.issue41902@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
pull_requests: +21498
pull_request: https://github.com/python/cpython/pull/22480

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 11:54:52 2020
From: report at bugs.python.org (Ben Avrahami)
Date: Thu, 01 Oct 2020 15:54:52 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
Message-ID: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>


New submission from Ben Avrahami <avrahami.ben at gmail.com>:

python-ideas discussion:
https://mail.python.org/archives/list/python-ideas at python.org/thread/6BNJ3YSEBPHEPGXSAZGBW3TJ64ZGZIHE/

In order to allow "decorator mixins" (most notably dataclass and total_ordering) to implement ABCs, new functionality is needed. I propose a new python function in `abc.py` called `update_abstractmethods`. The function will accept a class and, if the class is an instance of ABCMeta, will update the class's `__abstractmethods__` attribute to not include implemented attributes, and to include new abstractmethods (proposed implementation in thread).

Both dataclass and total_ordering will be modified to call this function on the subject class before returning it, and 3rd-party libraries which implement mixin decorators (like attrs) will be to do the same.

Also, the function can be used as a decorator individually, this is especially useful in cases where 3rd party decorators do not call the function.

----------
components: Library (Lib)
messages: 377769
nosy: avrahami.ben
priority: normal
severity: normal
status: open
title: add update_abstractmethods function to update an ABC's abstract methods
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Thu Oct  1 12:03:05 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 01 Oct 2020 16:03:05 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601568185.59.0.797955107452.issue41905@roundup.psfhosted.org>


Change by Eric V. Smith <eric at trueblade.com>:


----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Thu Oct  1 12:21:43 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 01 Oct 2020 16:21:43 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601569303.06.0.577250978276.issue41902@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

PR 22479 and PR 22480 are different approaches.

I (and Victor) want to check which approach might be better.

PR 22480 would affect overall long division performance
PR 22479 assumes that step=1 case is very often (e.g range(100), range(-100, 100))

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 12:22:39 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Thu, 01 Oct 2020 16:22:39 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1601567658.27.0.420109981563.issue41904@roundup.psfhosted.org>
Message-ID: <1601569359.78.0.591823205606.issue41904@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Even if I agreed that this method "makes no sense", and I don't, removing it would be gratuitous breakage.

Why should we break potentially thousands of people's code who are happily using this method, merely because you say that people who use it have "the wrong semantic mental model"?

Considered as a datetime, having `today` return the date and time *now* makes good sense to me. Obviously the date components must be today's date, not yesterday or tomorrow; and the time component could be any arbitrary time, with the current time an obvious choice.

And since datetime inherits from date, it would be very odd if it didn't inherit the `today` method. It would also violate the Liskov Substitution Principle.

But even if you disagree with my opinions, you still have to justify breaking backwards compatibility.

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Thu Oct  1 12:22:44 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 16:22:44 +0000
Subject: [issue39337] codecs.lookup() ignores non-ASCII characters,
 whereas encodings.normalize_encoding() copies them
In-Reply-To: <1579038882.16.0.589810918272.issue39337@roundup.psfhosted.org>
Message-ID: <1601569364.79.0.392868243197.issue39337@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

See also bpo-37751 and my PR 17997.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39337>
_______________________________________

From report at bugs.python.org  Thu Oct  1 12:23:20 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 16:23:20 +0000
Subject: [issue39337] codecs.lookup() ignores non-ASCII characters,
 whereas encodings.normalize_encoding() copies them
In-Reply-To: <1579038882.16.0.589810918272.issue39337@roundup.psfhosted.org>
Message-ID: <1601569400.61.0.00609261923612.issue39337@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21499
pull_request: https://github.com/python/cpython/pull/17997

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39337>
_______________________________________

From report at bugs.python.org  Thu Oct  1 12:26:44 2020
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 01 Oct 2020 16:26:44 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601569604.6.0.641123320205.issue41902@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> Do we need another fast-path in long_div(a, b) when b == _PyLong_One? Just return a in this case.

I'd much prefer not. Every extra fast path check costs time for the general case, and there's no strong reason to expect people to be dividing by one. The range code seems like the right place for this optimization, not the long-divide code.

----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 12:30:18 2020
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 01 Oct 2020 16:30:18 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601569818.05.0.674184810173.issue26680@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:


New changeset 58a7da9e125422323f79c4ee95ac5549989d8162 by Robert Smallshire in branch 'master':
bpo-26680: Incorporate is_integer in all built-in and standard library numeric types (GH-6121)
https://github.com/python/cpython/commit/58a7da9e125422323f79c4ee95ac5549989d8162


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Thu Oct  1 12:31:55 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 16:31:55 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601569915.16.0.888413418947.issue41902@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Mark: "I'd much prefer not. Every extra fast path check costs time for the general case, and there's no strong reason to expect people to be dividing by one. The range code seems like the right place for this optimization, not the long-divide code."

In this case, I suggest to add a comment in long_div() to explain why there is no fast-path in long_div(). Otherwise, I am likely to suggest the exact same optimization in 6 months :-D

I'm thinking at something similar to my comment in ceval.c:

        case TARGET(BINARY_ADD): {
            PyObject *right = POP();
            PyObject *left = TOP();
            PyObject *sum;
            /* NOTE(haypo): Please don't try to micro-optimize int+int on
               CPython using bytecode, it is simply worthless.
               See http://bugs.python.org/issue21955 and
               http://bugs.python.org/issue10044 for the discussion. In short,
               no patch shown any impact on a realistic benchmark, only a minor
               speedup on microbenchmarks. */

This comment is the outcome of 2 years of hard work by many developers :-D See bpo-21955.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 12:34:12 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 16:34:12 +0000
Subject: [issue21955] ceval.c: implement fast path for integers with a single
 digit
In-Reply-To: <1405069827.92.0.324101531394.issue21955@psf.upfronthosting.co.za>
Message-ID: <1601570052.41.0.484236749321.issue21955@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21500
pull_request: https://github.com/python/cpython/pull/22481

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21955>
_______________________________________

From report at bugs.python.org  Thu Oct  1 12:37:28 2020
From: report at bugs.python.org (Damian Yurzola)
Date: Thu, 01 Oct 2020 16:37:28 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1601567658.27.0.420109981563.issue41904@roundup.psfhosted.org>
Message-ID: <1601570248.43.0.143406560443.issue41904@roundup.psfhosted.org>


Damian Yurzola <damian at yurzola.net> added the comment:

Thanks for your prompt answer Steven.

I was inspired to file this bug after reading through a multiplicity of bugs introduced by folks confused by the library's behavior. So there's good precedent.

While granted, the documentation is explicit and the inheritance chain substantiates it. There's nothing more explicit than the function/type names and saying datetime.today() brings, as you say, arbitrary time to the conversation. Which I claim, subjectively, that it should not.


Gratuitous breakage, is debatable. It would not be the first or last. It could be a chance to remove a lot of code that works around potentially incorrect mental models.

But since both points are to some extent subjective. I'm OK to have left this on the record and move on.


What do you say about the unnecessarily redefined properties?

Lines Lib/datetime.py#L1606 to datetime.py#L1620

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Thu Oct  1 12:57:44 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 16:57:44 +0000
Subject: [issue21955] ceval.c: implement fast path for integers with a single
 digit
In-Reply-To: <1405069827.92.0.324101531394.issue21955@psf.upfronthosting.co.za>
Message-ID: <1601571464.69.0.709066166451.issue21955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset bd0a08ea90e4c7a2ebf29697937e9786d4d8e5ee by Victor Stinner in branch 'master':
bpo-21955: Change my nickname in BINARY_ADD comment (GH-22481)
https://github.com/python/cpython/commit/bd0a08ea90e4c7a2ebf29697937e9786d4d8e5ee


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21955>
_______________________________________

From report at bugs.python.org  Thu Oct  1 12:59:20 2020
From: report at bugs.python.org (Marco Sulla)
Date: Thu, 01 Oct 2020 16:59:20 +0000
Subject: [issue41901] Added some explaining to pickle errors.
In-Reply-To: <1601554070.38.0.74604376475.issue41901@roundup.psfhosted.org>
Message-ID: <1601571560.01.0.221923447421.issue41901@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

I do not remember the problem I had, but when I experimented with frozendict I get one of these errors. I failed to understand the problem so I added the additional info.

Maybe adding an assert in debug mode? It will be visible only to devs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41901>
_______________________________________

From report at bugs.python.org  Thu Oct  1 14:24:11 2020
From: report at bugs.python.org (Carl Bordum Hansen)
Date: Thu, 01 Oct 2020 18:24:11 +0000
Subject: [issue29893] create_subprocess_exec doc doesn't match software
In-Reply-To: <1490332817.83.0.92510042207.issue29893@psf.upfronthosting.co.za>
Message-ID: <1601576651.61.0.144529526541.issue29893@roundup.psfhosted.org>


Carl Bordum Hansen <carl at bordum.dk> added the comment:

This was fixed in https://github.com/python/cpython/pull/12598

----------
nosy: +carlbordum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29893>
_______________________________________

From report at bugs.python.org  Thu Oct  1 14:38:14 2020
From: report at bugs.python.org (Carl Bordum Hansen)
Date: Thu, 01 Oct 2020 18:38:14 +0000
Subject: [issue29127] Incorrect reference names in asyncio.subprocess
 documentation
In-Reply-To: <1483238654.05.0.408550900872.issue29127@psf.upfronthosting.co.za>
Message-ID: <1601577494.9.0.836836603307.issue29127@roundup.psfhosted.org>


Carl Bordum Hansen <carl at bordum.dk> added the comment:

I do not think this is the case any longer

----------
nosy: +carlbordum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29127>
_______________________________________

From report at bugs.python.org  Thu Oct  1 15:37:51 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 01 Oct 2020 19:37:51 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1601581071.03.0.59741994622.issue40956@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +21501
pull_request: https://github.com/python/cpython/pull/22484

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Thu Oct  1 16:58:01 2020
From: report at bugs.python.org (Roundup Robot)
Date: Thu, 01 Oct 2020 20:58:01 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601585881.32.0.443585329749.issue41905@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 2.0 -> 3.0
pull_requests: +21502
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22485

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Thu Oct  1 17:16:16 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 21:16:16 +0000
Subject: [issue29893] create_subprocess_exec doc doesn't match software
In-Reply-To: <1490332817.83.0.92510042207.issue29893@psf.upfronthosting.co.za>
Message-ID: <1601586976.43.0.586633104326.issue29893@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> This was fixed in https://github.com/python/cpython/pull/12598

Right, thanks. I close the issue.

commit 1328375ad1c91f25a1500945a67b0ef36e387527
Author: Dima Tisnek <dimaqq at gmail.com>
Date:   Fri Apr 5 23:02:28 2019 +0900

    Fix doc for create_subprocess_exec (GH-12598)
    
    
    
    Add missing `program` argument to asyncio.create_subprocess_exec documentation.

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29893>
_______________________________________

From report at bugs.python.org  Thu Oct  1 17:57:39 2020
From: report at bugs.python.org (Ben Avrahami)
Date: Thu, 01 Oct 2020 21:57:39 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601589459.45.0.708209403316.issue41905@roundup.psfhosted.org>


Ben Avrahami <avrahami.ben at gmail.com> added the comment:

for the functionality to work, `total_ordering` needs to change to also override abstract methods. I believe this is an OK change since total_ordering implicitly dictates that the comparison methods are interchangable. Thus, implementing some comparison operators, but leaving others unchanged is undesired behaviour.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Thu Oct  1 18:36:47 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 22:36:47 +0000
Subject: [issue38605] [typing] PEP 563: Postponed evaluation of annotations:
 enable it by default in Python 3.10
In-Reply-To: <1572192430.43.0.755831692199.issue38605@roundup.psfhosted.org>
Message-ID: <1601591807.24.0.889399034862.issue38605@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Issue 41314 changed the __future__ annotations default version to 3.10.  3.10.0a1 is scheduled for next Oct 5, less than 2 months from now.  It would be good if PR 20434 were merged before that.

Python 3.9.0 final is also around the corner. Any update on this issue?

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38605>
_______________________________________

From report at bugs.python.org  Thu Oct  1 18:45:53 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 22:45:53 +0000
Subject: [issue41834] Remove _Py_CheckRecursionLimit variable
In-Reply-To: <1600778367.51.0.464121227135.issue41834@roundup.psfhosted.org>
Message-ID: <1601592353.41.0.430864457706.issue41834@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41834>
_______________________________________

From report at bugs.python.org  Thu Oct  1 18:58:56 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 22:58:56 +0000
Subject: [issue41692] Deprecate immortal interned strings:
 PyUnicode_InternImmortal()
In-Reply-To: <1599055165.93.0.874786911809.issue41692@roundup.psfhosted.org>
Message-ID: <1601593136.07.0.708325419323.issue41692@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +21503
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22486

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41692>
_______________________________________

From report at bugs.python.org  Thu Oct  1 19:00:06 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 23:00:06 +0000
Subject: [issue41692] Deprecate immortal interned strings:
 PyUnicode_InternImmortal()
In-Reply-To: <1599055165.93.0.874786911809.issue41692@roundup.psfhosted.org>
Message-ID: <1601593206.25.0.613140576811.issue41692@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I proposed PR 22486 to deprecate the function.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41692>
_______________________________________

From report at bugs.python.org  Thu Oct  1 19:08:20 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 01 Oct 2020 23:08:20 +0000
Subject: [issue17490] Improve ast.literal_eval test suite coverage
In-Reply-To: <1363746875.32.0.0832947039866.issue17490@psf.upfronthosting.co.za>
Message-ID: <1601593700.26.0.0586709091494.issue17490@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I agree that it's better to just close this issue, the patch is 7 years old.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17490>
_______________________________________

From report at bugs.python.org  Thu Oct  1 19:10:22 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Thu, 01 Oct 2020 23:10:22 +0000
Subject: [issue17490] Improve ast.literal_eval test suite coverage
In-Reply-To: <1363746875.32.0.0832947039866.issue17490@psf.upfronthosting.co.za>
Message-ID: <1601593822.99.0.991523178728.issue17490@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
keywords: +patch
pull_requests: +21504
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22469

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17490>
_______________________________________

From report at bugs.python.org  Thu Oct  1 19:17:11 2020
From: report at bugs.python.org (Ammar Askar)
Date: Thu, 01 Oct 2020 23:17:11 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601594231.29.0.612489957035.issue41902@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

Out of curiosity, what is the motivation for this optimization? 

Is there reason to believe that range.index is performed often enough that it's worth the extra code and maintenance cost here?

----------
nosy: +ammar2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Thu Oct  1 19:19:29 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 01 Oct 2020 23:19:29 +0000
Subject: [issue40455] GCC 10 compiler warnings
In-Reply-To: <1588279868.77.0.13865368461.issue40455@roundup.psfhosted.org>
Message-ID: <1601594369.07.0.953335674062.issue40455@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

There are still warnings on compile.c:
https://buildbot.python.org/all/#/builders/448/builds/130

Python/compile.c:5660:19: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=]
Python/compile.c:5660: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=]
Python/compile.c:5660: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=]

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40455>
_______________________________________

From report at bugs.python.org  Thu Oct  1 19:22:24 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 01 Oct 2020 23:22:24 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601594544.69.0.711716290413.issue41905@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Thu Oct  1 19:22:37 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 01 Oct 2020 23:22:37 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601594557.21.0.165656895023.issue41905@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Thu Oct  1 19:26:19 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 01 Oct 2020 23:26:19 +0000
Subject: [issue17490] Improve ast.literal_eval test suite coverage
In-Reply-To: <1363746875.32.0.0832947039866.issue17490@psf.upfronthosting.co.za>
Message-ID: <1601594779.82.0.0209637742523.issue17490@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Hm, I don't think PR 22469 is relevant to this issue?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17490>
_______________________________________

From report at bugs.python.org  Thu Oct  1 19:31:29 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Thu, 01 Oct 2020 23:31:29 +0000
Subject: [issue41613] get_type_hints regression for 3.9 and 3.10
In-Reply-To: <1598088602.53.0.71167650591.issue41613@roundup.psfhosted.org>
Message-ID: <1601595089.16.0.341626771326.issue41613@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

Commit 3ff51d425ecd98b7ba5a12ca9f77eda73fbf9f53 set the __builtins__ to None in namedtuple's creation, but the problem is that it is causing harm when the point came to the point of getting type hints on typing.NamedTuple.__new__ (we had a test about it), I'm changing that test (in the PR 20434) to work directly with the namedtuple itself instead of __new__ (since the annotations get proxied).

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41613>
_______________________________________

From report at bugs.python.org  Thu Oct  1 19:34:28 2020
From: report at bugs.python.org (Ethan Furman)
Date: Thu, 01 Oct 2020 23:34:28 +0000
Subject: [issue41889] enum: Mixin and int base class regression in 3.8.6
In-Reply-To: <1601439696.58.0.28102514399.issue41889@roundup.psfhosted.org>
Message-ID: <1601595268.76.0.466051455768.issue41889@roundup.psfhosted.org>


Change by Ethan Furman <ethan at stoneleaf.us>:


----------
keywords: +patch
pull_requests: +21505
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22487

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41889>
_______________________________________

From report at bugs.python.org  Thu Oct  1 19:35:19 2020
From: report at bugs.python.org (Ethan Furman)
Date: Thu, 01 Oct 2020 23:35:19 +0000
Subject: [issue41889] enum: Mixin and int base class regression in 3.8.6
In-Reply-To: <1601439696.58.0.28102514399.issue41889@roundup.psfhosted.org>
Message-ID: <1601595319.75.0.780663090455.issue41889@roundup.psfhosted.org>


Change by Ethan Furman <ethan at stoneleaf.us>:


----------
assignee:  -> ethan.furman

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41889>
_______________________________________

From report at bugs.python.org  Thu Oct  1 19:58:37 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 01 Oct 2020 23:58:37 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601596717.62.0.606999704601.issue41905@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

The downside of this proposal is that it is tightly coupled with class creation process.  It requires all existing class decorators, metaclasses, and code generators to start caring about something that isn't part of their core functionality (very few tools are ABC aware).

I'm usually dubious about proposed solutions to problems that 1) rarely occur in practice and 2) require everyone else to change their code.

Am not sure why total_ordering was mentioned?  No current collections ABC requires the ordering methods and hand-rolled numeric classes typically don't use total_ordering because it is simpler, faster, and cleaner to implement the methods directly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Thu Oct  1 20:10:28 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 02 Oct 2020 00:10:28 +0000
Subject: [issue41513] High accuracy math.hypot()
In-Reply-To: <1597022054.77.0.549983904563.issue41513@roundup.psfhosted.org>
Message-ID: <1601597428.98.0.470539445355.issue41513@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


Removed file: https://bugs.python.org/file49435/best_frac.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41513>
_______________________________________

From report at bugs.python.org  Thu Oct  1 20:19:15 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 02 Oct 2020 00:19:15 +0000
Subject: [issue41513] High accuracy math.hypot()
In-Reply-To: <1597022054.77.0.549983904563.issue41513@roundup.psfhosted.org>
Message-ID: <1601597955.84.0.832392949111.issue41513@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


Added file: https://bugs.python.org/file49484/best_frac.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41513>
_______________________________________

From report at bugs.python.org  Thu Oct  1 20:43:26 2020
From: report at bugs.python.org (raybb)
Date: Fri, 02 Oct 2020 00:43:26 +0000
Subject: [issue41906] logging.config.dictConfig does not work with callable
 filters
Message-ID: <1601599406.74.0.279190575587.issue41906@roundup.psfhosted.org>


New submission from raybb <rayz321z at gmail.com>:

According to the docs here (https://docs.python.org/3/library/logging.html):

"You don?t need to create specialized Filter classes, or use other classes with a filter method: you can use a function (or other callable) as a filter. The filtering logic will check to see if the filter object has a filter attribute: if it does, it?s assumed to be a Filter and its filter() method is called. Otherwise, it?s assumed to be a callable and called with the record as the single parameter."


If I use this code:

def noErrorLogs(param):
    return 1 if param.levelno < 40 else 0

logconfig_dict = {
    'filters': {
        'myfilter': {
            '()': noErrorLogs,
        }
    },
    "handlers": {
        "console": {
            "class": "logging.StreamHandler",
            "level": "DEBUG",
            "stream": "ext://sys.stdout",
            "filters": ["myfilter"]
        }
    },
    "root": {"level": "DEBUG", "handlers": ["console"]},
    "version": 1,
}
dictConfig(logconfig_dict)

I get the error "Unable to configure filter 'myfilter'" because "noErrorLogs() missing 1 required positional argument: 'param'"


However, If I use this code:


def noErrorLogs(param):
    return 1 if param.levelno < 40 else 0

logconfig_dict = {
    "handlers": {
        "console": {
            "class": "logging.StreamHandler",
            "level": "DEBUG",
            "stream": "ext://sys.stdout",
        }
    },
    "root": {"level": "DEBUG", "handlers": ["console"]},
    "version": 1,
}

logging.basicConfig()
dictConfig(logconfig_dict)
l = logging.getLogger()
l.handlers[0].addFilter(noErrorLogs)

Then the filter works correctly.




The bug I am reporting is that when using logging.config.dictConfig you cannot pass in a callable that acts a filter. You can only pass in a class with a filter method or a function that returns a callable filter.

If this is the expected behavior perhaps the docs should make it clear that callables cannot be used with dictConfig.

----------
messages: 377791
nosy: raybb
priority: normal
severity: normal
status: open
title: logging.config.dictConfig does not work with callable filters
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41906>
_______________________________________

From report at bugs.python.org  Thu Oct  1 21:00:11 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 02 Oct 2020 01:00:11 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1601570248.43.0.143406560443.issue41904@roundup.psfhosted.org>
Message-ID: <20201002005958.GO2186@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

On Thu, Oct 01, 2020 at 04:37:28PM +0000, Damian Yurzola wrote:
> I was inspired to file this bug after reading through a multiplicity 
> of bugs introduced by folks confused by the library's behavior.

Are these public bug reports or private anecdotes?

I'm not saying that the method cannot be deprecated or removed, but it 
needs to be justified. We don't break people's code gratuitiously, at 
least not intentionally. If you make a good enough case for deprecating 
the method, we can do so.

> What do you say about the unnecessarily redefined properties?
> 
> Lines Lib/datetime.py#L1606 to datetime.py#L1620

I don't know. Do all the tests still pass if you take them out?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Thu Oct  1 21:56:15 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 02 Oct 2020 01:56:15 +0000
Subject: [issue41906] logging.config.dictConfig does not work with callable
 filters
In-Reply-To: <1601599406.74.0.279190575587.issue41906@roundup.psfhosted.org>
Message-ID: <1601603775.71.0.243690295504.issue41906@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +vinay.sajip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41906>
_______________________________________

From report at bugs.python.org  Thu Oct  1 21:57:11 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 02 Oct 2020 01:57:11 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1601567658.27.0.420109981563.issue41904@roundup.psfhosted.org>
Message-ID: <1601603831.62.0.181198961878.issue41904@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +belopolsky, p-ganssle

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Thu Oct  1 22:38:10 2020
From: report at bugs.python.org (Roger Taylor)
Date: Fri, 02 Oct 2020 02:38:10 +0000
Subject: [issue41907] Regression in IntFlag behaviour in f-string
Message-ID: <1601606290.92.0.604621625655.issue41907@roundup.psfhosted.org>


New submission from Roger Taylor <roger.taylor.email at gmail.com>:

An IntFlag member before 3.8.6 was converted to an integer in an f-string. After 3.8.6, the textual IntFlag class and member name are placed in the interpolated f-string instead of the integer.

3.8.3: f"... {X.F} ..." where X.F = 1 << 4 will give "... 16 ..."
3.8.5: Same
3.8.6: f"... {X.F} ..." where X.F = 1 << 4 will give "... X.F ..."

I have reproduced this on Linux using the version compiled and installed by pyenv, and on Windows using the 32-bit versions from the downloadable standalone installer.

Now I have to locate and go through all my SQL statements and verify that they explicitly convert IntFlag values to integer to avoid the errors introduced by this regression.

----------
components: Interpreter Core
messages: 377793
nosy: rt121212121
priority: normal
severity: normal
status: open
title: Regression in IntFlag behaviour in f-string
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41907>
_______________________________________

From report at bugs.python.org  Thu Oct  1 22:48:15 2020
From: report at bugs.python.org (mohamed koubaa)
Date: Fri, 02 Oct 2020 02:48:15 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1601606895.65.0.94813080512.issue1635741@roundup.psfhosted.org>


Change by mohamed koubaa <koubaa.m at gmail.com>:


----------
pull_requests: +21506
pull_request: https://github.com/python/cpython/pull/22489

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Thu Oct  1 23:06:24 2020
From: report at bugs.python.org (mohamed koubaa)
Date: Fri, 02 Oct 2020 03:06:24 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1601607984.59.0.438724522551.issue1635741@roundup.psfhosted.org>


Change by mohamed koubaa <koubaa.m at gmail.com>:


----------
pull_requests: +21507
pull_request: https://github.com/python/cpython/pull/22490

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Thu Oct  1 23:50:52 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 02 Oct 2020 03:50:52 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601610652.05.0.593917881258.issue41902@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

> s there reason to believe that range.index is performed often enough that it's worth the extra code and maintenance cost here?

There are at least 3 reasons
1. pointer comparaition optimization quite common usecase in CPython codebase. e.x) list.count
2. if you create the range object, step = 1 which is singleton object is quite high percentage use case.
   - range(100) -> step = 1
   - range(-100, 100) -> step =1
   - range(-100, 100, 2) -> step != 1
3. fast path code does not cost high difficulty maintainence for this case but can bring 12% performance enhancement.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Fri Oct  2 00:10:30 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 02 Oct 2020 04:10:30 +0000
Subject: [issue41907] Regression in IntFlag behaviour in f-string
In-Reply-To: <1601606290.92.0.604621625655.issue41907@roundup.psfhosted.org>
Message-ID: <1601611830.52.0.818439394072.issue41907@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +barry, eli.bendersky, ethan.furman

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41907>
_______________________________________

From report at bugs.python.org  Fri Oct  2 00:23:54 2020
From: report at bugs.python.org (Justin Arthur)
Date: Fri, 02 Oct 2020 04:23:54 +0000
Subject: [issue33533] Provide an async-generator version of as_completed
In-Reply-To: <1526453333.0.0.682650639539.issue33533@psf.upfronthosting.co.za>
Message-ID: <1601612634.29.0.599835723193.issue33533@roundup.psfhosted.org>


Change by Justin Arthur <justinarthur at gmail.com>:


----------
nosy: +JustinTArthur
nosy_count: 5.0 -> 6.0
pull_requests: +21508
pull_request: https://github.com/python/cpython/pull/22491

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33533>
_______________________________________

From report at bugs.python.org  Fri Oct  2 00:27:17 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 02 Oct 2020 04:27:17 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601612837.7.0.791104970863.issue41902@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

I found another optimal case and this looks more practical usecase than range.index

----------
Added file: https://bugs.python.org/file49485/bench_range_compute_item.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Fri Oct  2 00:27:31 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 02 Oct 2020 04:27:31 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601612851.96.0.203191153438.issue41902@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

Mean +- std dev: [master-compute] 317 ns +- 3 ns -> [bpo-41902-compute] 287 ns +- 6 ns: 1.11x faster (-10%)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Fri Oct  2 00:33:45 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 02 Oct 2020 04:33:45 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601613225.17.0.998086348748.issue41902@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
pull_requests: +21509
pull_request: https://github.com/python/cpython/pull/22492

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Fri Oct  2 00:36:27 2020
From: report at bugs.python.org (Justin Arthur)
Date: Fri, 02 Oct 2020 04:36:27 +0000
Subject: [issue33533] Provide an async-generator version of as_completed
In-Reply-To: <1526453333.0.0.682650639539.issue33533@psf.upfronthosting.co.za>
Message-ID: <1601613387.49.0.976088889713.issue33533@roundup.psfhosted.org>


Justin Arthur <justinarthur at gmail.com> added the comment:

I've added a new PR, PR 22491. This one has as_completed returning an iterator and includes tests for both the old and new style.

I see a trivial amount of latency added in extra call stack over Guido's original implementation. Should we decide to deprecate the plain-iterator-of-awaitables form, we can possibly regain that latency in refactoring this as an asynchronous generator.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33533>
_______________________________________

From report at bugs.python.org  Fri Oct  2 00:52:07 2020
From: report at bugs.python.org (Justin Arthur)
Date: Fri, 02 Oct 2020 04:52:07 +0000
Subject: [issue38032] lib2to3 doesn't parse Python 3 identifiers containing
 non-spacing marks
In-Reply-To: <1567639302.72.0.55214965787.issue38032@roundup.psfhosted.org>
Message-ID: <1601614327.74.0.921085262348.issue38032@roundup.psfhosted.org>


Justin Arthur <justinarthur at gmail.com> added the comment:

Not sure if there is consensus on how to fix, but fixing #12731 will fix this for most of the cases I've seen complaints about as a side effect.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38032>
_______________________________________

From report at bugs.python.org  Fri Oct  2 02:55:18 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 02 Oct 2020 06:55:18 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601621718.06.0.62278450135.issue41902@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

@vstinner @pablo @mark

On my local machine (without cpu isolation),
PR 22480 does not affect performance issues.

import pyperf

runner = pyperf.Runner()
runner.timeit(name="bench long divide",
              stmt="""
for i in range(1, 256):
    a = 10000 // i
""")

but I think that my benchmark does not cover the worst case.

I need to set up the CPU isolation environment but my resource is limited.
(I need a Linux machine with sufficient permission but not)


PR 22479 and PR 22480 has two sides of assumption.

PR 22479: PyNumber_FloorDivide is a heavy operation if the user thinks that this is an unnecessary operation it should be avoided.
(In this case divide by one)
PR 22480: PyNumber_FloorDivide should process handle unnecessary operations smartly.


In conclusion, I'd like to +1 on mark's decision.
- PR 22480: even though the divisor value is one, if the dividend is not qualified from PyLong_CheckExact it will not get an optimization path.
So it will not cover all the 'divide by one' case and it can cause performance issues.
- PR 22480: Always optimized if the user does not set a specific step value and this will be same effect on PR 22492.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Fri Oct  2 02:56:53 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 02 Oct 2020 06:56:53 +0000
Subject: [issue17490] Improve ast.literal_eval test suite coverage
In-Reply-To: <1363746875.32.0.0832947039866.issue17490@psf.upfronthosting.co.za>
Message-ID: <1601621813.43.0.0704351660802.issue17490@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests:  -21504

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17490>
_______________________________________

From report at bugs.python.org  Fri Oct  2 02:57:20 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 02 Oct 2020 06:57:20 +0000
Subject: [issue17490] Improve ast.literal_eval test suite coverage
In-Reply-To: <1363746875.32.0.0832947039866.issue17490@psf.upfronthosting.co.za>
Message-ID: <1601621840.16.0.721871442352.issue17490@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17490>
_______________________________________

From report at bugs.python.org  Fri Oct  2 03:19:22 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Fri, 02 Oct 2020 07:19:22 +0000
Subject: [issue41906] logging.config.dictConfig does not work with callable
 filters
In-Reply-To: <1601599406.74.0.279190575587.issue41906@roundup.psfhosted.org>
Message-ID: <1601623162.75.0.198575736701.issue41906@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

The value of the '()' key should be a factory - something that returns a filter (either something that has a filter method or a callable). That returned callable, or the filter method, will be called with a LogRecord and its return value used to determine whether the event should be processed. An example of using factories is here:

https://docs.python.org/3/library/logging.config.html#user-defined-objects

In your first example, you're passing the filter where you need to pass the factory. If you change it to e.g. return a lambda that does the filtering, it should work as expected.

At the moment you can't directly pass a filter callable in the config dictionary - only a factory that returns a filter. I'll look at this as a possible enhancement.

----------
type: behavior -> enhancement
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41906>
_______________________________________

From report at bugs.python.org  Fri Oct  2 03:26:47 2020
From: report at bugs.python.org (Kyle Stanley)
Date: Fri, 02 Oct 2020 07:26:47 +0000
Subject: [issue29127] Incorrect reference names in asyncio.subprocess
 documentation
In-Reply-To: <1483238654.05.0.408550900872.issue29127@psf.upfronthosting.co.za>
Message-ID: <1601623607.25.0.107813167135.issue29127@roundup.psfhosted.org>


Kyle Stanley <aeros167 at gmail.com> added the comment:

I can confirm that both on the latest version of the docs (for 3.8) and for the version mentioned in the issue (3.6), the issue mentioned with asyncio.subprocess.PIPE is no longer present. (It was likely fixed in the asyncio documentation overhaul that happened within the last couple of years).

As a result, I'll proceed with closing this issue. Thanks for checking, Carl.

----------
nosy: +aeros
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29127>
_______________________________________

From report at bugs.python.org  Fri Oct  2 03:55:44 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Fri, 02 Oct 2020 07:55:44 +0000
Subject: [issue41907] Regression in IntFlag behaviour in f-string
In-Reply-To: <1601606290.92.0.604621625655.issue41907@roundup.psfhosted.org>
Message-ID: <1601625344.67.0.158923777752.issue41907@roundup.psfhosted.org>


Change by Eric V. Smith <eric at trueblade.com>:


----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41907>
_______________________________________

From report at bugs.python.org  Fri Oct  2 04:04:15 2020
From: report at bugs.python.org (Ben Avrahami)
Date: Fri, 02 Oct 2020 08:04:15 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601625855.15.0.293911522345.issue41905@roundup.psfhosted.org>


Ben Avrahami <avrahami.ben at gmail.com> added the comment:

Good points all, that I will try to address one by one:

Firstly, this function is by no means mandatory for "post-creation mixins". Such tools can still be used without calling it (and remain ABC unaware), with absolutely no change in functionality. Indeed, the function itself can be used as a decorator for just such cases, where a tool is ABC unaware (either from deciding that ABC aren't a use case for them, or from simply not considering that possibility), but the user wants to also subclass an ABC. The problem is that, right now, post-creation tools simply can't be ABC aware.

The thought that few tools are ABC aware is not, I think, a good reason to neglect tools that would like to be. Just as dispatch and type-routing tools might not be ABC aware to use `abc.get_cache_token()`, but it is still added for tools that want to be ABC aware and sidestep this confusing behavior.

As for not occurring in practice: a simple github search reveals many instances of comparison operators being abstract, and while likely few of them likely use dataclasses, that is a possibility that I believe should be addressed (of course, we could decide that this is desired behavior, and scrap this whole issue).

Finally, total_ordering: I originally added it to the issue because it was the other decorator mixin in the standard library, after I rand into this behavior using dataclasses. If total_ordering proves to be a barrier, we can remove it from the PR (and perhaps re-introduce it later if that is deemed necessary). I will only remark that I find total_ordering used in many hand-rolled classes where users would sacrifice some performance for cleaner code and an assertion that total order is enforced.

Sorry for the scroll and thanks for the scrutiny :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Fri Oct  2 04:14:04 2020
From: report at bugs.python.org (=?utf-8?b?SHJ2b2plIE5pa8WhacSH?=)
Date: Fri, 02 Oct 2020 08:14:04 +0000
Subject: [issue33533] Provide an async-generator version of as_completed
In-Reply-To: <1526453333.0.0.682650639539.issue33533@psf.upfronthosting.co.za>
Message-ID: <1601626444.8.0.534158867978.issue33533@roundup.psfhosted.org>


Hrvoje Nik?i? <hniksic at gmail.com> added the comment:

Hi, thanks for providing a PR. One thing I noticed is that the implementation in the PR yields results of the futures from the generator. This issue proposes a generator that instead yields the futures passed to as_completed. This is needed not just for consistency with concurrent.futures.as_completed, but also to allow associating results with the requests that produced them, which is an important use case for as_completed.

An example of how this is useful is the snippet at https://docs.python.org/3/library/concurrent.futures.html#threadpoolexecutor-example which you cannot implement with an as_completed that doesn't yield the original futures. The StackOverflow question at [1] inquires about that issue, and would be easily resolved by yielding the futures as concurrent.futures.as_completed does.

As far as I can tell, the needed change is simple: just yield `f` instead of `f.result()` from `_wait_for_one` when invoked from __anext__. (It must still return f.result() when called from __next__ for backward compatibility.)

[1] https://stackoverflow.com/questions/50028465/python-get-reference-to-original-task-after-ordering-tasks-by-completion

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33533>
_______________________________________

From report at bugs.python.org  Fri Oct  2 04:46:48 2020
From: report at bugs.python.org (Dominic Davis-Foster)
Date: Fri, 02 Oct 2020 08:46:48 +0000
Subject: [issue41907] Regression in IntFlag behaviour in f-string
In-Reply-To: <1601606290.92.0.604621625655.issue41907@roundup.psfhosted.org>
Message-ID: <1601628408.68.0.607597676952.issue41907@roundup.psfhosted.org>


Dominic Davis-Foster <dom1310df at googlemail.com> added the comment:

I believe the regression is due to GH-14545 which "fixed" bpo-37479. The news entry states:

"When `Enum.__str__` is overridden in a derived class, the override will be used by `Enum.__format__` regardless of whether mixin classes are present."

.

The change is in the __format__ method of Enum. It now checks if type(self).__str__ != Enum.__str__ and if True calls str(self). Because Flag defines its own __str__ method, the expression evaluates to True. I do not think this is the indented behaviour.

In 3.8.5 str(self) was only called if _member_type_ is object.

----------
nosy: +dom1310df

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41907>
_______________________________________

From report at bugs.python.org  Fri Oct  2 05:56:26 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 02 Oct 2020 09:56:26 +0000
Subject: [issue41908] Make IDLE Start Menu entry more descriptive
Message-ID: <1601632586.45.0.38147245228.issue41908@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

A current python-list thread "Problem" is about the difficulties beginners have getting started immediately after installation.  I believe it started with another beginner asking about getting the modify/repair note.  One other thing that came up is that "IDLE", by itself, means nothing to someone who does not know what it is.  So one suggestion was to replace the current
  IDLE (Python 3.9 64 bit)
with something more descriptive.

The current longest entry is
  Python 3.9 Module Docs (64-bit)
which appears to be about as long as possible that fits in the space allowed without being truncated with ... (like "Microsoft Visual Studio 2010 Express").  (The font is proportional, I believe, so a char count does not give an exact measure.)

I propose a new entry for IDLE that is slightly shorter that the apparent maximum.
  IDLE Shell-Editor (3.9 64-bit)

The menu entry is also the initial filename for a desktop shortcut.  For me, after editing is complete, it displays as either


    IDLE
Shell-Edit...
(inactive, 2 lines only) or

  IDLE
Shell-Editor
(3.9 64-bit)
(active, full 3 lines)

I checked that the future '3.10' will not cause a problem.
The popup shortcut comment
"Launches IDLE, the interactive environment for Python 3.9."
nicely complements the proposed title, tying 'IDLE' to 'Python'.
For a taskbar icon, the menu entry is the popup description.
---

macOS: The equivalent of 'Python 3.9' on the start menu is the 'Python 3.9' folder in Finder.  The equivalent of the 'IDLE (Python 3.9 64 bit)' entry is the Python app icon labelled simply 'IDLE' for the IDLE.app startup file. Ned, what would you think of the longer name "IDLE Shell-Editor.app'?  (And maybe add 3.9 somewhere -- I have 3.8 and 3.9 loaded and on the (taskbar) I only know which is which by position.)

----------
assignee: terry.reedy
components: IDLE, Installation, Windows
messages: 377805
nosy: ned.deily, paul.moore, steve.dower, terry.reedy, tim.golden, zach.ware
priority: normal
severity: normal
stage: needs patch
status: open
title: Make IDLE Start Menu entry more descriptive
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41908>
_______________________________________

From report at bugs.python.org  Fri Oct  2 06:19:34 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 02 Oct 2020 10:19:34 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601633974.31.0.885155620296.issue41902@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I would need to carefully look at the PRs to estimate the maintenance cost, but it seems to me initially that all these operations happen very rarely in regular code and probably will have no impact on macro benchmarks. In general, I dislike branches because they quickly can become the source of slight different semantics.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Fri Oct  2 06:49:51 2020
From: report at bugs.python.org (Ran Benita)
Date: Fri, 02 Oct 2020 10:49:51 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
Message-ID: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>


New submission from Ran Benita <ran at unusedvar.com>:

The following program crashes with a segfault:

class Segfault:
    def __getattr__(self, name):
        self.unknown_attribute

instance = Segfault()
issubclass(instance, int)  # int doesn't matter

Tested with Python 3.7, 3.8, 3.9rc2, and master in debug mode (commit 497126f7ea955ee005e78f2cdd61f175d4fcdbb2).

The program is odd, but this affects pytest (see https://github.com/pytest-dev/pytest/issues/2330).
The class is buggy user code, pytest does the issubclass check.
In pytest there are other code paths which trigger it besides issubclass, but that's the one I am able to quickly reproduce standalone.

Here is the backtrace with python master:

ran at ran:~/src/cpython$ gdb --args ./python segfault.py
Reading symbols from ./python...
(gdb) r
Starting program: /home/ran/src/cpython/python segfault.py

Program received signal SIGSEGV, Segmentation fault.
0x00005555556bc55e in PyGILState_Check () at Python/pystate.c:1353
1353	    if (!PyThread_tss_is_created(&gilstate->autoTSSkey)) {


(gdb) bt 29
#0  0x00005555556bc55e in PyGILState_Check () at Python/pystate.c:1353
#1  0x00005555555fc117 in _PyMem_DebugCheckGIL (func=0x55555581b330 <__func__.10> "_PyMem_DebugMalloc") at Objects/obmalloc.c:2329
#2  _PyMem_DebugMalloc (ctx=0x55555593b140 <_PyMem_Debug+96>, nbytes=185) at Objects/obmalloc.c:2329
#3  0x00005555555fcee8 in PyObject_Malloc (size=<optimized out>) at Objects/obmalloc.c:685
#4  0x000055555562d6f3 in PyUnicode_New (size=136, maxchar=<optimized out>) at Objects/unicodeobject.c:1455
#5  0x00005555556556e7 in _PyUnicodeWriter_PrepareInternal (writer=writer at entry=0x7fffff7ff0c0, length=length at entry=1, maxchar=<optimized out>, maxchar at entry=127)
    at Objects/unicodeobject.c:14004
#6  0x0000555555658439 in _PyUnicodeWriter_WriteASCIIString (writer=writer at entry=0x7fffff7ff0c0, ascii=ascii at entry=0x5555558196c8 "'%.50s' object has no attribute '%U'", 
    len=1) at Objects/unicodeobject.c:14174
#7  0x000055555565a18d in PyUnicode_FromFormatV (format=format at entry=0x5555558196c8 "'%.50s' object has no attribute '%U'", vargs=vargs at entry=0x7fffff7ff170)
    at Objects/unicodeobject.c:3114
#8  0x000055555569646b in _PyErr_FormatV (tstate=0x5555559aa300, exception=<type at remote 0x555555932040>, 
    format=format at entry=0x5555558196c8 "'%.50s' object has no attribute '%U'", vargs=vargs at entry=0x7fffff7ff170) at Python/errors.c:1029
#9  0x0000555555696ff3 in PyErr_Format (exception=<optimized out>, format=format at entry=0x5555558196c8 "'%.50s' object has no attribute '%U'") at Python/errors.c:1071
#10 0x00005555555fa4a5 in _PyObject_GenericGetAttrWithDict (obj=obj at entry=<Segfault at remote 0x7ffff772dd70>, name=name at entry='unknown_attribute', dict=<optimized out>, 
    dict at entry=0x0, suppress=suppress at entry=0) at Objects/object.c:1268
#11 0x00005555555fa96f in PyObject_GenericGetAttr (obj=obj at entry=<Segfault at remote 0x7ffff772dd70>, name=name at entry='unknown_attribute') at Objects/object.c:1281
#12 0x000055555561c3f8 in slot_tp_getattr_hook (self=<Segfault at remote 0x7ffff772dd70>, name='unknown_attribute') at Objects/typeobject.c:6805
#13 0x00005555555f68c2 in PyObject_GetAttr (v=v at entry=<Segfault at remote 0x7ffff772dd70>, name=<optimized out>) at Objects/object.c:891
#14 0x000055555567c254 in _PyEval_EvalFrameDefault (tstate=0x5555559aa300, 
    f=Frame 0x7ffff71cc3b0, for file /home/ran/src/cpython/segfault.py, line 3, in __getattr__ (self=<Segfault at remote 0x7ffff772dd70>, name='unknown_attribute'), 
    throwflag=<optimized out>) at Python/ceval.c:3036
#15 0x00005555555b9d1d in _PyEval_EvalFrame (throwflag=0, 
    f=Frame 0x7ffff71cc3b0, for file /home/ran/src/cpython/segfault.py, line 3, in __getattr__ (self=<Segfault at remote 0x7ffff772dd70>, name='unknown_attribute'), 
    tstate=0x5555559aa300) at ./Include/internal/pycore_ceval.h:40
#16 function_code_fastcall (tstate=0x5555559aa300, co=<optimized out>, args=0x7fffff7ff590, nargs=2, globals=<optimized out>) at Objects/call.c:329
#17 0x00005555555ba67b in _PyFunction_Vectorcall (func=<optimized out>, stack=<optimized out>, nargsf=<optimized out>, kwnames=<optimized out>) at Objects/call.c:366
#18 0x000055555576c2d4 in _PyObject_VectorcallTstate (tstate=0x5555559aa300, callable=<function at remote 0x7ffff773c4b0>, args=0x7fffff7ff580, nargsf=2, kwnames=0x0)
    at ./Include/cpython/abstract.h:114
#19 0x000055555576cb87 in method_vectorcall (method=<optimized out>, args=0x7fffff7ff588, nargsf=<optimized out>, kwnames=0x0) at Objects/classobject.c:53
#20 0x00005555556109ac in _PyObject_VectorcallTstate (kwnames=0x0, nargsf=9223372036854775809, args=0x7fffff7ff588, callable=<method at remote 0x7ffff71c8c50>, 
    tstate=0x5555559aa300) at ./Include/cpython/abstract.h:114
#21 PyObject_CallOneArg (arg='unknown_attribute', func=<method at remote 0x7ffff71c8c50>) at ./Include/cpython/abstract.h:184
#22 call_attribute (self=self at entry=<Segfault at remote 0x7ffff772dd70>, attr=<method at remote 0x7ffff71c8c50>, attr at entry=<function at remote 0x7ffff773c4b0>, 
    name=name at entry='unknown_attribute') at Objects/typeobject.c:6771
#23 0x000055555561c44a in slot_tp_getattr_hook (self=<Segfault at remote 0x7ffff772dd70>, name='unknown_attribute') at Objects/typeobject.c:6813
#24 0x00005555555f68c2 in PyObject_GetAttr (v=v at entry=<Segfault at remote 0x7ffff772dd70>, name=<optimized out>) at Objects/object.c:891
#25 0x000055555567c254 in _PyEval_EvalFrameDefault (tstate=0x5555559aa300, 
    f=Frame 0x7ffff71cc200, for file /home/ran/src/cpython/segfault.py, line 3, in __getattr__ (self=<Segfault at remote 0x7ffff772dd70>, name='unknown_attribute'), 
    throwflag=<optimized out>) at Python/ceval.c:3036
#26 0x00005555555b9d1d in _PyEval_EvalFrame (throwflag=0, 
    f=Frame 0x7ffff71cc200, for file /home/ran/src/cpython/segfault.py, line 3, in __getattr__ (self=<Segfault at remote 0x7ffff772dd70>, name='unknown_attribute'), 
    tstate=0x5555559aa300) at ./Include/internal/pycore_ceval.h:40
#27 function_code_fastcall (tstate=0x5555559aa300, co=<optimized out>, args=0x7fffff7ff8b0, nargs=2, globals=<optimized out>) at Objects/call.c:329
#28 0x00005555555ba67b in _PyFunction_Vectorcall (func=<optimized out>, stack=<optimized out>, nargsf=<optimized out>, kwnames=<optimized out>) at Objects/call.c:366
(More stack frames follow...)



(gdb) py-bt
Traceback (most recent call first):
  File "/home/ran/src/cpython/segfault.py", line 3, in __getattr__
    self.unknown_attribute
  File "/home/ran/src/cpython/segfault.py", line 3, in __getattr__
    self.unknown_attribute
  File "/home/ran/src/cpython/segfault.py", line 3, in __getattr__
    self.unknown_attribute
  File "/home/ran/src/cpython/segfault.py", line 3, in __getattr__
    self.unknown_attribute
  File "/home/ran/src/cpython/segfault.py", line 3, in __getattr__
    self.unknown_attribute
  File "/home/ran/src/cpython/segfault.py", line 3, in __getattr__
    self.unknown_attribute
  File "/home/ran/src/cpython/segfault.py", line 3, in __getattr__
    self.unknown_attribute
  File "/home/ran/src/cpython/segfault.py", line 3, in __getattr__
    self.unknown_attribute
--Type <RET> for more, q to quit, c to continue without paging--q

----------
components: Interpreter Core
messages: 377807
nosy: bluetech
priority: normal
severity: normal
status: open
title: Segfault on __getattr__ infinite recursion on certain attribute accesses

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Fri Oct  2 06:58:24 2020
From: report at bugs.python.org (Ran Benita)
Date: Fri, 02 Oct 2020 10:58:24 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601636304.33.0.746312922568.issue41909@roundup.psfhosted.org>


Change by Ran Benita <ran at unusedvar.com>:


----------
type:  -> crash

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Fri Oct  2 08:49:08 2020
From: report at bugs.python.org (Roundup Robot)
Date: Fri, 02 Oct 2020 12:49:08 +0000
Subject: [issue40643] Improve doc-strings for datetime.strftime & strptime
In-Reply-To: <1589628564.12.0.439754688359.issue40643@roundup.psfhosted.org>
Message-ID: <1601642948.26.0.839665978108.issue40643@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
pull_requests: +21510
pull_request: https://github.com/python/cpython/pull/22477

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40643>
_______________________________________

From report at bugs.python.org  Fri Oct  2 08:49:08 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 02 Oct 2020 12:49:08 +0000
Subject: [issue41692] Deprecate immortal interned strings:
 PyUnicode_InternImmortal()
In-Reply-To: <1599055165.93.0.874786911809.issue41692@roundup.psfhosted.org>
Message-ID: <1601642948.43.0.516064645638.issue41692@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 583ee5a5b1971a18ebeb877948ce6264da0cc8aa by Victor Stinner in branch 'master':
bpo-41692: Deprecate PyUnicode_InternImmortal() (GH-22486)
https://github.com/python/cpython/commit/583ee5a5b1971a18ebeb877948ce6264da0cc8aa


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41692>
_______________________________________

From report at bugs.python.org  Fri Oct  2 08:49:27 2020
From: report at bugs.python.org (Florian Bruhin)
Date: Fri, 02 Oct 2020 12:49:27 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601642967.78.0.203337503845.issue41909@roundup.psfhosted.org>


Change by Florian Bruhin <python.org at the-compiler.org>:


----------
nosy: +The Compiler

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Fri Oct  2 08:49:46 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 02 Oct 2020 12:49:46 +0000
Subject: [issue41692] Deprecate immortal interned strings:
 PyUnicode_InternImmortal()
In-Reply-To: <1599055165.93.0.874786911809.issue41692@roundup.psfhosted.org>
Message-ID: <1601642986.9.0.353293366207.issue41692@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The function is now deprecated. Thanks for the review INADA-san, I close the issue. Let's meet in Python 3.12 to remove it ;-)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41692>
_______________________________________

From report at bugs.python.org  Fri Oct  2 09:56:19 2020
From: report at bugs.python.org (Ethan Furman)
Date: Fri, 02 Oct 2020 13:56:19 +0000
Subject: [issue41907] Regression in IntFlag behaviour in f-string
In-Reply-To: <1601606290.92.0.604621625655.issue41907@roundup.psfhosted.org>
Message-ID: <1601646979.07.0.193114236405.issue41907@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:

Thank you for the bug report.

Another solution would be to subclass IntFlag and specify the `__format__` method:


    from enum import IntFlag as _IntFlag
    class IntFlag(_IntFlag):
        def __format__(self, spec):
            return format(self.value, spec)

----------
assignee:  -> ethan.furman
stage:  -> needs patch
versions: +Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41907>
_______________________________________

From report at bugs.python.org  Fri Oct  2 10:05:36 2020
From: report at bugs.python.org (Tal Einat)
Date: Fri, 02 Oct 2020 14:05:36 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1601647536.61.0.0600527346783.issue41894@roundup.psfhosted.org>


Change by Tal Einat <taleinat+python at gmail.com>:


----------
versions:  -Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Fri Oct  2 10:19:40 2020
From: report at bugs.python.org (Joshua Bronson)
Date: Fri, 02 Oct 2020 14:19:40 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1601648380.23.0.462866375064.issue7946@roundup.psfhosted.org>


Change by Joshua Bronson <jabronson at gmail.com>:


----------
nosy: +jab

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Fri Oct  2 10:34:37 2020
From: report at bugs.python.org (=?utf-8?b?TMOhc3psw7MgS2lzcyBLb2xsw6Fy?=)
Date: Fri, 02 Oct 2020 14:34:37 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601649277.84.0.666739491467.issue41490@roundup.psfhosted.org>


L?szl? Kiss Koll?r <kiss.kollar.laszlo at gmail.com> added the comment:

pip 20.2.1 contains a regression which breaks `--system-site-package` integration: https://github.com/pypa/pip/issues/8695. It would be nice to include the latest patch version (20.2.3 at the moment) which fixes this and a few other issues.

----------
nosy: +lkollar

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Fri Oct  2 10:42:46 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 02 Oct 2020 14:42:46 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601649766.64.0.74479063775.issue41490@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I think that the backport to 3.8 may have some unintended consequences in the last patch release as venv created with 3.8 now exhibit the pip regression (https://github.com/pypa/pip/issues/8695.).

Steve, would you be ok if we bump all branches (master, 3.9 and 3.8) to 20.2.3?

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Fri Oct  2 10:55:50 2020
From: report at bugs.python.org (raybb)
Date: Fri, 02 Oct 2020 14:55:50 +0000
Subject: [issue41906] logging.config.dictConfig does not work with callable
 filters
In-Reply-To: <1601599406.74.0.279190575587.issue41906@roundup.psfhosted.org>
Message-ID: <1601650550.8.0.148674676307.issue41906@roundup.psfhosted.org>


raybb <rayz321z at gmail.com> added the comment:

Thank you for the clarification.

I think I was most confused by the docs on this page (which I should have included in my initial post): https://docs.python.org/3/howto/logging.html

It says: 

"In Python 3.2, a new means of configuring logging has been introduced, using dictionaries to hold configuration information. This provides a superset of the functionality of the config-file-based approach outlined above, and is the recommended configuration method for new applications and deployments."


Since it is the recommended configuration method I had naively assumed that it would be compatible with the feature of just using callables instead which was mentioned here https://docs.python.org/3/library/logging.html. 


I think it would be a nice enhancement long term to be able too support callables in dictconfigs.

In the short term do you think it is reasonable to update the first page mentioned in this comment to clarify that even though dictConfig is recommended it is not a feature parity with the object oriented api?

It would also be nice to clarify this on the second page to say that callables don't work if using dictConfig.


I understand it does say a factory is required on the page you linked. I think anyone who reads the docs as well as they should will find it. But I think adding information about this too other parts of the docs will make it much easier for newer folks to catch the difference early on.


Thanks for your work on the logging parts of the api in python. I've read many of your docs and they are very helpful.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41906>
_______________________________________

From report at bugs.python.org  Fri Oct  2 11:19:55 2020
From: report at bugs.python.org (Marco Sulla)
Date: Fri, 02 Oct 2020 15:19:55 +0000
Subject: [issue41901] Added some explaining to pickle errors.
In-Reply-To: <1601554070.38.0.74604376475.issue41901@roundup.psfhosted.org>
Message-ID: <1601651995.07.0.913019881989.issue41901@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

I closed it for this reason:

https://github.com/python/cpython/pull/22438#issuecomment-702794261

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41901>
_______________________________________

From report at bugs.python.org  Fri Oct  2 11:21:18 2020
From: report at bugs.python.org (hai shi)
Date: Fri, 02 Oct 2020 15:21:18 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1601652078.16.0.907758277671.issue41902@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Fri Oct  2 11:22:02 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 02 Oct 2020 15:22:02 +0000
Subject: [issue41910] Document that object.__eq__ implements `a is b`
Message-ID: <1601652122.88.0.984647748564.issue41910@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

If you look at the data model `for object.__eq__` (https://docs.python.org/3.8/reference/datamodel.html#object.__eq__) you will see that it doesn't mention any actual implementation (unlike for __ne__). But https://github.com/python/cpython/blob/v3.8.3/Objects/typeobject.c#L3834-L3880 shows that object.__eq__ actually does have an implementation of `a is b`/`id(a) == id(b)`.

----------
assignee: docs at python
components: Documentation
messages: 377816
nosy: brett.cannon, docs at python
priority: low
severity: normal
status: open
title: Document that object.__eq__ implements `a is b`
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41910>
_______________________________________

From report at bugs.python.org  Fri Oct  2 11:22:14 2020
From: report at bugs.python.org (hai shi)
Date: Fri, 02 Oct 2020 15:22:14 +0000
Subject: [issue40455] GCC 10 compiler warnings
In-Reply-To: <1588279868.77.0.13865368461.issue40455@roundup.psfhosted.org>
Message-ID: <1601652134.12.0.132381296317.issue40455@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40455>
_______________________________________

From report at bugs.python.org  Fri Oct  2 11:22:29 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 02 Oct 2020 15:22:29 +0000
Subject: [issue41910] Document that object.__eq__ implements `a is b`
In-Reply-To: <1601652122.88.0.984647748564.issue41910@roundup.psfhosted.org>
Message-ID: <1601652149.48.0.223106463948.issue41910@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
assignee: docs at python -> brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41910>
_______________________________________

From report at bugs.python.org  Fri Oct  2 11:27:33 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 02 Oct 2020 15:27:33 +0000
Subject: [issue41911] Language reference incorrectly says comparison
 expressions return boolean values
Message-ID: <1601652453.05.0.89373160388.issue41911@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

https://docs.python.org/3/reference/expressions.html#comparisons claims that "Comparisons yield boolean values: True or False." But that's not necessarily true:

```python
>>> class Spam: 
...  def __eq__(self, _): return 42
... 
>>> Spam() == object()
42
```

That really only happens when an expressions is used in a boolean context like an `if` statements guard expression.

----------
assignee: brett.cannon
components: Documentation
messages: 377817
nosy: brett.cannon
priority: low
severity: normal
status: open
title: Language reference incorrectly says comparison expressions return boolean values
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41911>
_______________________________________

From report at bugs.python.org  Fri Oct  2 12:05:44 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 02 Oct 2020 16:05:44 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1601654744.38.0.148401800646.issue7946@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Fri Oct  2 12:07:28 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 02 Oct 2020 16:07:28 +0000
Subject: [issue41802] Missing documentation for 'PyDict_DelItem' behavior
In-Reply-To: <1600340753.64.0.782309837767.issue41802@roundup.psfhosted.org>
Message-ID: <1601654848.32.0.128415640127.issue41802@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +patch
nosy: +iritkatriel
nosy_count: 1.0 -> 2.0
pull_requests: +21512
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22291

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41802>
_______________________________________

From report at bugs.python.org  Fri Oct  2 12:15:28 2020
From: report at bugs.python.org (E. Paine)
Date: Fri, 02 Oct 2020 16:15:28 +0000
Subject: [issue41908] Make IDLE Start Menu entry more descriptive
In-Reply-To: <1601632586.45.0.38147245228.issue41908@roundup.psfhosted.org>
Message-ID: <1601655328.09.0.0234613689213.issue41908@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

Do we need to include the bitness (IDLE doesn't care)? On Windows, it will also be included in the Python start-menu folder, so maybe we should consider moving the bitness to the folder title (so the folder becomes "Python 3.8 64-bit")?


However, I also want to propose something a little more controversial: do we really need to have the word "IDLE" in the entry? The example that comes to mind immediately is Nautilus (a GNOME application), which in all graphical places (like the menu) is referred to simply as "Files". Internally and on the CLI it is known by Nautilus but, similar to "IDLE", seeing a menu entry for Nautilus wouldn't mean anything to a beginner.

On Windows, we could go for something, like
  Shell-Editor (3.9 64-bit)
Once in IDLE, we can use that name (and obviously internally), but from the outside I propose we avoid using it (this would also affect the right-click entry, for example).

I think this could cause more confusion than it avoids, but wanted to put the idea out there.

----------
nosy: +epaine

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41908>
_______________________________________

From report at bugs.python.org  Fri Oct  2 12:18:11 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 02 Oct 2020 16:18:11 +0000
Subject: [issue41802] Missing documentation for 'PyDict_DelItem' behavior
In-Reply-To: <1600340753.64.0.782309837767.issue41802@roundup.psfhosted.org>
Message-ID: <1601655491.75.0.0995780174501.issue41802@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 20ce62f00957d11f24f6449cd5c0ef5dd67174d4 by Campbell Barton in branch 'master':
bpo-41802: Document 'PyDict_DelItem' can raise a 'KeyError' (GH-22291)
https://github.com/python/cpython/commit/20ce62f00957d11f24f6449cd5c0ef5dd67174d4


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41802>
_______________________________________

From report at bugs.python.org  Fri Oct  2 12:18:33 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 02 Oct 2020 16:18:33 +0000
Subject: [issue41802] Missing documentation for 'PyDict_DelItem' behavior
In-Reply-To: <1600340753.64.0.782309837767.issue41802@roundup.psfhosted.org>
Message-ID: <1601655513.65.0.524090939565.issue41802@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21513
pull_request: https://github.com/python/cpython/pull/22493

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41802>
_______________________________________

From report at bugs.python.org  Fri Oct  2 12:18:41 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 02 Oct 2020 16:18:41 +0000
Subject: [issue41802] Missing documentation for 'PyDict_DelItem' behavior
In-Reply-To: <1600340753.64.0.782309837767.issue41802@roundup.psfhosted.org>
Message-ID: <1601655521.49.0.877128953217.issue41802@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21514
pull_request: https://github.com/python/cpython/pull/22494

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41802>
_______________________________________

From report at bugs.python.org  Fri Oct  2 12:27:58 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 02 Oct 2020 16:27:58 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601656078.88.0.536344543869.issue41905@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

You might be misunderstanding what @total_ordering does.  It can't be used by subclasses to override abstract methods.

>>> from abc import abstractmethod, ABC
>>> from functools import total_ordering

>>> class X(ABC):
	@abstractmethod
	def __lt__(self, other):
		raise RuntimeError('abstract called')

>>> @total_ordering
class Y(X):
    def __le__(self, other):
        return True

>>> sorted(vars(Y))    # note that __lt__ is missing and Y() won't instantiate
['__abstractmethods__', '__doc__', '__ge__', '__gt__', '__le__', '__module__', '_abc_impl']

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Fri Oct  2 12:28:04 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 02 Oct 2020 16:28:04 +0000
Subject: [issue41802] Missing documentation for 'PyDict_DelItem' behavior
In-Reply-To: <1600340753.64.0.782309837767.issue41802@roundup.psfhosted.org>
Message-ID: <1601656084.17.0.83044663962.issue41802@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ab32ea8d79d6bfb6580d35bfc4aa42d2729c0bcf by Miss Islington (bot) in branch '3.8':
bpo-41802: Document 'PyDict_DelItem' can raise a 'KeyError' (GH-22291)
https://github.com/python/cpython/commit/ab32ea8d79d6bfb6580d35bfc4aa42d2729c0bcf


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41802>
_______________________________________

From report at bugs.python.org  Fri Oct  2 12:38:18 2020
From: report at bugs.python.org (Ben Avrahami)
Date: Fri, 02 Oct 2020 16:38:18 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601656698.68.0.865934239091.issue41905@roundup.psfhosted.org>


Ben Avrahami <avrahami.ben at gmail.com> added the comment:

This is a behavior that the PR changes. total_ordering should be able to override/implement abstract methods (in my opinion). If this ends up a strickling point then we can exclude total_ordering from this issue.

Regardless, I think that this behavior is extremely unintuitive.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Fri Oct  2 12:39:24 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 02 Oct 2020 16:39:24 +0000
Subject: [issue41802] Missing documentation for 'PyDict_DelItem' behavior
In-Reply-To: <1600340753.64.0.782309837767.issue41802@roundup.psfhosted.org>
Message-ID: <1601656764.17.0.284075790497.issue41802@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6dc8e0eb9b471f6665f841216a6b2d83741b3973 by Miss Islington (bot) in branch '3.9':
bpo-41802: Document 'PyDict_DelItem' can raise a 'KeyError' (GH-22291)
https://github.com/python/cpython/commit/6dc8e0eb9b471f6665f841216a6b2d83741b3973


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41802>
_______________________________________

From report at bugs.python.org  Fri Oct  2 13:19:20 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 02 Oct 2020 17:19:20 +0000
Subject: [issue40391] io.FileIO.mode doesn't comply with the docs
In-Reply-To: <1587862256.98.0.383192510406.issue40391@roundup.psfhosted.org>
Message-ID: <1601659160.82.0.144299693004.issue40391@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

The mode string is calculated here: https://github.com/python/cpython/blob/master/Modules/_io/fileio.c#L1055

and is based on these four values in the fileio struct:

    unsigned int created : 1;
    unsigned int readable : 1;
    unsigned int writable : 1;
    unsigned int appending : 1;

This is not enough information to distinguish between r+ and w+. That distinction was lost in _io_FileIO___init___impl, where it specified the flags that went into creating fd, but these flags are not saved.

The bit fields in this struct add up to 7 bits, so it seems possible to fix this if another bit is allocated for this purpose.

If it's not worth it, then the documentation needs to change a little.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40391>
_______________________________________

From report at bugs.python.org  Fri Oct  2 13:21:22 2020
From: report at bugs.python.org (Ethan Furman)
Date: Fri, 02 Oct 2020 17:21:22 +0000
Subject: [issue41907] Regression in IntFlag behaviour in f-string
In-Reply-To: <1601606290.92.0.604621625655.issue41907@roundup.psfhosted.org>
Message-ID: <1601659282.39.0.669682808821.issue41907@roundup.psfhosted.org>


Change by Ethan Furman <ethan at stoneleaf.us>:


----------
keywords: +patch
pull_requests: +21515
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22497

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41907>
_______________________________________

From report at bugs.python.org  Fri Oct  2 13:31:11 2020
From: report at bugs.python.org (Ethan Furman)
Date: Fri, 02 Oct 2020 17:31:11 +0000
Subject: [issue41907] Regression in IntFlag behaviour in f-string
In-Reply-To: <1601606290.92.0.604621625655.issue41907@roundup.psfhosted.org>
Message-ID: <1601659870.99.0.78149349547.issue41907@roundup.psfhosted.org>


Change by Ethan Furman <ethan at stoneleaf.us>:


----------
components: +Library (Lib) -Interpreter Core

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41907>
_______________________________________

From report at bugs.python.org  Fri Oct  2 13:46:15 2020
From: report at bugs.python.org (Larry Hastings)
Date: Fri, 02 Oct 2020 17:46:15 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1601660775.01.0.132258506437.issue7946@roundup.psfhosted.org>


Larry Hastings <larry at hastings.org> added the comment:

FWIW: I think David's cited behavior proves that the GIL is de facto a scheduler.  And, in case you missed it, scheduling is a hard problem, and not a solved problem.  There are increasingly complicated schedulers with new approaches and heuristics.  They're getting better and better... as well as more and more complex.  BFS is an example of that trend from ten years ago.  But the Linux kernel has been shy about merging it, not sure why (technical deficiency? licensing problem? personality conflict? the name?).

I think Python's current thread scheduling approach is almost certainly too simple.  My suspicion is that we should have a much more elaborate scheduler--which hopefully would fix most (but not all!) of these sorts of pathological performance regressions.  But that's going to be a big patch, and it's going to need a champion, and that champion would have to be more educated about it than I am, so I don't think it's gonna be me.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Fri Oct  2 13:53:58 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 02 Oct 2020 17:53:58 +0000
Subject: [issue41802] Missing documentation for 'PyDict_DelItem' behavior
In-Reply-To: <1600340753.64.0.782309837767.issue41802@roundup.psfhosted.org>
Message-ID: <1601661238.4.0.419078790165.issue41802@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
assignee:  -> docs at python
components: +Documentation
nosy: +docs at python
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41802>
_______________________________________

From report at bugs.python.org  Fri Oct  2 14:01:25 2020
From: report at bugs.python.org (Tom Karzes)
Date: Fri, 02 Oct 2020 18:01:25 +0000
Subject: [issue41912] Long generator chain causes segmentation fault
Message-ID: <1601661685.77.0.221830308398.issue41912@roundup.psfhosted.org>


New submission from Tom Karzes <karzes at sonic.net>:

If I create a sufficiently long chain of generators, I encounter a segmentation fault.  For example, the following works as expected:

    % ./gen_bug3.py 10000
    10000
    %

But for sufficiently larger chain lengths, it seg faults:

    % ./gen_bug3.py 20000
    Segmentation fault (core dumped)
    %

and:

    % ./gen_bug3.py 100000
    Segmentation fault (core dumped)
    %

The exact point where it seg faults seems to vary slightly between different invocations of Python, but the range is very narrow for a given Python installation.  I believe the difference is due to slight variations in used memory upon startup.

I can't see any reason why this should happen, and in any case, if there is some limit that I'm exceeding, it should raise an exception rather than core dump.

I'm using:

    3.6.9 (default, Jul 17 2020, 12:50:27)
    [GCC 8.4.0]

on a 64-bit Ubuntu Linux system.

Additional info:  A friend of mine is running 3.7.9 on a Windows system.  In his case, the symptom is that the program produces no output for a sufficiently long generator chain (presumably it's silently crashing).  Additionally, he encounters the problem with much shorter generator chains than I do.  I suspect it's the same underlying problem.

----------
components: Interpreter Core
files: gen_bug3.py
messages: 377826
nosy: karzes
priority: normal
severity: normal
status: open
title: Long generator chain causes segmentation fault
type: crash
versions: Python 3.6
Added file: https://bugs.python.org/file49486/gen_bug3.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41912>
_______________________________________

From report at bugs.python.org  Fri Oct  2 14:56:35 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 02 Oct 2020 18:56:35 +0000
Subject: [issue40391] io.FileIO.mode doesn't comply with the docs
In-Reply-To: <1587862256.98.0.383192510406.issue40391@roundup.psfhosted.org>
Message-ID: <1601664995.23.0.0390386444635.issue40391@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It is a duplicate of issue25341.

----------
nosy: +serhiy.storchaka
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> File mode wb+ appears as rb+

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40391>
_______________________________________

From report at bugs.python.org  Fri Oct  2 14:57:46 2020
From: report at bugs.python.org (Frederik Rietdijk)
Date: Fri, 02 Oct 2020 18:57:46 +0000
Subject: [issue41913] EnvBuilder.install_scripts should use explicit
 permissions
Message-ID: <1601665066.98.0.447364183883.issue41913@roundup.psfhosted.org>


New submission from Frederik Rietdijk <fridh at fridh.nl>:

Creating a venv with `python3 -m venv foo` and then reinitializing it with `python3 -m venv foo` fails with a `Error: [Errno 13] Permission denied: '/path/to/cwd/foo/bin/activate.fish'` with the CPython interpreters from Nixpkgs.

The method `EnvBuilder.install_scripts` that is responsible for copying the files, copies the permissions, instead of explicitly stating what permissions are needed. This fails with the Nixpkgs builds of CPython because in Nixpkgs the entire store is made read-only.

Files that need to be copied from the installation during run-time should be explicit about the permissions they require, instead of depending on their current permissions.

----------
messages: 377828
nosy: Frederik Rietdijk
priority: normal
severity: normal
status: open
title: EnvBuilder.install_scripts should use explicit permissions
type: behavior
versions: Python 3.10, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41913>
_______________________________________

From report at bugs.python.org  Fri Oct  2 14:58:45 2020
From: report at bugs.python.org (Frederik Rietdijk)
Date: Fri, 02 Oct 2020 18:58:45 +0000
Subject: [issue41913] EnvBuilder.install_scripts should use explicit
 permissions
In-Reply-To: <1601665066.98.0.447364183883.issue41913@roundup.psfhosted.org>
Message-ID: <1601665125.25.0.0582929858246.issue41913@roundup.psfhosted.org>


Frederik Rietdijk <fridh at fridh.nl> added the comment:

Nixpkgs issue https://github.com/NixOS/nixpkgs/issues/99156.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41913>
_______________________________________

From report at bugs.python.org  Fri Oct  2 15:21:09 2020
From: report at bugs.python.org (Sumagna Das)
Date: Fri, 02 Oct 2020 19:21:09 +0000
Subject: [issue39710] "will be returned as unicode" reminiscent from Python 2
In-Reply-To: <1582300708.21.0.335550003251.issue39710@roundup.psfhosted.org>
Message-ID: <1601666469.99.0.894101639162.issue39710@roundup.psfhosted.org>


Sumagna Das <sumagnadas at gmail.com> added the comment:

Can i take on this issue? If yes, what am I supposed to do except for removing those lines which are mentioned?

----------
nosy: +sumagnadas

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39710>
_______________________________________

From report at bugs.python.org  Fri Oct  2 15:43:02 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Fri, 02 Oct 2020 19:43:02 +0000
Subject: [issue41906] logging.config.dictConfig does not work with callable
 filters
In-Reply-To: <1601599406.74.0.279190575587.issue41906@roundup.psfhosted.org>
Message-ID: <1601667782.8.0.15521056682.issue41906@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

You make reasonable points. I won't close this issue, and get to those updates when I can/as time allows. Meanwhile, if you or someone else proposes specific changes by way of a pull request, I'll look at that too. And thanks for your kind words about the logging docs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41906>
_______________________________________

From report at bugs.python.org  Fri Oct  2 16:01:37 2020
From: report at bugs.python.org (Tim Peters)
Date: Fri, 02 Oct 2020 20:01:37 +0000
Subject: [issue41912] Long generator chain causes segmentation fault
In-Reply-To: <1601661685.77.0.221830308398.issue41912@roundup.psfhosted.org>
Message-ID: <1601668897.19.0.735470715735.issue41912@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

The docs are already clear about that you play with `setrecursionlimit()` at your own risk:

"""
Set the maximum depth of the Python interpreter stack to limit. This limit prevents infinite recursion from causing an overflow of the C stack and crashing Python.

The highest possible limit is platform-dependent. A user may need to set the limit higher when they have a program that requires deep recursion and a platform that supports a higher limit. This should be done with care, because a too-high limit can lead to a crash.
"""

If you see a crash instead of a `RecursionError` exception when you _don't_ shoot yourself in the foot this way, that might be interesting. But, as is, you're deliberately overriding a mechanism designed to prevent these kinds of crashes.

----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41912>
_______________________________________

From report at bugs.python.org  Fri Oct  2 16:11:40 2020
From: report at bugs.python.org (Alice Bevan-McGregor)
Date: Fri, 02 Oct 2020 20:11:40 +0000
Subject: [issue36094] When using an SMTP SSL connection,, get ValueError.
In-Reply-To: <1550943841.97.0.129283187576.issue36094@roundup.psfhosted.org>
Message-ID: <1601669500.4.0.695038817911.issue36094@roundup.psfhosted.org>


Alice Bevan-McGregor <alice at gothcandy.com> added the comment:

Howdy!  One of my projects, Marrow Mailer (formerly TurboMail) has received a bit of a flood of reports and erroneous pull requests attempting to correct this bug in the invocation of smtplib by Mailer.

https://github.com/marrow/mailer/issues/83 is our own tracking issue, with https://github.com/marrow/mailer/pull/91 as the most "successful" pull request with more detailed (contextualized) traceback, comparison, and links to official documentation. (Also, yay, worked around the problem here by recovering my "native" issue tracker account rather than trying to sign in with GitHub.)

This appears to be a clear regression. The particular reason why I'm unwilling to accept these patches to Mailer is that passing a hostname at SMTP_SSL instantiation time will cause the connection to be initiated from within __init__ itself, prior to any ability to set the diagnostic logging level, which is boo, hiss. Initializers actually doing things is un-good, beyond diagnostic logging not being an optional keyword argument.  (Instantiation != procedural invocation.)

----------
nosy: +amcgregor

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36094>
_______________________________________

From report at bugs.python.org  Fri Oct  2 16:22:14 2020
From: report at bugs.python.org (Tom Karzes)
Date: Fri, 02 Oct 2020 20:22:14 +0000
Subject: [issue41912] Long generator chain causes segmentation fault
In-Reply-To: <1601661685.77.0.221830308398.issue41912@roundup.psfhosted.org>
Message-ID: <1601670134.55.0.446378576555.issue41912@roundup.psfhosted.org>


Tom Karzes <karzes at sonic.net> added the comment:

That is a good point, except I don't believe the value needed to expose this bug is a "too-high limit" (as the documentation calls it).  I set it to 100100 for convenience, but in practice even a value of 17000 is more than enough to expose the bug on my system (it occurs at around 16500).  For my friend using Windows, a value as low as 4000 suffices, which I don't think anyone would argue is unreasonably high.

The default value of 1000 is extremely low, and is intended to catch recursion bugs in programs that are not expected to recurse very deeply.  For a program that genuinely needs recursion, I don't think a value of 20000, or even 100000, is unreasonable given today's typical memory sizes (and when I run my failing case, the memory usage is so low as to be inconsequential).  By my interpretation, these limits should be well within the range that Python can handle.

It seems likely to me that in this case, the problem isn't due to any kind of system limit, but is rather the result of a logical error in the implementation which is somehow exposed by this test.  Hopefully a developer will take advantage of this test case to fix what I believe is a serious bug.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41912>
_______________________________________

From report at bugs.python.org  Fri Oct  2 16:39:36 2020
From: report at bugs.python.org (Sumagna Das)
Date: Fri, 02 Oct 2020 20:39:36 +0000
Subject: [issue41914] test_pdb fails wit
Message-ID: <1601671175.99.0.383994267715.issue41914@roundup.psfhosted.org>


New submission from Sumagna Das <sumagnadas at gmail.com>:

I was thinking about contributing to cpython so i cloned it and followed the tests mentioned on devguide.python.org. When i ran my tests, it failed on two of them: test_pdb and test_ssl. test_ssl had an issue already as i found here. test_pdb failure was the one which i didn't find here. It failed with the following message:

== CPython 3.10.0a0 (heads/master:a937ab45d6, Oct 3 2020, 00:16:29) [GCC 9.3.0]
== Linux-5.4.0-48-generic-x86_64-with-glibc2.31 little-endian
== cwd: /mnt/sda2/github/cpython/build/test_python_21809?
== CPU count: 4
== encodings: locale=UTF-8, FS=utf-8
0:00:00 load avg: 1.52 Run tests in parallel using 2 child processes
0:00:06 load avg: 1.48 [1/1/1] test_pdb failed
test_blocks_at_first_code_line (test.test_pdb.PdbTestCase) ... ok
test_breakpoint (test.test_pdb.PdbTestCase) ... ok
test_errors_in_command (test.test_pdb.PdbTestCase) ... FAIL
test_find_function_empty_file (test.test_pdb.PdbTestCase) ... ok
test_find_function_found (test.test_pdb.PdbTestCase) ... ok
test_find_function_found_with_bom (test.test_pdb.PdbTestCase) ... ok
test_find_function_found_with_encoding_cookie (test.test_pdb.PdbTestCase) ... ok
test_header (test.test_pdb.PdbTestCase) ... ok
test_issue13120 (test.test_pdb.PdbTestCase) ... ok
test_issue13183 (test.test_pdb.PdbTestCase) ... ok
test_issue16180 (test.test_pdb.PdbTestCase) ... ok
test_issue36250 (test.test_pdb.PdbTestCase) ... ok
test_issue7964 (test.test_pdb.PdbTestCase) ... ok
test_module_is_run_as_main (test.test_pdb.PdbTestCase) ... ok
test_module_without_a_main (test.test_pdb.PdbTestCase) ... ok
test_readrc_homedir (test.test_pdb.PdbTestCase) ... ok
test_readrc_kwarg (test.test_pdb.PdbTestCase) ... ok
test_relative_imports (test.test_pdb.PdbTestCase) ... ok
test_relative_imports_on_plain_module (test.test_pdb.PdbTestCase) ... ok
test_run_module (test.test_pdb.PdbTestCase) ... ok
test_run_pdb_with_pdb (test.test_pdb.PdbTestCase) ... ok
test_list_commands (test.test_pdb)
Doctest: test.test_pdb.test_list_commands ... ok
test_next_until_return_at_return_event (test.test_pdb)
Doctest: test.test_pdb.test_next_until_return_at_return_event ... ok
test_pdb_basic_commands (test.test_pdb)
Doctest: test.test_pdb.test_pdb_basic_commands ... ok
test_pdb_breakpoint_commands (test.test_pdb)
Doctest: test.test_pdb.test_pdb_breakpoint_commands ... ok
test_pdb_continue_in_bottomframe (test.test_pdb)
Doctest: test.test_pdb.test_pdb_continue_in_bottomframe ... ok
test_pdb_displayhook (test.test_pdb)
Doctest: test.test_pdb.test_pdb_displayhook ... ok
test_pdb_issue_20766 (test.test_pdb)
Doctest: test.test_pdb.test_pdb_issue_20766 ... ok
test_pdb_next_command_for_asyncgen (test.test_pdb)
Doctest: test.test_pdb.test_pdb_next_command_for_asyncgen ... ok
test_pdb_next_command_for_coroutine (test.test_pdb)
Doctest: test.test_pdb.test_pdb_next_command_for_coroutine ... ok
test_pdb_next_command_for_generator (test.test_pdb)
Doctest: test.test_pdb.test_pdb_next_command_for_generator ... ok
test_pdb_next_command_in_generator_for_loop (test.test_pdb)
Doctest: test.test_pdb.test_pdb_next_command_in_generator_for_loop ... ok
test_pdb_next_command_subiterator (test.test_pdb)
Doctest: test.test_pdb.test_pdb_next_command_subiterator ... ok
test_pdb_return_command_for_coroutine (test.test_pdb)
Doctest: test.test_pdb.test_pdb_return_command_for_coroutine ... ok
test_pdb_return_command_for_generator (test.test_pdb)
Doctest: test.test_pdb.test_pdb_return_command_for_generator ... ok
test_pdb_run_with_code_object (test.test_pdb)
Doctest: test.test_pdb.test_pdb_run_with_code_object ... ok
test_pdb_run_with_incorrect_argument (test.test_pdb)
Doctest: test.test_pdb.test_pdb_run_with_incorrect_argument ... ok
test_pdb_skip_modules (test.test_pdb)
Doctest: test.test_pdb.test_pdb_skip_modules ... ok
test_pdb_skip_modules_with_callback (test.test_pdb)
Doctest: test.test_pdb.test_pdb_skip_modules_with_callback ... ok
test_pdb_until_command_for_coroutine (test.test_pdb)
Doctest: test.test_pdb.test_pdb_until_command_for_coroutine ... ok
test_pdb_until_command_for_generator (test.test_pdb)
Doctest: test.test_pdb.test_pdb_until_command_for_generator ... ok
test_pdb_whatis_command (test.test_pdb)
Doctest: test.test_pdb.test_pdb_whatis_command ... ok
test_post_mortem (test.test_pdb)
Doctest: test.test_pdb.test_post_mortem ... ok

======================================================================
FAIL: test_errors_in_command (test.test_pdb.PdbTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/sda2/github/cpython/Lib/test/test_pdb.py", line 1650, in test_errors_in_command
    self.assertEqual(stdout.splitlines()[1:], [
AssertionError: Lists differ: ['(Pd[283 chars]efined", 'LEAVING RECURSIVE DEBUGGER', '(Pdb) ', '\x1b[?1034h'] != ['(Pd[283 chars]efined", 'LEAVING RECURSIVE DEBUGGER', '(Pdb) ']

First list contains 1 additional elements.
First extra element 9:
'\x1b[?1034h'

  ['(Pdb) *** SyntaxError: unexpected EOF while parsing',
   '(Pdb) ENTERING RECURSIVE DEBUGGER',
   '*** SyntaxError: unexpected EOF while parsing',
   'LEAVING RECURSIVE DEBUGGER',
   '(Pdb) ENTERING RECURSIVE DEBUGGER',
   '> <string>(1)<module>()',
   "((Pdb)) *** NameError: name 'doesnotexist' is not defined",
   'LEAVING RECURSIVE DEBUGGER',
-  '(Pdb) ',
?          ^

+  '(Pdb) ']
?          ^

-  '\x1b[?1034h']

----------------------------------------------------------------------

Ran 43 tests in 5.143s

FAILED (failures=1)
test test_pdb failed

== Tests result: FAILURE ==

1 test failed:
    test_pdb

Total duration: 6.8 sec
Tests result: FAILURE

Is this happening only with me?

----------
components: Tests
messages: 377835
nosy: sumagnadas
priority: normal
severity: normal
status: open
title: test_pdb fails wit
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41914>
_______________________________________

From report at bugs.python.org  Fri Oct  2 16:43:28 2020
From: report at bugs.python.org (Sumagna Das)
Date: Fri, 02 Oct 2020 20:43:28 +0000
Subject: [issue41914] test_pdb fails
In-Reply-To: <1601671175.99.0.383994267715.issue41914@roundup.psfhosted.org>
Message-ID: <1601671408.72.0.424688781322.issue41914@roundup.psfhosted.org>


Change by Sumagna Das <sumagnadas at gmail.com>:


----------
title: test_pdb fails wit -> test_pdb fails

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41914>
_______________________________________

From report at bugs.python.org  Fri Oct  2 16:48:44 2020
From: report at bugs.python.org (Tim Peters)
Date: Fri, 02 Oct 2020 20:48:44 +0000
Subject: [issue41912] Long generator chain causes segmentation fault
In-Reply-To: <1601661685.77.0.221830308398.issue41912@roundup.psfhosted.org>
Message-ID: <1601671724.3.0.662344614789.issue41912@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

There is no way in portable ANSI C to deduce a "safe" limit. The limits that exist were picked by hand across platforms, to be conservative guesses at what would "never" break.

You're allowed to increase the limit if you think you know better - and you may! No two platforms are the same. But - again - you do so at your own risk.  There is no bug here unless you can provoke a crash _without_ overriding the default limit.

I was there when the limit was introduced. It was introduced precisely to avoid the vast array of strange system failures that can occur when the C stack overflows - and, again, there is no portable way to detect that "it's getting close" in ANSI C.  Stack sizes provided by platform C implementations are all over the place, from kilobytes to megabytes, and can also be different yet again for threads, and there is no portable way in C to find out what they are.

"""
For my friend using Windows, a value as low as 4000 suffices, which I don't think anyone would argue is unreasonably high.
"""

For the defaults provided by Microsoft's Visual C compiler (which CPython uses), it is unreasonably high - the C stack overflows.  In fact, under the released Python 3.8.5 on my 64-bit Windows, the largest value for which your program isn't obviously broken is about 2512.  If I don't override the default recursion limit on Windows, I cannot provoke a problem with your program on Windows (instead it dies - as designed and intended - with a `RecursionError` exception instead).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41912>
_______________________________________

From report at bugs.python.org  Fri Oct  2 17:09:58 2020
From: report at bugs.python.org (Tom Karzes)
Date: Fri, 02 Oct 2020 21:09:58 +0000
Subject: [issue41912] Long generator chain causes segmentation fault
In-Reply-To: <1601661685.77.0.221830308398.issue41912@roundup.psfhosted.org>
Message-ID: <1601672998.86.0.852605748915.issue41912@roundup.psfhosted.org>


Tom Karzes <karzes at sonic.net> added the comment:

I tested this some more, and one thing became clear that I hadn't realized before:  This bug has nothing to do specifically with generators (as I had thought), but is in fact due purely to the recursion limit.

I created a recursive test program that doesn't use generators at all, and ran into the exact same problem (at only a slightly higher recursion level).  I am attaching that test case as recurse_bug4.py.  Here's a sample failing invocation:

    % ./recurse_bug4.py 20000
    Segmentation fault (core dumped)
    % 

On my system, the cutoff point for this one seems to be around 17600, roughly 1100 higher than for the generator example.

What surprises me about this is the Python implementation uses recursion to implement recursion in Python apps.  I would have thought that it would use heap memory for something like this, and as a result only require a fixed amount of stack.  That would clearly have major advantages, since it would decouple recursion limits in Python code from stack limits on the platform.

On the other hand, now that I understand that this is in fact the result of a system limit, I was *very* easily able to work around the problem!  I simply disabled the stack limit.  From csh:

    % unlimit stacksize
    %

Then:

    % ./gen_bug3.py 100000
    100000
    %

and:

    % ./recurse_bug4.py 100000
    100000
    %

So you were right, this was due solely to the default stack limit on my system, and not a bug in the Python implementation.  And it was also very easy to remove that limit.  Hopefully something similar can be done on Windows (which I know very little about).

Thank you for your help!

----------
Added file: https://bugs.python.org/file49487/recurse_bug4.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41912>
_______________________________________

From report at bugs.python.org  Fri Oct  2 17:59:50 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 02 Oct 2020 21:59:50 +0000
Subject: [issue18228] AIX locale parsing failure
In-Reply-To: <1371355395.07.0.213079327558.issue18228@psf.upfronthosting.co.za>
Message-ID: <1601675990.91.0.556061132146.issue18228@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Looks like this can be closed.

----------
nosy: +iritkatriel
status: pending -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18228>
_______________________________________

From report at bugs.python.org  Fri Oct  2 19:15:27 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 02 Oct 2020 23:15:27 +0000
Subject: [issue41866] Document error in chinese version of contextlib.
In-Reply-To: <1601137438.19.0.414392303646.issue41866@roundup.psfhosted.org>
Message-ID: <1601680527.44.0.338247662395.issue41866@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
nosy: +mdk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41866>
_______________________________________

From report at bugs.python.org  Fri Oct  2 19:20:27 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 02 Oct 2020 23:20:27 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601680827.34.0.680098779667.issue41905@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I'm going to ignore this issue until you two have reached agreement. I recommend using some example code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Fri Oct  2 19:28:10 2020
From: report at bugs.python.org (Justin Arthur)
Date: Fri, 02 Oct 2020 23:28:10 +0000
Subject: [issue33533] Provide an async-generator version of as_completed
In-Reply-To: <1526453333.0.0.682650639539.issue33533@psf.upfronthosting.co.za>
Message-ID: <1601681290.43.0.736088696164.issue33533@roundup.psfhosted.org>


Justin Arthur <justinarthur at gmail.com> added the comment:

Thanks, Hrvoje. I've updated the patch to match this bug's suggested format and have updated the documentation and What's New.

The one quirk that comes with the benefit of getting the same futures back is that we still allow both coroutines and futures to be passed in. Coroutines will not be yielded back in their original form, but instead a new task.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33533>
_______________________________________

From report at bugs.python.org  Fri Oct  2 19:43:15 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 02 Oct 2020 23:43:15 +0000
Subject: [issue41877] Check against misspellings of assert etc. in mock
In-Reply-To: <1601317157.88.0.730935461305.issue41877@roundup.psfhosted.org>
Message-ID: <1601682195.13.0.740296954019.issue41877@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Vedran, you explained why many use pytest instead of unittest. But we have the latter and a stability policy.

I am not familiar with the existing mock code, but one already invented solution for misspelling tolerance without enumeration is the soundex algorithm.  I have not read the details for over a decade, but I belive soundex(<assert variation>) = 'asrt' for all examples given here.  Perhaps it could be used to broaden the test.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41877>
_______________________________________

From report at bugs.python.org  Fri Oct  2 19:47:13 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 02 Oct 2020 23:47:13 +0000
Subject: [issue41878] python3 fails to use custom mapping object as symbols in
 eval()
In-Reply-To: <1601320340.36.0.581578891193.issue41878@roundup.psfhosted.org>
Message-ID: <1601682433.95.0.571213640024.issue41878@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Robert, this tracker is for patching CPython, not for debugging user code.  If, as it appears, you are not suggesting the former, please close this.  For the latter, python-list and stackoverflow.com are appropriate forums.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41878>
_______________________________________

From report at bugs.python.org  Fri Oct  2 20:17:07 2020
From: report at bugs.python.org (Brett Cannon)
Date: Sat, 03 Oct 2020 00:17:07 +0000
Subject: [issue41584] Clarify documentation for binary arithmetic operation
 subclass __r*__ precedence
In-Reply-To: <1597773394.37.0.055865211998.issue41584@roundup.psfhosted.org>
Message-ID: <1601684227.42.0.0551456524859.issue41584@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
keywords: +patch
pull_requests: +21516
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22505

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41584>
_______________________________________

From report at bugs.python.org  Fri Oct  2 20:17:11 2020
From: report at bugs.python.org (Justin Arthur)
Date: Sat, 03 Oct 2020 00:17:11 +0000
Subject: [issue33533] Provide an async iterator version of as_completed
In-Reply-To: <1526453333.0.0.682650639539.issue33533@psf.upfronthosting.co.za>
Message-ID: <1601684231.12.0.800427314122.issue33533@roundup.psfhosted.org>


Change by Justin Arthur <justinarthur at gmail.com>:


----------
title: Provide an async-generator version of as_completed -> Provide an async iterator version of as_completed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33533>
_______________________________________

From report at bugs.python.org  Fri Oct  2 20:17:58 2020
From: report at bugs.python.org (Brett Cannon)
Date: Sat, 03 Oct 2020 00:17:58 +0000
Subject: [issue41584] Clarify documentation for binary arithmetic operation
 subclass __r*__ precedence
In-Reply-To: <1597773394.37.0.055865211998.issue41584@roundup.psfhosted.org>
Message-ID: <1601684278.32.0.137708396226.issue41584@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
stage: patch review -> commit review

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41584>
_______________________________________

From report at bugs.python.org  Fri Oct  2 20:25:02 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 03 Oct 2020 00:25:02 +0000
Subject: [issue41887] ast.literal_eval does not accept strings with leading
 whitespaces
In-Reply-To: <1601430417.52.0.930336195437.issue41887@roundup.psfhosted.org>
Message-ID: <1601684701.99.0.208243999334.issue41887@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The doc for literal_eval says "evaluate ... a string containing a Python literal or container display."  To me, ' 1' qualifies, just as it does as an expression for eval().

The exception comes from parsing raising IndentationError with leading whitespace even when the mode is 'eval' rather than 'exec'.  This surprised me. Eval() gets strips the beginning of the string before it is parsed.  If parsing remains as is, I agree that doing the same for literal_eval strings.  But why should not parsing remove indents for 'eval' mode?

----------
nosy: +terry.reedy
versions: +Python 3.10 -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41887>
_______________________________________

From report at bugs.python.org  Fri Oct  2 20:34:52 2020
From: report at bugs.python.org (Eryk Sun)
Date: Sat, 03 Oct 2020 00:34:52 +0000
Subject: [issue41908] Make IDLE Start Menu entry more descriptive
In-Reply-To: <1601632586.45.0.38147245228.issue41908@roundup.psfhosted.org>
Message-ID: <1601685292.44.0.491364527591.issue41908@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> maybe we should consider moving the bitness to the folder title 
> (so the folder becomes "Python 3.8 64-bit")?

Splitting up the start-menu entries into separate "Python 3.9 (32-bit)" and "Python 3.9 (64-bit)" folders would reduce clutter in the folder when browsing the start menu. But the link names have to retain the bitness. If you type "idle" in the start menu, all you get is the link name, not the folder context, so the link name has to distinguish 32-bit vs 64-bit. Also, link names without bitness are already used by the Python store app distribution.

> On Windows, we could go for something, like
> Shell-Editor (3.9 64-bit)

Then searching for "idle" no longer works, which may be a practical trade-off considering novices are probably unfamiliar with IDLE.

With or without "IDLE" in the name, this only works well for novices that browse the start menu. It's not discoverable if the user just taps the WIN key and types "python". That search will return links to python.exe, which uses a system console session instead of the IDLE shell. If IDLE should be preferred, then maybe the name should be "Python 3.9 Shell+Editor (64-bit)".

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41908>
_______________________________________

From report at bugs.python.org  Fri Oct  2 21:10:11 2020
From: report at bugs.python.org (Johan Herland)
Date: Sat, 03 Oct 2020 01:10:11 +0000
Subject: [issue41913] EnvBuilder.install_scripts should use explicit
 permissions
In-Reply-To: <1601665066.98.0.447364183883.issue41913@roundup.psfhosted.org>
Message-ID: <1601687411.73.0.873005050332.issue41913@roundup.psfhosted.org>


Change by Johan Herland <jherland at cisco.com>:


----------
nosy: +jherland

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41913>
_______________________________________

From report at bugs.python.org  Fri Oct  2 21:13:56 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 03 Oct 2020 01:13:56 +0000
Subject: [issue41910] Document that object.__eq__ implements `a is b`
In-Reply-To: <1601652122.88.0.984647748564.issue41910@roundup.psfhosted.org>
Message-ID: <1601687636.17.0.0883480334158.issue41910@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The word 'object' in this section is a bit confusing because it refers to any Python object, not to base class 'object' or an instance thereof.  I suspect that this usage predates the introduction of the latter in 2.2.

This interpretation is required for sentences like "By default, __ne__() delegates to __eq__() and inverts the result unless it is NotImplemented." and "If a class does not define an __eq__() method ..." (in the __hash__ entry) to make sense.  I think that the meaning of 'object' should be stipulated at the top of the section and mention the existence of base class 'object', and maybe list which of the following methods it has, and that they are inherited by subclasses.

The base class __eq__ implementation is implied in this paragraph in the __hash__ entry.

"User-defined classes have __eq__() and __hash__() methods by default; with them, all objects compare unequal (except with themselves) and x.__hash__() returns an appropriate value such that x == y implies both that x is y and hash(x) == hash(y)."

I think it worthwhile explaining that user classes get these defaults by inheriting them (and others) from 'object', and that the implication follows from inheriting a particular base class implementation of __eq__.  To put it another way, I believe the quoted paragraph makes the  definition a Python requirement rather than just a CPython implementation detail.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41910>
_______________________________________

From report at bugs.python.org  Fri Oct  2 21:23:47 2020
From: report at bugs.python.org (Ethan Tang US)
Date: Sat, 03 Oct 2020 01:23:47 +0000
Subject: [issue41915] unittest.mock.create_autospec(Obj,
 instance=True) has self keyword in _spec_signature if Obj implements
 __call__
Message-ID: <1601688227.96.0.0965935424623.issue41915@roundup.psfhosted.org>


New submission from Ethan Tang US <ettang at nvidia.com>:

When an `unittest.mock.create_autospec(Obj, instance=True)` is used, and said Obj implements the `__call__(self, ...)` function, the mocked instance of it will take the full function signature including the `self` argument.

This will then cause an issue when `assert_called_once_with()` or `assert_called_with()` is used. Those two assertions will fail regardless if the arguments used were correct or not. The error message will contain the error: `TypeError: missing a required argument: 'self'`

Here an example of this issue happening

```
from unittest import mock

def Foo(object):

    def __call__(self, a):
        pass

    def bar(self, b):
        ```This is to just compare it with a regular function.```
        pass

foo_mock = mock.create_autospec(Foo, instance=True)
foo_mock(a=1)

foo_mock.assert_called_once_with(a=1)
```

In the example above, the assertion will then fail and raise an error even though the assertion should be correct.

upon inspecting further to understand the issue, this is because `foo_mock._spec_signature` will be `<Signature (self, a)>`.

The existence of `self` in `foo_mock._spec_signature` will cause this error.

As compared to the method `foo_mock.bar._spec_signature`, it will only be `<Signature (b)>`.

The reason for me posting this issue is that development with the Keras library heavily uses __call__ in their API and therefore it is hard to mock the APIs if such issue exists. One work around would be iterating through its `called_args_list`.

----------
components: Library (Lib)
messages: 377846
nosy: ettang
priority: normal
severity: normal
status: open
title: unittest.mock.create_autospec(Obj, instance=True) has self keyword in _spec_signature if Obj implements __call__
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41915>
_______________________________________

From report at bugs.python.org  Fri Oct  2 21:43:58 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 03 Oct 2020 01:43:58 +0000
Subject: [issue41911] Language reference incorrectly says comparison
 expressions return boolean values
In-Reply-To: <1601652453.05.0.89373160388.issue41911@roundup.psfhosted.org>
Message-ID: <1601689438.59.0.230854251145.issue41911@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

For rich comparisons, a proper explanation is given in the rich comparison entry in the datamodel section ( #41910) 

"A rich comparison method may return the singleton NotImplemented if it does not implement the operation for a given pair of arguments. By convention, False and True are returned for a successful comparison. However, these methods can return any value, so if the comparison operator is used in a Boolean context (e.g., in the condition of an if statement), Python will call bool() on the value to determine if the result is true or false."

bool(x) calls x.__bool__ and requires that the latter return False or True.

As for the other two comparisons, x is y always returns False or True for a proper implementation because int == int always does.  If y.__contains__(x) does not raise, x in y returns bool(y.__contains__(x)), clamping aberrant implementations of __contains__.

A replacement text might be 

"Comparisons normally yield boolean values: True or False.  But rich comparisons not in a Boolean context may yield anything."

Possibly link 'rich comparisons' to the datamodel section.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41911>
_______________________________________

From report at bugs.python.org  Fri Oct  2 22:05:02 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 03 Oct 2020 02:05:02 +0000
Subject: [issue41912] Long generator chain causes segmentation fault
In-Reply-To: <1601661685.77.0.221830308398.issue41912@roundup.psfhosted.org>
Message-ID: <1601690702.82.0.739514178907.issue41912@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Another "We are not responsible, proceed at your own risk" operation is importing ctypes, which allows one to overwrite bytes in the running python.

----------
nosy: +terry.reedy
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41912>
_______________________________________

From report at bugs.python.org  Fri Oct  2 23:31:29 2020
From: report at bugs.python.org (Tim Peters)
Date: Sat, 03 Oct 2020 03:31:29 +0000
Subject: [issue41912] Long generator chain causes segmentation fault
In-Reply-To: <1601661685.77.0.221830308398.issue41912@roundup.psfhosted.org>
Message-ID: <1601695889.96.0.760111587774.issue41912@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Right, generators played no essential role here. Just one way of piling up a tall tower of C stack frames.

Search the web for "stackless Python" for the history of attempts to divorce the CPython implementation from the platform C stack.

There are ways to increase the main thread's stack size on Windows too using MSVC, but unless someone is extremely knowledgeable and willing to write some assembler to help out, they need to change it via a Windows linker option when the .exe is built, or via the EDITBIN developer tool (to modify the .exe file).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41912>
_______________________________________

From report at bugs.python.org  Fri Oct  2 23:49:00 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 03 Oct 2020 03:49:00 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601696940.22.0.808099181589.issue41905@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> I'm going to ignore this issue until you two have reached agreement.
> I recommend using some example code.

That won't be necessary.  I now understand what the OP is trying to do and am going to recommend against it.  

Guido, this really a decision for you to make.  Formerly ABC logic existed independent of any other class logic.  Nothing else in the standard library or in third-party tooling was required to take it into account.  A developer could leave or take it if they pleased.

The OP is proposing much tighter coupling and interdependence.  Effectively, he wants two new general rules to apply pervasively to existing tooling that previously had no reason to interact with ABCs at all.

1) When checking to see if a method exists, perhaps by using hasattr(), it should exclude abstract methods as determined by a follow-up getattr() call.

2) If a tool dynamically adds a method, it has duty to call update_abstractmethods() if even a slim possibility exists that ABCs are being used.

Presumably, none of this is unique to the total_ordering() decorator and it would apply to anything that dynamically inspects or updates classes whether by direct call, by class decorator, or by metaclass.

My recommendation is to not go down this path.  In the particular case of total_ordering(), the value add is slightly above zero.  In the decade long history of ABCs and the total_ordering() decorator, the need for this has arisen zero times.

P.S.  In the standard library, only the numbers module has ABCs with abstract rich comparison methods.  Typically, these would be used by registering the ABC rather than by inheriting from it.  That may be one reason why this hasn't come up.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sat Oct  3 00:55:04 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 03 Oct 2020 04:55:04 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601700904.2.0.475360456827.issue41905@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I still like to have a helper that recalculates the abstractness status of a class after adding some new methods (or deleting some).

I would prefer the isinstance(cls, ABCMeta) check to be inside that helper, so that you could call it unconditionally after adding/deleting methods: abc.update_abstractmethods(cls).  (It doesn't really need a comment saying "Update abstract methods" either. :-)

In fact, its signature makes the helper feasible as a class decorator itself, so that users who are using a mixin class decorator that doesn't update abstractness can add it conveniently themselvs. E.g. suppose @total_ordering didn't make this call itself, then the user could write

@abc.update_abstractmethods
@functools.total_ordering
class MyClass(SomeAbstractBaseClass):
    def __lt__(self, other):
        whatever

But I think it would be nice if @total_ordering and @dataclass did include this call.

However, I don't see why @total_ordering needs to be changed to also override abstract methods *defined in the decorated class*.  If I write

@functools.total_ordering
class MyAbstractClass(abc.ABC):
    @abc.abstractmethod
    def __lt__(self, other):
        return NotImplemented

it's totally clear to me what @total_ordering should do -- it should define __le__, __gt__ and __ge__ in terms of __lt__, and leave __lt__ alone, for some subclass to implement.

With these two amendments, the changes to dataclasses.py and functools.py are limited to two lines (adding the call to abc.update_abstractmethod(cls)), plus an import change.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sat Oct  3 01:10:32 2020
From: report at bugs.python.org (Tom Karzes)
Date: Sat, 03 Oct 2020 05:10:32 +0000
Subject: [issue41912] Long generator chain causes segmentation fault
In-Reply-To: <1601661685.77.0.221830308398.issue41912@roundup.psfhosted.org>
Message-ID: <1601701832.84.0.677291103701.issue41912@roundup.psfhosted.org>


Tom Karzes <karzes at sonic.net> added the comment:

Thanks Tim and Terry.  Stackless Python sounds interesting.  It's nice to know that others had the same idea I did, although I tend to shy away from exotic variants since they tend to be less well-supported.  Any chance that CPython will go stackless at some point in the future?

By the way, I saw that I can increase the process stack limit from within a Python app:

    resource.setrlimit(resource.RLIMIT_STACK, (resource.RLIM_INFINITY,
                                               resource.RLIM_INFINITY))

I tried it, and it works (on my Linux system), but of course is unavailable on Windows systems.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41912>
_______________________________________

From report at bugs.python.org  Sat Oct  3 01:10:35 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 03 Oct 2020 05:10:35 +0000
Subject: [issue41887] ast.literal_eval does not accept strings with leading
 whitespaces
In-Reply-To: <1601430417.52.0.930336195437.issue41887@roundup.psfhosted.org>
Message-ID: <1601701835.08.0.281420068919.issue41887@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

[Terry]
> But why should not parsing remove indents for 'eval' mode?

I dunno, but it's been doing this since 1992, so I think it would be fragile to change. The best thing therefore is to make ast.literal_eval() match it exactly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41887>
_______________________________________

From report at bugs.python.org  Sat Oct  3 01:50:29 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 03 Oct 2020 05:50:29 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601704229.51.0.600302118474.issue41905@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> it's totally clear to me what @total_ordering should do 
> -- it should define __le__, __gt__ and __ge__ in terms 
> of __lt__, and leave __lt__ alone, for some subclass to 
> implement.

+1

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sat Oct  3 01:59:01 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 05:59:01 +0000
Subject: [issue41892] use both "for in" and "ElementTree.remove" has a index
 bug
In-Reply-To: <1601475625.07.0.195514916094.issue41892@roundup.psfhosted.org>
Message-ID: <1601704741.96.0.985715468766.issue41892@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
versions: +Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41892>
_______________________________________

From report at bugs.python.org  Sat Oct  3 02:07:25 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 03 Oct 2020 06:07:25 +0000
Subject: [issue41900] XML C14N serialisation fails with default namespace
In-Reply-To: <1601539771.76.0.649263421271.issue41900@roundup.psfhosted.org>
Message-ID: <1601705245.94.0.822678597348.issue41900@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 1.0 -> 2.0
pull_requests: +21517
pull_request: https://github.com/python/cpython/pull/22507

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41900>
_______________________________________

From report at bugs.python.org  Sat Oct  3 02:07:33 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 03 Oct 2020 06:07:33 +0000
Subject: [issue41900] XML C14N serialisation fails with default namespace
In-Reply-To: <1601539771.76.0.649263421271.issue41900@roundup.psfhosted.org>
Message-ID: <1601705253.67.0.274678998346.issue41900@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21518
pull_request: https://github.com/python/cpython/pull/22508

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41900>
_______________________________________

From report at bugs.python.org  Sat Oct  3 02:07:20 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 06:07:20 +0000
Subject: [issue41900] XML C14N serialisation fails with default namespace
In-Reply-To: <1601539771.76.0.649263421271.issue41900@roundup.psfhosted.org>
Message-ID: <1601705240.15.0.462371933589.issue41900@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:


New changeset 6a412c94b6b68e7e3632562dc7358a12ffd1447f by scoder in branch 'master':
bpo-41900: C14N 2.0 serialisation failed for unprefixed attributes when a default namespace was defined. (GH-22474)
https://github.com/python/cpython/commit/6a412c94b6b68e7e3632562dc7358a12ffd1447f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41900>
_______________________________________

From report at bugs.python.org  Sat Oct  3 02:41:38 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 06:41:38 +0000
Subject: [issue41900] XML C14N serialisation fails with default namespace
In-Reply-To: <1601539771.76.0.649263421271.issue41900@roundup.psfhosted.org>
Message-ID: <1601707298.94.0.649288462612.issue41900@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:


New changeset a0f2b664335eb689abdecc677e09a193f503af59 by Miss Skeleton (bot) in branch '3.9':
bpo-41900: C14N 2.0 serialisation failed for unprefixed attributes when a default namespace was defined. (GH-22474) (GH-22507)
https://github.com/python/cpython/commit/a0f2b664335eb689abdecc677e09a193f503af59


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41900>
_______________________________________

From report at bugs.python.org  Sat Oct  3 02:42:41 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 06:42:41 +0000
Subject: [issue41900] XML C14N serialisation fails with default namespace
In-Reply-To: <1601539771.76.0.649263421271.issue41900@roundup.psfhosted.org>
Message-ID: <1601707361.25.0.544722249254.issue41900@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:


New changeset cfed5343331350c5737b464970a31f7588319e8b by Miss Skeleton (bot) in branch '3.8':
bpo-41900: C14N 2.0 serialisation failed for unprefixed attributes when a default namespace was defined. (GH-22474) (GH-22508)
https://github.com/python/cpython/commit/cfed5343331350c5737b464970a31f7588319e8b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41900>
_______________________________________

From report at bugs.python.org  Sat Oct  3 02:44:34 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 06:44:34 +0000
Subject: [issue41900] XML C14N serialisation fails with default namespace
In-Reply-To: <1601539771.76.0.649263421271.issue41900@roundup.psfhosted.org>
Message-ID: <1601707474.59.0.607443493489.issue41900@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41900>
_______________________________________

From report at bugs.python.org  Sat Oct  3 02:56:08 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 06:56:08 +0000
Subject: [issue6721] Locks in the standard library should be sanitized on fork
In-Reply-To: <1250550378.97.0.072881968798.issue6721@psf.upfronthosting.co.za>
Message-ID: <1601708168.13.0.560599055899.issue6721@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
nosy: +scoder
nosy_count: 29.0 -> 30.0
pull_requests: +21519
pull_request: https://github.com/python/cpython/pull/22474

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6721>
_______________________________________

From report at bugs.python.org  Sat Oct  3 02:56:08 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 06:56:08 +0000
Subject: [issue36533] logging regression with threading + fork are mixed in
 3.7.1rc2 (deadlock potential)
In-Reply-To: <1554452151.49.0.211568667786.issue36533@roundup.psfhosted.org>
Message-ID: <1601708168.39.0.930670024937.issue36533@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
nosy: +scoder
nosy_count: 9.0 -> 10.0
pull_requests: +21520
pull_request: https://github.com/python/cpython/pull/22474

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36533>
_______________________________________

From report at bugs.python.org  Sat Oct  3 02:56:08 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 06:56:08 +0000
Subject: [issue33802] Regression in logging configuration
In-Reply-To: <1528412435.4.0.592728768989.issue33802@psf.upfronthosting.co.za>
Message-ID: <1601708168.75.0.343986504159.issue33802@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
nosy: +scoder
nosy_count: 9.0 -> 10.0
pull_requests: +21521
pull_request: https://github.com/python/cpython/pull/22474

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33802>
_______________________________________

From report at bugs.python.org  Sat Oct  3 03:07:34 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 07:07:34 +0000
Subject: [issue36533] logging regression with threading + fork are mixed in
 3.7.1rc2 (deadlock potential)
In-Reply-To: <1554452151.49.0.211568667786.issue36533@roundup.psfhosted.org>
Message-ID: <1601708854.22.0.192327741844.issue36533@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
pull_requests:  -21520

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36533>
_______________________________________

From report at bugs.python.org  Sat Oct  3 03:08:03 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 07:08:03 +0000
Subject: [issue36533] logging regression with threading + fork are mixed in
 3.7.1rc2 (deadlock potential)
In-Reply-To: <1554452151.49.0.211568667786.issue36533@roundup.psfhosted.org>
Message-ID: <1601708883.02.0.991271268335.issue36533@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
nosy:  -scoder

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36533>
_______________________________________

From report at bugs.python.org  Sat Oct  3 03:08:30 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 07:08:30 +0000
Subject: [issue6721] Locks in the standard library should be sanitized on fork
In-Reply-To: <1250550378.97.0.072881968798.issue6721@psf.upfronthosting.co.za>
Message-ID: <1601708910.72.0.626187590012.issue6721@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
pull_requests:  -21519

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6721>
_______________________________________

From report at bugs.python.org  Sat Oct  3 03:08:56 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 07:08:56 +0000
Subject: [issue6721] Locks in the standard library should be sanitized on fork
In-Reply-To: <1250550378.97.0.072881968798.issue6721@psf.upfronthosting.co.za>
Message-ID: <1601708936.28.0.937821461048.issue6721@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
nosy:  -scoder

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6721>
_______________________________________

From report at bugs.python.org  Sat Oct  3 03:09:21 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 07:09:21 +0000
Subject: [issue33802] Regression in logging configuration
In-Reply-To: <1528412435.4.0.592728768989.issue33802@psf.upfronthosting.co.za>
Message-ID: <1601708961.34.0.29115114888.issue33802@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
pull_requests:  -21521

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33802>
_______________________________________

From report at bugs.python.org  Sat Oct  3 03:09:33 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 03 Oct 2020 07:09:33 +0000
Subject: [issue33802] Regression in logging configuration
In-Reply-To: <1528412435.4.0.592728768989.issue33802@psf.upfronthosting.co.za>
Message-ID: <1601708973.95.0.813191851371.issue33802@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
nosy:  -scoder

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33802>
_______________________________________

From report at bugs.python.org  Sat Oct  3 03:20:28 2020
From: report at bugs.python.org (Dustin Spicuzza)
Date: Sat, 03 Oct 2020 07:20:28 +0000
Subject: [issue41916] cxx pthread check is not overrideable
Message-ID: <1601709628.96.0.95457003563.issue41916@roundup.psfhosted.org>


New submission from Dustin Spicuzza <dustin at virtualroadside.com>:

I'm cross-compiling python to ARM, following instructions from the crossenv project @ https://crossenv.readthedocs.io/en/latest/quickstart.html#build-or-obtain-host-python

I was getting pthread related errors when using cross-built extension modules. I realized the issue was that distutils wasn't passing -pthread to gcc.

On my native python (Fedora 32 Python 3.8):

>>> import pprint, distutils.sysconfig
>>> pprint.pprint({i: distutils.sysconfig.get_config_vars(i)[0] for i in ('CC', 'CXX', 'LDSHARED')})
{'CC': 'gcc -pthread',
 'CXX': 'g++ -pthread',
 'LDSHARED': 'gcc -pthread -shared -Wl,-z,relro -Wl,--as-needed  -Wl,-z,now  '
             '-g  -Wl,-z,relro -Wl,--as-needed  -Wl,-z,now  -g'}

In my cross-compiled python environment:

>>> import pprint, distutils.sysconfig
>>> pprint.pprint({i: distutils.sysconfig.get_config_vars(i)[0] for i in ('CC', 'CXX', 'LDSHARED')})
{'CC': 'arm-frc2020-linux-gnueabi-gcc',
 'CXX': 'arm-frc2020-linux-gnueabi-c++',
 'LDSHARED': 'arm-frc2020-linux-gnueabi-gcc -shared'}

As you can see, no -pthread flag. I went digging in the configure script and found this comment in configure.ac:2110:

# Some compilers won't report that they do not support -pthread,
# so we need to run a program to see whether it really made the
# function available.

... well, that doesn't work when cross-compiling. I looked at some other variables set to override things for cross compiling, and tried adding "ac_cv_pthread_is_default=no ac_cv_pthread=yes ac_cv_cxx_thread=yes" to my cross-compile ./configure, and it's closer:

>>> import pprint, distutils.sysconfig
>>> pprint.pprint({i: distutils.sysconfig.get_config_vars(i)[0] for i in ('CC', 'CXX', 'LDSHARED')})
{'CC': 'arm-frc2020-linux-gnueabi-gcc -pthread',
 'CXX': 'arm-frc2020-linux-gnueabi-c++',
 'LDSHARED': 'arm-frc2020-linux-gnueabi-gcc -pthread -shared'}

Closer, but not there yet! It appears that the $ac_cv_cxx_thread is not externally settable (unlike ac_cv_pthread), which I guess is because it's not wrapped in a AC_CACHE_VAL macro?

It seems that the right fix would be for someone to use AC_CACHE_VAL to allow $ac_cv_cxx_thread to be set externally? I'm happy to cargo cult some code from other parts of configure.ac and make a PR for it, but it's not immediately clear (a) what bad side effects this could cause and (b) what the best mechanism to use to regenerate configure et al is?

----------
components: Cross-Build
messages: 377858
nosy: Alex.Willmer, virtuald
priority: normal
severity: normal
status: open
title: cxx pthread check is not overrideable
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41916>
_______________________________________

From report at bugs.python.org  Sat Oct  3 03:49:25 2020
From: report at bugs.python.org (ullix)
Date: Sat, 03 Oct 2020 07:49:25 +0000
Subject: [issue41917] Python 3.9rc2 fails to install matplotlib
Message-ID: <1601711365.63.0.761607861812.issue41917@roundup.psfhosted.org>


New submission from ullix <ullix at urkam.de>:

Installing matplotlib via: python3 -m pip install -U matplotlib
fails because kiwisolver cannot be installed. Among a lot of error output is: WARNING: The wheel package is not available.

Not having matplotlib is a MAJOR hurdle for many!


Sstem: Ubuntu 16.04 with Python 3.9rc2 installed from deadsnakes repository (http://ppa.launchpad.net/deadsnakes/ppa/ubuntu/)

----------
components: Installation
messages: 377859
nosy: ullix
priority: normal
severity: normal
status: open
title: Python 3.9rc2 fails to install matplotlib
type: resource usage
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41917>
_______________________________________

From report at bugs.python.org  Sat Oct  3 04:08:54 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 03 Oct 2020 08:08:54 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601712534.87.0.55387824907.issue41909@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Interesting, when lookup any attribute you will get a RecursionError, but this is one of only two places where the recursion check is disabled (the other one is in interning strings).

You get a crash also when call isinstance(1, instance) or issubclass(int, instance). This is the same bug.

The implementation of issubclass() calls PyObject_IsSubclass() which calls object_issubclass() which calls recursive_issubclass() which calls check_class() which calls abstract_get_bases() which looks up attribute "__bases__" which leads to infinite recursion in __getattr__().

#125278 0x000055555576116d in abstract_get_bases (cls=cls at entry=0x7fffeabcee10) at Objects/abstract.c:2340
#125279 0x00005555557611f1 in check_class (cls=cls at entry=0x7fffeabcee10, error=error at entry=0x55555585c828 "issubclass() arg 1 must be a class") at Objects/abstract.c:2396
#125280 0x00005555557619bf in recursive_issubclass (derived=derived at entry=0x7fffeabcee10, cls=cls at entry=0x555555946220 <PyLong_Type>) at Objects/abstract.c:2524
#125281 0x0000555555761daf in object_issubclass (tstate=<optimized out>, derived=0x7fffeabcee10, cls=0x555555946220 <PyLong_Type>) at Objects/abstract.c:2550
#125282 0x0000555555765ea1 in PyObject_IsSubclass (derived=<optimized out>, cls=<optimized out>) at Objects/abstract.c:2600
#125283 0x00005555557b78f3 in builtin_issubclass_impl (module=module at entry=0x7fffeae21d70, cls=<optimized out>, class_or_tuple=<optimized out>) at Python/bltinmodule.c:2511
#125284 0x00005555557b794d in builtin_issubclass (module=0x7fffeae21d70, args=0x7fffead0e388, nargs=<optimized out>) at Python/clinic/bltinmodule.c.h:828

The problem is that in abstract_get_bases() the recursion check is disabled by using macros Py_ALLOW_RECURSION/Py_END_ALLOW_RECURSION (added in 5b222135f8d2492713994f2cb003980e87ce6a72). I do not know why it was necessary. Currently tests are passed if enable recursion check, and this fixes this issue.

It is worth to mention that attribute __bases__ is looked up to support non-types in issubclass() and isinstance(). Originally it was added in issue464992 to support Zope extension ExtensionClass. I tested that the current code of ExtensionClass does not need it. So we could simplify the code and avoid recursion by just using tp_bases. But this needs wider discussion.

----------
nosy: +gvanrossum, loewis, nascheme, serhiy.storchaka
versions: +Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Sat Oct  3 04:17:58 2020
From: report at bugs.python.org (Ben Avrahami)
Date: Sat, 03 Oct 2020 08:17:58 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601713078.93.0.168590040801.issue41905@roundup.psfhosted.org>


Ben Avrahami <avrahami.ben at gmail.com> added the comment:

> I would prefer the isinstance(cls, ABCMeta) check to be inside that helper

I had a little debate about this in my mind, I'll change it.

> it's totally clear to me what @total_ordering should do -- it should define __le__, __gt__ and __ge__ in terms of __lt__, and leave __lt__ alone, for some subclass to implement.

Implementing this logic would require more than two lines. I will add it to the PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sat Oct  3 05:06:44 2020
From: report at bugs.python.org (Quentin Peter)
Date: Sat, 03 Oct 2020 09:06:44 +0000
Subject: [issue41918] exec fails to take locals into account when running list
 comprehensions
Message-ID: <1601716004.0.0.802801393199.issue41918@roundup.psfhosted.org>


New submission from Quentin Peter <qpeter at bluewin.ch>:

The exec function fails to take locals into account when executing a list comprehension:
```
Python 3.7.7 (default, Mar 10 2020, 15:43:33) 
[Clang 11.0.0 (clang-1100.0.33.17)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> exec(compile('[my_var for i in range(1)]\n', '<stdin>', 'single'), {**globals(), "my_var": 0}, None)
[0]
>>> exec(compile('[my_var for i in range(1)]\n', '<stdin>', 'single'), globals(), {"my_var": 0})
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "<stdin>", line 1, in <module>
  File "<stdin>", line 1, in <listcomp>
NameError: name 'my_var' is not defined
>>> 
```
This is the cause of https://bugs.python.org/issue21161

----------
messages: 377862
nosy: qpeter
priority: normal
severity: normal
status: open
title: exec fails to take locals into account when running list comprehensions
type: enhancement
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41918>
_______________________________________

From report at bugs.python.org  Sat Oct  3 05:37:07 2020
From: report at bugs.python.org (hai shi)
Date: Sat, 03 Oct 2020 09:37:07 +0000
Subject: [issue41919] Move the codecs' register operation to testcases
Message-ID: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>


New submission from hai shi <shihai1991 at 126.com>:

After PR22360 merged, we can move the codecs' register operation to testcases.

----------
components: Tests
messages: 377863
nosy: shihai1991, vstinner
priority: normal
severity: normal
status: open
title: Move the codecs' register operation to testcases
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Sat Oct  3 05:39:36 2020
From: report at bugs.python.org (hai shi)
Date: Sat, 03 Oct 2020 09:39:36 +0000
Subject: [issue41919] Move the codecs' register operation to testcases
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1601717976.78.0.7822904364.issue41919@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
keywords: +patch
pull_requests: +21522
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22513

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Sat Oct  3 05:40:12 2020
From: report at bugs.python.org (hai shi)
Date: Sat, 03 Oct 2020 09:40:12 +0000
Subject: [issue41919] Move the codecs.register operation to testcases
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1601718012.31.0.427663754347.issue41919@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
title: Move the codecs' register operation to testcases -> Move the codecs.register operation to testcases

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Sat Oct  3 05:52:17 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 03 Oct 2020 09:52:17 +0000
Subject: [issue40833] Clarify docstring of Path.rename
In-Reply-To: <1590933048.45.0.441602956173.issue40833@roundup.psfhosted.org>
Message-ID: <1601718737.39.0.923532798743.issue40833@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:


New changeset f97e42ef4d97dee64f45ed65170a6e77c8e46fdf by Ram Rachum in branch 'master':
bpo-40833: Clarify Path.rename doc-string regarding relative paths (GH-20554)
https://github.com/python/cpython/commit/f97e42ef4d97dee64f45ed65170a6e77c8e46fdf


----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40833>
_______________________________________

From report at bugs.python.org  Sat Oct  3 05:52:29 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 03 Oct 2020 09:52:29 +0000
Subject: [issue40833] Clarify docstring of Path.rename
In-Reply-To: <1590933048.45.0.441602956173.issue40833@roundup.psfhosted.org>
Message-ID: <1601718749.16.0.413175462136.issue40833@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21523
pull_request: https://github.com/python/cpython/pull/22514

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40833>
_______________________________________

From report at bugs.python.org  Sat Oct  3 05:52:37 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 03 Oct 2020 09:52:37 +0000
Subject: [issue40833] Clarify docstring of Path.rename
In-Reply-To: <1590933048.45.0.441602956173.issue40833@roundup.psfhosted.org>
Message-ID: <1601718757.74.0.882319501605.issue40833@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21524
pull_request: https://github.com/python/cpython/pull/22515

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40833>
_______________________________________

From report at bugs.python.org  Sat Oct  3 06:02:35 2020
From: report at bugs.python.org (David Beazley)
Date: Sat, 03 Oct 2020 10:02:35 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1601719355.58.0.651111116056.issue7946@roundup.psfhosted.org>


David Beazley <dave at dabeaz.com> added the comment:

About nine years ago, I stood in front of a room of Python developers, including many core developers, and gave a talk about the problem described in this issue.  It included some live demos and discussion of a possible fix. 

https://www.youtube.com/watch?v=fwzPF2JLoeU

Based on subsequent interest, I think it's safe to say that this issue will never be fixed.  Probably best to close this issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Sat Oct  3 06:11:43 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 03 Oct 2020 10:11:43 +0000
Subject: [issue40833] Clarify docstring of Path.rename
In-Reply-To: <1590933048.45.0.441602956173.issue40833@roundup.psfhosted.org>
Message-ID: <1601719903.31.0.938954645104.issue40833@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 4b982e0dd7354c9103a0cae8e6e78b5e57794e77 by Miss Skeleton (bot) in branch '3.8':
bpo-40833: Clarify Path.rename doc-string regarding relative paths (GH-20554)
https://github.com/python/cpython/commit/4b982e0dd7354c9103a0cae8e6e78b5e57794e77


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40833>
_______________________________________

From report at bugs.python.org  Sat Oct  3 06:17:18 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 03 Oct 2020 10:17:18 +0000
Subject: [issue40833] Clarify docstring of Path.rename
In-Reply-To: <1590933048.45.0.441602956173.issue40833@roundup.psfhosted.org>
Message-ID: <1601720238.37.0.584478634029.issue40833@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21525
pull_request: https://github.com/python/cpython/pull/22516

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40833>
_______________________________________

From report at bugs.python.org  Sat Oct  3 06:29:27 2020
From: report at bugs.python.org (Ken Jin)
Date: Sat, 03 Oct 2020 10:29:27 +0000
Subject: [issue41428] PEP 604 -- Allow writing union types as X | Y
In-Reply-To: <1595975550.94.0.895278514403.issue41428@roundup.psfhosted.org>
Message-ID: <1601720967.06.0.850715903907.issue41428@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
nosy: +kj
nosy_count: 4.0 -> 5.0
pull_requests: +21526
pull_request: https://github.com/python/cpython/pull/22517

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41428>
_______________________________________

From report at bugs.python.org  Sat Oct  3 06:43:50 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 03 Oct 2020 10:43:50 +0000
Subject: [issue41867] Include options for timespec in docstrings of isoformat
In-Reply-To: <1601138683.03.0.777121692912.issue41867@roundup.psfhosted.org>
Message-ID: <1601721830.26.0.166995065854.issue41867@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:


New changeset 52301312bb9de2299b0c42468fd1936d869e651c by Ram Rachum in branch 'master':
bpo-41867: List options for timespec in docstrings of isoformat methods (GH-22418)
https://github.com/python/cpython/commit/52301312bb9de2299b0c42468fd1936d869e651c


----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41867>
_______________________________________

From report at bugs.python.org  Sat Oct  3 06:44:01 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 03 Oct 2020 10:44:01 +0000
Subject: [issue41867] Include options for timespec in docstrings of isoformat
In-Reply-To: <1601138683.03.0.777121692912.issue41867@roundup.psfhosted.org>
Message-ID: <1601721841.55.0.541991779072.issue41867@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +21527
pull_request: https://github.com/python/cpython/pull/22518

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41867>
_______________________________________

From report at bugs.python.org  Sat Oct  3 06:44:17 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 03 Oct 2020 10:44:17 +0000
Subject: [issue40833] Clarify docstring of Path.rename
In-Reply-To: <1590933048.45.0.441602956173.issue40833@roundup.psfhosted.org>
Message-ID: <1601721857.8.0.972478362292.issue40833@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:


New changeset ef7b937b8fe94f4c59dfcbe7567c3ca76097a41d by Miss Skeleton (bot) in branch '3.9':
[3.9] bpo-40833: Clarify Path.rename doc-string regarding relative paths (GH-20554)
https://github.com/python/cpython/commit/ef7b937b8fe94f4c59dfcbe7567c3ca76097a41d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40833>
_______________________________________

From report at bugs.python.org  Sat Oct  3 06:44:10 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 03 Oct 2020 10:44:10 +0000
Subject: [issue41867] Include options for timespec in docstrings of isoformat
In-Reply-To: <1601138683.03.0.777121692912.issue41867@roundup.psfhosted.org>
Message-ID: <1601721850.19.0.678084562659.issue41867@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21528
pull_request: https://github.com/python/cpython/pull/22519

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41867>
_______________________________________

From report at bugs.python.org  Sat Oct  3 06:45:03 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 03 Oct 2020 10:45:03 +0000
Subject: [issue40833] Clarify docstring of Path.rename
In-Reply-To: <1590933048.45.0.441602956173.issue40833@roundup.psfhosted.org>
Message-ID: <1601721903.61.0.860127641076.issue40833@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

Thanks, Ram!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40833>
_______________________________________

From report at bugs.python.org  Sat Oct  3 07:01:51 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 03 Oct 2020 11:01:51 +0000
Subject: [issue41867] Include options for timespec in docstrings of isoformat
In-Reply-To: <1601138683.03.0.777121692912.issue41867@roundup.psfhosted.org>
Message-ID: <1601722911.27.0.375993541761.issue41867@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 9aa34f1bbbe1ca6376539f9ba436ff75d2141888 by Miss Skeleton (bot) in branch '3.8':
bpo-41867: List options for timespec in docstrings of isoformat methods (GH-22418)
https://github.com/python/cpython/commit/9aa34f1bbbe1ca6376539f9ba436ff75d2141888


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41867>
_______________________________________

From report at bugs.python.org  Sat Oct  3 07:39:41 2020
From: report at bugs.python.org (Leonard Schwennesen)
Date: Sat, 03 Oct 2020 11:39:41 +0000
Subject: [issue41920] Weird add operation of "0.2222 + 0.1111"
Message-ID: <1601725181.53.0.727469935565.issue41920@roundup.psfhosted.org>


New submission from Leonard Schwennesen <l.schwennesen at gmx.net>:

If I add 0.2222 + 0.1111 in the python cli I get the value 0.33330000000000004 and not 0.3333. Also the other way around.
But if I enter for example 0.22222+0.11111 I get 0.33333 so that's right.
Here are a few examples I tested that working properly:

>>> 0.22+0.11
0.33
>>> 0.222+0.111
0.333
>>> 0.22222+0.11111
0.33333
>>> 0.3333+0.7777
1.111
>>> 0.3333+0.6666
0.9999
>>> 0.3333+0.3333
0.6666
>>> 0.6666+0.1111
0.7777
>>> 0.2222+0.3333
0.5555

Python 3.8.5
[GCC 10.2.0] on linux

I also tested that in a newly setup VM, same issue

----------
messages: 377871
nosy: ungedummt
priority: normal
severity: normal
status: open
title: Weird add operation of "0.2222 + 0.1111"
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41920>
_______________________________________

From report at bugs.python.org  Sat Oct  3 07:42:31 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 03 Oct 2020 11:42:31 +0000
Subject: [issue41867] Include options for timespec in docstrings of isoformat
In-Reply-To: <1601138683.03.0.777121692912.issue41867@roundup.psfhosted.org>
Message-ID: <1601725351.73.0.763998497706.issue41867@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:


New changeset 8ca08310a882b7db6469fe732465610b92f4665e by Miss Skeleton (bot) in branch '3.9':
[3.9] bpo-41867: List options for timespec in docstrings of isoformat methods (GH-22418)
https://github.com/python/cpython/commit/8ca08310a882b7db6469fe732465610b92f4665e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41867>
_______________________________________

From report at bugs.python.org  Sat Oct  3 07:43:06 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 03 Oct 2020 11:43:06 +0000
Subject: [issue41867] Include options for timespec in docstrings of isoformat
In-Reply-To: <1601138683.03.0.777121692912.issue41867@roundup.psfhosted.org>
Message-ID: <1601725386.22.0.0832431131813.issue41867@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

Thanks for this, Ram!

----------
assignee:  -> docs at python
components: +Documentation
nosy: +docs at python
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41867>
_______________________________________

From report at bugs.python.org  Sat Oct  3 07:50:13 2020
From: report at bugs.python.org (Leonard Schwennesen)
Date: Sat, 03 Oct 2020 11:50:13 +0000
Subject: [issue41920] Weird add operation of "0.2222 + 0.1111"
In-Reply-To: <1601725181.53.0.727469935565.issue41920@roundup.psfhosted.org>
Message-ID: <1601725813.78.0.99170368432.issue41920@roundup.psfhosted.org>


Leonard Schwennesen <l.schwennesen at gmx.net> added the comment:

Same problem with 0.3333-0.1111 python returns 0.22219999999999998 and not 0.2222

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41920>
_______________________________________

From report at bugs.python.org  Sat Oct  3 08:04:34 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Sat, 03 Oct 2020 12:04:34 +0000
Subject: [issue41920] Weird add operation of "0.2222 + 0.1111"
In-Reply-To: <1601725181.53.0.727469935565.issue41920@roundup.psfhosted.org>
Message-ID: <1601726674.23.0.799944204492.issue41920@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Please forgive me if my answer is a little bit brusque, but we get essentially this same bug report regularly, only the numbers are different.

This is not a bug in Python, it is an unavoidable consequence of how floating point arithmetic works in every single programming language that does floating point arithmetic.

There's a FAQ about it:

https://docs.python.org/3/faq/design.html#why-am-i-getting-strange-results-with-simple-arithmetic-operations

it's discussed in the tutorial:

https://docs.python.org/3/tutorial/floatingpoint.html#tut-fp-issues

there's probably a million websites, blog posts, Stackoverflow questions etc about it, and computer scientists write papers about it:

https://docs.oracle.com/cd/E19957-01/806-3568/ncg_goldberg.html

----------
nosy: +steven.daprano
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41920>
_______________________________________

From report at bugs.python.org  Sat Oct  3 08:15:03 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Sat, 03 Oct 2020 12:15:03 +0000
Subject: [issue41920] Weird add operation of "0.2222 + 0.1111"
In-Reply-To: <1601725181.53.0.727469935565.issue41920@roundup.psfhosted.org>
Message-ID: <1601727303.11.0.467428285029.issue41920@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Some further resources:

https://stackoverflow.com/questions/8215437/floating-point-accuracy-in-python

https://stackoverflow.com/questions/21895756/why-are-floating-point-numbers-inaccurate

https://stackoverflow.com/questions/1089018/why-cant-decimal-numbers-be-represented-exactly-in-binary?noredirect=1&lq=1

https://randomascii.wordpress.com/category/floating-point/page/1/


If you google a bit you will find many other places that discuss this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41920>
_______________________________________

From report at bugs.python.org  Sat Oct  3 08:23:07 2020
From: report at bugs.python.org (Leonard Schwennesen)
Date: Sat, 03 Oct 2020 12:23:07 +0000
Subject: [issue41920] Weird add operation of "0.2222 + 0.1111"
In-Reply-To: <1601725181.53.0.727469935565.issue41920@roundup.psfhosted.org>
Message-ID: <1601727787.62.0.177662759567.issue41920@roundup.psfhosted.org>


Leonard Schwennesen <l.schwennesen at gmx.net> added the comment:

Ok thank you for these resources. I didn't know that before. (;

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41920>
_______________________________________

From report at bugs.python.org  Sat Oct  3 08:27:17 2020
From: report at bugs.python.org (Leonard Schwennesen)
Date: Sat, 03 Oct 2020 12:27:17 +0000
Subject: [issue41920] Weird add operation of "0.2222 + 0.1111"
In-Reply-To: <1601725181.53.0.727469935565.issue41920@roundup.psfhosted.org>
Message-ID: <1601728037.28.0.248685032247.issue41920@roundup.psfhosted.org>


Leonard Schwennesen <l.schwennesen at gmx.net> added the comment:

But this "bug" only affects floating numbers?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41920>
_______________________________________

From report at bugs.python.org  Sat Oct  3 08:31:05 2020
From: report at bugs.python.org (Pradyun Gedam)
Date: Sat, 03 Oct 2020 12:31:05 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1601649766.64.0.74479063775.issue41490@roundup.psfhosted.org>
Message-ID: <CAPA-EqsnftEO=QjHxiqJYw-=vho3Xo+MtOoRcZ4mCJkx6L2aqw@mail.gmail.com>


Pradyun Gedam <pradyunsg at gmail.com> added the comment:

+1 for bumping to 20.2.3, in case an upstream voice is helpful. :)

On Fri, Oct 2, 2020 at 8:12 PM Pablo Galindo Salgado <report at bugs.python.org>
wrote:

>
> Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:
>
> I think that the backport to 3.8 may have some unintended consequences in
> the last patch release as venv created with 3.8 now exhibit the pip
> regression (https://github.com/pypa/pip/issues/8695.).
>
> Steve, would you be ok if we bump all branches (master, 3.9 and 3.8) to
> 20.2.3?
>
> ----------
> nosy: +pablogsal
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue41490>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Sat Oct  3 09:00:20 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 03 Oct 2020 13:00:20 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601730020.45.0.817488236494.issue41898@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

You didn't specify the logger in the assertLogs() call. 

The documentation says that "The default is the root logger, which will catch all messages."

https://docs.python.org/3/library/unittest.html#unittest.TestCase.assertLogs

This is behaving as expected.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Sat Oct  3 09:38:21 2020
From: report at bugs.python.org (=?utf-8?q?Andr=C3=A9s_Delfino?=)
Date: Sat, 03 Oct 2020 13:38:21 +0000
Subject: [issue36533] logging regression with threading + fork are mixed in
 3.7.1rc2 (deadlock potential)
In-Reply-To: <1554452151.49.0.211568667786.issue36533@roundup.psfhosted.org>
Message-ID: <1601732301.45.0.998861434844.issue36533@roundup.psfhosted.org>


Change by Andr?s Delfino <adelfino at gmail.com>:


----------
nosy:  -adelfino

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36533>
_______________________________________

From report at bugs.python.org  Sat Oct  3 09:38:34 2020
From: report at bugs.python.org (=?utf-8?q?Andr=C3=A9s_Delfino?=)
Date: Sat, 03 Oct 2020 13:38:34 +0000
Subject: [issue6721] Locks in the standard library should be sanitized on fork
In-Reply-To: <1250550378.97.0.072881968798.issue6721@psf.upfronthosting.co.za>
Message-ID: <1601732314.49.0.969804357913.issue6721@roundup.psfhosted.org>


Change by Andr?s Delfino <adelfino at gmail.com>:


----------
nosy:  -adelfino

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6721>
_______________________________________

From report at bugs.python.org  Sat Oct  3 09:38:41 2020
From: report at bugs.python.org (=?utf-8?q?Andr=C3=A9s_Delfino?=)
Date: Sat, 03 Oct 2020 13:38:41 +0000
Subject: [issue33802] Regression in logging configuration
In-Reply-To: <1528412435.4.0.592728768989.issue33802@psf.upfronthosting.co.za>
Message-ID: <1601732321.87.0.410244720503.issue33802@roundup.psfhosted.org>


Change by Andr?s Delfino <adelfino at gmail.com>:


----------
nosy:  -adelfino

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33802>
_______________________________________

From report at bugs.python.org  Sat Oct  3 10:28:59 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Sat, 03 Oct 2020 14:28:59 +0000
Subject: [issue41826] test_peg_generator compilation warnings
In-Reply-To: <1600710972.69.0.778161141813.issue41826@roundup.psfhosted.org>
Message-ID: <1601735339.56.0.805135892864.issue41826@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:


New changeset c111355480ff51b50a671679c5099f534cb01cae by Pablo Galindo in branch 'master':
bpo-41826: Fix compiler warnings in test_peg_generator (GH-22455)
https://github.com/python/cpython/commit/c111355480ff51b50a671679c5099f534cb01cae


----------
nosy: +lys.nikolaou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41826>
_______________________________________

From report at bugs.python.org  Sat Oct  3 10:32:49 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 03 Oct 2020 14:32:49 +0000
Subject: [issue41887] ast.literal_eval does not accept strings with leading
 whitespaces
In-Reply-To: <1601430417.52.0.930336195437.issue41887@roundup.psfhosted.org>
Message-ID: <1601735569.95.0.639398669239.issue41887@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> I dunno, but it's been doing this since 1992, so I think it would be fragile to change. The best thing therefore is to make ast.literal_eval() match it exactly.

+1 We had considerable finicky behaviour in the parser related to new lines and whitespace so I would recommend to strive for stability.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41887>
_______________________________________

From report at bugs.python.org  Sat Oct  3 10:33:07 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 03 Oct 2020 14:33:07 +0000
Subject: [issue41826] test_peg_generator compilation warnings
In-Reply-To: <1600710972.69.0.778161141813.issue41826@roundup.psfhosted.org>
Message-ID: <1601735587.27.0.707794844813.issue41826@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41826>
_______________________________________

From report at bugs.python.org  Sat Oct  3 10:58:43 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 03 Oct 2020 14:58:43 +0000
Subject: [issue40564] Using zipfile.Path with several files prematurely closes
 zip
In-Reply-To: <1588952821.29.0.991302590341.issue40564@roundup.psfhosted.org>
Message-ID: <1601737123.76.0.581795147688.issue40564@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:


New changeset ebbe8033b1c61854c4b623aaf9c3e170d179f875 by Jason R. Coombs in branch 'master':
bpo-40564: Avoid copying state from extant ZipFile. (GH-22371)
https://github.com/python/cpython/commit/ebbe8033b1c61854c4b623aaf9c3e170d179f875


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40564>
_______________________________________

From report at bugs.python.org  Sat Oct  3 10:59:40 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 03 Oct 2020 14:59:40 +0000
Subject: [issue40564] Using zipfile.Path with several files prematurely closes
 zip
In-Reply-To: <1588952821.29.0.991302590341.issue40564@roundup.psfhosted.org>
Message-ID: <1601737180.9.0.725403238188.issue40564@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

Fix merged into master. Please use zipp 3.2.0 on Python 3.9 and earlier for the improved behavior or report back here if a backport is needed (and why).

----------
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40564>
_______________________________________

From report at bugs.python.org  Sat Oct  3 10:59:58 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 03 Oct 2020 14:59:58 +0000
Subject: [issue40564] Using zipfile.Path with several files prematurely closes
 zip
In-Reply-To: <1588952821.29.0.991302590341.issue40564@roundup.psfhosted.org>
Message-ID: <1601737198.36.0.266184201747.issue40564@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
resolution:  -> fixed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40564>
_______________________________________

From report at bugs.python.org  Sat Oct  3 11:12:49 2020
From: report at bugs.python.org (yeting li)
Date: Sat, 03 Oct 2020 15:12:49 +0000
Subject: [issue41921] REDoS in parseentities
Message-ID: <1601737969.46.0.495788645161.issue41921@roundup.psfhosted.org>


New submission from yeting li <liyt at ios.ac.cn>:

Hi,

I find this regex '<!ENTITY +(\w+) +CDATA +"([^"]+)" +-- +((?:.|\n)+?) *-->' may be stucked by input.
The vulnerable regex is located in
https://github.com/python/cpython/blob/8d21aa21f2cbc6d50aab3f420bb23be1d081dac4/Tools/scripts/parseentities.py#L18

The ReDOS vulnerability of the regex is mainly due to the sub-pattern ' +((?:.|\n)+?) *'
and can be exploited with the following string
'<!ENTITY a CDATA "a" -- ' + ' ' * 5000

You can execute the following code to reproduce ReDos


from Tools.scripts.parseentities import parse
from time import perf_counter

for i in range(0, 10000):
    ATTACK = '<!ENTITY a CDATA "a" -- ' + ' ' * i * 100
    LEN = len(ATTACK)
    BEGIN = perf_counter()
    parse(ATTACK)
    DURATION = perf_counter() - BEGIN
    print(f"{LEN}: took {DURATION} seconds!")





Looking forward for your response?!

Best,
Yeting Li

----------
components: Demos and Tools
messages: 377885
nosy: yetingli
priority: normal
severity: normal
status: open
title: REDoS in parseentities
versions: Python 3.10, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41921>
_______________________________________

From report at bugs.python.org  Sat Oct  3 11:19:19 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 03 Oct 2020 15:19:19 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601738359.48.0.0293677080183.issue41905@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Why would that require more code? That?s already how it worked. Maybe you misunderstand what I tried to say?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sat Oct  3 11:29:55 2020
From: report at bugs.python.org (Ben Avrahami)
Date: Sat, 03 Oct 2020 15:29:55 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601738995.61.0.526442189939.issue41905@roundup.psfhosted.org>


Ben Avrahami <avrahami.ben at gmail.com> added the comment:

> Maybe you misunderstand what I tried to say?

Possibly, right now, total_ordering avoids overriding any method that is declared, either in the class or its superclasses (except for object), regardless of whether or not it is abstract. For it to be ABC-aware, it would need the ability to override abstract methods defined in superclasses, so we need to check whether an exisitng method is abstract.

Additionally we want to not override abstract methods defined in the subject class, so we also need to check whether the method is defined in the class __dict__ (that's the extra logic I was referring to).

An argument could be made that total_ordering should override any method not defined in the subject class, abstract or no (implementing this logic would also speed up total_ordering, but that's beside the point).

Is this what you meant?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sat Oct  3 11:43:43 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 03 Oct 2020 15:43:43 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601739823.92.0.120040049784.issue41905@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Ah, okay. I wasn't familiar with @total_ordering so I assumed differently.  Sorry for the continued misunderstanding.

Perhaps we should just leave it alone completely then, since ISTM that any change to its implementation may cause subtle bugs in currently working code.

The problem you see only occurs when there are abstract ordering methods present. The cure is simple, just implement all four comparison functions (and do away with @total_ordering). This is not a great burden. Instead we should probably add a line or two to the docs explaining how it interacts with ABCs defining abstract ordering methods.

@dataclass uses a different approach ("is it defined in the current class?"). That is perfectly ready for a call to abc.update_abstractmethods(). (I checked, and dataclasses already depends on abc, indirectly via functools, so the extra import is free.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sat Oct  3 12:00:56 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 03 Oct 2020 16:00:56 +0000
Subject: [issue41922] Use PEP 590 vectorcall to speed up calls to reversed()
Message-ID: <1601740856.71.0.650184607578.issue41922@roundup.psfhosted.org>


New submission from Dong-hee Na <donghee.na92 at gmail.com>:

reversed is also a very well-used type.
if shows 10+ percent performance improvement from baseline and this metric.
And this improvement looks acceptable from viewing builtin types which are applied PEP 590 (frozenset, list, set, dict)  

reversed creation + for loop
Mean +- std dev: [reversed_master] 157 ns +- 4 ns -> [reversed_opt] 139 ns +- 2 ns: 1.13x faster (-11%)

reversed creation
Mean +- std dev: [reversed2_master] 118 ns +- 2 ns -> [reversed2_opt] 101 ns +- 2 ns: 1.18x faster (-15%)

----------
components: Interpreter Core
files: bench_reversed.py
messages: 377889
nosy: corona10, pablogsal, vstinner
priority: normal
severity: normal
status: open
title: Use PEP 590 vectorcall to speed up calls to reversed()
type: performance
versions: Python 3.10
Added file: https://bugs.python.org/file49488/bench_reversed.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41922>
_______________________________________

From report at bugs.python.org  Sat Oct  3 12:01:02 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 03 Oct 2020 16:01:02 +0000
Subject: [issue41922] Use PEP 590 vectorcall to speed up calls to reversed()
In-Reply-To: <1601740856.71.0.650184607578.issue41922@roundup.psfhosted.org>
Message-ID: <1601740862.38.0.214554819858.issue41922@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
assignee:  -> corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41922>
_______________________________________

From report at bugs.python.org  Sat Oct  3 12:06:34 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 03 Oct 2020 16:06:34 +0000
Subject: [issue41922] Use PEP 590 vectorcall to speed up calls to reversed()
In-Reply-To: <1601740856.71.0.650184607578.issue41922@roundup.psfhosted.org>
Message-ID: <1601741194.98.0.914370215604.issue41922@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
keywords: +patch
pull_requests: +21529
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22523

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41922>
_______________________________________

From report at bugs.python.org  Sat Oct  3 12:16:30 2020
From: report at bugs.python.org (Mikhail Golubev)
Date: Sat, 03 Oct 2020 16:16:30 +0000
Subject: [issue41923] Add PEP 613 typing.TypeAlias to the standard library
Message-ID: <1601741790.03.0.822782590759.issue41923@roundup.psfhosted.org>


New submission from Mikhail Golubev <mikhail.golubev at jetbrains.com>:

TypeAlias is already included in typing_extensions package, making it available for pre-3.10 versions of Python. I'd like port this implementation to the upstream version of typing.

----------
components: Library (Lib)
messages: 377890
nosy: mikhail.golubev
priority: normal
severity: normal
status: open
title: Add PEP 613 typing.TypeAlias to the standard library
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41923>
_______________________________________

From report at bugs.python.org  Sat Oct  3 12:37:11 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 03 Oct 2020 16:37:11 +0000
Subject: [issue41921] REDoS in parseentities
In-Reply-To: <1601737969.46.0.495788645161.issue41921@roundup.psfhosted.org>
Message-ID: <1601743031.04.0.995243927491.issue41921@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41921>
_______________________________________

From report at bugs.python.org  Sat Oct  3 12:41:50 2020
From: report at bugs.python.org (Emmanuel Arias)
Date: Sat, 03 Oct 2020 16:41:50 +0000
Subject: [issue40455] GCC 10 compiler warnings
In-Reply-To: <1588279868.77.0.13865368461.issue40455@roundup.psfhosted.org>
Message-ID: <1601743310.14.0.413177316393.issue40455@roundup.psfhosted.org>


Emmanuel Arias <eamanu at yaerobi.com> added the comment:

Hi, I've on my Debian (testing) the reported warning:

In function ?assemble_lnotab?,
    inlined from ?assemble_emit? at Python/compile.c:5706:25,
    inlined from ?assemble? at Python/compile.c:6048:18:
Python/compile.c:5660:19: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=]
 5660 |         *lnotab++ = k;
      |      


gcc --version          
gcc (Debian 10.2.0-5) 10.2.0
Copyright (C) 2020 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

----------
nosy: +eamanu

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40455>
_______________________________________

From report at bugs.python.org  Sat Oct  3 12:54:27 2020
From: report at bugs.python.org (Dustin Spicuzza)
Date: Sat, 03 Oct 2020 16:54:27 +0000
Subject: [issue41916] cxx pthread check is not overrideable
In-Reply-To: <1601709628.96.0.95457003563.issue41916@roundup.psfhosted.org>
Message-ID: <1601744067.2.0.218106321101.issue41916@roundup.psfhosted.org>


Change by Dustin Spicuzza <dustin at virtualroadside.com>:


----------
keywords: +patch
pull_requests: +21530
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22525

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41916>
_______________________________________

From report at bugs.python.org  Sat Oct  3 12:57:41 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 03 Oct 2020 16:57:41 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601744261.17.0.304416978571.issue41898@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +patch
pull_requests: +21531
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22526

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Sat Oct  3 13:03:33 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 03 Oct 2020 17:03:33 +0000
Subject: [issue41919] Modify test_codecs to use the new codecs.unregister()
 function
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1601744613.28.0.895415777002.issue41919@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
title: Move the codecs.register operation to testcases -> Modify test_codecs to use the new codecs.unregister() function

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Sat Oct  3 13:06:27 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 03 Oct 2020 17:06:27 +0000
Subject: [issue18228] AIX locale parsing failure
In-Reply-To: <1371355395.07.0.213079327558.issue18228@psf.upfronthosting.co.za>
Message-ID: <1601744787.12.0.682625970821.issue18228@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Sorry, I forgot to close it 7 years ago. Done ;-)

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18228>
_______________________________________

From report at bugs.python.org  Sat Oct  3 13:09:34 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 03 Oct 2020 17:09:34 +0000
Subject: [issue32192] Provide importlib.util.lazy_import helper function
In-Reply-To: <1512118241.83.0.213398074469.issue32192@psf.upfronthosting.co.za>
Message-ID: <1601744974.01.0.0389419232193.issue32192@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete. Can is be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32192>
_______________________________________

From report at bugs.python.org  Sat Oct  3 13:17:03 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 03 Oct 2020 17:17:03 +0000
Subject: [issue41922] Use PEP 590 vectorcall to speed up calls to reversed()
In-Reply-To: <1601740856.71.0.650184607578.issue41922@roundup.psfhosted.org>
Message-ID: <1601745423.15.0.807300365386.issue41922@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:


New changeset d646e91f5c4f4b76f96494103d440ed0b6257425 by Dong-hee Na in branch 'master':
bpo-41922: Use PEP 590 vectorcall to speed up reversed() (GH-22523)
https://github.com/python/cpython/commit/d646e91f5c4f4b76f96494103d440ed0b6257425


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41922>
_______________________________________

From report at bugs.python.org  Sat Oct  3 13:17:15 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 03 Oct 2020 17:17:15 +0000
Subject: [issue41922] Use PEP 590 vectorcall to speed up calls to reversed()
In-Reply-To: <1601740856.71.0.650184607578.issue41922@roundup.psfhosted.org>
Message-ID: <1601745435.17.0.0484246919551.issue41922@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41922>
_______________________________________

From report at bugs.python.org  Sat Oct  3 13:19:09 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 03 Oct 2020 17:19:09 +0000
Subject: [issue41922] Use PEP 590 vectorcall to speed up calls to reversed()
In-Reply-To: <1601740856.71.0.650184607578.issue41922@roundup.psfhosted.org>
Message-ID: <1601745549.53.0.416502801066.issue41922@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41922>
_______________________________________

From report at bugs.python.org  Sat Oct  3 13:18:54 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 03 Oct 2020 17:18:54 +0000
Subject: [issue41922] Use PEP 590 vectorcall to speed up calls to reversed()
In-Reply-To: <1601740856.71.0.650184607578.issue41922@roundup.psfhosted.org>
Message-ID: <1601745534.09.0.041321384683.issue41922@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

Thank you Victor!

----------
resolution: fixed -> 
stage: resolved -> patch review
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41922>
_______________________________________

From report at bugs.python.org  Sat Oct  3 13:27:45 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 03 Oct 2020 17:27:45 +0000
Subject: [issue41923] Add PEP 613 typing.TypeAlias to the standard library
In-Reply-To: <1601741790.03.0.822782590759.issue41923@roundup.psfhosted.org>
Message-ID: <1601746065.09.0.880607267336.issue41923@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +gvanrossum, levkivskyi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41923>
_______________________________________

From report at bugs.python.org  Sat Oct  3 14:01:23 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 03 Oct 2020 18:01:23 +0000
Subject: [issue33235] Better help text for dict.setdefault
In-Reply-To: <1523009627.66.0.682650639539.issue33235@psf.upfronthosting.co.za>
Message-ID: <1601748083.97.0.525618401031.issue33235@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

The help message is now:

  Help on method_descriptor:
  setdefault(self, key, default=None, /)
    Insert key with a value of default if key is not in the dictionary.    
    Return the value for key if key is in the dictionary, else default.

This issue should be closed as out of date.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33235>
_______________________________________

From report at bugs.python.org  Sat Oct  3 14:21:03 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 03 Oct 2020 18:21:03 +0000
Subject: [issue36568] Typo in socket.CAN_RAW_FD_FRAMES library documentation
In-Reply-To: <1554776259.35.0.774393301329.issue36568@roundup.psfhosted.org>
Message-ID: <1601749263.27.0.365287844531.issue36568@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This issue can be closed.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36568>
_______________________________________

From report at bugs.python.org  Sat Oct  3 14:22:46 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 03 Oct 2020 18:22:46 +0000
Subject: [issue33235] Better help text for dict.setdefault
In-Reply-To: <1523009627.66.0.682650639539.issue33235@psf.upfronthosting.co.za>
Message-ID: <1601749366.87.0.101877340371.issue33235@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33235>
_______________________________________

From report at bugs.python.org  Sat Oct  3 14:25:02 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 03 Oct 2020 18:25:02 +0000
Subject: [issue29986] Documentation recommends raising TypeError from
 tp_richcompare
In-Reply-To: <1491346313.99.0.131506773991.issue29986@psf.upfronthosting.co.za>
Message-ID: <1601749502.65.0.533242602398.issue29986@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Looks like this issue can be closed.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29986>
_______________________________________

From report at bugs.python.org  Sat Oct  3 14:54:43 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 03 Oct 2020 18:54:43 +0000
Subject: [issue41923] Add PEP 613 typing.TypeAlias to the standard library
In-Reply-To: <1601741790.03.0.822782590759.issue41923@roundup.psfhosted.org>
Message-ID: <1601751283.9.0.978900926521.issue41923@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Sure go right ahead.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41923>
_______________________________________

From report at bugs.python.org  Sat Oct  3 15:05:27 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 03 Oct 2020 19:05:27 +0000
Subject: [issue40202] Misleading grammatically of ValueError Message?
In-Reply-To: <1586160974.41.0.711704681431.issue40202@roundup.psfhosted.org>
Message-ID: <1601751927.4.0.80783670487.issue40202@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I think this can be closed as a duplicate of 39816.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40202>
_______________________________________

From report at bugs.python.org  Sat Oct  3 15:09:37 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 03 Oct 2020 19:09:37 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601752177.87.0.61691745873.issue41490@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +21532
pull_request: https://github.com/python/cpython/pull/22527

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Sat Oct  3 15:12:51 2020
From: report at bugs.python.org (Ammar Askar)
Date: Sat, 03 Oct 2020 19:12:51 +0000
Subject: [issue40202] Misleading grammatically of ValueError Message?
In-Reply-To: <1586160974.41.0.711704681431.issue40202@roundup.psfhosted.org>
Message-ID: <1601752371.15.0.657713227574.issue40202@roundup.psfhosted.org>


Change by Ammar Askar <ammar at ammaraskar.com>:


----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> More descriptive error message than "too many values to unpack"

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40202>
_______________________________________

From report at bugs.python.org  Sat Oct  3 15:45:59 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 03 Oct 2020 19:45:59 +0000
Subject: [issue41840] [regression] symtable.Symbol.is_local() is no longer
 True for bound global symbols
In-Reply-To: <1600863724.98.0.825702411391.issue41840@roundup.psfhosted.org>
Message-ID: <1601754359.36.0.965865188163.issue41840@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset fb0a4651f1be4ad936f8277478f73f262d8eeb72 by Pablo Galindo in branch 'master':
bpo-41840: Report module-level globals as both local and global in the symtable module (GH-22391)
https://github.com/python/cpython/commit/fb0a4651f1be4ad936f8277478f73f262d8eeb72


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41840>
_______________________________________

From report at bugs.python.org  Sat Oct  3 15:48:02 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 03 Oct 2020 19:48:02 +0000
Subject: [issue41840] [regression] symtable.Symbol.is_local() is no longer
 True for bound global symbols
In-Reply-To: <1600863724.98.0.825702411391.issue41840@roundup.psfhosted.org>
Message-ID: <1601754482.8.0.897378315944.issue41840@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +21533
pull_request: https://github.com/python/cpython/pull/22528

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41840>
_______________________________________

From report at bugs.python.org  Sat Oct  3 15:48:51 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 03 Oct 2020 19:48:51 +0000
Subject: [issue41840] [regression] symtable.Symbol.is_local() is no longer
 True for bound global symbols
In-Reply-To: <1600863724.98.0.825702411391.issue41840@roundup.psfhosted.org>
Message-ID: <1601754531.33.0.932008624252.issue41840@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +21534
pull_request: https://github.com/python/cpython/pull/22529

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41840>
_______________________________________

From report at bugs.python.org  Sat Oct  3 16:01:32 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 03 Oct 2020 20:01:32 +0000
Subject: [issue40348] Programming FAQ about "What is delegation?": Fix typos
In-Reply-To: <1587419868.54.0.356271490131.issue40348@roundup.psfhosted.org>
Message-ID: <1601755292.28.0.666191279666.issue40348@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This issue can be closed.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40348>
_______________________________________

From report at bugs.python.org  Sat Oct  3 16:23:06 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 03 Oct 2020 20:23:06 +0000
Subject: [issue41840] [regression] symtable.Symbol.is_local() is no longer
 True for bound global symbols
In-Reply-To: <1600863724.98.0.825702411391.issue41840@roundup.psfhosted.org>
Message-ID: <1601756586.19.0.948726536941.issue41840@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 7b7aa94e51a396365df41f86b7b64a3b74481a6c by Pablo Galindo in branch '3.9':
[3.9] bpo-41840: Report module-level globals as both local and global in the symtable module (GH-22391). (GH-22528)
https://github.com/python/cpython/commit/7b7aa94e51a396365df41f86b7b64a3b74481a6c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41840>
_______________________________________

From report at bugs.python.org  Sat Oct  3 17:49:56 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 03 Oct 2020 21:49:56 +0000
Subject: [issue41840] [regression] symtable.Symbol.is_local() is no longer
 True for bound global symbols
In-Reply-To: <1600863724.98.0.825702411391.issue41840@roundup.psfhosted.org>
Message-ID: <1601761796.51.0.532587688127.issue41840@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41840>
_______________________________________

From report at bugs.python.org  Sat Oct  3 17:50:03 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 03 Oct 2020 21:50:03 +0000
Subject: [issue41840] [regression] symtable.Symbol.is_local() is no longer
 True for bound global symbols
In-Reply-To: <1600863724.98.0.825702411391.issue41840@roundup.psfhosted.org>
Message-ID: <1601761803.3.0.168134703694.issue41840@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset fd22823991380de2a309221748fc41cf0ba6ed40 by Pablo Galindo in branch '3.8':
[3.8] bpo-41840: Report module-level globals as both local and global in the symtable module (GH-22391). (GH-22529)
https://github.com/python/cpython/commit/fd22823991380de2a309221748fc41cf0ba6ed40


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41840>
_______________________________________

From report at bugs.python.org  Sat Oct  3 18:21:15 2020
From: report at bugs.python.org (Mikhail Golubev)
Date: Sat, 03 Oct 2020 22:21:15 +0000
Subject: [issue41923] Add PEP 613 typing.TypeAlias to the standard library
In-Reply-To: <1601741790.03.0.822782590759.issue41923@roundup.psfhosted.org>
Message-ID: <1601763675.98.0.58215373309.issue41923@roundup.psfhosted.org>


Change by Mikhail Golubev <qsolo825 at gmail.com>:


----------
keywords: +patch
nosy: +east825
nosy_count: 3.0 -> 4.0
pull_requests: +21535
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22532

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41923>
_______________________________________

From report at bugs.python.org  Sat Oct  3 18:30:01 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 03 Oct 2020 22:30:01 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601764201.61.0.486639063177.issue41909@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I don't think I remember what's so special about abstract_get_bases() to disable the recursion check. Maybe this macro is always just a micro-optimization? Then again it's hard to be sure, the behavior may depend on the platform.

Pulling in Antoine, who showed up in the  email https://mail.python.org/pipermail/python-dev/2008-August/082106.html is mentioned in a long comment in ceval.h about the recursion protection.

Possibly the Py_ALLOW_RECURSION macro is intended to ensure that some handler code for first-order recursion errors doesn't get interrupted by second-order recursion errors? There's a limit of 50 stack frames which feels a bit dodgy.

----------
nosy: +pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Sat Oct  3 19:24:10 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Sat, 03 Oct 2020 23:24:10 +0000
Subject: [issue41920] Weird add operation of "0.2222 + 0.1111"
In-Reply-To: <1601728037.28.0.248685032247.issue41920@roundup.psfhosted.org>
Message-ID: <20201003232404.GH10971@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Hi Leonard,

Any number which has only fixed precision will experience similar 
issues. It might affect different calculations.

In Python, float, complex and Decimal have fixed precision, so they can 
experience this issue.

But for simple calculations, Decimal may be better for you, as it uses 
base-10 floats, not base-2, so many numbers which are rounded off in 
binary floats are not rounded in Decimal:

    py> from decimal import Decimal
    py> 0.1111 + 0.2222  # binary floats
    0.33330000000000004
    py> Decimal('0.1111') + Decimal('0.2222')  # decimal floats
    Decimal('0.3333')

But with Decimal, you have other numbers which are rounded off and so 
are not exact:

    py> one_third = 1/Decimal(3)
    py> 3*one_third  # should be exactly 1
    Decimal('0.9999999999999999999999999999')

    py> (1/Decimal(6)) * 3
    Decimal('0.5000000000000000000000000001')

ints are always exact, but you can only do whole numbers with ints. 
Fractions are also exact:

    py> from fractions import Fraction
    py> Fraction(1111, 10000) + Fraction(2222, 10000)
    Fraction(3333, 10000)

Using Fraction is a good way to see what number a binary float really 
is:

    py> Fraction(0.1111)
    Fraction(4002799348806897, 36028797018963968)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41920>
_______________________________________

From report at bugs.python.org  Sat Oct  3 20:16:09 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 04 Oct 2020 00:16:09 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601770569.08.0.547369017006.issue41905@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Guido, can the method update be made automatic?  When instantiation fails, recheck to see the missing abstract methods had been defined?

    >>> from abc import *
    >>> class P(ABC):
            @abstractmethod
            def m(self):
                    pass
            
    >>> class C(P):
            pass

    >>> C.m = lambda self: None
    >>> C()
    Traceback (most recent call last):
      File "<pyshell#11>", line 1, in <module>
        C()
    TypeError: Can't instantiate abstract class C with abstract method m

The latter message doesn't make sense that it should occur at all.

Roughly, the existing instantiation logic is:

     if cls.__abstractmethods__:
         raise TypeError(f"TypeError: Can't instantiate abstract class
                         {cls.__name} with abstract method {methname}")

Could that be changed to something like this:

     if cls.__abstractmethods__:
         for methname is cls.__abstractmethods__.copy():
             if getattr(cls, methname).__isabstractmethod__:
                 raise TypeError(f"TypeError: Can't instantiate abstract class
                                  {cls.__name} with abstract method {methname}")
             cls.__abstractmethods__.remove(methname)

I haven't thought this through.  Was just thinking that it would nice to have automatic updates rather than transferring the responsibility outside of the core ABC logic.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sat Oct  3 20:17:04 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 04 Oct 2020 00:17:04 +0000
Subject: [issue40348] Programming FAQ about "What is delegation?": Fix typos
In-Reply-To: <1587419868.54.0.356271490131.issue40348@roundup.psfhosted.org>
Message-ID: <1601770624.57.0.549298500921.issue40348@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40348>
_______________________________________

From report at bugs.python.org  Sat Oct  3 20:43:54 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 04 Oct 2020 00:43:54 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601772234.47.0.0633762458425.issue41905@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Hm, you're effectively proposing to compute (or update) __abstractmethods__ lazily. There are a number of subtleties with that, e.g. __abstractmethods__ is currently a frozenset, and a base class's __abstractmethods__ is used when computing the __abstractmethods__ of new subclasses.

Moreover, the instantiation check is in object_new(), in typeobject.c.

The good news is that when you assign an empty iterable to cls.__abstractmethod__ the bit that object_new() checks is cleared, so other approaches are still open.

I think adding the API currently proposed is a reasonable compromise.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sat Oct  3 20:46:47 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 04 Oct 2020 00:46:47 +0000
Subject: [issue41887] ast.literal_eval does not accept strings with leading
 whitespaces
In-Reply-To: <1601430417.52.0.930336195437.issue41887@roundup.psfhosted.org>
Message-ID: <1601772407.73.0.990739777186.issue41887@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset e799aa8b92c195735f379940acd9925961ad04ec by Batuhan Taskaya in branch 'master':
bpo-41887: omit leading spaces/tabs on ast.literal_eval (#22469)
https://github.com/python/cpython/commit/e799aa8b92c195735f379940acd9925961ad04ec


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41887>
_______________________________________

From report at bugs.python.org  Sat Oct  3 20:49:00 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 04 Oct 2020 00:49:00 +0000
Subject: [issue41887] ast.literal_eval does not accept strings with leading
 whitespaces
In-Reply-To: <1601430417.52.0.930336195437.issue41887@roundup.psfhosted.org>
Message-ID: <1601772540.57.0.262876617262.issue41887@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 5.0 -> 6.0
pull_requests: +21536
pull_request: https://github.com/python/cpython/pull/22533

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41887>
_______________________________________

From report at bugs.python.org  Sat Oct  3 20:54:49 2020
From: report at bugs.python.org (ThePokestarFan)
Date: Sun, 04 Oct 2020 00:54:49 +0000
Subject: [issue41924] TextWrap's wrap method throws unhelpful error on bytes
 object
Message-ID: <1601772889.68.0.485991506579.issue41924@roundup.psfhosted.org>


New submission from ThePokestarFan <sarkaraoyan at gmail.com>:

The wrap() method of the TextWrapper class (and the module-level wrap method) throws an unhelpful TypeError upon getting a bytes object.

----------
components: Library (Lib)
files: traceback.txt
messages: 377910
nosy: ThePokestarFan
priority: normal
severity: normal
status: open
title: TextWrap's wrap method throws unhelpful error on bytes object
type: behavior
versions: Python 3.8
Added file: https://bugs.python.org/file49489/traceback.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41924>
_______________________________________

From report at bugs.python.org  Sat Oct  3 20:56:32 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 04 Oct 2020 00:56:32 +0000
Subject: [issue41887] ast.literal_eval does not accept strings with leading
 whitespaces
In-Reply-To: <1601430417.52.0.930336195437.issue41887@roundup.psfhosted.org>
Message-ID: <1601772992.25.0.389982155361.issue41887@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Closing. Let?s not backport.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41887>
_______________________________________

From report at bugs.python.org  Sat Oct  3 21:02:33 2020
From: report at bugs.python.org (ThePokestarFan)
Date: Sun, 04 Oct 2020 01:02:33 +0000
Subject: [issue41924] TextWrap's wrap method throws unhelpful error on bytes
 object
In-Reply-To: <1601772889.68.0.485991506579.issue41924@roundup.psfhosted.org>
Message-ID: <1601773353.99.0.881270789928.issue41924@roundup.psfhosted.org>


Change by ThePokestarFan <sarkaraoyan at gmail.com>:


----------
keywords: +patch
pull_requests: +21537
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22534

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41924>
_______________________________________

From report at bugs.python.org  Sat Oct  3 21:05:22 2020
From: report at bugs.python.org (Josh Rosenberg)
Date: Sun, 04 Oct 2020 01:05:22 +0000
Subject: [issue41924] TextWrap's wrap method throws unhelpful error on bytes
 object
In-Reply-To: <1601772889.68.0.485991506579.issue41924@roundup.psfhosted.org>
Message-ID: <1601773522.92.0.212079957024.issue41924@roundup.psfhosted.org>


Josh Rosenberg <shadowranger+python at gmail.com> added the comment:

It's not textwrap that's doing it, which is why the error is so unhelpful; the input is assumed to be a str, and the translate method is called on it with a dict argument, which is valid for str.translate, but not for bytes.translate.

You'll get other "unhelpful" error messages for other arguments (e.g. most other built-in types die because they lack an expandtabs method). Is it necessary to provide specific error messages when an API is given a type it never claimed to support? I could see issues with a "check for str" check if someone is implementing their own str-like type that matches the API but gets rejected for not being str.

----------
nosy: +josh.r

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41924>
_______________________________________

From report at bugs.python.org  Sat Oct  3 21:15:20 2020
From: report at bugs.python.org (ThePokestarFan)
Date: Sun, 04 Oct 2020 01:15:20 +0000
Subject: [issue41924] TextWrap's wrap method throws unhelpful error on bytes
 object
In-Reply-To: <1601772889.68.0.485991506579.issue41924@roundup.psfhosted.org>
Message-ID: <1601774120.94.0.254090666814.issue41924@roundup.psfhosted.org>


ThePokestarFan <sarkaraoyan at gmail.com> added the comment:

You're most likely right, so I'll close it. The lesson is most likely to not use weird arguments, but modules such as datetime warn against it, so I was surprised.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41924>
_______________________________________

From report at bugs.python.org  Sat Oct  3 21:15:37 2020
From: report at bugs.python.org (ThePokestarFan)
Date: Sun, 04 Oct 2020 01:15:37 +0000
Subject: [issue41924] TextWrap's wrap method throws unhelpful error on bytes
 object
In-Reply-To: <1601772889.68.0.485991506579.issue41924@roundup.psfhosted.org>
Message-ID: <1601774137.96.0.737801191212.issue41924@roundup.psfhosted.org>


Change by ThePokestarFan <sarkaraoyan at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41924>
_______________________________________

From report at bugs.python.org  Sat Oct  3 21:16:20 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 04 Oct 2020 01:16:20 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601774180.32.0.206457112658.issue41905@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> you're effectively proposing to compute (or update)
> __abstractmethods__ lazily.

Would it be possible to do the update whenever the class dictionary is modified, in PyType_Modified() perhaps (using logic similar to __mro__ updates__)?  

I not pushing for this; am just asking whether it is possible to make sure that __abstractmethods__ is always in sync with reality.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sat Oct  3 21:39:19 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 04 Oct 2020 01:39:19 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601774180.32.0.206457112658.issue41905@roundup.psfhosted.org>
Message-ID: <CAP7+vJJkfAd=TyB6pa=OV6VNkjJxrztcXUZasPfgKvgzzSvQEw@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

Yes, we could override ABCMeta.__setattr__ to do that. Though it seems this
class is considered performance sensitive (else why have Modules/_abc.c) we
would probably have to write it in C.--
--Guido (mobile)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sat Oct  3 23:28:41 2020
From: report at bugs.python.org (Chris Tse)
Date: Sun, 04 Oct 2020 03:28:41 +0000
Subject: [issue41925] Lowercase path to python.exe in pip.exe from venv is
 throwing error
Message-ID: <1601782121.26.0.581028489128.issue41925@roundup.psfhosted.org>


New submission from Chris Tse <christse at hey.com>:

Following up on https://bugs.python.org/issue37369 as it was advised to open a new issue regarding case sensitivity.

I am on Windows 10 running Version 10.0.19041 Build 19041. I am experiencing the same problem in that issue when using venv on Powershell. 
The path to python.exe in the pip.exe generated by venv is all lowercase, which is the source of this error.
After activating the venv with Activate.ps1 and attempting to use pip, I get the following error, while activate.bat on cmd works fine:

Fatal error in launcher: Unable to create process using '"c:\users\chris\code\project\myenv\scripts\python.exe"  "C:\Users\chris\code\project\myenv\Scripts\pip.exe" ': The system cannot find the file specified.


Full steps to reproduce:
  1. Install Python 3.8.6 from python.org (ticking add to PATH option in installer)
  2. Open Powershell (via both native Powershell app or the new Windows Terminal) and verify that `python` is bound to the correct Version
  3. Run `python -m venv myenv`
  4. Run `.\myenv\Scripts\Activate.ps1`
  5. Run `pip`

Expected behavior: Get the pip usage commands list

Actual behavior: Get the above Fatal error

Notes:
I did not explicitly set case sensitivity on my machine. All my drives are formatted as NTFS, but should not be case sensitive, which can be confirmed by fsutils:

> fsutil.exe file queryCaseSensitiveInfo C:\
Case sensitive attribute on directory C:\ is disabled.

Attempting to actually call that python.exe using the full lowercase path throws a similar error. 

Someone I know who has been helping with debugging this ran the Scripts\activate script successfully on the same version of Powershell as mine (5.1.19041.1) which should be meant for use on bash. I however was not able to do so.

----------
components: Windows
messages: 377916
nosy: chris-tse, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Lowercase path to python.exe in pip.exe from venv is throwing error
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41925>
_______________________________________

From report at bugs.python.org  Sat Oct  3 23:28:50 2020
From: report at bugs.python.org (Chris Tse)
Date: Sun, 04 Oct 2020 03:28:50 +0000
Subject: [issue41925] Lowercase path to python.exe in pip.exe from venv is
 throwing error
In-Reply-To: <1601782121.26.0.581028489128.issue41925@roundup.psfhosted.org>
Message-ID: <1601782130.45.0.127748076702.issue41925@roundup.psfhosted.org>


Change by Chris Tse <christse at hey.com>:


----------
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41925>
_______________________________________

From report at bugs.python.org  Sun Oct  4 00:14:19 2020
From: report at bugs.python.org (Chris Tse)
Date: Sun, 04 Oct 2020 04:14:19 +0000
Subject: [issue41925] Lowercase path to python.exe in pip.exe from venv is
 throwing error
In-Reply-To: <1601782121.26.0.581028489128.issue41925@roundup.psfhosted.org>
Message-ID: <1601784859.79.0.339683481153.issue41925@roundup.psfhosted.org>


Chris Tse <christse at hey.com> added the comment:

UPDATE:

After some further investigation, it seems like even on cmd and seeing the (myenv) indicator, it actually seems to be falling back to system pip and installing packages globally. Running `.\myenv\Scripts\pip.exe` actually throws that same error. CMD just seems to fallback to system pip and silently fails the desired venv pip, unlike Powershell.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41925>
_______________________________________

From report at bugs.python.org  Sun Oct  4 00:45:08 2020
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 04 Oct 2020 04:45:08 +0000
Subject: [issue41925] Lowercase path to python.exe in pip.exe from venv is
 throwing error
In-Reply-To: <1601782121.26.0.581028489128.issue41925@roundup.psfhosted.org>
Message-ID: <1601786708.98.0.961071812879.issue41925@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> "C:\Users\chris\code\project\myenv\Scripts\pip.exe"

Have you tried different case combinations for "Users" and "Scripts"?

    * C:\users\chris\code\project\myenv\scripts\pip.exe
    * C:\users\chris\code\project\myenv\Scripts\pip.exe
    * C:\Users\chris\code\project\myenv\scripts\pip.exe
    * C:\Users\chris\code\project\myenv\Scripts\pip.exe

> fsutil.exe file queryCaseSensitiveInfo C:\

Have you checked "C:\Users\chris\code\project\myenv"?

---

Off Topic

> Open Powershell (via both native Powershell app or the new 
> Windows Terminal) 

FYI, "native PowerShell app" is not the right way to think of this. Both cases run the same command-line interface (CLI) shell (i.e. pwsh.exe or powershell.exe), which is a console application that either inherits or allocates a console session (i.e. an instance of conhost.exe or openconsole.exe). When run from a graphical desktop application (e.g. explorer.exe), a console application usually has to allocate a new console session since there's none to inherit. Currently there's no way to set a default terminal for console applications, so a regular console session is allocated, which creates its own window. When run from a terminal in Windows 10 (e.g. Windows Terminal), a console application inherits a headless console session (i.e. pseudoconsole mode), and the user interface is provided by the terminal.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41925>
_______________________________________

From report at bugs.python.org  Sun Oct  4 00:48:50 2020
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 04 Oct 2020 04:48:50 +0000
Subject: [issue41925] Lowercase path to python.exe in pip.exe from venv is
 throwing error
In-Reply-To: <1601782121.26.0.581028489128.issue41925@roundup.psfhosted.org>
Message-ID: <1601786930.67.0.338876094459.issue41925@roundup.psfhosted.org>


Change by Eryk Sun <eryksun at gmail.com>:


----------
Removed message: https://bugs.python.org/msg377918

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41925>
_______________________________________

From report at bugs.python.org  Sun Oct  4 00:49:49 2020
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 04 Oct 2020 04:49:49 +0000
Subject: [issue41925] Lowercase path to python.exe in pip.exe from venv is
 throwing error
In-Reply-To: <1601782121.26.0.581028489128.issue41925@roundup.psfhosted.org>
Message-ID: <1601786989.26.0.391484483927.issue41925@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> "C:\Users\chris\code\project\myenv\Scripts\python.exe"

Have you tried different case combinations for "Users" and "Scripts"?

    * C:\users\chris\code\project\myenv\scripts\python.exe
    * C:\users\chris\code\project\myenv\Scripts\python.exe
    * C:\Users\chris\code\project\myenv\scripts\python.exe
    * C:\Users\chris\code\project\myenv\Scripts\python.exe

> fsutil.exe file queryCaseSensitiveInfo C:\

Have you checked "C:\Users\chris\code\project\myenv"?

---

Off Topic

> Open Powershell (via both native Powershell app or the new 
> Windows Terminal) 

FYI, "native PowerShell app" is not the right way to think of this. Both cases run the same command-line interface (CLI) shell (i.e. pwsh.exe or powershell.exe), which is a console application that either inherits or allocates a console session (i.e. an instance of conhost.exe or openconsole.exe). When run from a graphical desktop application (e.g. explorer.exe), a console application usually has to allocate a new console session since there's none to inherit. Currently there's no way to set a default terminal for console applications, so a regular console session is allocated, which creates its own window. When run from a terminal in Windows 10 (e.g. Windows Terminal), a console application inherits a headless console session (i.e. pseudoconsole mode), and the user interface is provided by the terminal.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41925>
_______________________________________

From report at bugs.python.org  Sun Oct  4 01:34:56 2020
From: report at bugs.python.org (Debojyoti Chakraborty)
Date: Sun, 04 Oct 2020 05:34:56 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601789696.41.0.0205214395048.issue41909@roundup.psfhosted.org>


Debojyoti Chakraborty <sparkingdebo at protonmail.com> added the comment:

Is it open Then give the process to  reproduce the issue.

----------
nosy: +sparkingdark

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Sun Oct  4 01:40:33 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 04 Oct 2020 05:40:33 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601790033.08.0.49905987268.issue26680@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Mark, why did this get merged with is_integer() still in the numeric tower?  I thought we had agreed not to do that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Sun Oct  4 01:50:57 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 04 Oct 2020 05:50:57 +0000
Subject: [issue35928] socket makefile read-write discards received data
In-Reply-To: <1549542632.16.0.548779418887.issue35928@roundup.psfhosted.org>
Message-ID: <1601790657.99.0.493356638899.issue35928@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
nosy: +ZackerySpytz
nosy_count: 5.0 -> 6.0
pull_requests: +21538
pull_request: https://github.com/python/cpython/pull/22535

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35928>
_______________________________________

From report at bugs.python.org  Sun Oct  4 03:42:44 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 04 Oct 2020 07:42:44 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601797364.87.0.952495778828.issue41909@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Antoine give me a hint. The problem seems related to using PyDict_GetItem() when look up an attribute in the instance dict. It silences all exceptions (including RecursionError) and this results in silent "no such key in a dict".

But since 3.8 it was replaced with PyDict_GetItemWithError() which preserves RecursionError (see issue35459). I think we can remove Py_ALLOW_RECURSION/Py_END_ALLOW_RECURSION now.

As for other case in interning string, Py_ALLOW_RECURSION/Py_END_ALLOW_RECURSION was used to guard PyDict_GetItem(). But the current code uses PyDict_SetDefault() (added in 3.4) which does not silence errors. So Py_ALLOW_RECURSION/Py_END_ALLOW_RECURSION can be removed in that place too.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Sun Oct  4 03:46:35 2020
From: report at bugs.python.org (Ben Avrahami)
Date: Sun, 04 Oct 2020 07:46:35 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601797595.3.0.512285347781.issue41905@roundup.psfhosted.org>


Ben Avrahami <avrahami.ben at gmail.com> added the comment:

Implementing this behavior automatically would be more complicated since you would also have to take subclasses into account. Current implementation enforces that the class is unused (as much as can be reasonably done) when its abstraction status is re-calculated, such checks cannot be done in an automatic implementation.

The question becomes whether or not we think its reasonable that an abstract class would change its abstraction status throughout its lifetime. I'd argue "not implicitly".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sun Oct  4 04:05:52 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 04 Oct 2020 08:05:52 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601798752.83.0.514291510897.issue41909@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21539
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22536

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Sun Oct  4 04:13:54 2020
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 04 Oct 2020 08:13:54 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601799234.82.0.859262937759.issue26680@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

I interpreted "in the numeric tower" as meaning declared as an abstract method that all those registering with the class would have to implement. As you point out in msg350173, that would be problematic - adding new methods to published interfaces is pretty much a no-no for backwards compatibility reasons.

But that's not what happened here. Robert's original patch *did* add is_integer as an abstract method. The PR that was merged did not - it was added as a concrete method, as a convenience for those using the ABCs via direct subclassing rather than registering.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Sun Oct  4 04:35:25 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 04 Oct 2020 08:35:25 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601800525.84.0.638388516916.issue26680@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

>  it was added as a concrete method,

That still amounts to making it a requirement for all numeric classes, even ones that predate this patch.  So existing classes that are registered will no longer comply with the ABC.  

In general, it's hard to add methods to ABCs because an ABC makes a promise about what methods are available in any class registered to that ABC.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Sun Oct  4 04:57:41 2020
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 04 Oct 2020 08:57:41 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601801861.91.0.37180147759.issue26680@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> That still amounts to making it a requirement for all numeric classes

How so? I don't follow the reasoning here.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Sun Oct  4 05:00:37 2020
From: report at bugs.python.org (=?utf-8?b?SHJ2b2plIE5pa8WhacSH?=)
Date: Sun, 04 Oct 2020 09:00:37 +0000
Subject: [issue33533] Provide an async iterator version of as_completed
In-Reply-To: <1526453333.0.0.682650639539.issue33533@psf.upfronthosting.co.za>
Message-ID: <1601802037.88.0.31845879688.issue33533@roundup.psfhosted.org>


Hrvoje Nik?i? <hniksic at gmail.com> added the comment:

Justin, thanks for updating the PR! I'll take another look at the code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33533>
_______________________________________

From report at bugs.python.org  Sun Oct  4 07:03:56 2020
From: report at bugs.python.org (=?utf-8?b?0JTQttC+0L0g0KHQvNC40YI=?=)
Date: Sun, 04 Oct 2020 11:03:56 +0000
Subject: [issue41926] Unpredictable behavior when parsing xml.
 (xml.etree.ElementTree.iterparse)
Message-ID: <1601809436.34.0.291596574869.issue41926@roundup.psfhosted.org>


New submission from ???? ???? <kibertitan at gmail.com>:

Data is lost when parsing large files.
I have prepared 5 test files for different cases.
With their help, I learned that losses are not accidental.
In example.xml, when going to iteration 717 (i = 717), the data is lost.

In the rest of the files, I learned that data loss occurs when the number of characters changes. It looks like some kind of buffer overflow.
In example5.xml I am using randomly generated data using a generator.py.

Several xml files have been prepared to show that this is not an error in the input data, but a problem in the library itself.

I tried to trace the cause of the occurrence, and came to the conclusion that the bug lies in the compiled file.

In the ElementTree.py library file, the line
"events = self._events_queue" 
returns an empty list. This can be seen at iteration 717 in example.xml.

----------
components: XML
messages: 377928
nosy: kibertitan
priority: normal
severity: normal
status: open
title: Unpredictable behavior when parsing xml. (xml.etree.ElementTree.iterparse)
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41926>
_______________________________________

From report at bugs.python.org  Sun Oct  4 07:06:30 2020
From: report at bugs.python.org (=?utf-8?b?0JTQttC+0L0g0KHQvNC40YI=?=)
Date: Sun, 04 Oct 2020 11:06:30 +0000
Subject: [issue41926] Unpredictable behavior when parsing xml.
 (xml.etree.ElementTree.iterparse)
In-Reply-To: <1601809436.34.0.291596574869.issue41926@roundup.psfhosted.org>
Message-ID: <1601809590.37.0.304815596927.issue41926@roundup.psfhosted.org>


Change by ???? ???? <kibertitan at gmail.com>:


Added file: https://bugs.python.org/file49490/app.rar

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41926>
_______________________________________

From report at bugs.python.org  Sun Oct  4 07:07:41 2020
From: report at bugs.python.org (=?utf-8?b?0JTQttC+0L0g0KHQvNC40YI=?=)
Date: Sun, 04 Oct 2020 11:07:41 +0000
Subject: [issue41926] Unpredictable behavior when parsing xml.
 (xml.etree.ElementTree.iterparse)
In-Reply-To: <1601809436.34.0.291596574869.issue41926@roundup.psfhosted.org>
Message-ID: <1601809661.36.0.0254340851728.issue41926@roundup.psfhosted.org>


???? ???? <kibertitan at gmail.com> added the comment:

The file example5.xml could not be loaded, so to generate it, run the generator.py.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41926>
_______________________________________

From report at bugs.python.org  Sun Oct  4 07:11:57 2020
From: report at bugs.python.org (=?utf-8?b?0JHQvtGA0LjRgSDQm9Cw0LrQtdC10LI=?=)
Date: Sun, 04 Oct 2020 11:11:57 +0000
Subject: [issue41927] Why is there no documentation in Russian?
Message-ID: <1601809917.86.0.842552109928.issue41927@roundup.psfhosted.org>


New submission from ????? ?????? <lakeevboris at gmail.com>:

Is this a racist policy of the site management? For so much time, not even for 2.7. I'm sure there were a lot of suggestions to add. Aren't you ashamed?

----------
assignee: docs at python
components: Documentation
messages: 377930
nosy: docs at python, lakeevboris
priority: normal
severity: normal
status: open
title: Why is there no documentation in Russian?
type: resource usage
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41927>
_______________________________________

From report at bugs.python.org  Sun Oct  4 07:21:41 2020
From: report at bugs.python.org (Ivan Sorokin)
Date: Sun, 04 Oct 2020 11:21:41 +0000
Subject: [issue41928] ZipFile does not supports Unicode Path Extra Field
 (0x7075) zip header field
Message-ID: <1601810501.41.0.603959888811.issue41928@roundup.psfhosted.org>


New submission from Ivan Sorokin <ivan.sorokin.tech at gmail.com>:

See attached sample. Well-known unzip command line tool lists its contents correctly:

$ unzip -l 23.zip
Archive:  23.zip
  Length      Date    Time    Name
---------  ---------- -----   ----
    81408  2012-10-23 19:03   ?' ???? ??06 ??????? ???? (???).xls
---------                     -------
    81408                     1 file

But ZipFile lists the same file inside this archive as
?' ???? ??06 ??????? ???? (???).xls

It's because ZipFile completely ignores Unicode Path Extra Field (0x7075) zip header field.

See .ZIP specification for details on this field meaning and usage:
https://pkware.cachefly.net/webdocs/casestudies/APPNOTE.TXT

----------
components: Library (Lib)
files: 23.zip
messages: 377931
nosy: ivan.sorokin.tech
priority: normal
severity: normal
status: open
title: ZipFile does not supports Unicode Path Extra Field (0x7075) zip header field
type: enhancement
versions: Python 3.10
Added file: https://bugs.python.org/file49491/23.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41928>
_______________________________________

From report at bugs.python.org  Sun Oct  4 07:36:22 2020
From: report at bugs.python.org (Ivan Sorokin)
Date: Sun, 04 Oct 2020 11:36:22 +0000
Subject: [issue41929] Detect OEM code page for zip archives in ZipFile based
 on system locale
Message-ID: <1601811382.76.0.398158982461.issue41929@roundup.psfhosted.org>


New submission from Ivan Sorokin <ivan.sorokin.tech at gmail.com>:

ZipFile has problems with filename charset in .zip archives having filenames charset encoded in OEM code page.

ZipFile assumes that OEM code page always means "cp437". Actually many popular .zip packers (for example, Windows internal "zip folders" tool) use OEM code page corresponding to system locale to write file names in .zip files.

To read such files correctly we should detect correct OEM code page from system locale instead of sticking to cp437.

Here is locale-to-oem-code-page conversion table, generated from Wine source code:
https://github.com/unxed/oemcp/blob/master/oemcp.txt

Sample archive is attached. The file inside should be extracted as "????? ????????? ????????.txt" when ru_RU system locale is set.

----------
components: Library (Lib)
files: windows_cyrillic.zip
messages: 377932
nosy: ivan.sorokin.tech
priority: normal
severity: normal
status: open
title: Detect OEM code page for zip archives in ZipFile based on system locale
versions: Python 3.10
Added file: https://bugs.python.org/file49492/windows_cyrillic.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41929>
_______________________________________

From report at bugs.python.org  Sun Oct  4 07:42:28 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 04 Oct 2020 11:42:28 +0000
Subject: [issue41927] Why is there no documentation in Russian?
In-Reply-To: <1601809917.86.0.842552109928.issue41927@roundup.psfhosted.org>
Message-ID: <1601811748.31.0.283174910724.issue41927@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Oh no, you have discovered our dirty secret! Python is racist against Russia! /sarcasm

Python is created by volunteers, including the documentation. If you want a Russian translation, feel free to start working on one.

You could start here: https://wiki.python.org/moin/Languages

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41927>
_______________________________________

From report at bugs.python.org  Sun Oct  4 07:52:33 2020
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 04 Oct 2020 11:52:33 +0000
Subject: [issue41927] Why is there no documentation in Russian?
In-Reply-To: <1601809917.86.0.842552109928.issue41927@roundup.psfhosted.org>
Message-ID: <1601812353.09.0.164990412606.issue41927@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Python is a volunteer-driven project.
The documentation translation is provided by champions who does this hard work for free. 
You can join the team and maintain the Python Russian Translation :)

Sorry, to keep the discussion productive I should remind our community rules:
* Please keep calm and provide a polite attitude in conversations on this bug tracker.
* Otherwise, you must understand that the rude mood can be considered as the reason for the ban.

----------
nosy: +asvetlov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41927>
_______________________________________

From report at bugs.python.org  Sun Oct  4 08:05:11 2020
From: report at bugs.python.org (Kerrick Staley)
Date: Sun, 04 Oct 2020 12:05:11 +0000
Subject: [issue41930] Wrap sqlite3_serialize API in sqlite3 module
Message-ID: <1601813111.02.0.183059099502.issue41930@roundup.psfhosted.org>


New submission from Kerrick Staley <kerrick at kerrickstaley.com>:

It would be useful to provide a wrapper (in the Python sqlite3 stdlib module) for the sqlite3_serialize API. This API allows you to get a database's content as a byte string, as if you had called open('foo.sqlite3', 'rb').read(). sqlite3_serialize can even be used for :memory: databases, which I think is the most interesting use-case.

Concretely, I'd propose adding a .serialize() method on sqlite3.Connection objects that returns a bytes object representing the serialized database. It would be similar to the .iterdump() method except that it would use the binary format instead of the text format, and it would return all the data at once instead of an iterator (because that's how the underlying sqlite API works).

----------
components: Library (Lib)
messages: 377935
nosy: Kerrick Staley
priority: normal
severity: normal
status: open
title: Wrap sqlite3_serialize API in sqlite3 module
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41930>
_______________________________________

From report at bugs.python.org  Sun Oct  4 08:29:50 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 04 Oct 2020 12:29:50 +0000
Subject: [issue41927] Why is there no documentation in Russian?
In-Reply-To: <1601809917.86.0.842552109928.issue41927@roundup.psfhosted.org>
Message-ID: <1601814590.09.0.613695512535.issue41927@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Closed as an obvious trolling.

----------
nosy: +serhiy.storchaka
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41927>
_______________________________________

From report at bugs.python.org  Sun Oct  4 08:44:34 2020
From: report at bugs.python.org (Carl Bordum Hansen)
Date: Sun, 04 Oct 2020 12:44:34 +0000
Subject: [issue30578] Misleading example in sys.set_coroutine_wrapper docs
In-Reply-To: <1496717073.05.0.260137843936.issue30578@psf.upfronthosting.co.za>
Message-ID: <1601815474.83.0.444291540168.issue30578@roundup.psfhosted.org>


Carl Bordum Hansen <carl at bordum.dk> added the comment:

I think this can be closed as `sys.set_coroutine_wrapper` was removed in https://bugs.python.org/issue36933

----------
nosy: +carlbordum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30578>
_______________________________________

From report at bugs.python.org  Sun Oct  4 09:16:21 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 04 Oct 2020 13:16:21 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601817381.7.0.306360576006.issue41898@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21540
pull_request: https://github.com/python/cpython/pull/22537

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Sun Oct  4 09:16:30 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 04 Oct 2020 13:16:30 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601817390.18.0.55609920607.issue41898@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21541
pull_request: https://github.com/python/cpython/pull/22538

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Sun Oct  4 09:16:16 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Sun, 04 Oct 2020 13:16:16 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601817376.03.0.536549317787.issue41898@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset 1ed54435268b285964141fb74d47ceaa33ea79ab by Irit Katriel in branch 'master':
bpo-41898: add caveat on root logger seeing all messages in assertLogs doc (GH-22526)
https://github.com/python/cpython/commit/1ed54435268b285964141fb74d47ceaa33ea79ab


----------
nosy: +vinay.sajip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Sun Oct  4 09:23:03 2020
From: report at bugs.python.org (Carl Bordum Hansen)
Date: Sun, 04 Oct 2020 13:23:03 +0000
Subject: [issue29394] Cannot tunnel TLS connection through TLS connection
In-Reply-To: <1485847183.69.0.499542154053.issue29394@psf.upfronthosting.co.za>
Message-ID: <1601817783.75.0.191823284054.issue29394@roundup.psfhosted.org>


Change by Carl Bordum Hansen <carl at bordum.dk>:


----------
keywords: +patch
nosy: +carlbordum
nosy_count: 4.0 -> 5.0
pull_requests: +21542
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22539

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29394>
_______________________________________

From report at bugs.python.org  Sun Oct  4 09:27:21 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Sun, 04 Oct 2020 13:27:21 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601818041.78.0.427758157081.issue41898@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset b2611fac05ed391d68f09781903aae7394fab832 by Miss Skeleton (bot) in branch '3.8':
bpo-41898: add caveat on root logger seeing all messages in assertLogs doc (GH-22526) (GH-22537)
https://github.com/python/cpython/commit/b2611fac05ed391d68f09781903aae7394fab832


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Sun Oct  4 09:28:49 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 04 Oct 2020 13:28:49 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601818129.95.0.139123301704.issue41898@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21543
pull_request: https://github.com/python/cpython/pull/22540

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Sun Oct  4 09:44:57 2020
From: report at bugs.python.org (=?utf-8?b?4K6u4K6p4K+L4K6c4K+N4K6V4K+B4K6u4K6+4K6w4K+NIOCuquCutOCuqQ==?= =?utf-8?b?4K6/4K6a4K+N4K6a4K6+4K6u4K6/?=)
Date: Sun, 04 Oct 2020 13:44:57 +0000
Subject: [issue41931] Make dict(object) return its attribute __dict__
Message-ID: <1601819097.88.0.92979678916.issue41931@roundup.psfhosted.org>


Change by ??????????? ?????????? <smartmanoj42857 at gmail.com>:


----------
nosy: SmartManoj
priority: normal
severity: normal
status: open
title: Make dict(object) return its attribute __dict__
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41931>
_______________________________________

From report at bugs.python.org  Sun Oct  4 10:09:02 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Sun, 04 Oct 2020 14:09:02 +0000
Subject: [issue41183] [3.5] Workaround or fix for SSL ".._KEY_TOO_SMALL" test
 failures
In-Reply-To: <1593614146.46.0.384684767233.issue41183@roundup.psfhosted.org>
Message-ID: <1601820542.76.0.093437083397.issue41183@roundup.psfhosted.org>


Change by ?ukasz Langa <lukasz at langa.pl>:


----------
resolution:  -> fixed
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41183>
_______________________________________

From report at bugs.python.org  Sun Oct  4 10:17:27 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 04 Oct 2020 14:17:27 +0000
Subject: [issue41931] Make dict(object) return its attribute __dict__
Message-ID: <1601821047.33.0.238039916415.issue41931@roundup.psfhosted.org>


New submission from Irit Katriel <iritkatriel at yahoo.com>:

dict is not a function, it's a class and the purpose of a dict() call is to create a new instance of that class.

The change you are proposing is also breaking for iterators:

>>> class Pairs(list): pass
... 
>>> pairs = Pairs([('a', 1), ('b', 2)])
>>> pairs.__dict__
{}
>>> dict(pairs)
{'a': 1, 'b': 2}

A change of this magnitude will need to be discussed on python-ideas and will require a PEP explaining why the benefits of the change outweigh its costs. I very much doubt that they do.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41931>
_______________________________________

From report at bugs.python.org  Sun Oct  4 10:29:04 2020
From: report at bugs.python.org (=?utf-8?b?4K6u4K6p4K+L4K6c4K+N4K6V4K+B4K6u4K6+4K6w4K+NIOCuquCutOCuqQ==?= =?utf-8?b?4K6/4K6a4K+N4K6a4K6+4K6u4K6/?=)
Date: Sun, 04 Oct 2020 14:29:04 +0000
Subject: [issue41931] Make dict(object) return its attribute __dict__
In-Reply-To: <1601821047.33.0.238039916415.issue41931@roundup.psfhosted.org>
Message-ID: <1601821744.92.0.288270885771.issue41931@roundup.psfhosted.org>


??????????? ?????????? <smartmanoj42857 at gmail.com> added the comment:

Will return only if it is not an iterator

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41931>
_______________________________________

From report at bugs.python.org  Sun Oct  4 10:35:52 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 04 Oct 2020 14:35:52 +0000
Subject: [issue32922] dbm.open() encodes filename with default encoding rather
 than the filesystem encoding
In-Reply-To: <1519398668.71.0.467229070634.issue32922@psf.upfronthosting.co.za>
Message-ID: <1601822152.58.0.717951901258.issue32922@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems resolved, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32922>
_______________________________________

From report at bugs.python.org  Sun Oct  4 10:46:20 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 04 Oct 2020 14:46:20 +0000
Subject: [issue32222] pygettext doesn't extract docstrings for functions with
 type annotated params
In-Reply-To: <1512470175.69.0.213398074469.issue32222@psf.upfronthosting.co.za>
Message-ID: <1601822780.66.0.718143830021.issue32222@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I think this is resolved and can be closed.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32222>
_______________________________________

From report at bugs.python.org  Sun Oct  4 10:51:05 2020
From: report at bugs.python.org (Carl Bordum Hansen)
Date: Sun, 04 Oct 2020 14:51:05 +0000
Subject: [issue25292] ssl socket gets into broken state when client exits
 during handshake
In-Reply-To: <1443729972.18.0.386386409576.issue25292@psf.upfronthosting.co.za>
Message-ID: <1601823065.49.0.357438962362.issue25292@roundup.psfhosted.org>


Change by Carl Bordum Hansen <carl at bordum.dk>:


----------
keywords: +patch
nosy: +carlbordum
nosy_count: 5.0 -> 6.0
pull_requests: +21544
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22541

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25292>
_______________________________________

From report at bugs.python.org  Sun Oct  4 10:57:39 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 04 Oct 2020 14:57:39 +0000
Subject: [issue41483] Do not acquire lock in MemoryHandler.flush() if no
 target defined
In-Reply-To: <1596607573.95.0.247308930011.issue41483@roundup.psfhosted.org>
Message-ID: <1601823459.6.0.0299177294258.issue41483@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I think this issue should be closed - Kostis doesn't seem keen to discuss the merits of this change, and as I've said I don't think it's worth pursuing.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41483>
_______________________________________

From report at bugs.python.org  Sun Oct  4 11:24:54 2020
From: report at bugs.python.org (Ivan Sorokin)
Date: Sun, 04 Oct 2020 15:24:54 +0000
Subject: [issue41928] ZipFile does not supports Unicode Path Extra Field
 (0x7075) zip header field
In-Reply-To: <1601810501.41.0.603959888811.issue41928@roundup.psfhosted.org>
Message-ID: <1601825094.51.0.960614764386.issue41928@roundup.psfhosted.org>


Ivan Sorokin <ivan.sorokin.tech at gmail.com> added the comment:

Grand unified algorithm to read filenames from zip files correctly:

1. Do zip entry have ?Unicode Path Extra Field? (0x7075)? Use it for file name.
2. Is Unicode flag (0x800) set in ?Flags? Field of zip entry? Assume ?Filename? Field is in UTF-8.
3. Do ?HostOS? Field of zip entry have values of 0 (FAT) or 11 (NTFS)? Assume ?Filename? Field is in OEM charset corresponding to system locale.
4. Assume ?Filename? Field is in UTF-8.

p7zip with oemcp patch (https://github.com/unxed/oemcp/) uses exactly this method, and is able to process all zip files in my test set correctly (my test set contains several zips generated by different packers on windows, macos, linux, and by online services). The same algorithm should be used in any zip unpacker wishing to process non-latin filenames as gently as possible.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41928>
_______________________________________

From report at bugs.python.org  Sun Oct  4 11:38:09 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Sun, 04 Oct 2020 15:38:09 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601825889.97.0.725761533225.issue41898@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset faa8c6a8f1fe9c3bac31061e8a59a686b983ebb8 by Miss Skeleton (bot) in branch '3.9':
bpo-41898: add caveat on root logger seeing all messages in assertLogs doc (GH-22526) (GH-22540)
https://github.com/python/cpython/commit/faa8c6a8f1fe9c3bac31061e8a59a686b983ebb8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Sun Oct  4 11:38:47 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Sun, 04 Oct 2020 15:38:47 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601825927.34.0.683204373987.issue41898@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Sun Oct  4 11:42:16 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Sun, 04 Oct 2020 15:42:16 +0000
Subject: [issue41483] Do not acquire lock in MemoryHandler.flush() if no
 target defined
In-Reply-To: <1596607573.95.0.247308930011.issue41483@roundup.psfhosted.org>
Message-ID: <1601826136.99.0.985817742641.issue41483@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

OK, I'll mark as pending and close in a few days if nothing more is heard from Kostis.

----------
status: open -> pending

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41483>
_______________________________________

From report at bugs.python.org  Sun Oct  4 11:42:42 2020
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 04 Oct 2020 15:42:42 +0000
Subject: [issue41929] Detect OEM code page for zip archives in ZipFile based
 on system locale
In-Reply-To: <1601811382.76.0.398158982461.issue41929@roundup.psfhosted.org>
Message-ID: <1601826162.51.0.159122516773.issue41929@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

This is already addressed in bpo-28080, which adds an `encoding` parameter -- e.g. `encoding="oem"` ("oem" is only available in Windows). Unfortunately bpo-28080 has languished without resolution for four years.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41929>
_______________________________________

From report at bugs.python.org  Sun Oct  4 11:42:55 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 04 Oct 2020 15:42:55 +0000
Subject: [issue32112] Should uuid.UUID() accept another UUID() instance?
In-Reply-To: <1511347956.68.0.213398074469.issue32112@psf.upfronthosting.co.za>
Message-ID: <1601826175.03.0.267421469793.issue32112@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I agree with Serhiy that there needs to be a reason for adding this to a class constructor.

In the case of int, this is to implement conversion - it's not accepting int, it's accepting any number (it would be weird of int(3.4) worked and int(3) didn't).  Similarly, complex constructor accepts numbers.

In the case of tuple, bytes, bytearray - the constructor accepts any iterable, again in order to implement type conversion.


So it's not random - these constructors accept objects of the same type because they accept params of a more generic type, in order to provide type conversion functionality.

What functionality would we gain from increasing the API surface of the UUID constructor as you suggest?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32112>
_______________________________________

From report at bugs.python.org  Sun Oct  4 11:46:19 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 04 Oct 2020 15:46:19 +0000
Subject: [issue21756] IDLE - ParenMatch fails to find closing paren of
 multi-line statements
In-Reply-To: <1402739295.59.0.675144010232.issue21756@psf.upfronthosting.co.za>
Message-ID: <1601826379.73.0.296749760101.issue21756@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

As noted on the PR GH-20753, an incremental change to the current logic doesn't seem like a promising approach.

It seems to me that this will require refactoring the code parsing logic to allow it to incrementally parse lines backwards and forwards in order to find the beginning and end of a code block.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21756>
_______________________________________

From report at bugs.python.org  Sun Oct  4 11:51:13 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 04 Oct 2020 15:51:13 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601826673.74.0.182250157017.issue41898@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I'm not sure my patch completely resolved this issue. I'm adding Antoine re the OP's question about the assertLogs API. 

> Doing so would make the test over-specific and fragile.  The requirement is > that a warning be logged, not that a specific logger issue the warning.

My view is that your test is fragile because it just asks "was anything logged" without checking the log message. The docs show how to verify that the log message is what you expect it to be.

----------
nosy: +pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Sun Oct  4 11:53:19 2020
From: report at bugs.python.org (Carl Bordum Hansen)
Date: Sun, 04 Oct 2020 15:53:19 +0000
Subject: [issue25292] ssl socket gets into broken state when client exits
 during handshake
In-Reply-To: <1443729972.18.0.386386409576.issue25292@psf.upfronthosting.co.za>
Message-ID: <1601826799.29.0.48138468939.issue25292@roundup.psfhosted.org>


Carl Bordum Hansen <carl at bordum.dk> added the comment:

I have submitted a proposed solution

Just found this similar issue https://bugs.python.org/issue35840

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25292>
_______________________________________

From report at bugs.python.org  Sun Oct  4 11:56:06 2020
From: report at bugs.python.org (Kostis Anagnostopoulos)
Date: Sun, 04 Oct 2020 15:56:06 +0000
Subject: [issue41483] Do not acquire lock in MemoryHandler.flush() if no
 target defined
In-Reply-To: <1596607573.95.0.247308930011.issue41483@roundup.psfhosted.org>
Message-ID: <1601826966.77.0.518662492581.issue41483@roundup.psfhosted.org>


Kostis Anagnostopoulos <ankostis at gmail.com> added the comment:

Have nothing else to say on top of what iritkatriel discovered, a double-check would be needed, but may be a pointless speed up, if MemoryHandler is impossible to work without a `target`.  

Fixing the no-target error is more important.  Actually that's how i came to notice this optimization.

----------
status: pending -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41483>
_______________________________________

From report at bugs.python.org  Sun Oct  4 11:56:03 2020
From: report at bugs.python.org (berthin)
Date: Sun, 04 Oct 2020 15:56:03 +0000
Subject: [issue41932] Incorrect struct definition with bitfields
Message-ID: <1601826963.62.0.914106725495.issue41932@roundup.psfhosted.org>


New submission from berthin <berthin_37 at hotmail.com>:

Hi all,

I found one issue related to bitfields and ctypes, and although there is a similar issue already opened (https://bugs.python.org/issue29753), that only covers the case with pragmas. 

Please, consider the following scenario:

>>> from ctypes import *
>>> class X(Structure):
...     _fields_ = [("a", c_uint8, 8), ("b", c_uint8, 8), ("c", c_uint32, 16)]
...
>>> sizeof(X)
5


Which seems to be incorrect, because what natively C does is to generate a 4bytes struct.

root at 0bc6a647abaa:/target/cpython-fix# cat sample.c

#include <stdio.h>
#include <stdint.h>
struct X { 
    uint8_t a; 
    uint8_t b; 
    uint32_t c:16;
} X;

int main() { 
    printf("%u\n", sizeof(X)); 
}

root at 0bc6a647abaa:/target/cpython-fix# gcc sample.c -o a && ./a
4

Also, if I use different databtypes I get what I expect (a struct of 4 bytes).

>>> X = type('X', (Structure,), {'_fields_': [('a', c_uint32, 8), ('b', c_uint32, 8), ('c', c_uint32, 16)]})
>>> sizeof(X)
4
>>> X = type('X', (Structure,), {'_fields_': [('a', c_uint16, 8), ('b', c_uint16, 8), ('c', c_uint16, 16)]})
>>> sizeof(X)
4
>>> X = type('X', (Structure,), {'_fields_': [('a', c_uint8, 8), ('b', c_uint8, 8), ('c', c_uint16, 16)]})
>>> sizeof(X)
4

I tried to debug a little bit, adding some prints before and after calling *PyCField_FromDesc* in *Modules/_ctypes/stgdict.c:L603*.=, if someone wants to look at it, the logs are attached / one log file per each test, using the following gdb init:

# before
break stgdict.c:601
commands
p field_size
p bitofs
p size
p align
p *dict
continue
end


# after
break stgdict.c:617
commands
p field_size
p bitofs
p size
p align
p *(CFieldObject*) prop
continue
end

Hope someone could spot the issue, I will also try to investigate it by my own.

Best,

P.S. For the tests, I worked on top of bpo-29753 (https://github.com/python/cpython/pull/19850)

----------
components: ctypes
files: bitfields.zip
messages: 377953
nosy: FFY00, berthin
priority: normal
severity: normal
status: open
title: Incorrect struct definition with bitfields
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49493/bitfields.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41932>
_______________________________________

From report at bugs.python.org  Sun Oct  4 12:03:05 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 04 Oct 2020 16:03:05 +0000
Subject: [issue41483] Do not acquire lock in MemoryHandler.flush() if no
 target defined
In-Reply-To: <1596607573.95.0.247308930011.issue41483@roundup.psfhosted.org>
Message-ID: <1601827385.88.0.339224485844.issue41483@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

The missing target error was fixed under issue41503

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41483>
_______________________________________

From report at bugs.python.org  Sun Oct  4 12:15:22 2020
From: report at bugs.python.org (Bar Harel)
Date: Sun, 04 Oct 2020 16:15:22 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601828122.22.0.782289334338.issue41905@roundup.psfhosted.org>


Bar Harel <bzvi7919 at gmail.com> added the comment:

> When instantiation fails, recheck to see the missing abstract methods had been defined?

I've written about it in the python-ideas discussion as well, and completely agree.

There is no other approach that would guarantee correctness across all APIs, both internal and 3rd party. Adding a function to recalculate will require everyone to use it, and worse, know that it even exists.

The overhead should be quite low as this case is probably rare and the recalculation can happen only on failure.

I'm not sure however, what are the implications of changing Py_TPFLAGS_IS_ABSTRACT during type creation.

----------
nosy: +bar.harel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sun Oct  4 12:16:07 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 04 Oct 2020 16:16:07 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601828167.22.0.718092244126.issue41898@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Troy, 

I'm also confused about how you would have liked assertLogs to behave you say:

1. I don't want to specify the logger because I don't care which logger the message comes from.

2. I don't want it to catch messages from other loggers (whatever other means here).  But -- see 1 -- you didn't specify the logger because you don't care which logger.

What do you expect assertLogs to do when you don't specify a logger?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Sun Oct  4 12:20:21 2020
From: report at bugs.python.org (Julien Palard)
Date: Sun, 04 Oct 2020 16:20:21 +0000
Subject: [issue41933] Wording of s * n in Common Sequence Operations is not
 optimal
Message-ID: <1601828421.16.0.497838866676.issue41933@roundup.psfhosted.org>


New submission from Julien Palard <julien+python at palard.fr>:

As reported by Graham Ewart on docs@,

in https://docs.python.org/3/library/stdtypes.html#common-sequence-operations:

s * n or n * s | equivalent to adding s to itself n times

is badly worded. In fact it's more like n-1 times, but yet it's not adding s to itself.

I'd go for "n times the s sequence" or "n copies of the s sequence" instead, which both avoid the "n-1" and the "to itself" parts.

----------
assignee: docs at python
components: Documentation
keywords: easy
messages: 377958
nosy: docs at python, mdk
priority: normal
severity: normal
status: open
title: Wording of s * n in Common Sequence Operations is not optimal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41933>
_______________________________________

From report at bugs.python.org  Sun Oct  4 12:21:07 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Sun, 04 Oct 2020 16:21:07 +0000
Subject: [issue41875] __builtin_unreachable error in gcc 4.4.5
In-Reply-To: <1601291751.72.0.463788017117.issue41875@roundup.psfhosted.org>
Message-ID: <1601828467.38.0.708977964967.issue41875@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:

Done.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41875>
_______________________________________

From report at bugs.python.org  Sun Oct  4 12:24:13 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Sun, 04 Oct 2020 16:24:13 +0000
Subject: [issue38302] [3.10] __pow__ and __rpow__ are not reached when
 __ipow__ returns NotImplemented for **=
In-Reply-To: <1569621315.69.0.377751123288.issue38302@roundup.psfhosted.org>
Message-ID: <1601828653.37.0.175487042173.issue38302@roundup.psfhosted.org>


Change by ?ukasz Langa <lukasz at langa.pl>:


----------
title: __pow__ and __rpow__ are not reached when __ipow__ returns NotImplemented for **= -> [3.10] __pow__ and __rpow__ are not reached when __ipow__ returns NotImplemented for **=

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38302>
_______________________________________

From report at bugs.python.org  Sun Oct  4 12:29:39 2020
From: report at bugs.python.org (Josh Friend)
Date: Sun, 04 Oct 2020 16:29:39 +0000
Subject: [issue32922] dbm.open() encodes filename with default encoding rather
 than the filesystem encoding
In-Reply-To: <1519398668.71.0.467229070634.issue32922@psf.upfronthosting.co.za>
Message-ID: <1601828979.37.0.687833145985.issue32922@roundup.psfhosted.org>


Josh Friend <josh at fueledbycaffeine.com> added the comment:

yes it should be closed, can i do that? (ill try...)

----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32922>
_______________________________________

From report at bugs.python.org  Sun Oct  4 12:45:38 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Sun, 04 Oct 2020 16:45:38 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601829938.62.0.754697700935.issue41490@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 2cc6dc9896771ef3615abbb5ba80939a2f644a08 by Pablo Galindo in branch 'master':
bpo-41490: Bump vendored pip to version 20.2.3 (#22527)
https://github.com/python/cpython/commit/2cc6dc9896771ef3615abbb5ba80939a2f644a08


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Sun Oct  4 12:49:31 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 04 Oct 2020 16:49:31 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601830171.57.0.741611265658.issue41490@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +21545
pull_request: https://github.com/python/cpython/pull/22544

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Sun Oct  4 12:51:52 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 04 Oct 2020 16:51:52 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601830312.0.0.506008435992.issue41490@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +21546
pull_request: https://github.com/python/cpython/pull/22545

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Sun Oct  4 13:11:13 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Sun, 04 Oct 2020 17:11:13 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601831473.2.0.074947218805.issue41490@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 4b4d60f9287e0e52c2569876456f40efc11529b4 by Pablo Galindo in branch '3.9':
[3.9] bpo-41490: Bump vendored pip to version 20.2.3 (GH-22527). (GH-22544)
https://github.com/python/cpython/commit/4b4d60f9287e0e52c2569876456f40efc11529b4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Sun Oct  4 13:11:34 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Sun, 04 Oct 2020 17:11:34 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601831494.12.0.342072974446.issue41490@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 28cd96f2e5cfb16566a75dca8473b71889746f10 by Pablo Galindo in branch '3.8':
[3.8] bpo-41490: Bump vendored pip to version 20.2.3 (GH-22527). (GH-22545)
https://github.com/python/cpython/commit/28cd96f2e5cfb16566a75dca8473b71889746f10


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Sun Oct  4 13:13:29 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Sun, 04 Oct 2020 17:13:29 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601831609.91.0.0515997536487.issue41490@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:

This change goes into 3.9.0 with Pablo's fix.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Sun Oct  4 13:18:40 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sun, 04 Oct 2020 17:18:40 +0000
Subject: [issue41892] use both "for in" and "ElementTree.remove" has a index
 bug
In-Reply-To: <1601475625.07.0.195514916094.issue41892@roundup.psfhosted.org>
Message-ID: <1601831920.12.0.0877159897361.issue41892@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
pull_requests: +21547
pull_request: https://github.com/python/cpython/pull/22546

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41892>
_______________________________________

From report at bugs.python.org  Sun Oct  4 13:38:53 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 04 Oct 2020 17:38:53 +0000
Subject: [issue41931] Make dict(object) return its attribute __dict__
In-Reply-To: <1601821047.33.0.238039916415.issue41931@roundup.psfhosted.org>
Message-ID: <1601833133.58.0.484913696093.issue41931@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

You ignored the other point I made: dict is not a function, it is a class. dict() calls the function dict.__init__() which should create a new instance of dict (not return some field of its parameter). 


You also didn't justify your suggestion in any way. Why should this change be made?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41931>
_______________________________________

From report at bugs.python.org  Sun Oct  4 13:57:00 2020
From: report at bugs.python.org (Chris Tse)
Date: Sun, 04 Oct 2020 17:57:00 +0000
Subject: [issue41925] Lowercase path to python.exe in pip.exe from venv is
 throwing error
In-Reply-To: <1601782121.26.0.581028489128.issue41925@roundup.psfhosted.org>
Message-ID: <1601834220.74.0.775332098145.issue41925@roundup.psfhosted.org>


Chris Tse <christse at hey.com> added the comment:

Another update:

After a full shutdown from yesterday and trying again today, everything seems to be working now, including activating the venv via:

  1. python -m venv myenv
  2. .\myenv\Scripts\activate (not Activate.ps1, though that work too, is this intended?)

The only thing I can think of that changed since I opened the report was that I changed my system locale back to English (United States) from Japan (Japan). I did a system restart to make the changes take effect, but it didn't seem to fix the issue at the time. It could possibly be a difference between a shutdown vs a restart. Odd, either way.

I wouldn't think that changing locales would have an effect on Windows paths being case sensitive or not, otherwise folks from other countries would be experiencing this error. Perhaps the mixing of locale and system language? I had locale set to Japan but system language set to English

Thank you for taking the time to reply.

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41925>
_______________________________________

From report at bugs.python.org  Sun Oct  4 14:06:21 2020
From: report at bugs.python.org (=?utf-8?b?4K6u4K6p4K+L4K6c4K+N4K6V4K+B4K6u4K6+4K6w4K+NIOCuquCutOCuqQ==?= =?utf-8?b?4K6/4K6a4K+N4K6a4K6+4K6u4K6/?=)
Date: Sun, 04 Oct 2020 18:06:21 +0000
Subject: [issue41931] Make dict(object) return its attribute __dict__
In-Reply-To: <1601821047.33.0.238039916415.issue41931@roundup.psfhosted.org>
Message-ID: <1601834781.16.0.8070509155.issue41931@roundup.psfhosted.org>


??????????? ?????????? <smartmanoj42857 at gmail.com> added the comment:

Your point makes sense as it takes space to allocate for the new instance to just return another dict object. 
Then the attribute name at least should be meaningful.

Instead of __dict__ , __attr__ is more appropriate.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41931>
_______________________________________

From report at bugs.python.org  Sun Oct  4 14:17:08 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 04 Oct 2020 18:17:08 +0000
Subject: [issue41931] Make dict(object) return its attribute __dict__
In-Reply-To: <1601821047.33.0.238039916415.issue41931@roundup.psfhosted.org>
Message-ID: <1601835428.34.0.374448967943.issue41931@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

The vars() function already does this.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41931>
_______________________________________

From report at bugs.python.org  Sun Oct  4 14:22:03 2020
From: report at bugs.python.org (Ben Avrahami)
Date: Sun, 04 Oct 2020 18:22:03 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1601835723.97.0.696067886646.issue41905@roundup.psfhosted.org>


Ben Avrahami <avrahami.ben at gmail.com> added the comment:

> Adding a function to recalculate will require everyone to use it

I'd argue that this is akin to `functools.update_wrapper`. It too is a function that must be called in virtually every function decorator (the only function decorators that don't/needn't call it are the built-in method decorators and, appropriately enough, @abstractmethod), and if not called, certain functionality won't work.

> and worse, know that it even exists

I think that knowing about such a function is a fair requirement. Mixin tools already has nuances and edge cases, such that it should only be done (and especially distributed) by advanced users.

Furthermore, not all class mixin tools have/need to be ABC-aware. Just as `total_ordering` is ABC-agnostic (indeed, it is also subclass-agnostic), any other mixin tool can decide that implementing abstract classes is simply not a use case for them. The upshot of the `update_abstractmethods` implementation is that, as long as their implementation isn't afraid to override methods that are already defined (like attrs does), the function can be slotted above ABC-agnostic wrappers and it suddenly becomes ABC-aware.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Sun Oct  4 14:25:44 2020
From: report at bugs.python.org (=?utf-8?b?4K6u4K6p4K+L4K6c4K+N4K6V4K+B4K6u4K6+4K6w4K+NIOCuquCutOCuqQ==?= =?utf-8?b?4K6/4K6a4K+N4K6a4K6+4K6u4K6/?=)
Date: Sun, 04 Oct 2020 18:25:44 +0000
Subject: [issue41931] Make dict(object) return its attribute __dict__
In-Reply-To: <1601821047.33.0.238039916415.issue41931@roundup.psfhosted.org>
Message-ID: <1601835944.8.0.687554832735.issue41931@roundup.psfhosted.org>


??????????? ?????????? <smartmanoj42857 at gmail.com> added the comment:

Changing '__dict__' to __vars__ will be much better.

Like len() calling __len__()

Can we change the title?

Why Github Issue Tracker is not issued?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41931>
_______________________________________

From report at bugs.python.org  Sun Oct  4 14:43:39 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 04 Oct 2020 18:43:39 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601837019.52.0.878408411694.issue26680@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> How so?

When a concrete class registers with an ABC, it is making a promise that it implements everything in the ABC so that client code can count on all the methods being present.  That is the raison d'etre for abstract base classes.

In general, we restrict ABCs to a minimal useful subset of the capabilities of concrete classes.  That makes the ABC more broadly applicable and it makes life easier for implementers of concrete classes.  That's why collections.abc.Set doesn't include most of the named methods present in the concrete set/frozenset types.

Likewise, we don't want to add methods to already published ABCs because existing user classes registered to the ABC stop being compliant.  If an additional method is deemed essential, the technically correct way to do is to make a new ABC that subclasses from the old.  For example, that's why Python 2 had to have both UserDict and IterableUserDict when we needed to add a __iter__() method.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Sun Oct  4 15:16:05 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 04 Oct 2020 19:16:05 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601838965.92.0.774534057581.issue26680@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Possibly at some point in the future we can switch to using typing.Protocol, which requires neither registration nor explicit subclassing (it's like Hashable). This makes it easy for user code to define custom protocols as needed. So if you need something that has .keys() and .items() but you don't care about .values() you can just write

class KeysAndItems(typing.Protocol):
    def keys(self): ...
    def items(self): ...

def my_func(x: KeysAndItems):
    ...

This can be statically checked using e.g. mypy.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Sun Oct  4 16:55:49 2020
From: report at bugs.python.org (Hadi Alqattan)
Date: Sun, 04 Oct 2020 20:55:49 +0000
Subject: [issue41934] Add `has` method to `pathlib.Path` class.
Message-ID: <1601844949.96.0.502154484119.issue41934@roundup.psfhosted.org>


New submission from Hadi Alqattan <alqattanhadizaki at gmail.com>:

Adding a new method to `pathlib.Path` class, `has` method is a method that can determine if the `Path` object has a specific file/dir or not.

Assume that we have a `Path` object for this `project/` directory:
```
project/
  main.py
  __init__.py
  utils/
```
and we want to know if the project directory has `main.py` or not, after adding this method we will be able to do this:
```
from pathlib import Path

project_path = Path("./project")

if project_path.has("main.py"):
    pass  # do something.
```

----------
components: Library (Lib)
messages: 377973
nosy: hadialqattan
priority: normal
severity: normal
status: open
title: Add `has` method to `pathlib.Path` class.
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41934>
_______________________________________

From report at bugs.python.org  Sun Oct  4 17:02:53 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Sun, 04 Oct 2020 21:02:53 +0000
Subject: [issue41934] Add `has` method to `pathlib.Path` class.
In-Reply-To: <1601844949.96.0.502154484119.issue41934@roundup.psfhosted.org>
Message-ID: <1601845373.26.0.303724732485.issue41934@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Isn't this just:
(project_path / "main.py").exists()
?

I don't think .has would be any more efficient.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41934>
_______________________________________

From report at bugs.python.org  Sun Oct  4 17:13:11 2020
From: report at bugs.python.org (Hadi Alqattan)
Date: Sun, 04 Oct 2020 21:13:11 +0000
Subject: [issue41934] Add `has` method to `pathlib.Path` class.
In-Reply-To: <1601844949.96.0.502154484119.issue41934@roundup.psfhosted.org>
Message-ID: <1601845991.0.0.357557495831.issue41934@roundup.psfhosted.org>


Hadi Alqattan <alqattanhadizaki at gmail.com> added the comment:

You're right, I'm sorry.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41934>
_______________________________________

From report at bugs.python.org  Sun Oct  4 17:13:22 2020
From: report at bugs.python.org (Hadi Alqattan)
Date: Sun, 04 Oct 2020 21:13:22 +0000
Subject: [issue41934] Add `has` method to `pathlib.Path` class.
In-Reply-To: <1601844949.96.0.502154484119.issue41934@roundup.psfhosted.org>
Message-ID: <1601846002.37.0.494683285823.issue41934@roundup.psfhosted.org>


Change by Hadi Alqattan <alqattanhadizaki at gmail.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41934>
_______________________________________

From report at bugs.python.org  Sun Oct  4 17:22:09 2020
From: report at bugs.python.org (Hadi Alqattan)
Date: Sun, 04 Oct 2020 21:22:09 +0000
Subject: [issue41935] Add binary operator!
Message-ID: <1601846529.24.0.0764932773138.issue41935@roundup.psfhosted.org>


New submission from Hadi Alqattan <alqattanhadizaki at gmail.com>:

What are your opinions about adding a binary operator to Python in order to make this code possible?
```
my_counter = 0

for i in rage(1000):
    my_counter += 1 if (i % 2) == 0
```

----------
components: Interpreter Core
messages: 377976
nosy: hadialqattan
priority: normal
severity: normal
status: open
title: Add binary operator!
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41935>
_______________________________________

From report at bugs.python.org  Sun Oct  4 17:56:01 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 04 Oct 2020 21:56:01 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601848561.58.0.894591148999.issue41909@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 9ece9cd65cdeb0a1f6e60475bbd0219161c348ac by Serhiy Storchaka in branch 'master':
bpo-41909: Enable previously disabled recursion checks. (GH-22536)
https://github.com/python/cpython/commit/9ece9cd65cdeb0a1f6e60475bbd0219161c348ac


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Sun Oct  4 17:57:34 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 04 Oct 2020 21:57:34 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601848654.14.0.912440629054.issue41909@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +21548
pull_request: https://github.com/python/cpython/pull/22550

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Sun Oct  4 18:03:39 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 04 Oct 2020 22:03:39 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601849019.55.0.882442547256.issue41909@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +21549
pull_request: https://github.com/python/cpython/pull/22551

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Sun Oct  4 18:20:31 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 04 Oct 2020 22:20:31 +0000
Subject: [issue41936] Remove macros Py_ALLOW_RECURSION/Py_END_ALLOW_RECURSION
Message-ID: <1601850031.67.0.853880469279.issue41936@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

Macros Py_ALLOW_RECURSION and Py_END_ALLOW_RECURSION together with field recursion_critical of the PyInterpreterState structure were added in 5b222135f8d2492713994f2cb003980e87ce6a72 but were never documented. It seems that the reason of adding them was to work around the fact that PyDict_GetItem() can silence any exception including recursion error. But PyDict_GetItem() no longer used in that code and the macros are also no longer used (see issue41909).

GvR proposed to remove these macros. I think that recursion_critical can be removed too.

----------
components: C API
messages: 377978
nosy: gvanrossum, serhiy.storchaka, vstinner
priority: normal
severity: normal
status: open
title: Remove macros Py_ALLOW_RECURSION/Py_END_ALLOW_RECURSION
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41936>
_______________________________________

From report at bugs.python.org  Sun Oct  4 18:27:43 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 04 Oct 2020 22:27:43 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601850463.85.0.28215741389.issue41909@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 7aa22ba923509af1dbf115c090964f503c84ca8d by Serhiy Storchaka in branch '3.9':
[3.9] bpo-41909: Enable previously disabled recursion checks. (GH-22536) (GH-22550)
https://github.com/python/cpython/commit/7aa22ba923509af1dbf115c090964f503c84ca8d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Sun Oct  4 18:28:03 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 04 Oct 2020 22:28:03 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601850483.82.0.697390186322.issue41909@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 09a7b3b618cd02694a0bc8abfa24c75f0e659407 by Serhiy Storchaka in branch '3.8':
[3.8] bpo-41909: Enable previously disabled recursion checks. (GH-22536) (GH-22551)
https://github.com/python/cpython/commit/09a7b3b618cd02694a0bc8abfa24c75f0e659407


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Sun Oct  4 18:30:25 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 04 Oct 2020 22:30:25 +0000
Subject: [issue41936] Remove macros Py_ALLOW_RECURSION/Py_END_ALLOW_RECURSION
In-Reply-To: <1601850031.67.0.853880469279.issue41936@roundup.psfhosted.org>
Message-ID: <1601850625.05.0.647392945318.issue41936@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21550
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22552

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41936>
_______________________________________

From report at bugs.python.org  Sun Oct  4 18:34:17 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 04 Oct 2020 22:34:17 +0000
Subject: [issue40640] Tutorial for Continue missing ... line
In-Reply-To: <1589608941.53.0.91951505263.issue40640@roundup.psfhosted.org>
Message-ID: <1601850857.2.0.704031284708.issue40640@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

ping

----------
nosy: +iritkatriel
versions:  -Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40640>
_______________________________________

From report at bugs.python.org  Sun Oct  4 18:38:01 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 04 Oct 2020 22:38:01 +0000
Subject: [issue40640] Tutorial for Continue missing ... line
In-Reply-To: <1589608941.53.0.91951505263.issue40640@roundup.psfhosted.org>
Message-ID: <1601851081.23.0.695734845062.issue40640@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
nosy: +orsenthil

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40640>
_______________________________________

From report at bugs.python.org  Sun Oct  4 18:44:32 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 04 Oct 2020 22:44:32 +0000
Subject: [issue41909] Segfault on __getattr__ infinite recursion on certain
 attribute accesses
In-Reply-To: <1601635791.4.0.685475277421.issue41909@roundup.psfhosted.org>
Message-ID: <1601851472.05.0.988896064512.issue41909@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41909>
_______________________________________

From report at bugs.python.org  Sun Oct  4 19:14:03 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 04 Oct 2020 23:14:03 +0000
Subject: [issue41892] use both "for in" and "ElementTree.remove" has a index
 bug
In-Reply-To: <1601475625.07.0.195514916094.issue41892@roundup.psfhosted.org>
Message-ID: <1601853243.16.0.270879951039.issue41892@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 7.0 -> 8.0
pull_requests: +21551
pull_request: https://github.com/python/cpython/pull/22553

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41892>
_______________________________________

From report at bugs.python.org  Sun Oct  4 19:13:53 2020
From: report at bugs.python.org (Ned Deily)
Date: Sun, 04 Oct 2020 23:13:53 +0000
Subject: [issue41892] use both "for in" and "ElementTree.remove" has a index
 bug
In-Reply-To: <1601475625.07.0.195514916094.issue41892@roundup.psfhosted.org>
Message-ID: <1601853233.01.0.537925771339.issue41892@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 40db798692ca783fc2163656f196ac77e8b9e792 by scoder in branch 'master':
bpo-41892: Clarify that an example in the ElementTree docs explicitly avoids modifying an XML tree while iterating over it. (GH-22464)
https://github.com/python/cpython/commit/40db798692ca783fc2163656f196ac77e8b9e792


----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41892>
_______________________________________

From report at bugs.python.org  Sun Oct  4 19:14:07 2020
From: report at bugs.python.org (twoone3)
Date: Sun, 04 Oct 2020 23:14:07 +0000
Subject: [issue41937] how to use cpython O&
Message-ID: <1601853247.59.0.581530220045.issue41937@roundup.psfhosted.org>


New submission from twoone3 <3197653242 at qq.com>:

When I use'O&' to parse the parameters, I have never succeeded, I hope I can give a demo

----------
files: Screenshot_2020_1005_070639.png
messages: 377983
nosy: twoone3
priority: normal
severity: normal
status: open
title: how to use cpython O&
type: behavior
versions: Python 3.8
Added file: https://bugs.python.org/file49494/Screenshot_2020_1005_070639.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41937>
_______________________________________

From report at bugs.python.org  Sun Oct  4 19:22:22 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 04 Oct 2020 23:22:22 +0000
Subject: [issue41892] use both "for in" and "ElementTree.remove" has a index
 bug
In-Reply-To: <1601475625.07.0.195514916094.issue41892@roundup.psfhosted.org>
Message-ID: <1601853742.38.0.425633205402.issue41892@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21552
pull_request: https://github.com/python/cpython/pull/22554

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41892>
_______________________________________

From report at bugs.python.org  Sun Oct  4 19:23:51 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 04 Oct 2020 23:23:51 +0000
Subject: [issue41892] use both "for in" and "ElementTree.remove" has a index
 bug
In-Reply-To: <1601475625.07.0.195514916094.issue41892@roundup.psfhosted.org>
Message-ID: <1601853831.49.0.828537895912.issue41892@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6bd058e0ff5d4a63fb35f6d45161cdf51cb68c58 by Miss Skeleton (bot) in branch '3.8':
bpo-41892: Clarify that an example in the ElementTree docs explicitly avoids modifying an XML tree while iterating over it. (GH-22464)
https://github.com/python/cpython/commit/6bd058e0ff5d4a63fb35f6d45161cdf51cb68c58


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41892>
_______________________________________

From report at bugs.python.org  Sun Oct  4 19:41:08 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 04 Oct 2020 23:41:08 +0000
Subject: [issue41935] Add binary operator!
In-Reply-To: <1601846529.24.0.0764932773138.issue41935@roundup.psfhosted.org>
Message-ID: <1601854868.97.0.0494850073105.issue41935@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

You can already do:

my_counter = 0

for i in rage(1000):
    my_counter += (1 if (i % 2) == 0 else 0)

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41935>
_______________________________________

From report at bugs.python.org  Sun Oct  4 19:42:02 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 04 Oct 2020 23:42:02 +0000
Subject: [issue41935] Add binary operator!
In-Reply-To: <1601846529.24.0.0764932773138.issue41935@roundup.psfhosted.org>
Message-ID: <1601854922.23.0.852420707276.issue41935@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

In any case, for modifications about the Python syntax, please, open first some debate in the python-ideas mailing list.

----------
resolution:  -> postponed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41935>
_______________________________________

From report at bugs.python.org  Sun Oct  4 19:51:46 2020
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 04 Oct 2020 23:51:46 +0000
Subject: [issue41925] Lowercase path to python.exe in pip.exe from venv is
 throwing error
In-Reply-To: <1601782121.26.0.581028489128.issue41925@roundup.psfhosted.org>
Message-ID: <1601855506.12.0.607244104073.issue41925@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> I wouldn't think that changing locales would have an effect on Windows
> paths being case sensitive or not, otherwise folks from other countries
> would be experiencing this error. Perhaps the mixing of locale and system
> language? I had locale set to Japan but system language set to English

It shouldn't make a difference. Filenames are Unicode, the NTFS case table is set on disk when the filesystem is formatted, and the launcher uses wide-character strings and calls CreateProcessW. I wish I could offer up a reasonable explanation, but I think this one stays in the category of strange problems fixed by turning it off and on again.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41925>
_______________________________________

From report at bugs.python.org  Sun Oct  4 19:56:45 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 04 Oct 2020 23:56:45 +0000
Subject: [issue41937] how to use cpython O&
In-Reply-To: <1601853247.59.0.581530220045.issue41937@roundup.psfhosted.org>
Message-ID: <1601855805.44.0.28416723948.issue41937@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Please don't post screen shots of text when you can post a direct link to the page.

Are you talking about this?

https://docs.python.org/3/c-api/arg.html?highlight=py_cleanup#other-objects

This is a bug tracker, for reporting bugs in the Python interpreter and standard library, not a help desk for asking for help with your code. There are many other places where you can ask for help, such as:

- Stackoverflow

- Reddit's /r/learnpython

- https://python-forum.io/

- the Python-List mailing list https://mail.python.org/mailman/listinfo/python-list

- IRC https://www.python.org/community/irc/

and probably many more.

For help getting your code to work, see the above forums.

I'm going to close this as "Not A Bug", if you have an actual bug to report, you can re-open this with a demonstration of the bug.

----------
nosy: +steven.daprano
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41937>
_______________________________________

From report at bugs.python.org  Sun Oct  4 19:57:06 2020
From: report at bugs.python.org (Ned Deily)
Date: Sun, 04 Oct 2020 23:57:06 +0000
Subject: [issue41892] use both "for in" and "ElementTree.remove" has a index
 bug
In-Reply-To: <1601475625.07.0.195514916094.issue41892@roundup.psfhosted.org>
Message-ID: <1601855826.0.0.821246611146.issue41892@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset d5719247ba32b3ac700454bad9a9e2cc7edeac6a by Miss Skeleton (bot) in branch '3.9':
bpo-41892: Clarify that an example in the ElementTree docs explicitly avoids modifying an XML tree while iterating over it. (GH-22464) (GH-22554)
https://github.com/python/cpython/commit/d5719247ba32b3ac700454bad9a9e2cc7edeac6a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41892>
_______________________________________

From report at bugs.python.org  Sun Oct  4 22:01:18 2020
From: report at bugs.python.org (Tim Peters)
Date: Mon, 05 Oct 2020 02:01:18 +0000
Subject: [issue41912] Long generator chain causes segmentation fault
In-Reply-To: <1601661685.77.0.221830308398.issue41912@roundup.psfhosted.org>
Message-ID: <1601863278.13.0.330230275257.issue41912@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

"Stackless" is a large topic with a convoluted history. Do the web search. In short, no, it will never go in the core - too disruptive to too many things. Parts have lived on in other ways, watered down versions. The PyPy project captured most of what remains, as optional features. CPython's generators captured the easiest part: after a yield, the C stack space the generator consumed is released, while the Python VM stack space lives on in the heap awaiting possible resumption (but, if/when it's resumed, C stack space is required again).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41912>
_______________________________________

From report at bugs.python.org  Sun Oct  4 22:02:57 2020
From: report at bugs.python.org (Kaushal Rohit)
Date: Mon, 05 Oct 2020 02:02:57 +0000
Subject: [issue41938] concurrent.futures.wait calls len() on an possible
 iterable
Message-ID: <1601863377.27.0.411836826133.issue41938@roundup.psfhosted.org>


New submission from Kaushal Rohit <rohit.kg98 at gmail.com>:

`fs` argument could be an iterable, and calling len on it would raise an Exception.

We are converting `fs` into a set anyways for set difference, and that too twice. we can just put an `fs = set(fs)`.

Let me know if we choose to go with that and I will make a PR ASAP.

Thanks.

----------
components: Library (Lib)
messages: 377991
nosy: rohitkg98
priority: normal
severity: normal
status: open
title: concurrent.futures.wait calls len() on an possible iterable
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41938>
_______________________________________

From report at bugs.python.org  Sun Oct  4 22:35:35 2020
From: report at bugs.python.org (Kaushal Rohit)
Date: Mon, 05 Oct 2020 02:35:35 +0000
Subject: [issue41938] concurrent.futures.wait calls len() on an possible
 iterable
In-Reply-To: <1601863377.27.0.411836826133.issue41938@roundup.psfhosted.org>
Message-ID: <1601865335.44.0.921481373115.issue41938@roundup.psfhosted.org>


Change by Kaushal Rohit <rohit.kg98 at gmail.com>:


----------
keywords: +patch
pull_requests: +21553
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22555

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41938>
_______________________________________

From report at bugs.python.org  Mon Oct  5 00:22:13 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Mon, 05 Oct 2020 04:22:13 +0000
Subject: [issue41892] use both "for in" and "ElementTree.remove" has a index
 bug
In-Reply-To: <1601475625.07.0.195514916094.issue41892@roundup.psfhosted.org>
Message-ID: <1601871733.4.0.988910048925.issue41892@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

Closing since this works as designed.

Users are responsible for avoiding concurrent tree modifications during iteration.

----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41892>
_______________________________________

From report at bugs.python.org  Mon Oct  5 00:40:55 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 05 Oct 2020 04:40:55 +0000
Subject: [issue41428] PEP 604 -- Allow writing union types as X | Y
In-Reply-To: <1595975550.94.0.895278514403.issue41428@roundup.psfhosted.org>
Message-ID: <1601872855.56.0.257502122553.issue41428@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 8e1dd55e63d18d40e78d941fc9233d2c77bcd3de by Fidget-Spinner in branch 'master':
bpo-41428: Documentation for PEP 604  (gh-22517)
https://github.com/python/cpython/commit/8e1dd55e63d18d40e78d941fc9233d2c77bcd3de


----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41428>
_______________________________________

From report at bugs.python.org  Mon Oct  5 00:41:51 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 05 Oct 2020 04:41:51 +0000
Subject: [issue41428] PEP 604 -- Allow writing union types as X | Y
In-Reply-To: <1595975550.94.0.895278514403.issue41428@roundup.psfhosted.org>
Message-ID: <1601872911.59.0.830517532753.issue41428@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41428>
_______________________________________

From report at bugs.python.org  Mon Oct  5 00:59:29 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 05 Oct 2020 04:59:29 +0000
Subject: [issue41931] Make dict(object) return its attribute __dict__
In-Reply-To: <1601821047.33.0.238039916415.issue41931@roundup.psfhosted.org>
Message-ID: <1601873969.06.0.165227341213.issue41931@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Sorry, but I think there is a near zero chance that the language will be revised as you suggest. 

Marking this as closed. If you want to have more discussion, please take it to the python-ideas maillist.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41931>
_______________________________________

From report at bugs.python.org  Mon Oct  5 01:34:21 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 05 Oct 2020 05:34:21 +0000
Subject: [issue41774] While removing element from list using for and remove(), 
 which has same items output is not right
In-Reply-To: <1599927635.78.0.618314187509.issue41774@roundup.psfhosted.org>
Message-ID: <1601876061.67.0.632813046538.issue41774@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee:  -> terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41774>
_______________________________________

From report at bugs.python.org  Mon Oct  5 03:01:03 2020
From: report at bugs.python.org (Ned Deily)
Date: Mon, 05 Oct 2020 07:01:03 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
Message-ID: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>


New submission from Ned Deily <nad at python.org>:

For 3.9.0, test_site fails with an env changed warning:

Warning -- urllib.requests._opener was modified by test_site
  Before: None
  After:  <urllib.request.OpenerDirector object at 0xb76f4f88>
test_site failed (env changed)

== Tests result: SUCCESS ==

1 test altered the execution environment:
    test_site

The problem occurs in test_site's test_license_exists_at_url test and was introduced by the changes in Issue37421: "Some tests leak temporary files".

This failure has not been noticed up to now because test_license_exists_at_url is skipped unless the build being tested is for a released branch, which is about to happen for 3.9 with the 3.9.0 release.  The test failure can be reproduced on any build by commenting out Lib/test_site.py lines 503-504:

    @unittest.skipUnless(sys.version_info[3] == 'final',
                         'only for released versions')

Setting to "deferred blocker" status for release manager evaluation.

----------
components: Tests
messages: 377995
nosy: lukasz.langa, ned.deily, vstinner
priority: deferred blocker
severity: normal
status: open
title: 3.9.0 test_site warning: "urllib.requests._opener was modified by test_site"
type: behavior
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Mon Oct  5 03:25:22 2020
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 05 Oct 2020 07:25:22 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601882722.32.0.284121833427.issue26680@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> When a concrete class registers with an ABC, it is making a promise that it implements everything in the ABC.

Ah, interesting. I would have assumed that it's only making a promise that it registers all the methods and properties marked *abstract* in the ABC. Do you have references to back up the stronger statement?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Mon Oct  5 03:29:14 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 07:29:14 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1601882954.17.0.920689462707.issue41939@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

It's a minor issue in the test itself, not in urllib. Such bug should not block a release.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Mon Oct  5 03:38:17 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 07:38:17 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1601883497.1.0.124824454455.issue41939@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +21554
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22559

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Mon Oct  5 03:39:00 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 07:39:00 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1601883540.47.0.359976214655.issue41939@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I proposed PR 22559 to fix the issue.

See also bpo-37475: "What is urllib.request.urlcleanup() function?".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Mon Oct  5 03:45:47 2020
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 05 Oct 2020 07:45:47 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601883947.52.0.789875104462.issue26680@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Ok, so we need to either (a) revert PR 6121 and then re-do the changes, without the changes to numbers.py, or (b) make a second PR to undo the numbers.py changes. I think there's (calendar) time available for option (b), but I'm not going to have bandwidth to do it any time soon, so there's a risk that the current changes make it into Python 3.10 purely through inertia. What's the best approach here?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Mon Oct  5 04:09:33 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 08:09:33 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1601885373.33.0.494413246352.issue41557@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 1.0 -> 2.0
pull_requests: +21555
pull_request: https://github.com/python/cpython/pull/22560

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Mon Oct  5 04:09:40 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 08:09:40 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1601885380.9.0.144191075624.issue41557@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21556
pull_request: https://github.com/python/cpython/pull/22561

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Mon Oct  5 04:09:44 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 08:09:44 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1601885384.14.0.94451691193.issue41557@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 9a7642667a71a27b38b96eb63df45f17f48b3467 by Erlend Egeberg Aasland in branch 'master':
bpo-41557: Update macOS installer to use SQLite 3.33.0 (GH-21959)
https://github.com/python/cpython/commit/9a7642667a71a27b38b96eb63df45f17f48b3467


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Mon Oct  5 04:27:57 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 08:27:57 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1601886477.46.0.66124114772.issue41557@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset a859680a5bef0bced197454f4b67080694979252 by Miss Skeleton (bot) in branch '3.8':
bpo-41557: Update macOS installer to use SQLite 3.33.0 (GH-21959)
https://github.com/python/cpython/commit/a859680a5bef0bced197454f4b67080694979252


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Mon Oct  5 04:38:23 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 08:38:23 +0000
Subject: [issue41936] Remove macros Py_ALLOW_RECURSION/Py_END_ALLOW_RECURSION
In-Reply-To: <1601850031.67.0.853880469279.issue41936@roundup.psfhosted.org>
Message-ID: <1601887103.23.0.21690245045.issue41936@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I failed to find users of these macros outside the CPython code base, so it sounds safe to remove it, especially if it's documented in What's New in Python 3.10.

If someone reports the removal as a regression and describes a legit use case, we can reconsider to revert the removal. Until that, I'm fine with removing them.

--

I ran grep on Cython and numpy code base: I cannot find "Py_ALLOW_RECURSION", "Py_END_ALLOW_RECURSION" or "recursion_critical".

On GitHub, I only found copies of Include/ceval.h (I looked at the first 5 pages of result):
https://github.com/search?l=C&q=Py_ALLOW_RECURSION&type=Code

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41936>
_______________________________________

From report at bugs.python.org  Mon Oct  5 04:48:07 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 08:48:07 +0000
Subject: [issue41940] AMD64 Debian root 3.x: tests fail because downloaded
 files start with: <!DOCTYPE
Message-ID: <1601887687.95.0.739602877312.issue41940@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

Why do downloaded files start with <!DOCTYPE?

AMD64 Debian root 3.x:
https://buildbot.python.org/all/#/builders/345/builds/132

5 tests failed:
    test_codecmaps_cn test_codecmaps_jp test_codecmaps_kr
    test_codecmaps_tw test_hashlib

I'm not sure if all failures are download issues.


Examples:

ERROR: test_mapping_file (test.test_codecmaps_kr.TestCP949Map)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/root/buildarea/3.x.angelico-debian-amd64/build/Lib/test/multibytecodec_support.py", line 305, in test_mapping_file
    self._test_mapping_file_plain()
  File "/root/buildarea/3.x.angelico-debian-amd64/build/Lib/test/multibytecodec_support.py", line 319, in _test_mapping_file_plain
    csetval = eval(data[0])
  File "<string>", line 1
    <!DOCTYPE
    ^
SyntaxError: invalid syntax


ERROR: test_named_sequences_full (test.test_ucn.UnicodeNamesTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/root/buildarea/3.x.angelico-debian-amd64/build/Lib/test/test_ucn.py", line 181, in test_named_sequences_full
    testdata = support.open_urlresource(url, encoding="utf-8",
  File "/root/buildarea/3.x.angelico-debian-amd64/build/Lib/test/support/__init__.py", line 540, in open_urlresource
    raise TestFailed('invalid resource %r' % fn)
test.support.TestFailed: invalid resource '/root/buildarea/3.x.angelico-debian-amd64/build/Lib/test/data/NamedSequences.txt'


ERROR: test_blake2b_vectors (test.test_hashlib.HashLibTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/root/buildarea/3.x.angelico-debian-amd64/build/Lib/test/test_hashlib.py", line 733, in test_blake2b_vectors
    for msg, key, md in read_vectors('blake2b'):
  File "/root/buildarea/3.x.angelico-debian-amd64/build/Lib/test/test_hashlib.py", line 85, in read_vectors
    parts[0] = bytes.fromhex(parts[0])
ValueError: non-hexadecimal number found in fromhex() arg at position 0



AMD64 Debian root 3.9 has similar issues.

----------
components: Tests
messages: 378003
nosy: vstinner
priority: normal
severity: normal
status: open
title: AMD64 Debian root 3.x: tests fail because downloaded files start with: <!DOCTYPE
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41940>
_______________________________________

From report at bugs.python.org  Mon Oct  5 04:51:42 2020
From: report at bugs.python.org (twoone3)
Date: Mon, 05 Oct 2020 08:51:42 +0000
Subject: [issue41941] Py_Initialize affects the console
Message-ID: <1601887902.24.0.789073375797.issue41941@roundup.psfhosted.org>


New submission from twoone3 <3197653242 at qq.com>:

When I set Py_LegacyWindowsStdioFlag to 0, after Py_Initialize, the console will forcibly change what encoding is displayed. At this time, my standard stream output is utf-8, py's print is utf-8, chcp 65001 is useless, and still garbled.  When I set Py_LegacyWindowsStdioFlag to 1, the console encoding is mbcs, the standard stream output is UTF-8 and not garbled, but the print of py is gbk encoding, and my system is Windows server 2016. I hope that Py_Initialize will not affect the console in subsequent versions.  Do any behavior, I suggest you test the coding problem in Chinese

----------
components: C API
messages: 378004
nosy: twoone3
priority: normal
severity: normal
status: open
title: Py_Initialize affects the console
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41941>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:00:29 2020
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 05 Oct 2020 09:00:29 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601888429.08.0.113280510381.issue26680@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

[Guido]

> Possibly at some point in the future we can switch to using typing.Protocol [...]

Yes, I think there's an interesting wider problem here, that typing.Protocol might be the answer to.

For numbers and collections.abc in the std. lib., I'm happy to accept that simply having a method present in the relevant ABC class implicitly makes it a part of the interface (though it would be good if that were clarified somewhere).

But in our own code, we've found it convenient to have abc.ABC subclasses that are a combination of interface and convenience base class, with the external interface separated from the convenience methods via the @abstractmethod and @abstractproperty decorators: classes that register with the given ABC subclass must provide all methods marked with those decorators, but the other methods are not considered part of the formal interface, and not used by client code that expects only an object implementing that interface.

The alternative to that convenience is to have two classes: a separate purely abstract interface, and a base class implementing that interface that's designed for subclassing. That works too, but it's a bit unwieldy, and it's useful to have the all-in-one option available.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:02:17 2020
From: report at bugs.python.org (Ned Deily)
Date: Mon, 05 Oct 2020 09:02:17 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1601888537.75.0.73983243856.issue41557@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset b6d37e15cfa32e04f750d78a03a68ec5bef00a59 by Miss Skeleton (bot) in branch '3.9':
bpo-41557: Update macOS installer to use SQLite 3.33.0 (GH-21959) (GH-22560)
https://github.com/python/cpython/commit/b6d37e15cfa32e04f750d78a03a68ec5bef00a59


----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:04:10 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 09:04:10 +0000
Subject: [issue25292] [asyncio] ssl socket gets into broken state when client
 exits during handshake
In-Reply-To: <1443729972.18.0.386386409576.issue25292@psf.upfronthosting.co.za>
Message-ID: <1601888650.88.0.936315476745.issue25292@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
title: ssl socket gets into broken state when client exits during handshake -> [asyncio] ssl socket gets into broken state when client exits during handshake

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25292>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:06:41 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 09:06:41 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601888801.32.0.350475720442.issue41490@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Can this issue be closed? Are we waiting for manual checks? Or is there any remaining thing to do?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:04:52 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 09:04:52 +0000
Subject: [issue30578] Misleading example in sys.set_coroutine_wrapper docs
In-Reply-To: <1496717073.05.0.260137843936.issue30578@psf.upfronthosting.co.za>
Message-ID: <1601888692.72.0.41757702179.issue30578@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Right, I close the issue.

----------
resolution:  -> out of date
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30578>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:09:33 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 09:09:33 +0000
Subject: [issue25292] [asyncio] ssl socket gets into broken state when client
 exits during handshake
In-Reply-To: <1443729972.18.0.386386409576.issue25292@psf.upfronthosting.co.za>
Message-ID: <1601888973.93.0.857474350672.issue25292@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25292>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:31:19 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 05 Oct 2020 09:31:19 +0000
Subject: [issue41940] AMD64 Debian root 3.x: tests fail because downloaded
 files start with: <!DOCTYPE
In-Reply-To: <1601887687.95.0.739602877312.issue41940@roundup.psfhosted.org>
Message-ID: <1601890279.34.0.641045807794.issue41940@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It is also not safe to pass data downloaded from untrusted source to eval().

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41940>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:32:07 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 05 Oct 2020 09:32:07 +0000
Subject: [issue41936] Remove macros Py_ALLOW_RECURSION/Py_END_ALLOW_RECURSION
In-Reply-To: <1601850031.67.0.853880469279.issue41936@roundup.psfhosted.org>
Message-ID: <1601890327.14.0.99708991171.issue41936@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset dcc54215ac1eb4b6fab2a9ffe1abcdf3ac4bb77e by Serhiy Storchaka in branch 'master':
bpo-41936. Remove macros Py_ALLOW_RECURSION/Py_END_ALLOW_RECURSION (GH-22552)
https://github.com/python/cpython/commit/dcc54215ac1eb4b6fab2a9ffe1abcdf3ac4bb77e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41936>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:32:22 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 05 Oct 2020 09:32:22 +0000
Subject: [issue41936] Remove macros Py_ALLOW_RECURSION/Py_END_ALLOW_RECURSION
In-Reply-To: <1601850031.67.0.853880469279.issue41936@roundup.psfhosted.org>
Message-ID: <1601890342.62.0.174035955454.issue41936@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41936>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:47:51 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 05 Oct 2020 09:47:51 +0000
Subject: [issue41921] REDoS in parseentities
In-Reply-To: <1601737969.46.0.495788645161.issue41921@roundup.psfhosted.org>
Message-ID: <1601891271.5.0.0636260130765.issue41921@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Without evaluating the validity of the regex vulnerability, is important to note that the files in Tools/scripts are not part of the standard library and therefore they aren't a valid stack vector.

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41921>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:47:56 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 05 Oct 2020 09:47:56 +0000
Subject: [issue41941] Py_Initialize affects the console
In-Reply-To: <1601887902.24.0.789073375797.issue41941@roundup.psfhosted.org>
Message-ID: <1601891276.99.0.544135252286.issue41941@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

Python supports Unicode in a Windows console session by using the console API's wide-character functions (i.e. ReadConsoleW and WriteConsoleW) with UTF-16 encoded text. This is implemented in the io stack via io._WindowsConsoleIO, and for PyOS_Readline (e.g. builtin `input`) via _PyOS_WindowsConsoleReadline. The UTF-16 aspect is an internal detail that's presented externally as UTF-8 by automatically converting between the two.

Notwithstanding the behavior of third-party packages, CPython intentionally makes no changes to a console session's global settings, including:

    * input & output codepages
    * input & output modes (except for msvcrt.getwch, etc)
    * cursor size and visibility
    * screen-buffer size, font, colors, & attributes
    * window size
    * window title

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41941>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:48:41 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 05 Oct 2020 09:48:41 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601891321.08.0.562027833019.issue41490@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Yeah, there is some code in PR 21748 that should be merged (the new test).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Mon Oct  5 05:50:04 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 05 Oct 2020 09:50:04 +0000
Subject: [issue41941] Py_Initialize affects the console
In-Reply-To: <1601887902.24.0.789073375797.issue41941@roundup.psfhosted.org>
Message-ID: <1601891404.7.0.202782375458.issue41941@roundup.psfhosted.org>


Change by Eryk Sun <eryksun at gmail.com>:


----------
components: +IO, Unicode, Windows
nosy: +ezio.melotti, paul.moore, steve.dower, tim.golden, vstinner, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41941>
_______________________________________

From report at bugs.python.org  Mon Oct  5 06:31:27 2020
From: report at bugs.python.org (twoone3)
Date: Mon, 05 Oct 2020 10:31:27 +0000
Subject: [issue41941] Py_Initialize affects the console
In-Reply-To: <1601887902.24.0.789073375797.issue41941@roundup.psfhosted.org>
Message-ID: <1601893887.14.5.48107489775e-05.issue41941@roundup.psfhosted.org>


twoone3 <3197653242 at qq.com> added the comment:

So how does this explain

----------
Added file: https://bugs.python.org/file49495/Screenshots.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41941>
_______________________________________

From report at bugs.python.org  Mon Oct  5 06:33:27 2020
From: report at bugs.python.org (chienpingtsung)
Date: Mon, 05 Oct 2020 10:33:27 +0000
Subject: [issue41942] Add if condition for 'for loop'
Message-ID: <1601894007.96.0.390965204143.issue41942@roundup.psfhosted.org>


New submission from chienpingtsung <jianpingzong at outlook.com>:

'for loop' always been used as follow code:

arr = [...]
for e in arr:
    if not condition(e):
        continue
    ...

What if be written just like 'list expression', would it be more explicit?

for e in arr if condition(e):
    pass

----------
components: Interpreter Core
messages: 378015
nosy: chienpingtsung
priority: normal
severity: normal
status: open
title: Add if condition for 'for loop'
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41942>
_______________________________________

From report at bugs.python.org  Mon Oct  5 06:45:00 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 10:45:00 +0000
Subject: [issue41941] Py_Initialize affects the console
In-Reply-To: <1601887902.24.0.789073375797.issue41941@roundup.psfhosted.org>
Message-ID: <1601894700.58.0.105346610418.issue41941@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I suggest you to use https://docs.python.org/dev/c-api/init_config.html#c.PyConfig.PyConfig_InitIsolatedConfig API instead of the legacy Py_Initialize() API.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41941>
_______________________________________

From report at bugs.python.org  Mon Oct  5 06:51:01 2020
From: report at bugs.python.org (Florian Bruhin)
Date: Mon, 05 Oct 2020 10:51:01 +0000
Subject: [issue41940] AMD64 Debian root 3.x: tests fail because downloaded
 files start with: <!DOCTYPE
In-Reply-To: <1601887687.95.0.739602877312.issue41940@roundup.psfhosted.org>
Message-ID: <1601895061.9.0.320270766693.issue41940@roundup.psfhosted.org>


Florian Bruhin <python.org at the-compiler.org> added the comment:

> It is also not safe to pass data downloaded from untrusted source to eval().

To make matters worse, it's downloaded via HTTP (rather than HTTPS) - so anyone who can mess with the network of a machine running the Python testsuite can run arbitrary code on that machine.

(I contacted security at python.org about this a couple of hours ago, but I guess this is effectively public now anyways :D)

----------
nosy: +The Compiler

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41940>
_______________________________________

From report at bugs.python.org  Mon Oct  5 06:56:39 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 10:56:39 +0000
Subject: [issue41940] AMD64 Debian root 3.x: tests fail because downloaded
 files start with: <!DOCTYPE
In-Reply-To: <1601887687.95.0.739602877312.issue41940@roundup.psfhosted.org>
Message-ID: <1601895399.0.0.74156078352.issue41940@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> It is also not safe to pass data downloaded from untrusted source to eval().

Would you mind to open a separated issue for that?

Does someone want to propose a change to avoid eval() in the tests?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41940>
_______________________________________

From report at bugs.python.org  Mon Oct  5 07:31:14 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 05 Oct 2020 11:31:14 +0000
Subject: [issue28343] Bad encoding alias cp936 -> gbk: euro sign
In-Reply-To: <1475464291.36.0.0934021228231.issue28343@psf.upfronthosting.co.za>
Message-ID: <1601897474.35.0.612874947163.issue28343@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28343>
_______________________________________

From report at bugs.python.org  Mon Oct  5 08:22:52 2020
From: report at bugs.python.org (Ethan Furman)
Date: Mon, 05 Oct 2020 12:22:52 +0000
Subject: [issue40066] Enum._convert should change __repr__ and/or __str__ to
 use module name instead of class name
In-Reply-To: <1585165738.23.0.618463548627.issue40066@roundup.psfhosted.org>
Message-ID: <1601900572.11.0.551033207382.issue40066@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:

Python-Dev thread [0], summary below:

> As you may have noticed, Enums are starting to pop up all
> over the stdlib [1].
>
> To facilitate transforming existing module constants to
> IntEnums there is `IntEnum._convert_`.  In Issue36548 [2]
> Serhiy modified the __repr__ of RegexFlag:
>
>   >>> import re
>   >>> re.I
>   re.IGNORECASE
>
> I think for converted constants that that looks nice.
>  For anyone that wants the actual value, it is of course
> available as the `.value` attribute:
>
>   >>> re.I.value
>   2
>
> I'm looking for arguments relating to:
>
> - should _convert_ make the default __repr__ be
>   module_name.member_name?
>
> - should _convert_ make the default __str__ be the same,
>   or be the numeric value?

After discussions with Guido I made a (largely done) PR [3] which:

for stdlib global constants (such as RE)
   - repr() -> uses `module.member_name`
   - str() -> uses `member_name`

for stdlib non-global constants, and enums in general
   - repr() -> uses `class.member_name`
   - str() -> uses `member_name`

The questions I would most appreciate an answer to at this point:

- do you think the change has merit?
- why /shouldn't/ we make the change?

As a reminder, the underlying issue is trying to keep at least the stdlib Enum representations the same for those that are replacing preexisting constants.


[0] https://mail.python.org/archives/list/python-dev at python.org/message/CHQW6THTDYNPPFWQ2KDDTUYSAJDCZFNP/

[1] I'm working on making their creation faster.  If anyone wanted to convert EnumMeta to C I would be grateful.

[2] https://bugs.python.org/issue36548

[3] https://github.com/python/cpython/pull/22392

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40066>
_______________________________________

From report at bugs.python.org  Mon Oct  5 08:28:12 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 05 Oct 2020 12:28:12 +0000
Subject: [issue41942] Add if condition for 'for loop'
In-Reply-To: <1601894007.96.0.390965204143.issue41942@roundup.psfhosted.org>
Message-ID: <1601900892.45.0.368563346492.issue41942@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

This is a language change that has been discussed on the python-ideas list a number of times.

In my opinion adding this would not necessarily be an improvement, especially when names and expressions get longer. You'd also not win a lot compared to your initial pattern, especially because the "continue" statement can be placed on the same line as the if statement itself (for short enough conditions).

This is something that should be discussed on python-ideas, but please investigate what's been discussed before before you do so.

----------
nosy: +ronaldoussoren

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41942>
_______________________________________

From report at bugs.python.org  Mon Oct  5 08:31:22 2020
From: report at bugs.python.org (twoone3)
Date: Mon, 05 Oct 2020 12:31:22 +0000
Subject: [issue41941] Py_Initialize affects the console
In-Reply-To: <1601887902.24.0.789073375797.issue41941@roundup.psfhosted.org>
Message-ID: <1601901082.3.0.580515874818.issue41941@roundup.psfhosted.org>


twoone3 <3197653242 at qq.com> added the comment:

This problem has bothered me for a month, thank you for helping me solve this problem, you can close it

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41941>
_______________________________________

From report at bugs.python.org  Mon Oct  5 09:00:04 2020
From: report at bugs.python.org (chienpingtsung)
Date: Mon, 05 Oct 2020 13:00:04 +0000
Subject: [issue41942] Add if condition for 'for loop'
In-Reply-To: <1601894007.96.0.390965204143.issue41942@roundup.psfhosted.org>
Message-ID: <1601902804.51.0.558326350746.issue41942@roundup.psfhosted.org>


chienpingtsung <jianpingzong at outlook.com> added the comment:

Got it, thanks for your reply~

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41942>
_______________________________________

From report at bugs.python.org  Mon Oct  5 09:03:41 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 13:03:41 +0000
Subject: [issue41941] Py_Initialize affects the console
In-Reply-To: <1601887902.24.0.789073375797.issue41941@roundup.psfhosted.org>
Message-ID: <1601903021.07.0.464440613652.issue41941@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> This problem has bothered me for a month, thank you for helping me solve this problem, you can close it

I close the issue, but I'm not sure how you fixed it. Don't hesitate commenting to explain how you solved it ;-)

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41941>
_______________________________________

From report at bugs.python.org  Mon Oct  5 09:07:39 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 05 Oct 2020 13:07:39 +0000
Subject: [issue41941] Py_Initialize affects the console
In-Reply-To: <1601887902.24.0.789073375797.issue41941@roundup.psfhosted.org>
Message-ID: <1601903259.79.0.0547233069653.issue41941@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

Having looked at the screenshots, it seems that your issue is in part due to non-legacy mode not setting the standard I/O files to binary mode (_O_BINARY) from their default ANSI text mode (_O_TEXT). This is not a problem on its own. 

The real issue is that you're not using an isolated configuration, as Victor suggested, so the LC_CTYPE locale gets set to the default user locale instead of "C". When writing to the console in ANSI text mode with a configured locale other than the default "C" locale, the C runtime _write() function does a double translation from the locale encoding to the console codepage encoding via the internal function write_double_translated_ansi_nolock().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41941>
_______________________________________

From report at bugs.python.org  Mon Oct  5 09:10:49 2020
From: report at bugs.python.org (Hugo van Kemenade)
Date: Mon, 05 Oct 2020 13:10:49 +0000
Subject: [issue41917] Python 3.9rc2 fails to install matplotlib
In-Reply-To: <1601711365.63.0.761607861812.issue41917@roundup.psfhosted.org>
Message-ID: <1601903449.99.0.66274451327.issue41917@roundup.psfhosted.org>


Hugo van Kemenade <hugovk+python at gmail.com> added the comment:

This probably isn't an issue with CPython 3.9.0 itself, but rather third-party libraries needing to add 3.9 support and provide wheels, and they may be waiting for 3.9.0 to be officially released (due out today!).

Here's a PR to add Python 3.9 support to Kiwi (aka kiwisolver):

https://github.com/nucleic/kiwi/pull/88

----------
nosy: +hugovk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41917>
_______________________________________

From report at bugs.python.org  Mon Oct  5 09:11:50 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 13:11:50 +0000
Subject: [issue28343] Bad encoding alias cp936 -> gbk: euro sign
In-Reply-To: <1475464291.36.0.0934021228231.issue28343@psf.upfronthosting.co.za>
Message-ID: <1601903510.46.0.0574885666755.issue28343@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28343>
_______________________________________

From report at bugs.python.org  Mon Oct  5 09:12:34 2020
From: report at bugs.python.org (twoone3)
Date: Mon, 05 Oct 2020 13:12:34 +0000
Subject: [issue41941] Py_Initialize affects the console
In-Reply-To: <1601887902.24.0.789073375797.issue41941@roundup.psfhosted.org>
Message-ID: <1601903554.03.0.600996987027.issue41941@roundup.psfhosted.org>


twoone3 <3197653242 at qq.com> added the comment:

I used the link you gave me https://docs.python.org/dev/c-api/init_config.html#c.PyConfig.PyConfig_InitIsolatedConfig Click to open and turn up to see the box, I follow that box  The example inside is done, and the coding problem of the console is solved, but I hope that cpython can provide a more concise API, remove useless functions or variables, so that it is convenient for you to maintain and easy for users to read.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41941>
_______________________________________

From report at bugs.python.org  Mon Oct  5 09:14:44 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 05 Oct 2020 13:14:44 +0000
Subject: [issue41941] Py_Initialize affects the console
In-Reply-To: <1601887902.24.0.789073375797.issue41941@roundup.psfhosted.org>
Message-ID: <1601903684.94.0.443009445625.issue41941@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

PyConfig_InitIsolatedConfig() reduces side effects on the process. For example, it doesn't set the LC_CTYPE locale and it doesn't change the standard streams (stdio).

config_init_stdio() is not called in an isolated configuration:

https://github.com/python/cpython/blob/dcc54215ac1eb4b6fab2a9ffe1abcdf3ac4bb77e/Python/initconfig.c#L1855

https://github.com/python/cpython/blob/dcc54215ac1eb4b6fab2a9ffe1abcdf3ac4bb77e/Python/initconfig.c#L1809-L1817

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41941>
_______________________________________

From report at bugs.python.org  Mon Oct  5 09:14:35 2020
From: report at bugs.python.org (twoone3)
Date: Mon, 05 Oct 2020 13:14:35 +0000
Subject: [issue41941] Py_Initialize affects the console
In-Reply-To: <1601887902.24.0.789073375797.issue41941@roundup.psfhosted.org>
Message-ID: <1601903675.45.0.756903346807.issue41941@roundup.psfhosted.org>


twoone3 <3197653242 at qq.com> added the comment:

That's it

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41941>
_______________________________________

From report at bugs.python.org  Mon Oct  5 09:26:54 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 05 Oct 2020 13:26:54 +0000
Subject: [issue41941] Py_Initialize affects the console
In-Reply-To: <1601887902.24.0.789073375797.issue41941@roundup.psfhosted.org>
Message-ID: <1601904414.0.0.233035440835.issue41941@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> config_init_stdio() is not called in an isolated configuration:

config_init_stdio wasn't being called anyway since Py_Initialize uses _PyConfig_InitCompatConfig. The issue was primarily due to the LC_CTYPE locale being set to the default user locale, as I discussed in msg378024.

Note that for legacy mode, i.e. Py_LegacyWindowsStdioFlag = 1, there's no simple way to not modify the standard I/O files. The io stack needs binary mode. You'd have to use and modify duped file descriptors.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41941>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:11:20 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 05 Oct 2020 14:11:20 +0000
Subject: [issue41774] While removing element from list using for and remove(), 
 which has same items output is not right
In-Reply-To: <1599927635.78.0.618314187509.issue41774@roundup.psfhosted.org>
Message-ID: <1601907080.56.0.162101645733.issue41774@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
pull_requests: +21557
pull_request: https://github.com/python/cpython/pull/22562

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41774>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:15:36 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 05 Oct 2020 14:15:36 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601907336.61.0.190074032623.issue41898@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Please reopen this issue. I understand after a discussion on stackoverflow what the problem is, and there is indeed a bug. I will create a PR with a unit test for it an a fix.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:28:37 2020
From: report at bugs.python.org (Enrico Scholz)
Date: Mon, 05 Oct 2020 14:28:37 +0000
Subject: [issue38893] broken container/selinux integration
In-Reply-To: <1574408245.03.0.269959513005.issue38893@roundup.psfhosted.org>
Message-ID: <1601908117.07.0.758872035031.issue38893@roundup.psfhosted.org>


Enrico Scholz <github at ensc.de> added the comment:

IMO the SELinux security attributes must not be copied (except when requested explicitly).  Doing so will create badly labeled systems else.  It would be better to use default transition rules and call optionally selinux_restorecon() then.

E.g. when copying selinux.* attributes, after "cp /tmp/foo /bin/" the resulting "/bin/foo" would have a "tmp_t" label (which is wrong).

Without copying attributes, it would be labeled as "bin_t" (which is more realistic).

When there are SELinux rules for "/bin/foo", it might be relabeled e.g. to "bin_foo_t" by the manual selinux_restorecon().


Ignoring errors silently will make operations very unpredictable.

----------
nosy: +ensc2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38893>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:29:42 2020
From: report at bugs.python.org (Chris Angelico)
Date: Mon, 05 Oct 2020 14:29:42 +0000
Subject: [issue41940] AMD64 Debian root 3.x: tests fail because downloaded
 files start with: <!DOCTYPE
In-Reply-To: <1601887687.95.0.739602877312.issue41940@roundup.psfhosted.org>
Message-ID: <1601908182.78.0.682397645156.issue41940@roundup.psfhosted.org>


Chris Angelico <rosuav at gmail.com> added the comment:

Has this been ongoing, or is it something that started in the past day and a half? I've had intermittent internet issues (and expect them to continue for another half day or thereabouts), so it's possible that this is actually a symptom of that.

If that's the case, then the issue would be that my gateway returned a failure page of some sort, which?would be another good reason to download the content via HTTPS (since that response happens only on non-encrypted downloads).

----------
nosy: +Rosuav

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41940>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:30:27 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 05 Oct 2020 14:30:27 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1601908227.53.0.894991336992.issue41894@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I succeeded to reproduce it on Ubuntu 20.04.

    $ sudo vi /var/lib/locales/supported.d/ja # add "ja_JP.EUC-JP EUC-JP"
    $ sudo locale-gen ja_JP.EUC-JP
    Generating locales (this might take a while)...
    ja_JP.EUC-JP... done
    Generation complete.
    $ chmod -r./build/lib.linux-x86_64-3.10/_sha3.cpython-310-x86_64-linux-gnu.so
    $ LC_ALL=ja_JP.eucjp ./python
    Python 3.10.0a0 (heads/master:fbf43f051e, Aug 17 2020, 15:13:52)
    [GCC 9.3.0] on linux
    Type "help", "copyright", "credits" or "license" for more information.
    >>> import locale
    >>> locale.setlocale(locale.LC_ALL, "")
    'ja_JP.eucjp'
    >>> import _sha3
    Traceback (most recent call last):
    File "<stdin>", line 1, in <module>
    UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb6 in position 101: invalid start byte

Error message contains file path (byte string, probably encoded with fs encoding) and translated error message (encoded with locale encoding).

I want to use "backslashescape" error handler, but both of PyUnicode_DecodeLocale() and PyUnicode_DecodeFSDefault() don't support it.

After thinking about this several minutes, now I prefer PyUnicode_DecodeUTF8(msg, strlen(msg), "backslashreplace").
It fixes the issue with minimum behavior change, although error message is still backslashescaped.
It might be the best practice for creating Unicode object from C error message like strerror(3).

----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:31:53 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 05 Oct 2020 14:31:53 +0000
Subject: [issue41774] While removing element from list using for and remove(), 
 which has same items output is not right
In-Reply-To: <1599927635.78.0.618314187509.issue41774@roundup.psfhosted.org>
Message-ID: <1601908313.78.0.422666448904.issue41774@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 060937da988347a887a5f165b023d972fcb97802 by Terry Jan Reedy in branch 'master':
bpo-41774: Tweak new programming FAQ entry (GH-22562)
https://github.com/python/cpython/commit/060937da988347a887a5f165b023d972fcb97802


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41774>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:32:00 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 14:32:00 +0000
Subject: [issue41774] While removing element from list using for and remove(), 
 which has same items output is not right
In-Reply-To: <1599927635.78.0.618314187509.issue41774@roundup.psfhosted.org>
Message-ID: <1601908320.75.0.722451651701.issue41774@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21558
pull_request: https://github.com/python/cpython/pull/22563

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41774>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:32:09 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 14:32:09 +0000
Subject: [issue41774] While removing element from list using for and remove(), 
 which has same items output is not right
In-Reply-To: <1599927635.78.0.618314187509.issue41774@roundup.psfhosted.org>
Message-ID: <1601908329.45.0.931929948166.issue41774@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21559
pull_request: https://github.com/python/cpython/pull/22564

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41774>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:38:07 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 05 Oct 2020 14:38:07 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601908687.8.0.557080260399.issue41898@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
pull_requests: +21560
pull_request: https://github.com/python/cpython/pull/22565

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:40:00 2020
From: report at bugs.python.org (mrbean-bremen)
Date: Mon, 05 Oct 2020 14:40:00 +0000
Subject: [issue41943] unittest.assertLogs passes unexpectedly
Message-ID: <1601908800.0.0.297130696317.issue41943@roundup.psfhosted.org>


New submission from mrbean-bremen <hansemrbean at googlemail.com>:

Related to https://bugs.python.org/issue41898, creating a new issue after the discussion with Irit Katriel on StackOverflow (https://stackoverflow.com/a/64142338/12480730).

Consider the following:

import logging
import unittest

logger = logging.getLogger(__name__)
logger.setLevel(logging.INFO)


class TestLogging(unittest.TestCase):
    def test_logging(self):
        with self.assertLogs(level=logging.WARNING):
            logger.info('foo')

>From the docs:
The test passes if at least one message emitted inside the with block matches the logger and level conditions, otherwise it fails.

This means that this test should fail (nothing has been logged at warning level or above), but it passes. 

The reason is that in the assertLogs context manager, the log level of the passed logger is temporarily set to the passed level, and if no logging has happened on exit, the test will fail. 
If no logger is passed into the call, the temporary log level is set in the root level. If any descendant logger has it's own log level set (as in this example to INFO), this logger will still log at it's own level, and the test will pass. 

This will always happen on the condition that a descendent of the passed logger has it's own log level set that is smaller than the asserted level, and it does some logging at this level inside the assertLog context manager.

----------
components: Library (Lib)
messages: 378035
nosy: mrbean-bremen
priority: normal
severity: normal
status: open
title: unittest.assertLogs passes unexpectedly
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41943>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:40:52 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 05 Oct 2020 14:40:52 +0000
Subject: [issue41944] Python testsuite calls eval() on content received via
 HTTP
Message-ID: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

As was reported by Florian Bruhin, Python testsuite calls eval() on content received via HTTP (in Lib/test/multibytecodec_support.py).

----------
components: Tests
messages: 378036
nosy: The Compiler, serhiy.storchaka, vstinner
priority: normal
severity: normal
status: open
title: Python testsuite calls eval() on content received via HTTP
type: security
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:42:17 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 14:42:17 +0000
Subject: [issue41774] While removing element from list using for and remove(), 
 which has same items output is not right
In-Reply-To: <1599927635.78.0.618314187509.issue41774@roundup.psfhosted.org>
Message-ID: <1601908937.92.0.467288625154.issue41774@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 7e941fa8e0454c7814ce3ec646136758c0db5a25 by Miss Skeleton (bot) in branch '3.8':
bpo-41774: Tweak new programming FAQ entry (GH-22562)
https://github.com/python/cpython/commit/7e941fa8e0454c7814ce3ec646136758c0db5a25


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41774>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:49:59 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 05 Oct 2020 14:49:59 +0000
Subject: [issue41944] Python testsuite calls eval() on content received via
 HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601909399.89.0.0787793472185.issue41944@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21561
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22566

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:53:34 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 14:53:34 +0000
Subject: [issue41774] While removing element from list using for and remove(), 
 which has same items output is not right
In-Reply-To: <1599927635.78.0.618314187509.issue41774@roundup.psfhosted.org>
Message-ID: <1601909614.19.0.39432007196.issue41774@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 75dd70e1ce0b5ce50c572802c17b7fa427d9ce23 by Miss Skeleton (bot) in branch '3.9':
bpo-41774: Tweak new programming FAQ entry (GH-22562)
https://github.com/python/cpython/commit/75dd70e1ce0b5ce50c572802c17b7fa427d9ce23


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41774>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:53:41 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 05 Oct 2020 14:53:41 +0000
Subject: [issue41943] unittest.assertLogs passes unexpectedly
In-Reply-To: <1601908800.0.0.297130696317.issue41943@roundup.psfhosted.org>
Message-ID: <1601909621.23.0.531316123348.issue41943@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +patch
nosy: +iritkatriel
nosy_count: 1.0 -> 2.0
pull_requests: +21562
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22565

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41943>
_______________________________________

From report at bugs.python.org  Mon Oct  5 10:54:57 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 05 Oct 2020 14:54:57 +0000
Subject: [issue41898] Any logging causes assertLogs to pass
In-Reply-To: <1601493217.83.0.77998878518.issue41898@roundup.psfhosted.org>
Message-ID: <1601909697.81.0.0374815751104.issue41898@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Strike that - Troy has created the new issue 41943 so this one can remain closed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41898>
_______________________________________

From report at bugs.python.org  Mon Oct  5 11:07:29 2020
From: report at bugs.python.org (Ken Jin)
Date: Mon, 05 Oct 2020 15:07:29 +0000
Subject: [issue41805] types.GenericAlias and types.Union have no documentation
In-Reply-To: <1600370908.0.0.224627521485.issue41805@roundup.psfhosted.org>
Message-ID: <1601910449.5.0.430394792965.issue41805@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

Hi Patrick, I've completed the docs for PEP 604, and would like to work on the docs for PEP 585. May I know if you're still working on this?

----------
nosy: +kj

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41805>
_______________________________________

From report at bugs.python.org  Mon Oct  5 11:16:04 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 05 Oct 2020 15:16:04 +0000
Subject: [issue41774] Add programming FAQ entry: remove multiple entries from
 list
In-Reply-To: <1599927635.78.0.618314187509.issue41774@roundup.psfhosted.org>
Message-ID: <1601910964.92.0.57769906652.issue41774@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
title: While removing element from list using for and remove(), which has same items output is not right -> Add programming FAQ entry: remove multiple entries from list
type: behavior -> enhancement
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41774>
_______________________________________

From report at bugs.python.org  Mon Oct  5 11:19:46 2020
From: report at bugs.python.org (Jan Novak)
Date: Mon, 05 Oct 2020 15:19:46 +0000
Subject: [issue41945] http.cookies.SimpleCookie.parse error after [keys]
Message-ID: <1601911186.95.0.178044136501.issue41945@roundup.psfhosted.org>


New submission from Jan Novak <xnovakj at seznam.cz>:

If brackets [] are around cookie name,
next cookie names are not loaded.

try:
  import http.cookies as Cookie
except ImportError:
  import Cookie
c = Cookie.SimpleCookie()
c.load('id=12345; [object Object]=data; something=not loaded')
print(c)

Note:
It could cause big problems with session etc.
We found that Chrome/Edge starts to save and send this type of cookies for some (couple) users. The origin of that [object Object]=... cookies are probably some implementation of
https://cookiepedia.co.uk/cookies/euconsent
and errors somewhere in external javascripts or browsers?

Related issues:
https://bugs.python.org/issue41695
https://bugs.python.org/issue27674

The same problem occures in P3.7, P2.7, six.moves.http_cookies etc.

I know RFT says that cookie-name can't use brackets.
But you can set them to browser cookies.

RFC 6265:
set-cookie-header = "Set-Cookie:" SP set-cookie-string
 set-cookie-string = cookie-pair *( ";" SP cookie-av )
 cookie-pair       = cookie-name "=" cookie-value
 cookie-name       = token
 token             = <token, defined in [RFC2616], Section 2.2>

RFC 2616:
token          = 1*<any CHAR except CTLs or separators>
       separators     = "(" | ")" | "<" | ">" | "@"
                      | "," | ";" | ":" | "\" | <">
                      | "/" | "[" | "]" | "?" | "="
                      | "{" | "}" | SP | HT

----------
components: Library (Lib)
messages: 378041
nosy: xnovakj
priority: normal
severity: normal
status: open
title: http.cookies.SimpleCookie.parse error after [keys]
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41945>
_______________________________________

From report at bugs.python.org  Mon Oct  5 11:49:17 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Mon, 05 Oct 2020 15:49:17 +0000
Subject: [issue41943] unittest.assertLogs passes unexpectedly
In-Reply-To: <1601908800.0.0.297130696317.issue41943@roundup.psfhosted.org>
Message-ID: <1601912957.58.0.2081025882.issue41943@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
nosy: +vinay.sajip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41943>
_______________________________________

From report at bugs.python.org  Mon Oct  5 11:51:36 2020
From: report at bugs.python.org (ullix)
Date: Mon, 05 Oct 2020 15:51:36 +0000
Subject: [issue41917] Python 3.9rc2 fails to install matplotlib
In-Reply-To: <1601711365.63.0.761607861812.issue41917@roundup.psfhosted.org>
Message-ID: <1601913096.27.0.764288103967.issue41917@roundup.psfhosted.org>


ullix <ullix at urkam.de> added the comment:

I guess so. Just didn't know how else to bring this to someone's attention, thanks.

But not having matplotlib? Ohmygod!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41917>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:06:07 2020
From: report at bugs.python.org (Stargirl Flowers)
Date: Mon, 05 Oct 2020 16:06:07 +0000
Subject: [issue41946] Add concrete examples to os.path documentation
Message-ID: <1601913967.48.0.506783023492.issue41946@roundup.psfhosted.org>


New submission from Stargirl Flowers <me at thea.codes>:

Presently the documentation for os.path (https://docs.python.org/3.8/library/os.path.html) doesn't contain any concrete examples of the input and outputs of the various path manipulation functions.

Contrast this to the Node.js documentation for similar functionality (https://nodejs.org/api/path.html)

We could add replesque examples such as:

>> os.path.abspath("example.py")
"/full/path/to/example.py"

...

>> os.path.basename("example.py")
"example"

& so on.

I believe it would be useful for us to have concrete examples here and I'm happy to contribute this. If anyone feels differently, let me know.

----------
assignee: docs at python
components: Documentation
messages: 378043
nosy: docs at python, theacodes
priority: normal
severity: normal
status: open
title: Add concrete examples to os.path documentation
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41946>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:19 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:19 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601914219.95.0.00613853942087.issue41490@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 168a8383c8358eea1b34df0e832f5d652faa6444 by ?ukasz Langa (Pablo Galindo) in branch '3.9':
[3.9] bpo-41490: Bump vendored pip to version 20.2.3 (GH-22527). (GH-22544)
https://github.com/python/cpython/commit/168a8383c8358eea1b34df0e832f5d652faa6444


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:20 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:20 +0000
Subject: [issue41819] Fix some compiler warnings
In-Reply-To: <1600582202.7.0.502087072911.issue41819@roundup.psfhosted.org>
Message-ID: <1601914220.12.0.576017932431.issue41819@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset c549527ae2cc4b5934dbe80fea127fb04ff65af5 by ?ukasz Langa (Miss Islington (bot)) in branch '3.9':
bpo-41819: Fix compiler warning in init_dump_ascii_wstr() (GH-22332)
https://github.com/python/cpython/commit/c549527ae2cc4b5934dbe80fea127fb04ff65af5


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41819>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:19 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:19 +0000
Subject: [issue40833] Clarify docstring of Path.rename
In-Reply-To: <1590933048.45.0.441602956173.issue40833@roundup.psfhosted.org>
Message-ID: <1601914219.13.0.46688916936.issue40833@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 5533c4952cd6c44c63274874be7de06495b914ea by ?ukasz Langa (Miss Skeleton (bot)) in branch '3.9':
[3.9] bpo-40833: Clarify Path.rename doc-string regarding relative paths (GH-20554)
https://github.com/python/cpython/commit/5533c4952cd6c44c63274874be7de06495b914ea


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40833>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:19 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:19 +0000
Subject: [issue35293] make doctest (Sphinx) emits a lot of warnings
In-Reply-To: <1542835631.23.0.788709270274.issue35293@psf.upfronthosting.co.za>
Message-ID: <1601914219.41.0.680989904499.issue35293@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset f8b3c64958753abce7badbff3525863577fe2e04 by ?ukasz Langa (Victor Stinner) in branch '3.9':
bpo-35293: Travis CI uses "make venv" for the doc (GH-22307) (GH-22309)
https://github.com/python/cpython/commit/f8b3c64958753abce7badbff3525863577fe2e04


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35293>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:19 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:19 +0000
Subject: [issue41802] Missing documentation for 'PyDict_DelItem' behavior
In-Reply-To: <1600340753.64.0.782309837767.issue41802@roundup.psfhosted.org>
Message-ID: <1601914219.73.0.00722106422202.issue41802@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 95de3627f1527cbb1e98d64dd7cc6463c297b616 by ?ukasz Langa (Miss Islington (bot)) in branch '3.9':
bpo-41802: Document 'PyDict_DelItem' can raise a 'KeyError' (GH-22291)
https://github.com/python/cpython/commit/95de3627f1527cbb1e98d64dd7cc6463c297b616


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41802>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:20 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:20 +0000
Subject: [issue41602] Python doesn't exit with proper resultcode on SIGINT in
 runpy (pymain_run_module)
In-Reply-To: <1597953517.67.0.398105173164.issue41602@roundup.psfhosted.org>
Message-ID: <1601914220.27.0.618027908205.issue41602@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset c26a666e6751a9fad766ef83432b893f9b15ecaf by ?ukasz Langa in branch '3.9':
[3.9] bpo-41602: raise SIGINT exit code on KeyboardInterrupt from pymain_run_module (GH-21956) (#22397)
https://github.com/python/cpython/commit/c26a666e6751a9fad766ef83432b893f9b15ecaf


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41602>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:19 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:19 +0000
Subject: [issue41858] Fix incomplete line on optparse documentation
In-Reply-To: <1601000208.27.0.918892305857.issue41858@roundup.psfhosted.org>
Message-ID: <1601914219.23.0.787850385283.issue41858@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset a5750cf43466f5913cdeef774f7c2dcb5943d408 by ?ukasz Langa (Miss Islington (bot)) in branch '3.9':
bpo-41858: Clarify line in optparse doc (GH-22407)
https://github.com/python/cpython/commit/a5750cf43466f5913cdeef774f7c2dcb5943d408


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41858>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:19 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:19 +0000
Subject: [issue41875] __builtin_unreachable error in gcc 4.4.5
In-Reply-To: <1601291751.72.0.463788017117.issue41875@roundup.psfhosted.org>
Message-ID: <1601914219.67.0.0701507576477.issue41875@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset df71b65a882cc9ddf9cd45ae9f83a04ec441af1e by ?ukasz Langa (Miss Islington (bot)) in branch '3.9':
bpo-41875: Use __builtin_unreachable when possible (GH-22433)
https://github.com/python/cpython/commit/df71b65a882cc9ddf9cd45ae9f83a04ec441af1e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41875>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:20 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:20 +0000
Subject: [issue37328] remove deprecated HTMLParser.unescape
In-Reply-To: <1560839410.8.0.633433607628.issue37328@roundup.psfhosted.org>
Message-ID: <1601914220.07.0.542765577573.issue37328@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 8dd430265ccd4d34b74c841d6bcc8f58aa93ad94 by ?ukasz Langa (Terry Jan Reedy) in branch '3.9':
[3.9] bpo-27032, bpo-37328: Document removing HTMLParser.unescape() (GH-22288)
https://github.com/python/cpython/commit/8dd430265ccd4d34b74c841d6bcc8f58aa93ad94


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37328>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:19 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:19 +0000
Subject: [issue41815] SQLite: segfault if backup called on closed database
In-Reply-To: <1600531699.45.0.309106066833.issue41815@roundup.psfhosted.org>
Message-ID: <1601914219.86.0.0599868739084.issue41815@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset bd55c46895d2fcfadda46701d3c34d78441a7806 by ?ukasz Langa (Miss Islington (bot)) in branch '3.9':
bpo-41815: SQLite: segfault if backup called on closed database (GH-22322)
https://github.com/python/cpython/commit/bd55c46895d2fcfadda46701d3c34d78441a7806


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41815>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:19 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:19 +0000
Subject: [issue41844] IDLE subsection of What's New 3.9
In-Reply-To: <1600871517.81.0.0817092566943.issue41844@roundup.psfhosted.org>
Message-ID: <1601914219.63.0.57867680059.issue41844@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 7e21aab45d78e2593f231a1290fa6e629e50d90c by ?ukasz Langa (Miss Islington (bot)) in branch '3.9':
bpo-41844: Add IDLE section to What's New 3.9 (GN-22382)
https://github.com/python/cpython/commit/7e21aab45d78e2593f231a1290fa6e629e50d90c


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41844>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:19 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:19 +0000
Subject: [issue41867] Include options for timespec in docstrings of isoformat
In-Reply-To: <1601138683.03.0.777121692912.issue41867@roundup.psfhosted.org>
Message-ID: <1601914219.8.0.433214493486.issue41867@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset faaa30392221c7d53d995f65f59f26e86fb84d76 by ?ukasz Langa (Miss Skeleton (bot)) in branch '3.9':
[3.9] bpo-41867: List options for timespec in docstrings of isoformat methods (GH-22418)
https://github.com/python/cpython/commit/faaa30392221c7d53d995f65f59f26e86fb84d76


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41867>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:20 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:20 +0000
Subject: [issue37062] `AutoNumber` class in enum documentation: support *args
 in constructor
In-Reply-To: <1558936980.63.0.0585299344314.issue37062@roundup.psfhosted.org>
Message-ID: <1601914220.19.0.92302052104.issue37062@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset e8165e79f57cb3ca60bf031c417f8fd20c99eaa2 by ?ukasz Langa (Miss Islington (bot)) in branch '3.9':
bpo-37062: Enum: add extended AutoNumber example (GH-22349) (GH-22370)
https://github.com/python/cpython/commit/e8165e79f57cb3ca60bf031c417f8fd20c99eaa2


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37062>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:19 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:19 +0000
Subject: [issue27032] Remove deprecated html.parser.HTMLParser.unescape()
In-Reply-To: <1463339146.08.0.655083281356.issue27032@psf.upfronthosting.co.za>
Message-ID: <1601914219.5.0.0570741537012.issue27032@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 8dd430265ccd4d34b74c841d6bcc8f58aa93ad94 by ?ukasz Langa (Terry Jan Reedy) in branch '3.9':
[3.9] bpo-27032, bpo-37328: Document removing HTMLParser.unescape() (GH-22288)
https://github.com/python/cpython/commit/8dd430265ccd4d34b74c841d6bcc8f58aa93ad94


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27032>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:10:20 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:10:20 +0000
Subject: [issue41762] Documentation job fails on CIs: duplicate token
 description of format_spec
In-Reply-To: <1599821124.33.0.316149667628.issue41762@roundup.psfhosted.org>
Message-ID: <1601914220.35.0.801149029041.issue41762@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset e5cc5fd89cc8855ad644ce4ba5e7de766313e418 by ?ukasz Langa (Miss Islington (bot)) in branch '3.9':
bpo-41762: Fix usage of productionlist markup in the doc (GH-22281)
https://github.com/python/cpython/commit/e5cc5fd89cc8855ad644ce4ba5e7de766313e418


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41762>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:24:17 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 16:24:17 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1601915057.34.0.539929138296.issue41939@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21563
pull_request: https://github.com/python/cpython/pull/22567

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:24:15 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:24:15 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1601915055.33.0.241720074043.issue41939@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 1fce240d6c4b2b2cc17a86e88c65169e15b9feeb by Victor Stinner in branch 'master':
bpo-41939: Fix test_site.test_license_exists_at_url() (#22559)
https://github.com/python/cpython/commit/1fce240d6c4b2b2cc17a86e88c65169e15b9feeb


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:32:46 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 05 Oct 2020 16:32:46 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601915566.98.0.288386923286.issue26680@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> I would have assumed that it's only making a promise that it 
> registers all the methods and properties marked *abstract* in
> the ABC. Do you have references to back up the stronger statement?

The isn't some weird or incidental promise.  It is the fundamental reason that abstract base classes exist at all (and not just in Python).

>From PEP 3119: "Each test carries with it a set of promises: it contains a promise about the general behavior of the class, and a promise as to what other class methods will be available."

>From PEP 3119: "In addition, the ABCs define a minimal set of methods that establish the characteristic behavior of the type. Code that discriminates objects based on their ABC type can trust that those methods will always be present."

> we need to either (a) revert PR 6121 and then re-do the changes,
> without the changes to numbers.py, or (b) make a second PR to undo
> the numbers.py changes.

Given that (b) can't be done in the short-run, I recommend option (a) so that there is a single clean patch and to make sure this doesn't leak into a release.  The PR changed 19 files, so the longer we wait the harder it will be to revert cleanly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:35:49 2020
From: report at bugs.python.org (Tal Einat)
Date: Mon, 05 Oct 2020 16:35:49 +0000
Subject: [issue38490] statistics: add covariance, Pearson's correlation,
 and simple linear regression
In-Reply-To: <1571175609.51.0.475949905245.issue38490@roundup.psfhosted.org>
Message-ID: <1601915749.76.0.133443958794.issue38490@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

Given the discussion here and the state of the attached PR, I intend to merge the PR in several weeks, unless someone has anything else to say.

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38490>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:39:40 2020
From: report at bugs.python.org (Michael L. Boom)
Date: Mon, 05 Oct 2020 16:39:40 +0000
Subject: [issue41947] Tests When Building Python
Message-ID: <1601915979.99.0.0870574640961.issue41947@roundup.psfhosted.org>


New submission from Michael L. Boom <mikeboom at mikeboom.com>:

When building Python it runs 416 tests in sequence.  It would be a "lot" faster if these were run in parallel.

----------
components: Installation
messages: 378062
nosy: boom0192
priority: normal
severity: normal
status: open
title: Tests When Building Python
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41947>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:42:37 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 16:42:37 +0000
Subject: [issue41584] Clarify documentation for binary arithmetic operation
 subclass __r*__ precedence
In-Reply-To: <1597773394.37.0.055865211998.issue41584@roundup.psfhosted.org>
Message-ID: <1601916157.22.0.0321985165169.issue41584@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21564
stage: commit review -> patch review
pull_request: https://github.com/python/cpython/pull/22568

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41584>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:42:39 2020
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 05 Oct 2020 16:42:39 +0000
Subject: [issue41584] Clarify documentation for binary arithmetic operation
 subclass __r*__ precedence
In-Reply-To: <1597773394.37.0.055865211998.issue41584@roundup.psfhosted.org>
Message-ID: <1601916159.63.0.0159860620998.issue41584@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:


New changeset d02d824e05e2cb86f4df381be18832e76e2c475f by Brett Cannon in branch 'master':
bpo-41584: clarify when the reflected method of a binary arithemtic operator is called (#22505)
https://github.com/python/cpython/commit/d02d824e05e2cb86f4df381be18832e76e2c475f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41584>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:42:48 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 16:42:48 +0000
Subject: [issue41584] Clarify documentation for binary arithmetic operation
 subclass __r*__ precedence
In-Reply-To: <1597773394.37.0.055865211998.issue41584@roundup.psfhosted.org>
Message-ID: <1601916168.16.0.916261698148.issue41584@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21565
pull_request: https://github.com/python/cpython/pull/22569

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41584>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:49:49 2020
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 05 Oct 2020 16:49:49 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1601916589.13.0.176970767748.issue41939@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 10b4136bfa5878c058753e1d1bd091e0f7e1ba40 by Miss Skeleton (bot) in branch '3.9':
bpo-41939: Fix test_site.test_license_exists_at_url() (GH-22559) (#22567)
https://github.com/python/cpython/commit/10b4136bfa5878c058753e1d1bd091e0f7e1ba40


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:52:10 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 16:52:10 +0000
Subject: [issue41584] Clarify documentation for binary arithmetic operation
 subclass __r*__ precedence
In-Reply-To: <1597773394.37.0.055865211998.issue41584@roundup.psfhosted.org>
Message-ID: <1601916730.75.0.46070587971.issue41584@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 31ceccb2c77854893f3a754aca04bedd74bedb10 by Miss Skeleton (bot) in branch '3.8':
bpo-41584: clarify when the reflected method of a binary arithemtic operator is called (GH-22505)
https://github.com/python/cpython/commit/31ceccb2c77854893f3a754aca04bedd74bedb10


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41584>
_______________________________________

From report at bugs.python.org  Mon Oct  5 12:54:12 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 05 Oct 2020 16:54:12 +0000
Subject: [issue40430] ast.Slice is no longer a subclass of ast.slice
In-Reply-To: <1588114083.65.0.758237100014.issue40430@roundup.psfhosted.org>
Message-ID: <1601916852.32.0.959818919704.issue40430@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Even if make ast.Slice a (virtual) subclass of ast.slice it will not help much, because we cannot do it for ast.Index and ast.ExtSlice. ast.ExtSlice is not replaced with ast.Tuple, and any node type can now be used instead of ast.Index. The code that does isinstance() or issublass() check for ast.slice or one of its subcasses is now broken.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40430>
_______________________________________

From report at bugs.python.org  Mon Oct  5 13:05:58 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 05 Oct 2020 17:05:58 +0000
Subject: [issue41584] Clarify documentation for binary arithmetic operation
 subclass __r*__ precedence
In-Reply-To: <1597773394.37.0.055865211998.issue41584@roundup.psfhosted.org>
Message-ID: <1601917558.48.0.0540736993926.issue41584@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 4aad1e5770fab72908f922a7876075d3d5a7c0d0 by Miss Skeleton (bot) in branch '3.9':
bpo-41584: clarify when the reflected method of a binary arithemtic operator is called (GH-22505)
https://github.com/python/cpython/commit/4aad1e5770fab72908f922a7876075d3d5a7c0d0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41584>
_______________________________________

From report at bugs.python.org  Mon Oct  5 13:47:51 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 05 Oct 2020 17:47:51 +0000
Subject: [issue41947] Tests When Building Python
In-Reply-To: <1601915979.99.0.0870574640961.issue41947@roundup.psfhosted.org>
Message-ID: <1601920071.51.0.700185346162.issue41947@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

>From the test.regrtest help:

  -j PROCESSES, --multiprocess PROCESSES
                        run PROCESSES processes at once

So, if you want to run 4 processes in parallel:
./python -m test.regrtest -j4

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41947>
_______________________________________

From report at bugs.python.org  Mon Oct  5 14:01:23 2020
From: report at bugs.python.org (Chavdar Yotov)
Date: Mon, 05 Oct 2020 18:01:23 +0000
Subject: [issue41933] Wording of s * n in Common Sequence Operations is not
 optimal
In-Reply-To: <1601828421.16.0.497838866676.issue41933@roundup.psfhosted.org>
Message-ID: <1601920883.9.0.787586612531.issue41933@roundup.psfhosted.org>


Chavdar Yotov <choko43 at gmail.com> added the comment:

Looks like a fitting first contribution. Working on a PR now :-)

----------
nosy: +chavdar

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41933>
_______________________________________

From report at bugs.python.org  Mon Oct  5 14:11:29 2020
From: report at bugs.python.org (Matthieu hemea)
Date: Mon, 05 Oct 2020 18:11:29 +0000
Subject: [issue36207] robotsparser deny all with some rules
In-Reply-To: <1551865321.24.0.407834320039.issue36207@roundup.psfhosted.org>
Message-ID: <1601921489.97.0.99683372418.issue36207@roundup.psfhosted.org>


Matthieu hemea <mb at hemea.com> added the comment:

Hi, 

Does anyone find the solution ?
It would help me for this one : https://www.hemea.com/fr/devis-travaux

----------
nosy: +matthieuhemea -Jmgray47, Patrick Valibus 410 Gone, amiir.mascud, arnaud, calamina, jeanotlapin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36207>
_______________________________________

From report at bugs.python.org  Mon Oct  5 14:20:12 2020
From: report at bugs.python.org (Michael L. Boom)
Date: Mon, 05 Oct 2020 18:20:12 +0000
Subject: [issue41947] Tests When Building Python
In-Reply-To: <1601920071.51.0.700185346162.issue41947@roundup.psfhosted.org>
Message-ID: <DM6PR10MB3724DD1A243F3409E0961DFFB50C0@DM6PR10MB3724.namprd10.prod.outlook.com>


Michael L. Boom <mikeboom at mikeboom.com> added the comment:

When I do the ./configure, make -j 32, and make install it runs 416 tests in sequence.  Is there a way to make it run 32 unit tests at a time so it is much quicker?  Thanks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41947>
_______________________________________

From report at bugs.python.org  Mon Oct  5 14:24:34 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 05 Oct 2020 18:24:34 +0000
Subject: [issue41947] Tests When Building Python
In-Reply-To: <1601915979.99.0.0870574640961.issue41947@roundup.psfhosted.org>
Message-ID: <1601922274.43.0.210902717319.issue41947@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

You could try setting EXTRATESTOPTS, although I haven't tried it.

This question is probably better asked on python-list or StackOverflow.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41947>
_______________________________________

From report at bugs.python.org  Mon Oct  5 14:34:03 2020
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 05 Oct 2020 18:34:03 +0000
Subject: [issue41584] Clarify documentation for binary arithmetic operation
 subclass __r*__ precedence
In-Reply-To: <1597773394.37.0.055865211998.issue41584@roundup.psfhosted.org>
Message-ID: <1601922843.7.0.928697894899.issue41584@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41584>
_______________________________________

From report at bugs.python.org  Mon Oct  5 14:34:50 2020
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 05 Oct 2020 18:34:50 +0000
Subject: [issue32192] Provide importlib.util.lazy_import helper function
In-Reply-To: <1512118241.83.0.213398074469.issue32192@psf.upfronthosting.co.za>
Message-ID: <1601922890.21.0.304617667297.issue32192@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Yep, I think the example is enough to close this. Thanks!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32192>
_______________________________________

From report at bugs.python.org  Mon Oct  5 15:51:19 2020
From: report at bugs.python.org (Chavdar Yotov)
Date: Mon, 05 Oct 2020 19:51:19 +0000
Subject: [issue41933] Wording of s * n in Common Sequence Operations is not
 optimal
In-Reply-To: <1601828421.16.0.497838866676.issue41933@roundup.psfhosted.org>
Message-ID: <1601927480.0.0.682066165318.issue41933@roundup.psfhosted.org>


Change by Chavdar Yotov <choko43 at gmail.com>:


----------
keywords: +patch
pull_requests: +21566
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22570

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41933>
_______________________________________

From report at bugs.python.org  Mon Oct  5 16:36:17 2020
From: report at bugs.python.org (Abhi R)
Date: Mon, 05 Oct 2020 20:36:17 +0000
Subject: [issue41948] Runtime error while trying to use Python3.9 with
 virtualenv
Message-ID: <1601930177.87.0.41815594823.issue41948@roundup.psfhosted.org>


New submission from Abhi R <abhicantdraw at gmail.com>:

I tried to create a new virtual environment using virtualenv and the newly released Python3.9 version and I got a runtime error saying " failed to find interpreter for Builtin discover of python_spec='python3.9'".

----------
components: Interpreter Core
files: Untitled picture.png
messages: 378074
nosy: abhicantdraw
priority: normal
severity: normal
status: open
title: Runtime error while trying to use Python3.9 with virtualenv
type: behavior
versions: Python 3.9
Added file: https://bugs.python.org/file49496/Untitled picture.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41948>
_______________________________________

From report at bugs.python.org  Mon Oct  5 16:39:11 2020
From: report at bugs.python.org (Orian Zinger)
Date: Mon, 05 Oct 2020 20:39:11 +0000
Subject: [issue18163] Add a 'key' attribute to KeyError
In-Reply-To: <1370638316.1.0.167534610168.issue18163@psf.upfronthosting.co.za>
Message-ID: <1601930351.04.0.137420670105.issue18163@roundup.psfhosted.org>


Orian Zinger <zinger777 at gmail.com> added the comment:

Hi all,

As a Python developer, I encountered lots of blurry exception messages in the product logs such as:
<time and date> <process name> <log severity> Failed to do something. Exception: 'some key'

I believe printing the key name without explaining the exception itself is bad (explicit is better than implicit).

Thus, after forking the repository, I added a short explanation about the Exception.
Now, it looks like:

>>> try:
...     {}['some key']
... except Exception as e:
...     print(e)
... 
Missing key: some key

I'm a newbie in a contribution to CPython, so please let me know if the idea behind my commit is good. If not, please explain how can I improve my commit so it'll be pulled later to the main branch.

https://github.com/zingero/cpython/commit/8c9e5d9e16296cee1f3ec05638dd6989dae8b811

Regards,
Orian.

----------
components: +Library (Lib) -Interpreter Core
nosy: +zingero

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18163>
_______________________________________

From report at bugs.python.org  Mon Oct  5 16:40:25 2020
From: report at bugs.python.org (Orian Zinger)
Date: Mon, 05 Oct 2020 20:40:25 +0000
Subject: [issue18163] Add a 'key' attribute to KeyError
In-Reply-To: <1370638316.1.0.167534610168.issue18163@psf.upfronthosting.co.za>
Message-ID: <1601930425.8.0.0278844371454.issue18163@roundup.psfhosted.org>


Change by Orian Zinger <zinger777 at gmail.com>:


----------
components:  -Library (Lib)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18163>
_______________________________________

From report at bugs.python.org  Mon Oct  5 17:30:32 2020
From: report at bugs.python.org (Evan Fagerberg)
Date: Mon, 05 Oct 2020 21:30:32 +0000
Subject: [issue40864] spec_set/autospec/spec seems to not be reading
 attributes defined in class body
In-Reply-To: <1591280927.55.0.854829069355.issue40864@roundup.psfhosted.org>
Message-ID: <1601933432.13.0.684116318514.issue40864@roundup.psfhosted.org>


Evan Fagerberg <adioevan at gmail.com> added the comment:

Reflecting on it more, there should be a sensible way to retrieve the set attributes of the init method of any class without explicitly instantiating it, via the inspect module.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40864>
_______________________________________

From report at bugs.python.org  Mon Oct  5 18:37:37 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 05 Oct 2020 22:37:37 +0000
Subject: [issue35291] duplicate of memoryview from io.BufferedWriter leaks
In-Reply-To: <1542813152.98.0.788709270274.issue35291@psf.upfronthosting.co.za>
Message-ID: <1601937457.87.0.571982618487.issue35291@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I tried the script on master (windows), and the problem is not reproducible.


The OP also wrote that this is a 2.7-only issue, so it seems to be out of date.

----------
nosy: +iritkatriel, serhiy.storchaka
type:  -> resource usage

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35291>
_______________________________________

From report at bugs.python.org  Mon Oct  5 19:01:11 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 05 Oct 2020 23:01:11 +0000
Subject: [issue32902] FileInput "inplace" redirects output of other threads
In-Reply-To: <1519257688.59.0.467229070634.issue32902@psf.upfronthosting.co.za>
Message-ID: <1601938871.87.0.980458788462.issue32902@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

stdout is indeed shared between all threads, and it is also not guaranteed to be thread safe, so if two threads write to it simultaneously that can cause problems.

It is better to have one thread in you program writing to stdout, with thread-safe communication channels from other threads to this one.

Alternatively, you can create different processes instead of threads, and then each process will have its own stdout and redirecting one will not impact the others.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32902>
_______________________________________

From report at bugs.python.org  Mon Oct  5 19:02:48 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 05 Oct 2020 23:02:48 +0000
Subject: [issue41934] Add `has` method to `pathlib.Path` class.
In-Reply-To: <1601844949.96.0.502154484119.issue41934@roundup.psfhosted.org>
Message-ID: <1601938968.62.0.399025542685.issue41934@roundup.psfhosted.org>


Change by Eric V. Smith <eric at trueblade.com>:


----------
resolution:  -> rejected

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41934>
_______________________________________

From report at bugs.python.org  Mon Oct  5 19:04:17 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 05 Oct 2020 23:04:17 +0000
Subject: [issue32902] FileInput "inplace" redirects output of other threads
In-Reply-To: <1519257688.59.0.467229070634.issue32902@psf.upfronthosting.co.za>
Message-ID: <1601939057.29.0.484373731889.issue32902@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

In general, stackoverflow is a better place for questions like this - you are likely to get a quicker response there.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32902>
_______________________________________

From report at bugs.python.org  Mon Oct  5 19:04:54 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 05 Oct 2020 23:04:54 +0000
Subject: [issue41947] Tests When Building Python
In-Reply-To: <1601915979.99.0.0870574640961.issue41947@roundup.psfhosted.org>
Message-ID: <1601939094.01.0.320996232207.issue41947@roundup.psfhosted.org>


Change by Eric V. Smith <eric at trueblade.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41947>
_______________________________________

From report at bugs.python.org  Mon Oct  5 20:18:13 2020
From: report at bugs.python.org (Evan Fagerberg)
Date: Tue, 06 Oct 2020 00:18:13 +0000
Subject: [issue40864] spec_set/autospec/spec seems to not be reading
 attributes defined in class body
In-Reply-To: <1591280927.55.0.854829069355.issue40864@roundup.psfhosted.org>
Message-ID: <1601943493.66.0.474108103929.issue40864@roundup.psfhosted.org>


Change by Evan Fagerberg <adioevan at gmail.com>:


----------
keywords: +patch
pull_requests: +21567
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22572

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40864>
_______________________________________

From report at bugs.python.org  Mon Oct  5 20:46:50 2020
From: report at bugs.python.org (Gregory Szorc)
Date: Tue, 06 Oct 2020 00:46:50 +0000
Subject: [issue41949] Redefinition of HMAC functions prevents static linking
Message-ID: <1601945210.71.0.233142859875.issue41949@roundup.psfhosted.org>


New submission from Gregory Szorc <gregory.szorc at gmail.com>:

Commit 54f2898fe7e4ca1f239e96284af3cc5b34d2ae02 (bpo-40645) introduced the functions HMAC_CTX_new, HMAC_CTX_free, and HMAC_CTX_get_md.

These functions share the same names as HMAC functions provided by OpenSSL/LibreSSL. If you attempt to statically link the _hashlib extension as a builtin extension module that is also statically linked against a libcrytpo that provides these functions, the linker may complain about duplicate symbols:

cpython-3.9> /tools/host/bin/ld: /tools/deps/lib/libcrypto.a(libcrypto_la-hmac.o): in function `HMAC_CTX_free':
cpython-3.9> hmac.c:(.text+0x7d0): multiple definition of `HMAC_CTX_free';
cpython-3.9> Modules/_hashopenssl.o:/build/Python-3.9.0/./Modules/_hashopenssl.c:54: first defined here
cpython-3.9> /tools/host/bin/ld: /tools/deps/lib/libcrypto.a(libcrypto_la-hmac.o): in function `HMAC_CTX_get_md':
cpython-3.9> hmac.c:(.text+0xa20): multiple definition of `HMAC_CTX_get_md'; Modules/_hashopenssl.o:/build/Python-3.9.0/./Modules/_hashopenssl.c:                 63: first defined here
cpython-3.9> /tools/host/bin/ld: /tools/deps/lib/libcrypto.a(libcrypto_la-hmac.o): in function `HMAC_CTX_new':
cpython-3.9> hmac.c:(.text+0x780): multiple definition of `HMAC_CTX_new'; Modules/_hashopenssl.o:/build/Python-3.9.0/./Modules/_hashopenssl.c:42:                  first defined here
cpython-3.9> clang-10: error: linker command failed with exit code 1 (use -v to see invocation)
cpython-3.9> ln: failed to access 'libpython3.9.so.1.0': No such file or directory
cpython-3.9> make: *** [libpython3.9.so] Error 1
cpython-3.9> Makefile:656: recipe for target 'libpython3.9.so' failed

This log from a build attempting to statically link against LibreSSL 3.1.4. The issue does not reproduce against OpenSSL 1.1.1h for some reason.

While statically linking _hashlib as a built-in extension module and statically linking libcrypto isn't in the default configuration, I believe this use case should be supported.

Perhaps these 3 functions should be renamed to not conflict with symbols provided by libcrypto?

----------
components: Extension Modules
messages: 378080
nosy: indygreg
priority: normal
severity: normal
status: open
title: Redefinition of HMAC functions prevents static linking
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41949>
_______________________________________

From report at bugs.python.org  Mon Oct  5 20:46:58 2020
From: report at bugs.python.org (Gregory Szorc)
Date: Tue, 06 Oct 2020 00:46:58 +0000
Subject: [issue41949] Redefinition of HMAC functions prevents static linking
In-Reply-To: <1601945210.71.0.233142859875.issue41949@roundup.psfhosted.org>
Message-ID: <1601945218.69.0.122645374315.issue41949@roundup.psfhosted.org>


Change by Gregory Szorc <gregory.szorc at gmail.com>:


----------
type:  -> compile error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41949>
_______________________________________

From report at bugs.python.org  Mon Oct  5 20:47:32 2020
From: report at bugs.python.org (Gregory Szorc)
Date: Tue, 06 Oct 2020 00:47:32 +0000
Subject: [issue41949] Redefinition of HMAC functions prevents static linking
In-Reply-To: <1601945210.71.0.233142859875.issue41949@roundup.psfhosted.org>
Message-ID: <1601945252.99.0.633104400585.issue41949@roundup.psfhosted.org>


Change by Gregory Szorc <gregory.szorc at gmail.com>:


----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41949>
_______________________________________

From report at bugs.python.org  Mon Oct  5 21:00:25 2020
From: report at bugs.python.org (Gregory Szorc)
Date: Tue, 06 Oct 2020 01:00:25 +0000
Subject: [issue41949] Redefinition of HMAC functions prevents static linking
In-Reply-To: <1601945210.71.0.233142859875.issue41949@roundup.psfhosted.org>
Message-ID: <1601946025.89.0.806557307969.issue41949@roundup.psfhosted.org>


Gregory Szorc <gregory.szorc at gmail.com> added the comment:

I was going to work around this in python-build-standalone (https://github.com/indygreg/python-build-standalone) by reverting to OpenSSL for builds. But we must use LibreSSL when linking against musl libc due to some random weirdness getting OpenSSL to statically link against musl.

So I'm going to have to work around this via a source patch in python-build-standalone. Not the first time I've had to patch CPython source code to get a working statically linked build working.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41949>
_______________________________________

From report at bugs.python.org  Mon Oct  5 21:03:32 2020
From: report at bugs.python.org (Benjamin Peterson)
Date: Tue, 06 Oct 2020 01:03:32 +0000
Subject: [issue41949] Redefinition of HMAC functions prevents static linking
In-Reply-To: <1601945210.71.0.233142859875.issue41949@roundup.psfhosted.org>
Message-ID: <1601946212.22.0.530724762019.issue41949@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:

Note these are guarded by

#if (OPENSSL_VERSION_NUMBER < 0x10100000L) || defined(LIBRESSL_VERSION_NUMBER)

which suggests that needs to tweaked

----------
nosy: +benjamin.peterson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41949>
_______________________________________

From report at bugs.python.org  Mon Oct  5 21:13:07 2020
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 06 Oct 2020 01:13:07 +0000
Subject: [issue35291] duplicate of memoryview from io.BufferedWriter leaks
In-Reply-To: <1542813152.98.0.788709270274.issue35291@psf.upfronthosting.co.za>
Message-ID: <1601946787.02.0.931886945824.issue35291@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35291>
_______________________________________

From report at bugs.python.org  Mon Oct  5 21:16:00 2020
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 06 Oct 2020 01:16:00 +0000
Subject: [issue32222] pygettext doesn't extract docstrings for functions with
 type annotated params
In-Reply-To: <1512470175.69.0.213398074469.issue32222@psf.upfronthosting.co.za>
Message-ID: <1601946960.23.0.967406586176.issue32222@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32222>
_______________________________________

From report at bugs.python.org  Mon Oct  5 21:32:25 2020
From: report at bugs.python.org (Mark Diekhans)
Date: Tue, 06 Oct 2020 01:32:25 +0000
Subject: [issue27321] Email parser creates a message object that can't be
 flattened
In-Reply-To: <1465930372.53.0.0254623453508.issue27321@psf.upfronthosting.co.za>
Message-ID: <1601947945.56.0.451494095479.issue27321@roundup.psfhosted.org>


Mark Diekhans <markd at kermodei.com> added the comment:

any chance of getting this merged?  A work-around is not obvious

----------
nosy: +diekhans

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27321>
_______________________________________

From report at bugs.python.org  Mon Oct  5 21:38:26 2020
From: report at bugs.python.org (Gregory Szorc)
Date: Tue, 06 Oct 2020 01:38:26 +0000
Subject: [issue41949] Redefinition of HMAC functions prevents static linking
In-Reply-To: <1601945210.71.0.233142859875.issue41949@roundup.psfhosted.org>
Message-ID: <1601948306.6.0.0507816351631.issue41949@roundup.psfhosted.org>


Gregory Szorc <gregory.szorc at gmail.com> added the comment:

My workaround was to remove `|| defined(LIBRESSL_VERSION_NUMBER)`. That works with LibreSSL 3.1.4. I'm unsure if the symbols were introduced in a specific version though. But since python-build-standalone pins all dependencies, this is a safe patch for me.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41949>
_______________________________________

From report at bugs.python.org  Mon Oct  5 22:42:18 2020
From: report at bugs.python.org (Weiliang Li)
Date: Tue, 06 Oct 2020 02:42:18 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
Message-ID: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>


New submission from Weiliang Li <to.be.impressive at gmail.com>:

CONTAINS_OP for ?in? and ?is not? tests

should be 

CONTAINS_OP for ?in? and ?not in? tests

Ref:
https://bugs.python.org/issue39156

----------
assignee: docs at python
components: Documentation
messages: 378085
nosy: docs at python, kigawas
priority: normal
severity: normal
status: open
title: Typo in Python 3.9 what's new page
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Mon Oct  5 22:45:26 2020
From: report at bugs.python.org (Weiliang Li)
Date: Tue, 06 Oct 2020 02:45:26 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1601952326.12.0.0178280669441.issue41950@roundup.psfhosted.org>


Change by Weiliang Li <to.be.impressive at gmail.com>:


----------
keywords: +patch
pull_requests: +21568
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22573

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Mon Oct  5 22:51:39 2020
From: report at bugs.python.org (XIAO AN ZHENG)
Date: Tue, 06 Oct 2020 02:51:39 +0000
Subject: [issue41951] python-3.6.8.exe /uninstall /quiet fails woth Exit code:
 0x643
Message-ID: <1601952699.58.0.0444624447975.issue41951@roundup.psfhosted.org>


New submission from XIAO AN ZHENG <xiaoanzhengca at yahoo.com>:

The issue is caused by uninstalling Python 3.8.2 which wrongly detected?core_JustForMe even API only installed Python for All users :

[1E18:1B64][2020-09-30T11:16:11]i101: Detected package: core_AllUsers, state: Present, cached: Complete
[1E18:1B64][2020-09-30T11:16:11]i101: Detected package: core_AllUsers_pdb, state: Absent, cached: None
[1E18:1B64][2020-09-30T11:16:11]i101: Detected package: core_AllUsers_d, state: Absent, cached: None
[1E18:1B64][2020-09-30T11:16:11]i101: Detected package: core_JustForMe, state: Present, cached: None

Here is the normal log:

[113C:02BC][2020-10-05T12:06:55]i101: Detected package: core_AllUsers, state: Present, cached: Complete
[113C:02BC][2020-10-05T12:06:55]i101: Detected package: core_AllUsers_pdb, state: Absent, cached: None
[113C:02BC][2020-10-05T12:06:55]i101: Detected package: core_AllUsers_d, state: Absent, cached: None
[113C:02BC][2020-10-05T12:06:55]i101: Detected package: core_JustForMe, state: Absent, cached: None

----------
components: Installation
messages: 378086
nosy: szheng
priority: normal
severity: normal
status: open
title: python-3.6.8.exe /uninstall /quiet fails woth Exit code: 0x643
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41951>
_______________________________________

From report at bugs.python.org  Mon Oct  5 22:54:35 2020
From: report at bugs.python.org (XIAO AN ZHENG)
Date: Tue, 06 Oct 2020 02:54:35 +0000
Subject: [issue41951] python-3.6.8.exe /uninstall /quiet fails woth Exit code:
 0x643
In-Reply-To: <1601952699.58.0.0444624447975.issue41951@roundup.psfhosted.org>
Message-ID: <1601952875.99.0.210148666818.issue41951@roundup.psfhosted.org>


XIAO AN ZHENG <xiaoanzhengca at yahoo.com> added the comment:

The issue is happening very randomly, and caused by uninstalling Python 3.8.2 which wrongly detected core_JustForMe even it was only installed Python for All users :

[1E18:1B64][2020-09-30T11:16:11]i101: Detected package: core_AllUsers, state: Present, cached: Complete
[1E18:1B64][2020-09-30T11:16:11]i101: Detected package: core_AllUsers_pdb, state: Absent, cached: None
[1E18:1B64][2020-09-30T11:16:11]i101: Detected package: core_AllUsers_d, state: Absent, cached: None
[1E18:1B64][2020-09-30T11:16:11]i101: Detected package: core_JustForMe, state: Present, cached: None

Here is the normal log:

[113C:02BC][2020-10-05T12:06:55]i101: Detected package: core_AllUsers, state: Present, cached: Complete
[113C:02BC][2020-10-05T12:06:55]i101: Detected package: core_AllUsers_pdb, state: Absent, cached: None
[113C:02BC][2020-10-05T12:06:55]i101: Detected package: core_AllUsers_d, state: Absent, cached: None
[113C:02BC][2020-10-05T12:06:55]i101: Detected package: core_JustForMe, state: Absent, cached: None

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41951>
_______________________________________

From report at bugs.python.org  Mon Oct  5 22:54:38 2020
From: report at bugs.python.org (Mark Sapiro)
Date: Tue, 06 Oct 2020 02:54:38 +0000
Subject: [issue27321] Email parser creates a message object that can't be
 flattened
In-Reply-To: <1465930372.53.0.0254623453508.issue27321@psf.upfronthosting.co.za>
Message-ID: <1601952878.37.0.95144188272.issue27321@roundup.psfhosted.org>


Mark Sapiro <mark at msapiro.net> added the comment:

I work around it with
```
class Message(email.message.Message):

    def as_string(self):
        # Work around for https://bugs.python.org/issue27321 and
        # https://bugs.python.org/issue32330.
        try:
            value = email.message.Message.as_string(self)
        except (KeyError, LookupError, UnicodeEncodeError):
            value = email.message.Message.as_bytes(self).decode(
                'ascii', 'replace')
        # Also ensure no unicode surrogates in the returned string.
        return email.utils._sanitize(value)
```
This is easy for me because it's Mailman which already subclasses email.message.Message for other reasons. It is perhaps more difficult if you aren't already subclassing email.message.Message for other purposes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27321>
_______________________________________

From report at bugs.python.org  Mon Oct  5 23:01:39 2020
From: report at bugs.python.org (Steven Yan)
Date: Tue, 06 Oct 2020 03:01:39 +0000
Subject: [issue41952] Extra Space Between "Oct" and "5"
Message-ID: <1601953299.33.0.696069011222.issue41952@roundup.psfhosted.org>


Change by Steven Yan <Steven_Bot_Yan at 126.com>:


----------
assignee: terry.reedy
components: IDLE
nosy: sy, terry.reedy
priority: normal
severity: normal
status: open
title: Extra Space Between "Oct" and "5"
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41952>
_______________________________________

From report at bugs.python.org  Mon Oct  5 23:09:16 2020
From: report at bugs.python.org (Steven Yan)
Date: Tue, 06 Oct 2020 03:09:16 +0000
Subject: [issue41952] Top Sentence Had a Extra Space Between "Oct" and "5"
Message-ID: <1601953756.0.0.330414328588.issue41952@roundup.psfhosted.org>


Change by Steven Yan <Steven_Bot_Yan at 126.com>:


----------
title: Extra Space Between "Oct" and "5" -> Top Sentence Had a Extra Space Between "Oct" and "5"

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41952>
_______________________________________

From report at bugs.python.org  Mon Oct  5 23:21:11 2020
From: report at bugs.python.org (XIAO AN ZHENG)
Date: Tue, 06 Oct 2020 03:21:11 +0000
Subject: [issue41951] python-3.8.2.exe /uninstall /quiet fails woth Exit code:
 0x643
In-Reply-To: <1601952699.58.0.0444624447975.issue41951@roundup.psfhosted.org>
Message-ID: <1601954471.66.0.410854578349.issue41951@roundup.psfhosted.org>


Change by XIAO AN ZHENG <xiaoanzhengca at yahoo.com>:


----------
title: python-3.6.8.exe /uninstall /quiet fails woth Exit code: 0x643 -> python-3.8.2.exe /uninstall /quiet fails woth Exit code: 0x643

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41951>
_______________________________________

From report at bugs.python.org  Tue Oct  6 00:38:34 2020
From: report at bugs.python.org (Bug Reporter)
Date: Tue, 06 Oct 2020 04:38:34 +0000
Subject: [issue41561] test_ssl fails in Ubuntu 20.04:
 test_min_max_version_mismatch
In-Reply-To: <1597551049.14.0.0578030464715.issue41561@roundup.psfhosted.org>
Message-ID: <1601959114.43.0.696117777452.issue41561@roundup.psfhosted.org>


Bug Reporter <bugsrep at gmail.com> added the comment:

Just tested python 3.9.0 - same issue.

----------
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41561>
_______________________________________

From report at bugs.python.org  Tue Oct  6 01:12:46 2020
From: report at bugs.python.org (wyz23x2)
Date: Tue, 06 Oct 2020 05:12:46 +0000
Subject: [issue41953] Confusing error message of 50,*2
Message-ID: <1601961165.99.0.783247818914.issue41953@roundup.psfhosted.org>


New submission from wyz23x2 <wyz23x2 at 163.com>:

>>> (50,) * 2
(50, 50)
>>> 50, * 2
Traceback (most recent call last):
  File "<stdin>", line 2, in <module>
TypeError: 'int' object is not iterable

This message is confusing. It isn't clear that 50.__iter__ is called. tuple(50)*2 seems to happen, which isn't expected (at least to regular users). Not like "50 * 2," that relates to parsing.

----------
components: Interpreter Core
messages: 378090
nosy: wyz23x2
priority: normal
severity: normal
status: open
title: Confusing error message of 50,*2
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41953>
_______________________________________

From report at bugs.python.org  Tue Oct  6 01:19:32 2020
From: report at bugs.python.org (wyz23x2)
Date: Tue, 06 Oct 2020 05:19:32 +0000
Subject: [issue41953] Confusing error message of 50,*2
In-Reply-To: <1601961165.99.0.783247818914.issue41953@roundup.psfhosted.org>
Message-ID: <1601961572.75.0.794001849629.issue41953@roundup.psfhosted.org>


wyz23x2 <wyz23x2 at 163.com> added the comment:

>>> '1', * 2
Traceback (most recent call last):
  File "<stdin>", line 3, in <module>
TypeError: 'int' object is not iterable

Update: 2.__iter__ seems to be called.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41953>
_______________________________________

From report at bugs.python.org  Tue Oct  6 01:19:32 2020
From: report at bugs.python.org (wyz23x2)
Date: Tue, 06 Oct 2020 05:19:32 +0000
Subject: [issue41953] Confusing error message of 50,*2
In-Reply-To: <1601961165.99.0.783247818914.issue41953@roundup.psfhosted.org>
Message-ID: <1601961572.75.0.794001849629.issue41953@roundup.psfhosted.org>


wyz23x2 <wyz23x2 at 163.com> added the comment:

>>> '1', * 2
Traceback (most recent call last):
  File "<stdin>", line 3, in <module>
TypeError: 'int' object is not iterable

Update: 2.__iter__ seems to be called.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41953>
_______________________________________

From report at bugs.python.org  Tue Oct  6 01:36:55 2020
From: report at bugs.python.org (wyz23x2)
Date: Tue, 06 Oct 2020 05:36:55 +0000
Subject: [issue41953] Confusing error message of 50,*2
In-Reply-To: <1601961165.99.0.783247818914.issue41953@roundup.psfhosted.org>
Message-ID: <1601962615.79.0.0203008405169.issue41953@roundup.psfhosted.org>


wyz23x2 <wyz23x2 at 163.com> added the comment:

Just updated to 3.9. Fixed.

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41953>
_______________________________________

From report at bugs.python.org  Tue Oct  6 02:44:42 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 06 Oct 2020 06:44:42 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1601966682.59.0.794653673223.issue41939@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21569
pull_request: https://github.com/python/cpython/pull/22574

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Tue Oct  6 02:48:27 2020
From: report at bugs.python.org (Mark Dickinson)
Date: Tue, 06 Oct 2020 06:48:27 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601966907.47.0.779876339652.issue26680@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
nosy:  -mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Tue Oct  6 03:03:34 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 06 Oct 2020 07:03:34 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1601967814.99.0.127049393937.issue41939@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 78bddc7794a629614dc84e195b9117416ae97ed3 by Miss Skeleton (bot) in branch '3.8':
bpo-41939: Fix test_site.test_license_exists_at_url() (GH-22559)
https://github.com/python/cpython/commit/78bddc7794a629614dc84e195b9117416ae97ed3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Tue Oct  6 03:11:48 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 07:11:48 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1601968308.05.0.0992074786319.issue41939@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Tue Oct  6 03:12:22 2020
From: report at bugs.python.org (Stanislav Levin)
Date: Tue, 06 Oct 2020 07:12:22 +0000
Subject: [issue41954] [mock] Recursion on mocking inspect.isfunction
Message-ID: <1601968342.61.0.658071347558.issue41954@roundup.psfhosted.org>


New submission from Stanislav Levin <slev at altlinux.org>:

With Python 3.8 the mocking of `inspect.isfunction` results in recursion.

Please, consider a code snippet:

```python
from unittest import TestCase
from unittest.mock import patch

import inspect

class TestClass(TestCase):
    def setUp(self):
        patcher = patch('inspect.isfunction')
        self.addCleanup(patcher.stop)
        self.patched_func = patcher.start()

    def test_m(self):
        def f():
           pass

        inspect.isfunction(f)
```

Output:
```
ERROR: test_m (test.TestClass)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/src/test.py", line 16, in test_m
    inspect.isfunction(f)
  File "/usr/lib64/python3.8/unittest/mock.py", line 1081, in __call__
    return self._mock_call(*args, **kwargs)
  File "/usr/lib64/python3.8/unittest/mock.py", line 1085, in _mock_call
    return self._execute_mock_call(*args, **kwargs)
  File "/usr/lib64/python3.8/unittest/mock.py", line 1157, in _execute_mock_call
    return self.return_value
  File "/usr/lib64/python3.8/unittest/mock.py", line 526, in __get_return_value
    ret = self._get_child_mock(
  File "/usr/lib64/python3.8/unittest/mock.py", line 1025, in _get_child_mock
    return klass(**kw)
  File "/usr/lib64/python3.8/unittest/mock.py", line 408, in __new__
    sig = inspect.signature(NonCallableMock.__init__)
  File "/usr/lib64/python3.8/inspect.py", line 3093, in signature
    return Signature.from_callable(obj, follow_wrapped=follow_wrapped)
  File "/usr/lib64/python3.8/inspect.py", line 2842, in from_callable
    return _signature_from_callable(obj, sigcls=cls,
  File "/usr/lib64/python3.8/inspect.py", line 2289, in _signature_from_callable
    if isfunction(obj) or _signature_is_functionlike(obj):
  File "/usr/lib64/python3.8/unittest/mock.py", line 1081, in __call__
    return self._mock_call(*args, **kwargs)
  File "/usr/lib64/python3.8/unittest/mock.py", line 1085, in _mock_call
    return self._execute_mock_call(*args, **kwargs)
  File "/usr/lib64/python3.8/unittest/mock.py", line 1157, in _execute_mock_call
    return self.return_value
  File "/usr/lib64/python3.8/unittest/mock.py", line 526, in __get_return_value
    ret = self._get_child_mock(
  File "/usr/lib64/python3.8/unittest/mock.py", line 1025, in _get_child_mock
    return klass(**kw)
...

    return _signature_from_callable(obj, sigcls=cls,
RecursionError: maximum recursion depth exceeded
```

breaking commit: https://github.com/python/cpython/commit/77b3b7701a34ecf6316469e05b79bb91de2addfa

The pre-77b3b7701a34ecf6316469e05b79bb91de2addfa state of `Lib/unittest/mock.py` works as expected.

----------
messages: 378094
nosy: stanislavlevin
priority: normal
severity: normal
status: open
title: [mock] Recursion on mocking inspect.isfunction
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41954>
_______________________________________

From report at bugs.python.org  Tue Oct  6 03:15:48 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 06 Oct 2020 07:15:48 +0000
Subject: [issue41954] [mock] Recursion on mocking inspect.isfunction
In-Reply-To: <1601968342.61.0.658071347558.issue41954@roundup.psfhosted.org>
Message-ID: <1601968548.72.0.961056627079.issue41954@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +cjw296, lisroach, mariocj89, michael.foord, xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41954>
_______________________________________

From report at bugs.python.org  Tue Oct  6 03:17:47 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 06 Oct 2020 07:17:47 +0000
Subject: [issue40864] spec_set/autospec/spec seems to not be reading
 attributes defined in class body
In-Reply-To: <1591280927.55.0.854829069355.issue40864@roundup.psfhosted.org>
Message-ID: <1601968667.42.0.773634041524.issue40864@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +cjw296, lisroach, mariocj89, michael.foord

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40864>
_______________________________________

From report at bugs.python.org  Tue Oct  6 03:43:49 2020
From: report at bugs.python.org (XIAO AN ZHENG)
Date: Tue, 06 Oct 2020 07:43:49 +0000
Subject: [issue41951] python-3.8.2.exe /uninstall /quiet fails with Exit code:
 0x643
In-Reply-To: <1601952699.58.0.0444624447975.issue41951@roundup.psfhosted.org>
Message-ID: <1601970229.19.0.700090665434.issue41951@roundup.psfhosted.org>


XIAO AN ZHENG <xiaoanzhengca at yahoo.com> added the comment:

This happens in windows 2019 server running Powershell under SYSTEM account:

&"..\thirdparty\python-3.8.2.exe" /uninstall /quiet

----------
title: python-3.8.2.exe /uninstall /quiet fails woth Exit code: 0x643 -> python-3.8.2.exe /uninstall /quiet fails with Exit code: 0x643

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41951>
_______________________________________

From report at bugs.python.org  Tue Oct  6 04:30:28 2020
From: report at bugs.python.org (Gaming With Skytorrush)
Date: Tue, 06 Oct 2020 08:30:28 +0000
Subject: [issue41955] Python Modules
Message-ID: <1601973028.51.0.57170333188.issue41955@roundup.psfhosted.org>


New submission from Gaming With Skytorrush <clashwithchiefrpjyt at gmail.com>:

Modules such as Pillow, Psycopg2, Psycopg2-binary are not installing via pip stating this version doesn't support those

----------
messages: 378096
nosy: clashwithchiefrpjyt
priority: normal
severity: normal
status: open
title: Python Modules
type: resource usage
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41955>
_______________________________________

From report at bugs.python.org  Tue Oct  6 04:41:40 2020
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 06 Oct 2020 08:41:40 +0000
Subject: [issue41955] Python Modules
In-Reply-To: <1601973028.51.0.57170333188.issue41955@roundup.psfhosted.org>
Message-ID: <1601973700.95.0.852817696758.issue41955@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

All packages in your list use native C code and don't offer compiled binaries for Python 3.9 yet. It's usually taking a couple of days or weeks until major packages ship binaries for a new Python version.

Please report missing binaries with the maintainers of these packages.

----------
nosy: +christian.heimes
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41955>
_______________________________________

From report at bugs.python.org  Tue Oct  6 04:45:54 2020
From: report at bugs.python.org (E. Paine)
Date: Tue, 06 Oct 2020 08:45:54 +0000
Subject: [issue41952] sys.version has double space between month and date
Message-ID: <1601973954.75.0.975478254014.issue41952@roundup.psfhosted.org>


New submission from E. Paine <paineelisha at gmail.com>:

To elaborate on the information given in the title, @sy is referring to the shell start text. More specifically, they are raising a grammatical issue with `sys.version` where there are two spaces between the shortened month form and the date (on my build this is `Sep  5`).

This is not a problem with IDLE and I doubt this is an issue generally, but is it worth nosying Lukasz? (I presume he is the person to ask?)

----------
components:  -IDLE
nosy: +epaine
title: Top Sentence Had a Extra Space Between "Oct" and "5" -> sys.version has double space between month and date
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41952>
_______________________________________

From report at bugs.python.org  Tue Oct  6 04:47:53 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 06 Oct 2020 08:47:53 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601974073.85.0.283372060558.issue26680@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
priority: normal -> release blocker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Tue Oct  6 04:52:11 2020
From: report at bugs.python.org (Steve Dower)
Date: Tue, 06 Oct 2020 08:52:11 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1601974331.39.0.218658189082.issue41490@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I have no objection to bumping it further, provided someone has fixed importlib.resources on 3.10 (i.e. my backported tests pass)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Tue Oct  6 04:59:05 2020
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 06 Oct 2020 08:59:05 +0000
Subject: [issue41949] Redefinition of HMAC functions prevents static linking
In-Reply-To: <1601945210.71.0.233142859875.issue41949@roundup.psfhosted.org>
Message-ID: <1601974745.61.0.978142805511.issue41949@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

It looks like LibreSSL is finally adding OpenSSL 1.1.1 APIs after all. This is a good move but also breaks assumptions.

Please note that compiling Python with LibreSSL is completely untested and unmaintained.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41949>
_______________________________________

From report at bugs.python.org  Tue Oct  6 05:02:38 2020
From: report at bugs.python.org (Dan)
Date: Tue, 06 Oct 2020 09:02:38 +0000
Subject: [issue41956] Regression in HTMLParser on malformed tags
Message-ID: <1601974958.88.0.650741746715.issue41956@roundup.psfhosted.org>


New submission from Dan <negativeiq at gmail.com>:

The attached HTML document (pulled from a Samsung printer web interface) contains the following invalid HTML tag:
<img style="vertical-align:bottom;" ,="" src="images/sws/icon_alert_warning_16.gif" title="Warning">
(invalid because of ,="")
In Python 3.x completely stops the HTML parser, preventing any further tags from being parsed. This does not happen in Python 2.x
See the attached Python script, which counts the number of "input" tags. When executed using Python 2.7, it correctly counts 4 such tags. When executed using Python 3.8 it only finds 1.

----------
components: Library (Lib)
files: testhtmlparse.zip
messages: 378101
nosy: dan
priority: normal
severity: normal
status: open
title: Regression in HTMLParser on malformed tags
type: behavior
versions: Python 3.8
Added file: https://bugs.python.org/file49497/testhtmlparse.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41956>
_______________________________________

From report at bugs.python.org  Tue Oct  6 05:10:51 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 06 Oct 2020 09:10:51 +0000
Subject: [issue41952] sys.version has double space between month and date
In-Reply-To: <1601973954.75.0.975478254014.issue41952@roundup.psfhosted.org>
Message-ID: <1601975451.24.0.758082945016.issue41952@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

>>> sys.version
'3.10.0a1 (tags/v3.10.0a1:8e9afaf, Oct  5 2020, 20:32:52) [MSC v.1927 64 bit (AMD64)]'

I am guessing that the template is leaving spaces for 2 digits.  Intentional?  I see the same thing in local repository debug builds.

Pablo is the release manager for 3.10/11.

----------
assignee: terry.reedy -> 
nosy: +lukasz.langa, pablogsal
type: enhancement -> behavior
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41952>
_______________________________________

From report at bugs.python.org  Tue Oct  6 05:12:09 2020
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 06 Oct 2020 09:12:09 +0000
Subject: [issue41561] test_ssl fails in Ubuntu 20.04:
 test_min_max_version_mismatch
In-Reply-To: <1597551049.14.0.0578030464715.issue41561@roundup.psfhosted.org>
Message-ID: <1601975529.59.0.636204616539.issue41561@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

It sounds like a Debian/Ubuntu patch is breaking an assumption. Did somebody report the bug with Debian/Ubuntu maintainers of OpenSSL already?

Fedora also configures OpenSSL with minimum protocol version of TLS 1.2. The distribution does it in a slightly different way that makes the restriction discoverable and that is compatible with Python's test suite.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41561>
_______________________________________

From report at bugs.python.org  Tue Oct  6 05:15:43 2020
From: report at bugs.python.org (Florian Bruhin)
Date: Tue, 06 Oct 2020 09:15:43 +0000
Subject: [issue41944] Python testsuite calls eval() on content received via
 HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601975743.77.0.898292714893.issue41944@roundup.psfhosted.org>


Florian Bruhin <python.org at the-compiler.org> added the comment:

I wonder if I should request a CVE for this as well? Just to make sure the word gets out to distributions/organizations/etc. running the Python testsuite, given that we can't be sure it which contexts this happens (and as it could be exploited by e.g. spoofing a WiFi network or so).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 05:24:54 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 09:24:54 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601976294.76.0.952677804402.issue41944@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I don't think that a CVE is justified.

I don't know anyone running the Python test suite on production. Only developers of Python itself run Python.

----------
title: Python testsuite calls eval() on content received via HTTP -> [security] Python testsuite calls eval() on content received via HTTP

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 05:25:14 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 09:25:14 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601976314.43.0.169325784776.issue41944@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Oops: Only developers of Python itself run the Python test suite.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 05:42:03 2020
From: report at bugs.python.org (Florian Bruhin)
Date: Tue, 06 Oct 2020 09:42:03 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601977323.27.0.253885989301.issue41944@roundup.psfhosted.org>


Florian Bruhin <python.org at the-compiler.org> added the comment:

That assumption is false. For starters, distribution packagers do:

https://github.com/archlinux/svntogit-packages/blob/3fc85177e35d1ff9ab000950c5d1af9567730434/trunk/PKGBUILD#L72-L84

https://src.fedoraproject.org/rpms/python3.9/blob/master/f/python3.9.spec#_1168

When I build a Python from source (via an Arch User Repository package), I do as well, and so does anyone installing those packages by default.

Anyone building with --enable-optimizations (PGO) will likely do so as well, though I'm not sure if that runs this part of the testsuite.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 06:28:20 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 10:28:20 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601980100.06.0.400513384878.issue41944@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I'm not saying that this issue is not a vulnerability, just that the scope is limited.

By default, downloaded from the Internet are disabled. You have to opt-in for that using -u network (or -u all which enables the network resource) command line option of "./python -m test".

Impacted:

* "make testall", "make testuniversal" and "make buildbottest" commands are impacted (pass -u all to the test suite).

* Python buildbot workers are impacted: they run the "make buildbottest" command.

* Travis CI is impacted: it runs "./python -m test -uall,-cpu (...)".

* Multiple GitHub Action jobs are impacted (coverage, Windows, macOS, Ubuntu): run "-uall,-cpu".

* Azure Pipelines jobs are impacted: use -uall,-cpu.


> https://src.fedoraproject.org/rpms/python3.9/blob/master/f/python3.9.spec#_1168

Fedora packages are not impacted: no -u option is passed to the test suite.


> Anyone building with --enable-optimizations (PGO) will likely do so as well, though I'm not sure if that runs this part of the testsuite.

PGO build is not impacted, it uses "./python -m test --pgo" (download is disabled). Moreover, multibyte codec checks are not run by this command (see Lib/test/libregrtest/pgo.py, only test_codecs of codec tests is run).

----------
nosy: +pablogsal, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 06:45:56 2020
From: report at bugs.python.org (Florian Bruhin)
Date: Tue, 06 Oct 2020 10:45:56 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601981156.62.0.077076225458.issue41944@roundup.psfhosted.org>


Change by Florian Bruhin <python.org at the-compiler.org>:


----------
pull_requests: +21570
pull_request: https://github.com/python/cpython/pull/22575

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 06:47:05 2020
From: report at bugs.python.org (Will Chill)
Date: Tue, 06 Oct 2020 10:47:05 +0000
Subject: [issue30197] Enhance swap_attr() and swap_item() in test.support
In-Reply-To: <1493377560.96.0.413320673715.issue30197@psf.upfronthosting.co.za>
Message-ID: <1601981225.54.0.969800732259.issue30197@roundup.psfhosted.org>


Will Chill <wburchill7 at gmail.com> added the comment:

Thought I'd send

----------
nosy: +wburchill7
Added file: https://bugs.python.org/file49498/March 23rd 2017.htm

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30197>
_______________________________________

From report at bugs.python.org  Tue Oct  6 06:47:19 2020
From: report at bugs.python.org (Florian Bruhin)
Date: Tue, 06 Oct 2020 10:47:19 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601981239.59.0.159135332799.issue41944@roundup.psfhosted.org>


Florian Bruhin <python.org at the-compiler.org> added the comment:

Thanks for the clarification - I wasn't aware those tests aren't run by default.

FWIW I found another place where a similar thing is done, though by chance it's probably not exploitable - see GH-22575.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 06:48:50 2020
From: report at bugs.python.org (Will Chill)
Date: Tue, 06 Oct 2020 10:48:50 +0000
Subject: [issue30197] Enhance swap_attr() and swap_item() in test.support
In-Reply-To: <1493377560.96.0.413320673715.issue30197@psf.upfronthosting.co.za>
Message-ID: <1601981330.56.0.820522922099.issue30197@roundup.psfhosted.org>


Change by Will Chill <wburchill7 at gmail.com>:


Removed file: https://bugs.python.org/file49498/March 23rd 2017.htm

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30197>
_______________________________________

From report at bugs.python.org  Tue Oct  6 06:55:47 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 10:55:47 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601981747.79.0.0237936862585.issue41944@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> FWIW I found another place where a similar thing is done, though by chance it's probably not exploitable - see GH-22575.

I agree that test_ucn is not exploitable, but it would be nice to harden it anyway.

Extract of the code:

            self.assertEqual(unicodedata.lookup(seqname), codepoints)
            with self.assertRaises(SyntaxError):
                self.checkletter(seqname, None)

test_ucn downloads http://www.pythontest.net/unicode/13.0.0/NamedSequences.txt and calls checkletter() on each line, but first it ensures that unicodedata.lookup(seqname) works as expected.

I don't see how it would be possible to inject arbitrary Python code in the 'seqname' variable without making unicodedata.lookup() to fail.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 06:55:52 2020
From: report at bugs.python.org (Alex)
Date: Tue, 06 Oct 2020 10:55:52 +0000
Subject: [issue41957] IDLE does not Transform Tabs into Spaces in Interactive
 Mode
Message-ID: <1601981752.02.0.169108716796.issue41957@roundup.psfhosted.org>


New submission from Alex <2423067593 at qq.com>:

In Python I usually find the problem like this.
>>> for i in range(10):
	#some code
In edit mode, IDLE will automatically transform tabs into spaces.
But in interactive mode, IDLE won't do the same.
The same problem have been reported in some other forums as far as I know.
I don't know how the problem is caused. However, we shoule look at this problem carefully, until we solve it.

----------
assignee: terry.reedy
components: IDLE
messages: 378112
nosy: Alex-Python-Programmer, terry.reedy
priority: normal
severity: normal
status: open
title: IDLE does not Transform Tabs into Spaces in Interactive Mode
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41957>
_______________________________________

From report at bugs.python.org  Tue Oct  6 07:06:11 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 11:06:11 +0000
Subject: [issue36534] tarfile: handling Windows (path) illegal characters in
 archive member names
In-Reply-To: <1554458671.74.0.11308540457.issue36534@roundup.psfhosted.org>
Message-ID: <1601982371.81.0.961183496962.issue36534@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Also, while _sanitize_windows_name() handles trailing dots, for some reason it overlooks trailing spaces. It also doesn't handle reserved DOS device names.

The pathlib module has _WindowsFlavour.reserved_names list of Windows
reserved names:

>>> pprint.pprint(sorted(pathlib._WindowsFlavour.reserved_names))
['AUX',
 'COM1',
 'COM2',
 'COM3',
 'COM4',
 'COM5',
 'COM6',
 'COM7',
 'COM8',
 'COM9',
 'CON',
 'LPT1',
 'LPT2',
 'LPT3',
 'LPT4',
 'LPT5',
 'LPT6',
 'LPT7',
 'LPT8',
 'LPT9',
 'NUL',
 'PRN']

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36534>
_______________________________________

From report at bugs.python.org  Tue Oct  6 07:07:40 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 11:07:40 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601982460.32.0.368568286999.issue41944@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I'm now tracking this vulnerability at:
https://python-security.readthedocs.io/vuln/cjk-codec-download-eval.html

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 07:28:16 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 11:28:16 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1601983696.73.0.947568080536.issue1635741@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Statistics on C extension modules using the old API (PyModule_Create) / new API (PyModuleDef_Init):

* 3.5: 84 / 24 (22%), total: 108
* 3.6: 87 / 25 (22%), total: 112 (+4)
* 3.7 : 89 / 26 (23%), total: 115 (+3)
* 3.8: 91 / 27 (23%), total: 118 (+3)
* 3.9: 68 / 52 (43%), total: 120 (+2)
* master: 42 / 76 (64%), total: 118 (-2)

Before Python 3.8, it doesn't evolve much. Between 3.8 and 3.9, 25 extensions have been ported to the new API. Between 3.9 and master, 24 more extensions have been ported. Nice work so far!

I didn't check if these extensions use a module state or if they still use some kind of global shared state such as static types. I just used a dummy grep:

grep -E '\<PyModule_Create\>' $(find Modules/ -name "*.c")|wc -l

grep -E '\<PyModuleDef_Init\>' $(find Modules/ -name "*.c")|wc -l

Anyway, it's going in the right direction!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Tue Oct  6 07:53:46 2020
From: report at bugs.python.org (Mario Corchero)
Date: Tue, 06 Oct 2020 11:53:46 +0000
Subject: [issue41954] [mock] Recursion on mocking inspect.isfunction
In-Reply-To: <1601968342.61.0.658071347558.issue41954@roundup.psfhosted.org>
Message-ID: <1601985226.64.0.689416327232.issue41954@roundup.psfhosted.org>


Mario Corchero <mariocj89 at gmail.com> added the comment:

Oh, well spotted. We could add some guards around the code in mock to still work when key stdlib functionality is mocked out, but this might make the mock code quite messy. Specially as we will have to make sure that not only the function we call are safe to call (which is easy by just doing import from), but that all dependencies of those function are also safe to call.

I'd instead suggest for users to patch in the module where they are using the function instead.

I think that once any part of the stdlib is patched by mock, there are no guarantees that anything will work unless the patch provides a functioning implmentation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41954>
_______________________________________

From report at bugs.python.org  Tue Oct  6 08:14:59 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 06 Oct 2020 12:14:59 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601986499.51.0.102447299448.issue41944@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 2ef5caa58febc8968e670e39e3d37cf8eef3cab8 by Serhiy Storchaka in branch 'master':
bpo-41944: No longer call eval() on content received via HTTP in the CJK codec tests (GH-22566)
https://github.com/python/cpython/commit/2ef5caa58febc8968e670e39e3d37cf8eef3cab8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 08:15:11 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 06 Oct 2020 12:15:11 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601986511.35.0.238349470873.issue41944@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 5.0 -> 6.0
pull_requests: +21571
pull_request: https://github.com/python/cpython/pull/22576

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 08:15:21 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 06 Oct 2020 12:15:21 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601986521.72.0.953244326589.issue41944@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21572
pull_request: https://github.com/python/cpython/pull/22577

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 08:37:44 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 06 Oct 2020 12:37:44 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601987864.34.0.249662642531.issue41944@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b664a1df4ee71d3760ab937653b10997081b1794 by Miss Skeleton (bot) in branch '3.9':
bpo-41944: No longer call eval() on content received via HTTP in the CJK codec tests (GH-22566)
https://github.com/python/cpython/commit/b664a1df4ee71d3760ab937653b10997081b1794


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 08:38:07 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 06 Oct 2020 12:38:07 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601987887.58.0.151333231117.issue41944@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21573
pull_request: https://github.com/python/cpython/pull/22578

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 08:38:19 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 06 Oct 2020 12:38:19 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601987899.19.0.242583601274.issue41944@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21574
pull_request: https://github.com/python/cpython/pull/22579

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 08:38:57 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 12:38:57 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601987937.9.0.857648548291.issue41944@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 6c6c256df3636ff6f6136820afaefa5a10a3ac33 by Miss Skeleton (bot) in branch '3.8':
bpo-41944: No longer call eval() on content received via HTTP in the CJK codec tests (GH-22566) (GH-22577)
https://github.com/python/cpython/commit/6c6c256df3636ff6f6136820afaefa5a10a3ac33


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 08:39:20 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 12:39:20 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601987960.54.0.772999535243.issue41944@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Since it's a security vulnerability, I created backports to 3.6 and 3.7 as well.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 09:08:55 2020
From: report at bugs.python.org (Mario Idival)
Date: Tue, 06 Oct 2020 13:08:55 +0000
Subject: [issue41958] importlib has not util module
Message-ID: <1601989735.99.0.481225793113.issue41958@roundup.psfhosted.org>


New submission from Mario Idival <marioidival at gmail.com>:

After new version 3.9, the util module from importlib does not exists anymore

>>> import importlib
>>> importlib.util.find_spec('enum')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
AttributeError: module 'importlib' has no attribute 'util'
>>>

----------
components: Library (Lib)
messages: 378121
nosy: marioidival
priority: normal
severity: normal
status: open
title: importlib has not util module
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41958>
_______________________________________

From report at bugs.python.org  Tue Oct  6 09:10:37 2020
From: report at bugs.python.org (Mario Idival)
Date: Tue, 06 Oct 2020 13:10:37 +0000
Subject: [issue41958] importlib has not util module
In-Reply-To: <1601989735.99.0.481225793113.issue41958@roundup.psfhosted.org>
Message-ID: <1601989837.02.0.53008466658.issue41958@roundup.psfhosted.org>


Change by Mario Idival <marioidival at gmail.com>:


----------
type:  -> crash

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41958>
_______________________________________

From report at bugs.python.org  Tue Oct  6 09:12:41 2020
From: report at bugs.python.org (E. Paine)
Date: Tue, 06 Oct 2020 13:12:41 +0000
Subject: [issue41957] IDLE does not Transform Tabs into Spaces in Interactive
 Mode
In-Reply-To: <1601981752.02.0.169108716796.issue41957@roundup.psfhosted.org>
Message-ID: <1601989961.85.0.452546496743.issue41957@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

This has been an issue for a *long* time (issue 7676). Hopefully, the merging of #37903 will allow this to be explored but currently there is not a lot that can be done (without a serious refactor).

----------
nosy: +epaine

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41957>
_______________________________________

From report at bugs.python.org  Tue Oct  6 09:15:32 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 06 Oct 2020 13:15:32 +0000
Subject: [issue41958] importlib has not util module
In-Reply-To: <1601989735.99.0.481225793113.issue41958@roundup.psfhosted.org>
Message-ID: <1601990132.36.0.938709652917.issue41958@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

import importlib.util

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41958>
_______________________________________

From report at bugs.python.org  Tue Oct  6 09:51:04 2020
From: report at bugs.python.org (=?utf-8?q?Ra=C3=BAl_Cumplido?=)
Date: Tue, 06 Oct 2020 13:51:04 +0000
Subject: [issue41959] Doc/library/asyncio-policy.rst grammar error
Message-ID: <1601992264.68.0.320872676637.issue41959@roundup.psfhosted.org>


New submission from Ra?l Cumplido <raulcumplido at gmail.com>:

The Doc/library/asyncio-policy.rst file contains the following:
```
This implementation registers a :py:data:`SIGCHLD` signal handler on instantiation. That can break third-party code that installs a custom handler for `SIGCHLD`.  signal).
```
The latest . and ) are incorrect.

----------
assignee: docs at python
components: Documentation
messages: 378124
nosy: docs at python, raulcd
priority: normal
severity: normal
status: open
title: Doc/library/asyncio-policy.rst grammar error
type: enhancement
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41959>
_______________________________________

From report at bugs.python.org  Tue Oct  6 09:55:49 2020
From: report at bugs.python.org (=?utf-8?q?Ra=C3=BAl_Cumplido?=)
Date: Tue, 06 Oct 2020 13:55:49 +0000
Subject: [issue41959] Doc/library/asyncio-policy.rst grammar error
In-Reply-To: <1601992264.68.0.320872676637.issue41959@roundup.psfhosted.org>
Message-ID: <1601992549.05.0.694826972918.issue41959@roundup.psfhosted.org>


Change by Ra?l Cumplido <raulcumplido at gmail.com>:


----------
keywords: +patch
pull_requests: +21575
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22580

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41959>
_______________________________________

From report at bugs.python.org  Tue Oct  6 10:22:06 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 14:22:06 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1601994126.13.0.629425524477.issue41944@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset a8bf44d04915f7366d9f8dfbf84822ac37a4bab3 by Florian Bruhin in branch 'master':
bpo-41944: No longer call eval() on content received via HTTP in the UnicodeNames tests (GH-22575)
https://github.com/python/cpython/commit/a8bf44d04915f7366d9f8dfbf84822ac37a4bab3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct  6 10:27:58 2020
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 06 Oct 2020 14:27:58 +0000
Subject: [issue36534] tarfile: handling Windows (path) illegal characters in
 archive member names
In-Reply-To: <1554458671.74.0.11308540457.issue36534@roundup.psfhosted.org>
Message-ID: <1601994478.84.0.540287176118.issue36534@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> The pathlib module has _WindowsFlavour.reserved_names list of 
> Windows reserved names:

pathlib._WindowsFlavour.reserved_names is missing "CONIN$" and "CONOUT$". Prior to Windows 8 these two are reserved as relative names. In Windows 8+, they're also reserved in directories, just like the other reserved device names.

pathlib._WindowsFlavour.is_reserved() fails to reserve names containing ASCII control characters [0-31], vertical bar [|], the file-stream delimiter [:] (i.e. "filename:streamname:streamtype"), and the five wildcard characters [*?"<>]. (Maybe it should allow the file-stream delimiter, but that requires validating that a file stream is proper.) It fails to reserve names that end with a dot or space, which includes UNC and device paths except for \\?\ verbatim paths. It fails to match all reserved base names, which begin with a reserved device name, followed by zero or more spaces, a dot or colon, and zero or more characters. If names that contain colon are already reserved, then this check only has to be modified to strip trailing spaces before comparing against the list of reserved device names.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36534>
_______________________________________

From report at bugs.python.org  Tue Oct  6 10:44:49 2020
From: report at bugs.python.org (Robert Smallshire)
Date: Tue, 06 Oct 2020 14:44:49 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601995489.28.0.458832627737.issue26680@roundup.psfhosted.org>


Robert Smallshire <rob at sixty-north.com> added the comment:

First, I would like to apologise for the confusion I have inadvertently caused. I didn't see Raymond's question and Guido's clear response here about not modifying the numeric tower, as it came _long_ after activity had moved to GitHub, and code had been reviewed over there. Now Raymond has linked back to here and I've caught up with the situation, I offer to make a compensating PR with reverts the changes to the numeric tower. I should be able to do this in the next day or two.

Please let me know whether you would like me to proceed, or whether you intend to handle the a partial or complete rollback among yourselves.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Tue Oct  6 10:50:33 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 06 Oct 2020 14:50:33 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1601995833.63.0.765264840795.issue26680@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
assignee: gvanrossum -> rhettinger
nosy:  -gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Tue Oct  6 12:53:49 2020
From: report at bugs.python.org (E. Paine)
Date: Tue, 06 Oct 2020 16:53:49 +0000
Subject: [issue41952] sys.version has double space between month and date
In-Reply-To: <1601973954.75.0.975478254014.issue41952@roundup.psfhosted.org>
Message-ID: <1602003229.76.0.585810200709.issue41952@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

I just confirmed (compiling the master having changed the system date) that this double space does not occur when the date is double-digits (`Oct 10`), suggesting that this is almost certainly intentional.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41952>
_______________________________________

From report at bugs.python.org  Tue Oct  6 13:04:47 2020
From: report at bugs.python.org (E. Paine)
Date: Tue, 06 Oct 2020 17:04:47 +0000
Subject: [issue41951] python-3.8.2.exe /uninstall /quiet fails with Exit code:
 0x643
In-Reply-To: <1601952699.58.0.0444624447975.issue41951@roundup.psfhosted.org>
Message-ID: <1602003887.67.0.952112948837.issue41951@roundup.psfhosted.org>


Change by E. Paine <paineelisha at gmail.com>:


----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41951>
_______________________________________

From report at bugs.python.org  Tue Oct  6 13:22:47 2020
From: report at bugs.python.org (Ammar Askar)
Date: Tue, 06 Oct 2020 17:22:47 +0000
Subject: [issue41952] sys.version has double space between month and date
In-Reply-To: <1601973954.75.0.975478254014.issue41952@roundup.psfhosted.org>
Message-ID: <1602004967.8.0.628250890407.issue41952@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

For reference, this comes from https://github.com/python/cpython/blob/e42b705188271da108de42b55d9344642170aa2b/Modules/getbuildinfo.c#L45-L46
and is set by the compiler `__DATE__` macro. 

GCC documentation says:

> If the day of the month is less than 10, it is padded with a space on the left.

and MSVC documentation says:

> The first character of date dd is a space if the value is less than 10. This macro is always defined.


So I think we can close this as working-as-intended.

----------
nosy: +ammar2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41952>
_______________________________________

From report at bugs.python.org  Tue Oct  6 13:41:18 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 06 Oct 2020 17:41:18 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1602006078.17.0.426476081896.issue41905@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset bef7d299eb911086ea5a7ccf7a9da337e38a8491 by Ben Avrahami in branch 'master':
bpo-41905: Add abc.update_abstractmethods() (GH-22485)
https://github.com/python/cpython/commit/bef7d299eb911086ea5a7ccf7a9da337e38a8491


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Tue Oct  6 13:41:55 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 06 Oct 2020 17:41:55 +0000
Subject: [issue41905] add update_abstractmethods function to update an ABC's
 abstract methods
In-Reply-To: <1601567692.16.0.144251091539.issue41905@roundup.psfhosted.org>
Message-ID: <1602006115.18.0.534414771956.issue41905@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Thanks all!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41905>
_______________________________________

From report at bugs.python.org  Tue Oct  6 15:13:08 2020
From: report at bugs.python.org (Leonard Schwennesen)
Date: Tue, 06 Oct 2020 19:13:08 +0000
Subject: [issue41920] Weird add operation of "0.2222 + 0.1111"
In-Reply-To: <1601725181.53.0.727469935565.issue41920@roundup.psfhosted.org>
Message-ID: <1602011588.55.0.825648123226.issue41920@roundup.psfhosted.org>


Leonard Schwennesen <l.schwennesen at gmx.net> added the comment:

Hi Steven,
Thanks for your detailed explanations. They where very helpful for me. Now I know a bit more about Python and Computers in general. (;

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41920>
_______________________________________

From report at bugs.python.org  Tue Oct  6 16:02:12 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Tue, 06 Oct 2020 20:02:12 +0000
Subject: [issue38605] [typing] PEP 563: Postponed evaluation of annotations:
 enable it by default in Python 3.10
In-Reply-To: <1572192430.43.0.755831692199.issue38605@roundup.psfhosted.org>
Message-ID: <1602014532.79.0.0519506633808.issue38605@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

@gvanrossum should I draft a patch to convert this
inspect.signature(callable, *, follow_wrapped=True) (and also things like inspect.Signature.from_callable) into inspect.signature(callable, *, follow_wrapped=True, globalns=None, localns=None) in order to pass them to get_type_hints (for resolving in different namespaces)?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38605>
_______________________________________

From report at bugs.python.org  Tue Oct  6 16:03:29 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 06 Oct 2020 20:03:29 +0000
Subject: [issue38605] [typing] PEP 563: Postponed evaluation of annotations:
 enable it by default in Python 3.10
In-Reply-To: <1572192430.43.0.755831692199.issue38605@roundup.psfhosted.org>
Message-ID: <1602014609.81.0.16176788541.issue38605@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 044a1048ca93d466965afc027b91a5a9eb9ce23c by Batuhan Taskaya in branch 'master':
bpo-38605: Make 'from __future__ import annotations' the default (GH-20434)
https://github.com/python/cpython/commit/044a1048ca93d466965afc027b91a5a9eb9ce23c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38605>
_______________________________________

From report at bugs.python.org  Tue Oct  6 16:06:36 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 06 Oct 2020 20:06:36 +0000
Subject: [issue38605] [typing] PEP 563: Postponed evaluation of annotations:
 enable it by default in Python 3.10
In-Reply-To: <1572192430.43.0.755831692199.issue38605@roundup.psfhosted.org>
Message-ID: <1602014796.31.0.868263566063.issue38605@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I'm marking this fixed, but there are some subtle edge cases. That's what alpha releases are for.

@BTaskaya, adding those arguments to various inspect functions sounds like a nice thing to do. You could either open a new issue or just reference this (closed) issue in your PR -- up to you.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38605>
_______________________________________

From report at bugs.python.org  Tue Oct  6 16:19:14 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 06 Oct 2020 20:19:14 +0000
Subject: [issue41957] IDLE does not Transform Tabs into Spaces in Interactive
 Mode
In-Reply-To: <1601981752.02.0.169108716796.issue41957@roundup.psfhosted.org>
Message-ID: <1602015554.34.0.499870628249.issue41957@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

#37903 is the first stage of a serious refactor

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41957>
_______________________________________

From report at bugs.python.org  Tue Oct  6 16:39:01 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Tue, 06 Oct 2020 20:39:01 +0000
Subject: [issue41960] Add globalns and localns to the inspect.signature and
 inspect.Signature.from_callable
Message-ID: <1602016741.16.0.216443843373.issue41960@roundup.psfhosted.org>


New submission from Batuhan Taskaya <isidentical at gmail.com>:

To resolve annotations in local namespaces (and possibly in different contexts), inspect.signature can take globalns and localns parameters.

I'm not inclined to add these into the getfullargspec, but I'd appreciate any comments about whether it is a good idea or not!

----------
components: Library (Lib)
messages: 378137
nosy: BTaskaya, gvanrossum, yselivanov
priority: normal
severity: normal
status: open
title: Add globalns and localns to the inspect.signature and inspect.Signature.from_callable
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41960>
_______________________________________

From report at bugs.python.org  Tue Oct  6 16:49:27 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 06 Oct 2020 20:49:27 +0000
Subject: [issue26680] Incorporating float.is_integer into the numeric tower
 and Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1602017367.28.0.815591635014.issue26680@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

No worries Robert.  It's all part of the process :-)

If it's okay with you.  I would like to revert the incorrectly applied PR and then you can build a fresh, clean patch.  Does that work for you?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Tue Oct  6 16:49:50 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 06 Oct 2020 20:49:50 +0000
Subject: [issue26680] Incorporating float.is_integer into Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1602017390.16.0.212646016419.issue26680@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
title: Incorporating float.is_integer into the numeric tower and Decimal -> Incorporating float.is_integer into Decimal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Tue Oct  6 17:05:37 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Tue, 06 Oct 2020 21:05:37 +0000
Subject: [issue41960] Add globalns and localns to the inspect.signature and
 inspect.Signature.from_callable
In-Reply-To: <1602016741.16.0.216443843373.issue41960@roundup.psfhosted.org>
Message-ID: <1602018337.19.0.0838753102085.issue41960@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
keywords: +patch
pull_requests: +21576
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22583

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41960>
_______________________________________

From report at bugs.python.org  Tue Oct  6 19:22:54 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 23:22:54 +0000
Subject: [issue38605] [typing] PEP 563: Postponed evaluation of annotations:
 enable it by default in Python 3.10
In-Reply-To: <1572192430.43.0.755831692199.issue38605@roundup.psfhosted.org>
Message-ID: <1602026574.79.0.960092310217.issue38605@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Good! I'm happy to see yet another "Python 4.0 change" going away :-) Let's make "Python 4.0" as compatible as possible ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38605>
_______________________________________

From report at bugs.python.org  Tue Oct  6 19:24:35 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 06 Oct 2020 23:24:35 +0000
Subject: [issue36534] tarfile: handling Windows (path) illegal characters in
 archive member names
In-Reply-To: <1554458671.74.0.11308540457.issue36534@roundup.psfhosted.org>
Message-ID: <1602026675.04.0.256182817882.issue36534@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> pathlib._WindowsFlavour.is_reserved() fails to reserve names (...)

This issue is about tarfile. Maybe create another issue to enhance the pathlib module?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36534>
_______________________________________

From report at bugs.python.org  Tue Oct  6 19:32:05 2020
From: report at bugs.python.org (Steve Dower)
Date: Tue, 06 Oct 2020 23:32:05 +0000
Subject: [issue41961] Windows install failure "could not set file security"
Message-ID: <1602027124.24.0.555629849122.issue41961@roundup.psfhosted.org>


New submission from Steve Dower <steve.dower at python.org>:

Original report: https://twitter.com/Steve_Casselman/status/1313564671652159488?s=20

A user received MSI error 1926 in a popup dialog, text reading:

> Could not set file security for file 'C:\Users\sc\AppData\Roaming\Microsoft\Installer\'. Error: 0. Verify that you have sufficient privileges to modify the security permissions for this file.

OS version: 18362.1082 (Windows 10 Home 1903)

----------
components: Windows
messages: 378141
nosy: paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
stage: test needed
status: open
title: Windows install failure "could not set file security"
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41961>
_______________________________________

From report at bugs.python.org  Tue Oct  6 19:45:35 2020
From: report at bugs.python.org (Steve Dower)
Date: Tue, 06 Oct 2020 23:45:35 +0000
Subject: [issue41961] Windows install failure "could not set file security"
In-Reply-To: <1602027124.24.0.555629849122.issue41961@roundup.psfhosted.org>
Message-ID: <1602027935.75.0.637423017187.issue41961@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Suspicious points:
* error 0 means success, so it shouldn't be popping up an error
* 'Installer\' is a directory, not a file
* %AppData%\Microsoft\Installer is normally readable by Everyone, but only writable by Administrators, even in the user's directory

So I assume the error came back from the Windows Installer service which couldn't write to the folder for some reason. It may just be system permissions or corrupt ACLs (waiting on user logs for more ideas here).

Anyone else know of any possible causes for this? I'm not sure if it's anything we could even prevent, but maybe we can make it easier to troubleshoot.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41961>
_______________________________________

From report at bugs.python.org  Tue Oct  6 19:48:30 2020
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 06 Oct 2020 23:48:30 +0000
Subject: [issue36534] tarfile: handling Windows (path) illegal characters in
 archive member names
In-Reply-To: <1554458671.74.0.11308540457.issue36534@roundup.psfhosted.org>
Message-ID: <1602028110.71.0.727684066417.issue36534@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> This issue is about tarfile. Maybe create another issue to enhance 
> the pathlib module?

IIRC there's already an open issue for that. But in case anyone were to look to pathlib as an example of what should be reserved, I wanted to highlight here how its reserved_names list is incomplete and how its is_reserved() method is insufficient.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36534>
_______________________________________

From report at bugs.python.org  Tue Oct  6 21:09:44 2020
From: report at bugs.python.org (Ben Darnell)
Date: Wed, 07 Oct 2020 01:09:44 +0000
Subject: [issue41962] Make threading._register_atexit public?
Message-ID: <1602032984.5.0.326433134447.issue41962@roundup.psfhosted.org>


New submission from Ben Darnell <ben.darnell at gmail.com>:

I'm dealing with a subtle deadlock involving concurrent.futures.ThreadPoolExecutor, and my solution that worked in Python 3.8 broke with 3.9. I'm running some long-running (possibly infinite) tasks in the thread pool, and I cancel them in an `atexit` callback so that everything can shut down cleanly (before ThreadPoolExecutor joins all worker threads in its own `atexit` hook).

Python 3.9 broke this due to https://bugs.python.org/issue39812. That change introduced a new atexit-like mechanism to the threading module and uses it where Python 3.8 used regular atexit. This means that ThreadPoolExecutor's atexit runs before mine, and since I never get a chance to cancel my tasks, it deadlocks.

One way I can solve this is to move my own atexit function to `threading._register_atexit`, so my strawman proposal here is to make that function public and documented. 

On the other hand, even without the change in Python 3.9, my use of `atexit` smells like an abuse of implementation details in ThreadPoolExecutor (getting the atexit callbacks called in the right order was tricky when the concurrent.futures module started using lazy loading in Python 3.7). So I would welcome other suggestions about how to handle long-running but cancelable operations in a ThreadPoolExecutor at shutdown. 

One clean solution is to do the cancellation at the end of the main module instead of in an atexit hook. However, I'm doing this at a library so I don't have any way but atexit to ensure that this happens. Another option is to forego ThreadPoolExecutor entirely and manage the threads myself. 

My code in question is in a not-yet-released branch of Tornado: https://github.com/tornadoweb/tornado/blob/5913aa43ecfdaa76876fc57867062227b907b1dd/tornado/platform/asyncio.py#L57-L73

With the master branch of Tornado, Python 3.9, and Windows, `python -c "from tornado.httpclient import HTTPClient; c = HTTPClient()` reliably deadlocks at interpreter shutdown.

----------
messages: 378144
nosy: Ben.Darnell
priority: normal
severity: normal
status: open
title: Make threading._register_atexit public?
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41962>
_______________________________________

From report at bugs.python.org  Tue Oct  6 23:33:47 2020
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 07 Oct 2020 03:33:47 +0000
Subject: [issue41961] Windows install failure "could not set file security"
In-Reply-To: <1602027124.24.0.555629849122.issue41961@roundup.psfhosted.org>
Message-ID: <1602041627.51.0.893066805264.issue41961@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> Anyone else know of any possible causes for this?

The installer service runs as SYSTEM, with an access token at system integrity level that has full privileges and the administrators group enabled. Nothing in the file security should prevent the service from opening "%APPDATA%\Microsoft\Installer" with WRITE_DAC [1] and WRITE_OWNER [2] access, assuming it uses backup semantics with the restore privilege enabled, but apparently it doesn't.

I was able to reproduce the error dialog by changing the owner of the "Installer" folder to the current user and removing the two DACL entries that grant access to Administrators and SYSTEM. I then restored normal operation by changing the owner of the folder back to the Administrators group and adding the full-control DACL entries for Administrators (BA) and SYSTEM (SY):

    takeown /a /f "%APPDATA%\Microsoft\Installer"
    icacls "%APPDATA%\Microsoft\Installer" /grant:r *BA:(OI)(CI)(F) *SY:(OI)(CI)(F)

---

[1] A security context (access token) is allowed WRITE_DAC access to an object (to modify its discretionary ACL and security attributes) if the object's mandatory label allows write access to the token's integrity level and either the object's discretionary ACL explicitly grants WRITE_DAC access to the token's user and enabled groups or implicitly grants this access given the object's discretionary ACL does not contain an "OWNER RIGHTS" entry and the object's owner is the token's user or in the token's enabled groups. In particular for a kernel file object (e.g. opening a filesystem file/directory), WRITE_DAC access is always allowed if an open uses backup semantics and SeRestorePrivilege is enabled.

[2] A security context (access token) is allowed WRITE_OWNER access to an object (to modify its owner, group, and mandatory label) if the token has SeTakeOwnershipPrivilege enabled or if the object's mandatory label allows write access to the token's integrity level and the object's discretionary ACL grants WRITE_OWNER access to the token's user and enabled groups. The object's owner can be set to any security principal if the token has SeRestorePrivilege enabled, else it's limited to the access token user and any of the enabled groups in the access token that is flagged SE_GROUP_OWNER (typically the Administrators group). In particular for a kernel file object (e.g. opening a filesystem file/directory), WRITE_OWNER access is always allowed if an open uses backup semantics and SeRestorePrivilege is enabled.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41961>
_______________________________________

From report at bugs.python.org  Wed Oct  7 01:13:57 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 07 Oct 2020 05:13:57 +0000
Subject: [issue26680] Incorporating float.is_integer into Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1602047637.67.0.46922039.issue26680@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
pull_requests: +21577
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/22584

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Wed Oct  7 03:21:09 2020
From: report at bugs.python.org (=?utf-8?q?J=C3=BCrgen_Gmach?=)
Date: Wed, 07 Oct 2020 07:21:09 +0000
Subject: [issue41963] ConfigParser: stripping of comments should be documented
Message-ID: <1602055269.91.0.0897084304522.issue41963@roundup.psfhosted.org>


New submission from J?rgen Gmach <juergen.gmach at googlemail.com>:

While working on `tox-ini-fmt`, a formatter for - you guessed it - `tox.ini` files, I noticed ConfigParser strips comments when reading a config file.

( https://github.com/tox-dev/tox-ini-fmt/issues/34 )

While reasonable, this behaviour is surprising, as it is neither documented at https://docs.python.org/3/library/configparser.html nor in the docstrings (read and _read) which I read at first.

The stripping of comments is only documented with inline comments

https://github.com/jugmac00/cpython/blob/610a60c601fb4380eee30e15be1cd4dcbdaeec4c/Lib/configparser.py#L1019

and

https://github.com/jugmac00/cpython/blob/610a60c601fb4380eee30e15be1cd4dcbdaeec4c/Lib/configparser.py#L1031

Once I found these comments, I was surprised once again, as in my code the inline comments were not stripped. After some more pdb-ing and reading the source of ConfigParser, I noticed that - while comments have a default value, inline comments do not - and that is why when you read a config file, some comments get removed and others not.

I'd like to work on a pull request to document this behaviour, both in the official documentation and in the docstrings of the read and the _read methods.

----------
messages: 378146
nosy: jugmac00
priority: normal
severity: normal
status: open
title: ConfigParser: stripping of comments should be documented

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41963>
_______________________________________

From report at bugs.python.org  Wed Oct  7 03:23:32 2020
From: report at bugs.python.org (=?utf-8?q?J=C3=BCrgen_Gmach?=)
Date: Wed, 07 Oct 2020 07:23:32 +0000
Subject: [issue41963] ConfigParser: stripping of comments should be documented
In-Reply-To: <1602055269.91.0.0897084304522.issue41963@roundup.psfhosted.org>
Message-ID: <1602055412.74.0.600705580131.issue41963@roundup.psfhosted.org>


J?rgen Gmach <juergen.gmach at googlemail.com> added the comment:

This "while comments have a default value, inline comments do not" should read "while comment prefixes have a default value, inline comment prefixes do not"

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41963>
_______________________________________

From report at bugs.python.org  Wed Oct  7 03:26:28 2020
From: report at bugs.python.org (=?utf-8?q?J=C3=BCrgen_Gmach?=)
Date: Wed, 07 Oct 2020 07:26:28 +0000
Subject: [issue38914] Clarify wording for warning message when checking a
 package
In-Reply-To: <1574761271.03.0.166396347338.issue38914@roundup.psfhosted.org>
Message-ID: <1602055588.92.0.208198525232.issue38914@roundup.psfhosted.org>


J?rgen Gmach <juergen.gmach at googlemail.com> added the comment:

This issue can be closed as the related PR was merged.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38914>
_______________________________________

From report at bugs.python.org  Wed Oct  7 03:34:46 2020
From: report at bugs.python.org (Snidhi Sofpro)
Date: Wed, 07 Oct 2020 07:34:46 +0000
Subject: [issue41964] difflib SequenceMatcher get_matching_blocks returns
 non-matching blocks in some cases
Message-ID: <1602056086.63.0.741821149494.issue41964@roundup.psfhosted.org>


New submission from Snidhi Sofpro <Snidhi.Sofpro at gmail.com>:

---------- Demo case with unexpected results starting from matching block 3 (result of code that follows):

sys.version_info(major=3, minor=6, micro=9, releaselevel='final', serial=0) 

Matches between:
<a id="nhix_Rgstr" href="http://local:56067/register/200930162135700">
<a id="nhix_Rgstr" href="http://local:53813/register/20100517282450281">

Match(a=0, b=0, size=39)
same-> <a id="nhix_Rgstr" href="http://local:5
same=> <a id="nhix_Rgstr" href="http://local:5 

Match(a=43, b=43, size=12)
same-> /register/20
same=> /register/20 

Match(a=59, b=55, size=1)
same-> 1
same=> 0 

Match(a=66, b=56, size=2)
same-> 00
same=> 93 

Match(a=68, b=70, size=2)
same-> ">
same=>  


# ---------- code that results in the above:

def get_mblk(dpiy_Frst, dpiy_Scnd):
    import difflib;
    sqmn_o = difflib.SequenceMatcher(None, dpiy_Frst, dpiy_Scnd);
    mblk_ls = [ block for block in sqmn_o.get_matching_blocks()];
    for mblk in mblk_ls[:-1]: #exclude the last dummy block
        print(mblk);
        mtch_a = dpiy_Frst[mblk.a : mblk.a + mblk.size];
        mtch_b = dpiy_Frst[mblk.b : mblk.b + mblk.size];
        print('same->', mtch_a);
        print('same=>', mtch_b, '\n');
    #endfor
#endef get_mblk

# --- main --

s1='<a id="nhix_Rgstr" href="http://local:56067/register/200930162135700">'
s2='<a id="nhix_Rgstr" href="http://local:53813/register/20100517282450281">'

import sys; print(sys.version_info, '\n');
print("Matches between:"); print(s1); print(s2); print('\n');
get_mblk(s1, s2);

----------
messages: 378149
nosy: Snidhi
priority: normal
severity: normal
status: open
title: difflib SequenceMatcher get_matching_blocks returns non-matching blocks in some cases
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41964>
_______________________________________

From report at bugs.python.org  Wed Oct  7 04:27:35 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 07 Oct 2020 08:27:35 +0000
Subject: [issue41964] difflib SequenceMatcher get_matching_blocks returns
 non-matching blocks in some cases
In-Reply-To: <1602056086.63.0.741821149494.issue41964@roundup.psfhosted.org>
Message-ID: <1602059255.49.0.424063349965.issue41964@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41964>
_______________________________________

From report at bugs.python.org  Wed Oct  7 04:39:18 2020
From: report at bugs.python.org (Alexander Todorov)
Date: Wed, 07 Oct 2020 08:39:18 +0000
Subject: [issue41965] distutils.spawn.find_executable() fails to find .py
 files on Windows
Message-ID: <1602059958.37.0.118353319302.issue41965@roundup.psfhosted.org>


New submission from Alexander Todorov <atodorov at otb.bg>:

As part of installing python-bugzilla via pip it searches for `rst2man` or `rst2man.py`, see:
https://github.com/python-bugzilla/python-bugzilla/blob/master/setup.py#L81

on Windows venvs there is venv\Scripts\rst2man.py (no .exe or without suffix) and when you call find_executable('rst2man.py') if doesn't find it.


The trouble is in this code snippet:

```
    _, ext = os.path.splitext(executable)
    if (sys.platform == 'win32') and (ext != '.exe'):
        executable = executable + '.exe'
```

`ext` here is `.py` and the if condition executes its body so the executable to search for becomes `rst2man.py.exe` which doesn't exist.

The extension check has been like that for more than 20 years:
https://github.com/python/cpython/commit/69628b0ad10f89a65902f5b911d1040ed9ae1ca2

but IMO it should be 

```
    if (sys.platform == 'win32') and (ext == ''):
        executable = executable + '.exe'
```

i.e. add `.exe` only if the file we're looking for doesn't already have an extension.


Let me know what you think? I can submit a PR for this.


Related issues:

- https://bugs.python.org/issue2200

- https://bugs.python.org/issue39260

----------
components: Distutils
messages: 378150
nosy: Alexander.Todorov, dstufft, eric.araujo
priority: normal
severity: normal
status: open
title: distutils.spawn.find_executable() fails to find .py files on Windows
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41965>
_______________________________________

From report at bugs.python.org  Wed Oct  7 04:41:22 2020
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 07 Oct 2020 08:41:22 +0000
Subject: [issue27827] pathlib is_reserved fails for some reserved paths on
 Windows
In-Reply-To: <1471858428.08.0.847859442583.issue27827@psf.upfronthosting.co.za>
Message-ID: <1602060082.42.0.0750890327777.issue27827@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

See also bpo-36534 "tarfile: handling Windows (path) illegal characters in archive member names".

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27827>
_______________________________________

From report at bugs.python.org  Wed Oct  7 04:41:58 2020
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 07 Oct 2020 08:41:58 +0000
Subject: [issue36534] tarfile: handling Windows (path) illegal characters in
 archive member names
In-Reply-To: <1554458671.74.0.11308540457.issue36534@roundup.psfhosted.org>
Message-ID: <1602060118.76.0.821231482096.issue36534@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> IIRC there's already an open issue for that.

Ah, I found bpo-27827 "pathlib is_reserved fails for some reserved paths on Windows", open since 2016 (by you ;-)).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36534>
_______________________________________

From report at bugs.python.org  Wed Oct  7 04:43:49 2020
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 07 Oct 2020 08:43:49 +0000
Subject: [issue27827] pathlib is_reserved fails for some reserved paths on
 Windows
In-Reply-To: <1471858428.08.0.847859442583.issue27827@psf.upfronthosting.co.za>
Message-ID: <1602060229.44.0.295463733839.issue27827@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

See also bpo-37517 "Improve error messages for Windows reserved file names".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27827>
_______________________________________

From report at bugs.python.org  Wed Oct  7 05:33:38 2020
From: report at bugs.python.org (Cristi Fati)
Date: Wed, 07 Oct 2020 09:33:38 +0000
Subject: [issue36534] tarfile: handling Windows (path) illegal characters in
 archive member names
In-Reply-To: <1554458671.74.0.11308540457.issue36534@roundup.psfhosted.org>
Message-ID: <1602063218.21.0.381690972777.issue36534@roundup.psfhosted.org>


Cristi Fati <cristifati0 at gmail.com> added the comment:

As I see things now, there are multiple things (not necessarily related to this issue) to deal with:

1. Update *tarfile* and add *\_sanitize\_windows\_name* (name can change), that uses *pathlib.\_WindowsFlavour.reserved\_names* (or some public wrapper), and also handles control chars (pointed out by @eriksun), so that it covers as many cases as possible (I'd say all, but there's almost always one that gets away)

2. Fix *pathlib.\_WindowsFlavour.reserved\_names*

3. Apply the fix to *zipfile* as well

4. (optional) extract the sanitizing function into a common module (could be *pathlib*?) to avoid duplicates

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36534>
_______________________________________

From report at bugs.python.org  Wed Oct  7 06:08:31 2020
From: report at bugs.python.org (Dean)
Date: Wed, 07 Oct 2020 10:08:31 +0000
Subject: [issue41966] datetime.time issue with pickling in PyPy
Message-ID: <1602065311.95.0.279586156365.issue41966@roundup.psfhosted.org>


New submission from Dean <scaram at gmail.com>:

I've run into an issue pickling a datetime.time subclass in PyPy3. I believe it arises because PyPy uses the pure Python implementation of time and time.__reduce_ex__() returns (time, ...) on this line (https://github.com/python/cpython/blob/044a1048ca93d466965afc027b91a5a9eb9ce23c/Lib/datetime.py#L1551) rather than (self.__class__, ...) as it does for datetime.datetime (and in datetime.date.__reduce__()). So when pickle creates the dump it uses the time class rather than my subclass.

----------
components: Library (Lib)
messages: 378155
nosy: belopolsky, ddddaaaa, p-ganssle
priority: normal
severity: normal
status: open
title: datetime.time issue with pickling in PyPy
type: behavior
versions: Python 3.10, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41966>
_______________________________________

From report at bugs.python.org  Wed Oct  7 07:00:44 2020
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 07 Oct 2020 11:00:44 +0000
Subject: [issue41965] distutils.spawn.find_executable() fails to find .py
 files on Windows
In-Reply-To: <1602059958.37.0.118353319302.issue41965@roundup.psfhosted.org>
Message-ID: <1602068444.2.0.404197988823.issue41965@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

The linked code runs subprocess.check_output([rstbin, path]), which won't work with "rst2man.py" in Windows. Reliably running a .py script in Windows requires running it explicitly via py[w].exe or python[w].exe, or via sys.executable from an existing Python process. 

subprocess.Popen calls WinAPI CreateProcessW, which supports PE executables, and also CMD/BAT scripts via %ComSpec%. With shell=True the command is run via `cmd.exe /c`, which tries ShellExecuteExW in order to execute the file using the filetype's default registered action. However, the default action for .py files isn't dependable. It's often configured to open the script in an editor or IDE.

Thus script entrypoints in Windows get installed as wrapped launchers, e.g. "script.exe" instead of "script.py". The launcher executes the embedded entrypoint script via the fully-qualified path of python.exe.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41965>
_______________________________________

From report at bugs.python.org  Wed Oct  7 06:53:40 2020
From: report at bugs.python.org (Roundup Robot)
Date: Wed, 07 Oct 2020 10:53:40 +0000
Subject: [issue32592] Drop support of Windows Vista and 7 in Python 3.9
In-Reply-To: <1516268238.05.0.467229070634.issue32592@psf.upfronthosting.co.za>
Message-ID: <1602068020.27.0.825381374115.issue32592@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
nosy: +python-dev
nosy_count: 10.0 -> 11.0
pull_requests: +21578
pull_request: https://github.com/python/cpython/pull/22586

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32592>
_______________________________________

From report at bugs.python.org  Wed Oct  7 07:14:55 2020
From: report at bugs.python.org (Alexander Todorov)
Date: Wed, 07 Oct 2020 11:14:55 +0000
Subject: [issue41965] distutils.spawn.find_executable() fails to find .py
 files on Windows
In-Reply-To: <1602059958.37.0.118353319302.issue41965@roundup.psfhosted.org>
Message-ID: <1602069295.93.0.510446382997.issue41965@roundup.psfhosted.org>


Alexander Todorov <atodorov at otb.bg> added the comment:

@Eryk Sun,
you are of course correct but still don't we need to handle this in Python? 

- find_executable() will search for rst2man.py.exe which doesn't exist so no good for the user
- there is also no rst2man.exe which is probably an issue with how docutils distributes this script - e.g. it doesn't distribute the wrapper .exe file
- lastly the caller (in my case python-bugzilla) will try to execute rst2man.py which will probably fail but at least they would see another failure and are more likely to change their own code base

The trouble for me here is that find_executable() will generally not find anything that doesn't have .exe suffix on Windows. This is independent of how the resulting file would be consumed later.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41965>
_______________________________________

From report at bugs.python.org  Wed Oct  7 08:13:41 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 12:13:41 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
Message-ID: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

For Python 3.10 now that annotations are always returned as strings, we can drop all the unparse logic by obtaining the string in the parser directly (after checking that the annotation is a valid expression).

----------
messages: 378158
nosy: pablogsal
priority: normal
severity: normal
status: open
title: Handle annotations in the parser to avoid the need for roundtrip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 08:14:33 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 12:14:33 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602072873.45.0.755440888816.issue41967@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +21579
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22587

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 08:18:00 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 12:18:00 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602073080.36.0.696129779655.issue41967@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 08:15:32 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 12:15:32 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602072932.03.0.167922675756.issue41967@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I have attached a draft PR for this:

https://github.com/python/cpython/pull/22587

I think this may be a considerable win as the diff is +66 ?1,013

----------
nosy: +gvanrossum, lukasz.langa, lys.nikolaou
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 09:12:06 2020
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 07 Oct 2020 13:12:06 +0000
Subject: [issue41965] distutils.spawn.find_executable() fails to find .py
 files on Windows
In-Reply-To: <1602059958.37.0.118353319302.issue41965@roundup.psfhosted.org>
Message-ID: <1602076326.63.0.427679303173.issue41965@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

The existing behavior of find_executable() is unusual compared to a native Windows file search via CreateProcessW or SearchPathW, for which a default ".exe" extension is appended only if the executable name doesn't already have an extension. (CreateProcessW supports searching for a file that has no extension by adding a trailing dot to the name, which in Windows is equivalent to the name without the trailing dot.) 

However, I don't think it's prudent to change the default behavior of this old code, especially since there are plans to deprecate distutils per PEP 632. It's recommended to migrate existing code to use shutil.which() and subprocess.run(). 

There are open issues to improve the behavior of shutil.which() in Windows. For example, currently it's limited to PATHEXT extensions, which is a generalization of how find_executable() works with ".exe". shutil.which() won't find "rst2man.py" if ".PY" isn't in PATHEXT. The proper behavior, if the CMD shell is the standard of correctness, is to include the exact name as the first candidate to check before trying the name plus the PATHEXT extensions. To be more like the CMD shell, a name without an extension should be excluded, but effectively included anyway if PATHEXT contains a "." entry.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41965>
_______________________________________

From report at bugs.python.org  Wed Oct  7 09:54:09 2020
From: report at bugs.python.org (Velson Horie)
Date: Wed, 07 Oct 2020 13:54:09 +0000
Subject: [issue41968] 3.9 IDLE documentation.
Message-ID: <1602078849.36.0.609804596157.issue41968@roundup.psfhosted.org>


New submission from Velson Horie <c.v.horie at gmail.com>:

https://docs.python.org/3/library/idle.html
I am trying to sort out why a new installation of 3.9 onto Win10 64bit fails to associate a .py file type with IDLE. {hint - there is no idle.exe. installed - Why?}. 2.7, 3.6 and 3.8 worked fine.
The documentation gives no indication of the source format of "IDLE", where it might be found, what it calls etc - only how it is used.
Some indication/link to the underlying software structure should be included in the documentation.
PS thank you for all the other work involved.

----------
assignee: docs at python
components: Documentation
messages: 378161
nosy: c.v.horie, docs at python
priority: normal
severity: normal
status: open
title: 3.9 IDLE documentation.
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41968>
_______________________________________

From report at bugs.python.org  Wed Oct  7 10:13:23 2020
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 07 Oct 2020 14:13:23 +0000
Subject: [issue36534] tarfile: handling Windows (path) illegal characters in
 archive member names
In-Reply-To: <1554458671.74.0.11308540457.issue36534@roundup.psfhosted.org>
Message-ID: <1602080003.07.0.0866067836822.issue36534@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> extract the sanitizing function into a common module 
> (could be *pathlib*?) to avoid duplicates

I would prefer something common, cross-platform, and function-based such as os.path.isreservedname and os.path.sanitizename. In posixpath, it would just have to reserve and sanitize slash [/] and null [\0]. The real work would be in ntpath.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36534>
_______________________________________

From report at bugs.python.org  Wed Oct  7 10:44:02 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 07 Oct 2020 14:44:02 +0000
Subject: [issue41968] 3.9 IDLE documentation.
In-Reply-To: <1602078849.36.0.609804596157.issue41968@roundup.psfhosted.org>
Message-ID: <1602081842.54.0.956028280991.issue41968@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
components: +IDLE
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41968>
_______________________________________

From report at bugs.python.org  Wed Oct  7 10:44:36 2020
From: report at bugs.python.org (Steve Dower)
Date: Wed, 07 Oct 2020 14:44:36 +0000
Subject: [issue41961] Windows install failure "could not set file security"
In-Reply-To: <1602027124.24.0.555629849122.issue41961@roundup.psfhosted.org>
Message-ID: <1602081876.64.0.468512445942.issue41961@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> I was able to reproduce the error dialog by changing the owner of the "Installer" folder to the current user and removing the two DACL entries that grant access to Administrators and SYSTEM.

Yeah, I'd assumed the most likely cause was the ACLs having been reset on the machine in question, though I'd expect that to cause most installs to fail. It might be that Python is the first/only MSI that the user has tried though?

It sounds like just resetting the owner isn't enough on its own, but the inherited ACLs should include SYSTEM and not prevent it from working. So I wonder if something else is at play?

Also, did your change reproduce the "Error: 0"? Or did you get an actual error code?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41961>
_______________________________________

From report at bugs.python.org  Wed Oct  7 11:03:41 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 15:03:41 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602083021.6.0.136657564681.issue41967@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

After investigating with BTaskaya, seems that we cannot use the literal string from the tokenizer for multi-line annotations. But we could use the tokens (losing the literal whitespace), which honestly is less exciting because we will lose the literal formatting.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 11:16:54 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 15:16:54 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602083814.52.0.490650819712.issue41967@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

On the other hand, multi-line annotations are rare enough we could consider falling back to token reconstruction then (the produced string will miss all whitespace in that case).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 11:21:21 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Wed, 07 Oct 2020 15:21:21 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602084081.94.0.102787433573.issue41967@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

After scanning 1552 annotated assignments in over 25k python modules (from most populer packages in PyPI) there are only 6 AnnAssign nodes where the annotations are multiline. For 516389 annotated arguments, only 20 of them are multiline annotations.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 11:41:43 2020
From: report at bugs.python.org (Tim Peters)
Date: Wed, 07 Oct 2020 15:41:43 +0000
Subject: [issue41964] difflib SequenceMatcher get_matching_blocks returns
 non-matching blocks in some cases
In-Reply-To: <1602056086.63.0.741821149494.issue41964@roundup.psfhosted.org>
Message-ID: <1602085303.5.0.586144243678.issue41964@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

I believe your testing code is in error, perhaps because it's so overly elaborate you've lost track of what it's doing.  Here's a straightforward test program:

    import difflib
    s1='<a id="nhix_Rgstr" href="http://local:56067/register/200930162135700">'
    s2='<a id="nhix_Rgstr" href="http://local:53813/register/20100517282450281">'
    d = difflib.SequenceMatcher(None, s1, s2)
    for m in d.get_matching_blocks():
        print(m, repr(s1[m.a : m.a + m.size]),
                 repr(s2[m.b : m.b + m.size]))

and its output under 3.9.0:

    Match(a=0, b=0, size=39) '<a id="nhix_Rgstr" href="http://local:5' '<a id="nhix_Rgstr" href="http://local:5'
    Match(a=43, b=43, size=12) '/register/20' '/register/20'
    Match(a=59, b=55, size=1) '1' '1'
    Match(a=66, b=56, size=2) '00' '00'
    Match(a=68, b=70, size=2) '">' '">'
    Match(a=70, b=72, size=0) '' ''

Your test program is obtaining the substrings to display from these two lines:

        mtch_a = dpiy_Frst[mblk.a : mblk.a + mblk.size];
        mtch_b = dpiy_Frst[mblk.b : mblk.b + mblk.size];

But BOTH of those are extracting substrings from `dply_Frst`. Looks like you intended to use the `dply_Scnd` argument in the second line instead.

If I change my test program to use `s1` for both substrings, then it matches the output you gave. But that doesn't make sense ;-)

So I'm closing this as not-a-bug. If I missed something relevant, feel free to re-open it.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41964>
_______________________________________

From report at bugs.python.org  Wed Oct  7 12:03:31 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Wed, 07 Oct 2020 16:03:31 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602086611.02.0.060249311632.issue41967@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

s/For 516389 annotated arguments/For 516389 arguments/.

Example usages;
https://search.tree.science/?query=AnnAssign(annotation%20=%20expr(lineno%20=%20not%20~end_lineno))

https://search.tree.science/?query=arg(annotation=expr(lineno%20=%20not%20~end_lineno))

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 12:23:43 2020
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 07 Oct 2020 16:23:43 +0000
Subject: [issue41961] Windows install failure "could not set file security"
In-Reply-To: <1602027124.24.0.555629849122.issue41961@roundup.psfhosted.org>
Message-ID: <1602087823.44.0.456543985113.issue41961@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> It might be that Python is the first/only MSI that the user 
> has tried though?

It's likely the first per-user MSI install attempted since the security of the "Installer" directory was modified. There's no problem with a per-machine install.

> did your change reproduce the "Error: 0"? 

It's the same "Could not set file security for file... Error: 0" dialog, which is created by the python-3.9.0.exe child process that executes from a copy in %TEMP%. 

In Process Monitor, I see the actual access-denied error due to the installer service trying to open the directory with WRITE_DAC and WRITE_OWNER access.

If I also remove the Everyone group that grants read and execute access, the installer service fails at an earlier step, which results in an 0x80070643 fatal installation error.

> It sounds like just resetting the owner isn't enough on its own, 
> but the inherited ACLs should include SYSTEM and not prevent it 
> from working. 

The security descriptor that the installer service sets prevents inheritance of discretionary access control entries (i.e. the DACL is protected):

    >>> sd = GetFileSecurity('Installer', DACL_SECURITY_INFORMATION)
    >>> sd.GetSecurityDescriptorControl()[0] & SE_DACL_PROTECTED
    4096

Thus the entries in the ACL for SYSTEM and Administrators groups are set explicitly instead of inherited from the parent directory. If something else rewrites the security on the directory, it can just as easily protect the DACL from inheritance.

In my first experiment, I had left the entry for Everyone (WD) in the DACL, but, as mentioned above, it turns out that it's required at an earlier step. So a fix has to also add it back:

    >icacls "%APPDATA%\Microsoft\Installer" /grant:r *WD:(OI)(CI)(RX)

Also, in my first message, I manually re-added the SYSTEM and Administrators entries unnecessarily -- though it doesn't hurt to do so. It turns out that all the service needs is for the directory's owner to be set back to the Administrators group. Then it implicitly has WRITE_DAC access. It gets WRITE_OWNER access as well, even though the file security at the time doesn't grant it (the owner of an object does not implicitly have WRITE_OWNER access to it), so presumably the service is temporarily enabling SeTakeOwnershipPrivilege for the process or thread.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41961>
_______________________________________

From report at bugs.python.org  Wed Oct  7 12:57:17 2020
From: report at bugs.python.org (Kevin)
Date: Wed, 07 Oct 2020 16:57:17 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602089837.67.0.328545635057.issue41894@roundup.psfhosted.org>


Kevin <kadler at us.ibm.com> added the comment:

Glad you were able to reproduce on Linux.

I have since changed the PR to use PyUnicode_DecodeFSDefault based on review feedback. I was going to say that you will have to fight it out with @methane on GH, but I see that that's you. :D Would have been nice if you would have left the updated feedback there as well so people who aren't familiar would know it's one person adjusting their recommendation vs two different people with conflicting recommendations.


The only issue I see with using backslashreplace is that users of non-UTF-8 locales would see message text that contains non-ASCII characters only as escape codes. eg, the message above would show "Il modulo dipendente libbz2.so non \xe8 stato caricato." instead of "Il modulo dipendente libbz2.so non ? stato caricato." By using PyUnicode_DecodeFSDefault instead, the message should be properly decoded but any encoding errors (such as utf-8 paths, etc) would be handled by surrogateescape.

I guess the question comes to: what's more important to be decoded, the message text or the path?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Wed Oct  7 13:02:37 2020
From: report at bugs.python.org (Athanasius)
Date: Wed, 07 Oct 2020 17:02:37 +0000
Subject: [issue41969] ttk.RadioButtons mis-sized under Windows 10 UI Scaling, 
 with dpiAware set true
Message-ID: <1602090157.47.0.836989772149.issue41969@roundup.psfhosted.org>


New submission from Athanasius <github at miggy.org>:

Having recently looked into UI Scaling for an application I help develop I became aware with an issue involving tkinter.ttk.RadioButton and Windows UI Scaling.

When you have some UI Scaling set along with dpiAware set true you might find that radio buttons are mis-rendered. The usual manifestation of this is that the last button will be properly sized initially, with the others being undersized. If you even only mouse-over the 'correct' radio button it will then become undersized as well.

For more detail see: https://github.com/Athanasius/tk-radio-buttons

NB: This *has* been fixed upstream in the Tcl/Tk source, but I see they've not made a new release since 8.6.10 in November 2019.  Thus this issue is more in the way of a heads up about a bug others might encounter, and will have to wait for newer Tcl/Tk in some version of Python for it to be fixed.

See https://core.tcl-lang.org/tk/info/3c6660b6f0bed337 for the issue and fix.

----------
components: Tkinter
messages: 378171
nosy: Athanasius
priority: normal
severity: normal
status: open
title: ttk.RadioButtons mis-sized under Windows 10 UI Scaling, with dpiAware set true
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41969>
_______________________________________

From report at bugs.python.org  Wed Oct  7 13:14:49 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 07 Oct 2020 17:14:49 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602090889.64.0.321402528954.issue41967@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

What's the issue exactly with multi-line annotations? Is it that they can't be parsed by eval()? Could that be fixed by replacing comments and newlines with spaces? (Either in the parser or in get_type_hints() -- actually ForwardRef._evaluate(), which calls eval().)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 13:19:45 2020
From: report at bugs.python.org (E. Paine)
Date: Wed, 07 Oct 2020 17:19:45 +0000
Subject: [issue41968] 3.9 IDLE documentation.
In-Reply-To: <1602078849.36.0.609804596157.issue41968@roundup.psfhosted.org>
Message-ID: <1602091185.2.0.62279861013.issue41968@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

I am not touching the issue nosy and components for now but suspect this is a Windows installation issue. As you said, there is no `idle.exe` file and instead file association is done through a `idle.bat` file found at Lib/idlelib/idle.bat. I have a few of questions that I would appreciate if you could answer to give some more context:
 - What behaviour is incorrect? Is it that double clicking doesn't launch python.exe or there is no "edit with IDLE" entry in the right-click menu?
 - Did you install it for different users compared to the other versions (all users / admin vs. just for this user)
 - Do you have any other Python versions installed simultaneously with 3.9?

I agree it may be nice to give a brief overview on IDLE's "behind-the-scenes" though I am slightly confused why you raised this issue as a documentation issue.

----------
nosy: +epaine

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41968>
_______________________________________

From report at bugs.python.org  Wed Oct  7 14:39:20 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 18:39:20 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602095960.21.0.344241360429.issue41967@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> What's the issue exactly with multi-line annotations? 

The issue is that for grabbing the source, we are inspecting the tokenize buffer and using the information in the expr node of the annotation to know what we need to pick from it.

In multi-line annotations, the tokenize buffer does not contain the whole source, it just contains the last line.

To make it work, we would need to grab the individual tokens (because the tokenizer has all of them) and append them together to form the expression, but in this process we lose the non-significant whitespace.

---

Regarding loosing the whitespace for multi-line strings (or all string if we want to be consistent): the more I think about it the more I think is not that bad. This means that the string that the parser will place in the annotation field (and therefore the one that ends in __annotations__) will not have spaces, but the ast will be able to parse it without any problems. It will just look a bit crumbled, but that field is supposed to be used by tools, not humans, so I don't think is a huge problem.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 15:36:02 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 07 Oct 2020 19:36:02 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602099362.15.0.585586852403.issue41967@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Hm, this buffer thing is not what I had expected. I think it's a show-stopper -- if we don't reproduce spaces exactly.

Maybe we should just buffer the entire input always?

A way to handle multi-line annotations would be to surround them with parentheses? That way get_type_hints() doesn't need to change. Alternatively, strip comments and newlines in get_type_hints().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 15:42:28 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Wed, 07 Oct 2020 19:42:28 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602099748.05.0.299700437279.issue41967@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

It is not actually much of a difference;
 $ cat t.py
def func(
    arg: typing.Callable[
        [int, str],
        str # test
    ]
):
    pass

import typing
print("Annotations: ", func.__annotations__)
print("get_type_hints: ", typing.get_type_hints(func))
$ ./python t.py
Annotations:  {'arg': 'typing.Callable[[int,str],str]'}
get_type_hints:  {'arg': typing.Callable[[int, str], str]}

$ ./python
>>> foo: (List[List[List[int, str, bytes]], List[(int, str)]])
>>> __annotations__
{'foo': 'List[List[List[int,str,bytes]],List[(int,str)]]'}

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 16:41:38 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 20:41:38 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602103298.29.0.212903721617.issue41967@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Hm, this buffer thing is not what I had expected. I think it's a show-stopper -- if we don't reproduce spaces exactly.

Hummm, I think I may have not clarified this in my previous messages: the space issue is an aesthetic one. The AST generated with and without spaces is the same. As far as I understand get_type_hints() will give the same result in all cases being considered.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 16:51:18 2020
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 07 Oct 2020 20:51:18 +0000
Subject: [issue39934] Fatal Python error "XXX block stack overflow" when
 exception stacks >10
In-Reply-To: <1583933092.46.0.675431384436.issue39934@roundup.psfhosted.org>
Message-ID: <1602103878.6.0.15353500752.issue39934@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

After studying Mark's patch and the rest of the code, I understand the for loop oddity.

The else block of the for loop comes after the 
compiler_pop_fblock(c, FOR_LOOP, start);

So you can do this all day and it won't complain:

for x in '1': pass
else:
 for x in '2': pass
 else:
  for x in '3': pass
  else:
   for x in '4': pass
   else:
    for x in '5': pass
    else:
     for x in '6': pass
     else:
      for x in '7': pass
      else:
       for x in '8': pass
       else:
        for x in '9': pass
        else:
         for x in '10': pass
         else:
          for x in '11': pass
          else:
           for x in '12': pass
           else:
            for x in '13': pass
            else:
             for x in '14': pass
             else:
              for x in '15': pass
              else:
               for x in '16': pass
               else:
                for x in '17': pass
                else:
                 for x in '18': pass
                 else:
                  for x in '19': pass
                  else:
                   for x in '20': pass
                   else:
                    for x in '21': pass
                    else:
                     for x in '22': pass
                     else:
                      for x in '23': pass
                      else:
                       for x in '24': pass
                       else:
                        for x in '25': pass
                        else:
                         for x in '26': pass
                         else:
                          for x in '27': pass
                          else:
                           for x in '28': pass
                           else:
                            for x in '29': pass



I guess the same goes for while loops, and the else of a try-except.


Since If blocks were deliberately left out of this game, I'm assuming that this "static nesting" is actually number of frames, rather than true static nesting. If that is the case then there is no issue here and we can close this ticket.

But if this is something to be fixed, then I am happy to make a patch along the lines of Mark's (which I partially already have).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39934>
_______________________________________

From report at bugs.python.org  Wed Oct  7 16:57:25 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 07 Oct 2020 20:57:25 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602103298.29.0.212903721617.issue41967@roundup.psfhosted.org>
Message-ID: <CAP7+vJJj6QFjGTJ2MXj0fMU2XZWs9t94Ew5mgMOxUmhtDTau6Q@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

I know the final result is the same (i.e. the AST is identical and the
string differs only in the use of whitespace). I just wonder why bother
changing this unless we reproduce the spaces in the string exactly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 17:16:10 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 21:16:10 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602105370.94.0.290301572003.issue41967@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

>  I just wonder why bother
changing this unless we reproduce the spaces in the string exactly.

Maintenance reasons: it removes over 1000 lines of hand written code. Additionally, makes the compiler a bit faster because it does not need to transform the AST into a string.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 17:23:28 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 07 Oct 2020 21:23:28 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602105370.94.0.290301572003.issue41967@roundup.psfhosted.org>
Message-ID: <CAP7+vJ+POxG+AA1VGLgB0Kbi1QnoGLWsaCLWRPKf90UKXDNTgQ@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

Okay, but doesn't *any* way of handling multi-line annotations spoil the
wins? We cannot declare those illegal. (Though we can switch to a different
way of representing those.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 17:33:38 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 21:33:38 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602106418.6.0.258105565245.issue41967@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> We cannot declare those illegal.

They won't be illegal, is just that the string generated for multi line annotations will be a bit uglier because it won't have spaces between characters.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 17:37:17 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 07 Oct 2020 21:37:17 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602106637.43.0.0854021100354.issue41967@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

> the string generated for multi line annotations [...] won't have spaces between characters.

Okay, though aren't there cases where spaces are necessary? E.g. between names or between a name or keyword and a string or number.

Assuming this will only happen when the annotation spans multiple lines, right?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 17:42:32 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 21:42:32 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602106952.89.0.886520243897.issue41967@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Okay, though aren't there cases where spaces are necessary? E.g. between names or between a name or keyword and a string or number.

Yeah, we are trying to modify the patch to automatically add spaces between keywords and other tokens.

> Assuming this will only happen when the annotation spans multiple lines, right?

Yeah, for annotations in a single line we can just grab the string from the code as it is.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 17:44:49 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 07 Oct 2020 21:44:49 +0000
Subject: [issue41923] Add PEP 613 typing.TypeAlias to the standard library
In-Reply-To: <1601741790.03.0.822782590759.issue41923@roundup.psfhosted.org>
Message-ID: <1602107089.13.0.679292719903.issue41923@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 4f3c25043d651a13c41cffcee703f7d5cb677cc7 by Mikhail Golubev in branch 'master':
bpo-41923: PEP 613: Add TypeAlias to typing module (#22532)
https://github.com/python/cpython/commit/4f3c25043d651a13c41cffcee703f7d5cb677cc7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41923>
_______________________________________

From report at bugs.python.org  Wed Oct  7 17:50:50 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 21:50:50 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602107450.54.0.574583762722.issue41967@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Yeah, we are trying to modify the patch to automatically add spaces between keywords and other tokens.

Once we can see how this looks, we could think if is worth the effort or is better to abandon the idea. One could also argue that having multi-line annotations produce some uglier strings is inconsistent enough to drop this, but I think is easier to consider once we have a fully working version.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 18:16:17 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Wed, 07 Oct 2020 22:16:17 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1602108977.38.0.0174259205932.issue7946@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

It's a known issue and has been outlined very well and still comes up from time to time in real world applications, which tend to see this issue and Dave's presentation and just work around it in any way possible for their system and move on with life.

Keeping it open even if nobody is actively working on it makes sense to me as it is still a known issue that could be resolved should someone have the motivation to complete the work.

----------
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Wed Oct  7 18:17:38 2020
From: report at bugs.python.org (Steve Dower)
Date: Wed, 07 Oct 2020 22:17:38 +0000
Subject: [issue41965] distutils.spawn.find_executable() fails to find .py
 files on Windows
In-Reply-To: <1602059958.37.0.118353319302.issue41965@roundup.psfhosted.org>
Message-ID: <1602109058.68.0.731672306669.issue41965@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Yep, unless this directly impacts normal distutils usage, it's not going to be fixed (regardless of the formal deprecation proposal, we already have a policy of minimizing changes to distutils).

You could submit a patch to Bugzilla to switch them to shutil.which.

----------
nosy: +steve.dower
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41965>
_______________________________________

From report at bugs.python.org  Wed Oct  7 18:20:19 2020
From: report at bugs.python.org (Steve Dower)
Date: Wed, 07 Oct 2020 22:20:19 +0000
Subject: [issue41952] sys.version has double space between month and date
In-Reply-To: <1601973954.75.0.975478254014.issue41952@roundup.psfhosted.org>
Message-ID: <1602109219.77.0.969722084406.issue41952@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41952>
_______________________________________

From report at bugs.python.org  Wed Oct  7 18:25:16 2020
From: report at bugs.python.org (Steve Dower)
Date: Wed, 07 Oct 2020 22:25:16 +0000
Subject: [issue41917] Python 3.9rc2 fails to install matplotlib
In-Reply-To: <1601711365.63.0.761607861812.issue41917@roundup.psfhosted.org>
Message-ID: <1602109516.29.0.834342705823.issue41917@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41917>
_______________________________________

From report at bugs.python.org  Wed Oct  7 18:26:35 2020
From: report at bugs.python.org (Steve Dower)
Date: Wed, 07 Oct 2020 22:26:35 +0000
Subject: [issue28343] Bad encoding alias cp936 -> gbk: euro sign
In-Reply-To: <1475464291.36.0.0934021228231.issue28343@psf.upfronthosting.co.za>
Message-ID: <1602109595.85.0.300160949262.issue28343@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
versions: +Python 3.10 -Python 2.7, Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28343>
_______________________________________

From report at bugs.python.org  Wed Oct  7 18:28:42 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 07 Oct 2020 22:28:42 +0000
Subject: [issue41923] Add PEP 613 typing.TypeAlias to the standard library
In-Reply-To: <1601741790.03.0.822782590759.issue41923@roundup.psfhosted.org>
Message-ID: <1602109722.73.0.331546004422.issue41923@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41923>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:05:58 2020
From: report at bugs.python.org (Felix Yan)
Date: Wed, 07 Oct 2020 23:05:58 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
Message-ID: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>


New submission from Felix Yan <felixonmars at archlinux.org>:

I am packaging Python for Arch and the tests suite of Python 3.8.6 pass here without this:

```
0:09:06 load avg: 0.87 [205/424] test_lib2to3                                                                                                                                                                                                                                                                         
test test_lib2to3 crashed -- Traceback (most recent call last):                                                                                                                                                                                                                                                       
  File "/build/python/src/Python-3.9.0/Lib/test/libregrtest/runtest.py", line 270, in _runtest_inner                                                                                                                                                                                                                  
    refleak = _runtest_inner2(ns, test_name)                                                                                                                                                                                                                                                                          
  File "/build/python/src/Python-3.9.0/Lib/test/libregrtest/runtest.py", line 221, in _runtest_inner2                                                                                                                                                                                                                 
    the_module = importlib.import_module(abstest)                                                                                                                                                                                                                                                                     
  File "/build/python/src/Python-3.9.0/Lib/importlib/__init__.py", line 127, in import_module                                                                                                                                                                                                                         
    return _bootstrap._gcd_import(name[level:], package, level)                                                                                                                                                                                                                                                       
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import                                                                                                                                                                                                                                                     
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load                                                                                                                                                                                                                                                  
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked                                                                                                                                                                                                                                          
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked                                                                                                                                                                                                                                                   
  File "<frozen importlib._bootstrap_external>", line 790, in exec_module                                                                                                                                                                                                                                             
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed                                                                                                                                                                                                                                        
  File "/build/python/src/Python-3.9.0/Lib/test/test_lib2to3.py", line 5, in <module>                                                                                                                                                                                                                                 
    from lib2to3.tests import load_tests                                                                                                                                                                                                                                                                              
  File "/build/python/src/Python-3.9.0/Lib/contextlib.py", line 124, in __exit__                                                                                                                                                                                                                                      
    next(self.gen)                                                                                                                                                                                                                                                                                                    
  File "/build/python/src/Python-3.9.0/Lib/test/support/__init__.py", line 1171, in _filterwarnings                                                                                                                                                                                                                   
    raise AssertionError("filter (%r, %s) did not catch any warning" %                                                                                                                                                                                                                                                
AssertionError: filter ('', PendingDeprecationWarning) did not catch any warning                                                                                                                                                                                                                                      
                                                                                                                                                                                                                                                                                                                      
0:09:06 load avg: 0.87 [206/424/1] test_linecache -- test_lib2to3 failed    
```

----------
components: Tests
messages: 378190
nosy: felixonmars
priority: normal
severity: normal
status: open
title: test_lib2to3 fails since Python 3.9
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:05:38 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 23:05:38 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602111938.02.0.77752588509.issue41967@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

After some extra testing, we found that is not enough with handling spaces, unfortunately, as things like the walrus need also the parentheses to be preserved. Given that multi-line strings will complicate the code considerably, I am going to drop this for the time being unless we have a good way to solve these problems in a way that does not involve several workarounds.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:07:56 2020
From: report at bugs.python.org (Felix Yan)
Date: Wed, 07 Oct 2020 23:07:56 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
Message-ID: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>


New submission from Felix Yan <felixonmars at archlinux.org>:

I am packaging Python for Arch and the test suite of Python 3.8.6 passes here without these:

======================================================================
FAIL: test_multiple_roots (test.test_tools.test_c_analyzer.test_common.test_files.IterFilesTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/python/src/Python-3.9.0/Lib/test/test_tools/test_c_analyzer/test_common/test_files.py", line 118, in test_multiple_roots
    self.assertEqual(self.calls, [
AssertionError: Lists differ: [('_w[26 chars]tion walk at 0x7ff2eb562f70>)), ('_walk', ('eg[42 chars]0>))] != [('_w[26 chars]tion _walk_tree at 0x7ff2e5babdc0>)), ('_walk'[54 chars]0>))]

First differing element 0:
('_walk', ('spam', '.c', <function walk at 0x7ff2eb562f70>))
('_walk', ('spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>))

- [('_walk', ('spam', '.c', <function walk at 0x7ff2eb562f70>)),
?                                                     ^^^^^

+ [('_walk', ('spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>)),
?                                     +    +++++           + ^^^^

-  ('_walk', ('eggs', '.c', <function walk at 0x7ff2eb562f70>))]
?                                                     ^^^^^

+  ('_walk', ('eggs', '.c', <function _walk_tree at 0x7ff2e5babdc0>))]
?                                     +    +++++           + ^^^^


======================================================================
FAIL: test_multiple_suffixes (test.test_tools.test_c_analyzer.test_common.test_files.IterFilesTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/python/src/Python-3.9.0/Lib/test/test_tools/test_c_analyzer/test_common/test_files.py", line 189, in test_multiple_suffixes
    self.assertEqual(self.calls, [
AssertionError: Lists differ: [('_walk', ('spam', None, <function walk at 0x7ff2eb562f70>))] != [('_walk', ('spam', None, <function _walk_tree at 0x7ff2e5babdc0>))]

First differing element 0:
('_walk', ('spam', None, <function walk at 0x7ff2eb562f70>))
('_walk', ('spam', None, <function _walk_tree at 0x7ff2e5babdc0>))

- [('_walk', ('spam', None, <function walk at 0x7ff2eb562f70>))]
?                                                     ^^^^^

+ [('_walk', ('spam', None, <function _walk_tree at 0x7ff2e5babdc0>))]
?                                     +    +++++           + ^^^^


======================================================================
FAIL: test_no_suffix (test.test_tools.test_c_analyzer.test_common.test_files.IterFilesTests) [None]
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/python/src/Python-3.9.0/Lib/test/test_tools/test_c_analyzer/test_common/test_files.py", line 209, in test_no_suffix
    self.assertEqual(self.calls, [
AssertionError: Lists differ: [('_walk', ('spam', None, <function walk at 0x7ff2eb562f70>))] != [('_walk', ('spam', None, <function _walk_tree at 0x7ff2e5babdc0>))]

First differing element 0:
('_walk', ('spam', None, <function walk at 0x7ff2eb562f70>))
('_walk', ('spam', None, <function _walk_tree at 0x7ff2e5babdc0>))

- [('_walk', ('spam', None, <function walk at 0x7ff2eb562f70>))]
?                                                     ^^^^^

+ [('_walk', ('spam', None, <function _walk_tree at 0x7ff2e5babdc0>))]
?                                     +    +++++           + ^^^^


======================================================================
FAIL: test_no_suffix (test.test_tools.test_c_analyzer.test_common.test_files.IterFilesTests) []
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/python/src/Python-3.9.0/Lib/test/test_tools/test_c_analyzer/test_common/test_files.py", line 209, in test_no_suffix
    self.assertEqual(self.calls, [
AssertionError: Lists differ: [('_walk', ('spam', '', <function walk at 0x7ff2eb562f70>))] != [('_walk', ('spam', '', <function _walk_tree at 0x7ff2e5babdc0>))]

First differing element 0:
('_walk', ('spam', '', <function walk at 0x7ff2eb562f70>))
('_walk', ('spam', '', <function _walk_tree at 0x7ff2e5babdc0>))

- [('_walk', ('spam', '', <function walk at 0x7ff2eb562f70>))]
?                                                   ^^^^^

+ [('_walk', ('spam', '', <function _walk_tree at 0x7ff2e5babdc0>))]
?                                   +    +++++           + ^^^^


======================================================================
FAIL: test_no_suffix (test.test_tools.test_c_analyzer.test_common.test_files.IterFilesTests) [()]
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/python/src/Python-3.9.0/Lib/test/test_tools/test_c_analyzer/test_common/test_files.py", line 209, in test_no_suffix
    self.assertEqual(self.calls, [
AssertionError: Lists differ: [('_walk', ('spam', (), <function walk at 0x7ff2eb562f70>))] != [('_walk', ('spam', (), <function _walk_tree at 0x7ff2e5babdc0>))]

First differing element 0:
('_walk', ('spam', (), <function walk at 0x7ff2eb562f70>))
('_walk', ('spam', (), <function _walk_tree at 0x7ff2e5babdc0>))

- [('_walk', ('spam', (), <function walk at 0x7ff2eb562f70>))]
?                                                   ^^^^^

+ [('_walk', ('spam', (), <function _walk_tree at 0x7ff2e5babdc0>))]
?                                   +    +++++           + ^^^^


======================================================================
FAIL: test_one_root (test.test_tools.test_c_analyzer.test_common.test_files.IterFilesTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/python/src/Python-3.9.0/Lib/test/test_tools/test_c_analyzer/test_common/test_files.py", line 99, in test_one_root
    self.assertEqual(self.calls, [
AssertionError: Lists differ: [('_walk', ('spam', '.c', <function walk at 0x7ff2eb562f70>))] != [('_walk', ('spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>))]

First differing element 0:
('_walk', ('spam', '.c', <function walk at 0x7ff2eb562f70>))
('_walk', ('spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>))

- [('_walk', ('spam', '.c', <function walk at 0x7ff2eb562f70>))]
?                                                     ^^^^^

+ [('_walk', ('spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>))]
?                                     +    +++++           + ^^^^


======================================================================
FAIL: test_one_suffix (test.test_tools.test_c_analyzer.test_common.test_files.IterFilesTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/python/src/Python-3.9.0/Lib/test/test_tools/test_c_analyzer/test_common/test_files.py", line 167, in test_one_suffix
    self.assertEqual(self.calls, [
AssertionError: Lists differ: [('_walk', ('spam', None, <function walk at 0x7ff2eb562f70>))] != [('_walk', ('spam', None, <function _walk_tree at 0x7ff2e5babdc0>))]

First differing element 0:
('_walk', ('spam', None, <function walk at 0x7ff2eb562f70>))
('_walk', ('spam', None, <function _walk_tree at 0x7ff2e5babdc0>))

- [('_walk', ('spam', None, <function walk at 0x7ff2eb562f70>))]
?                                                     ^^^^^

+ [('_walk', ('spam', None, <function _walk_tree at 0x7ff2e5babdc0>))]
?                                     +    +++++           + ^^^^


======================================================================
FAIL: test_relparent (test.test_tools.test_c_analyzer.test_common.test_files.IterFilesTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/python/src/Python-3.9.0/Lib/test/test_tools/test_c_analyzer/test_common/test_files.py", line 228, in test_relparent
    self.assertEqual(self.calls, [
AssertionError: Lists differ: [('_w[33 chars]tion walk at 0x7ff2eb562f70>)), ('_walk', ('/x[49 chars]0>))] != [('_w[33 chars]tion _walk_tree at 0x7ff2e5babdc0>)), ('_walk'[61 chars]0>))]

First differing element 0:
('_walk', ('/x/y/z/spam', '.c', <function walk at 0x7ff2eb562f70>))
('_walk', ('/x/y/z/spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>))

- [('_walk', ('/x/y/z/spam', '.c', <function walk at 0x7ff2eb562f70>)),
?                                                            ^^^^^

+ [('_walk', ('/x/y/z/spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>)),
?                                            +    +++++           + ^^^^

-  ('_walk', ('/x/y/z/eggs', '.c', <function walk at 0x7ff2eb562f70>))]
?                                                            ^^^^^

+  ('_walk', ('/x/y/z/eggs', '.c', <function _walk_tree at 0x7ff2e5babdc0>))]
?                                            +    +++++           + ^^^^


test test_tools failed
======================================================================
FAIL: test_single_root (test.test_tools.test_c_analyzer.test_common.test_files.IterFilesTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/python/src/Python-3.9.0/Lib/test/test_tools/test_c_analyzer/test_common/test_files.py", line 82, in test_single_root
    self.assertEqual(self.calls, [
AssertionError: Lists differ: [('_walk', ('spam', '.c', <function walk at 0x7ff2eb562f70>))] != [('_walk', ('spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>))]

First differing element 0:
('_walk', ('spam', '.c', <function walk at 0x7ff2eb562f70>))
('_walk', ('spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>))

- [('_walk', ('spam', '.c', <function walk at 0x7ff2eb562f70>))]
?                                                     ^^^^^

+ [('_walk', ('spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>))]
?                                     +    +++++           + ^^^^


======================================================================
FAIL: test_single_suffix (test.test_tools.test_c_analyzer.test_common.test_files.IterFilesTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/python/src/Python-3.9.0/Lib/test/test_tools/test_c_analyzer/test_common/test_files.py", line 146, in test_single_suffix
    self.assertEqual(self.calls, [
AssertionError: Lists differ: [('_walk', ('spam', '.c', <function walk at 0x7ff2eb562f70>))] != [('_walk', ('spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>))]

First differing element 0:
('_walk', ('spam', '.c', <function walk at 0x7ff2eb562f70>))
('_walk', ('spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>))

- [('_walk', ('spam', '.c', <function walk at 0x7ff2eb562f70>))]
?                                                     ^^^^^

+ [('_walk', ('spam', '.c', <function _walk_tree at 0x7ff2e5babdc0>))]
?                                     +    +++++           + ^^^^


======================================================================
FAIL: test_typical (test.test_tools.test_c_analyzer.test_common.test_files.IterFilesTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/python/src/Python-3.9.0/Lib/test/test_tools/test_c_analyzer/test_common/test_files.py", line 64, in test_typical
    self.assertEqual(self.calls, [
AssertionError: Lists differ: [('_w[26 chars]tion walk at 0x7ff2eb562f70>)), ('_walk', ('eg[42 chars]0>))] != [('_w[26 chars]tion _walk_tree at 0x7ff2e5babdc0>)), ('_walk'[54 chars]0>))]

First differing element 0:
('_walk', ('spam', None, <function walk at 0x7ff2eb562f70>))
('_walk', ('spam', None, <function _walk_tree at 0x7ff2e5babdc0>))

- [('_walk', ('spam', None, <function walk at 0x7ff2eb562f70>)),
?                                                     ^^^^^

+ [('_walk', ('spam', None, <function _walk_tree at 0x7ff2e5babdc0>)),
?                                     +    +++++           + ^^^^

-  ('_walk', ('eggs', None, <function walk at 0x7ff2eb562f70>))]
?                                                     ^^^^^

+  ('_walk', ('eggs', None, <function _walk_tree at 0x7ff2e5babdc0>))]
?                                     +    +++++           + ^^^^


----------------------------------------------------------------------

Ran 184 tests in 3.357s

FAILED (failures=11, skipped=2, expected failures=14)
0:25:39 load avg: 0.95 [362/424/3] test_trace -- test_tools failed

----------
components: Tests
messages: 378191
nosy: felixonmars
priority: normal
severity: normal
status: open
title: multiple tests in test_tools fail since Python 3.9
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:24:37 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 07 Oct 2020 23:24:37 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1602113077.85.0.0377877236119.issue41557@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:24:40 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 23:24:40 +0000
Subject: [issue39934] Fatal Python error "XXX block stack overflow" when
 exception stacks >10
In-Reply-To: <1583933092.46.0.675431384436.issue39934@roundup.psfhosted.org>
Message-ID: <1602113080.32.0.365332599798.issue39934@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

PR 22395 should be backported to 3.8 and 3.9

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39934>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:28:04 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 07 Oct 2020 23:28:04 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602111938.02.0.77752588509.issue41967@roundup.psfhosted.org>
Message-ID: <CAP7+vJL+7J-uyAnZm2Mcs4AetV5-e8hoSFmRwsOxyvY12otQqw@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

Too bad. :-(

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:29:36 2020
From: report at bugs.python.org (Steve Dower)
Date: Wed, 07 Oct 2020 23:29:36 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1602113376.89.0.20471810907.issue41557@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I got the source repo update, and poked the PR to get it to re-run. If it's all clear, I have no opposition to someone else doing the final merge.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:29:17 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 23:29:17 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
In-Reply-To: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>
Message-ID: <1602113357.97.0.0462284803235.issue41971@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

All our buildbots are running these test without any problem and I cannot reproduce this locally after a fresh install from the binaries in 3.9, so my guess is that there must be something going on on your end.

? ./installed_dir/bin/python3 -m test test_tools
0:00:00 load avg: 6.90 Run tests sequentially
0:00:00 load avg: 6.90 [1/1] test_tools

== Tests result: SUCCESS ==

1 test OK.

Total duration: 40 ms
Tests result: SUCCESS

~/Downloads/Python-3.9.0
? ./python -m test test_tools
0:00:00 load avg: 6.43 Run tests sequentially
0:00:00 load avg: 6.43 [1/1] test_tools

== Tests result: SUCCESS ==

1 test OK.

Total duration: 2.5 sec
Tests result: SUCCESS

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:31:12 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 23:31:12 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602113472.04.0.850932848584.issue41970@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Same thing as in https://bugs.python.org/issue41971. I cannot reproduce this with a fresh install of 3.9 and our buildbots are not complaining about this.

ownloads/Python-3.9.0
? ./python -m test test_lib2to3
0:00:00 load avg: 3.64 Run tests sequentially
0:00:00 load avg: 3.64 [1/1] test_lib2to3

== Tests result: SUCCESS ==

1 test OK.

Total duration: 7.5 sec
Tests result: SUCCESS

-------

? ./lel/bin/python3 -m test test_lib2to3
0:00:00 load avg: 3.87 Run tests sequentially
0:00:00 load avg: 3.87 [1/1] test_lib2to3

== Tests result: SUCCESS ==

1 test OK.

Total duration: 7.4 sec
Tests result: SUCCESS

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:31:59 2020
From: report at bugs.python.org (Kevin Mills)
Date: Wed, 07 Oct 2020 23:31:59 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
Message-ID: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>


New submission from Kevin Mills <kevin.mills226+bugs.python at gmail.com>:

Sorry for the vague title. I'm not sure how to succinctly describe this issue.

The following code:

```
with open("data.bin", "rb") as f:
    data = f.read()

base = 15403807 * b'\xff'
longer = base + b'\xff'

print(data.find(base))
print(data.find(longer))
```

Always hangs on the second call to find.

It might complete eventually, but I've left it running and never seen it do so. Because of the structure of data.bin, it should find the same position as the first call to find.

The first call to find completes and prints near instantly, which makes the pathological performance of the second (which is only searching for one b"\xff" more than the first) even more mystifying.

I attempted to upload the data.bin file I was working with as an attachment here, but it failed multiple times. I assume it's too large for an attachment; it's a 32MiB file consisting only of 00 bytes and FF bytes.

Since I couldn't attach it, I uploaded it to a gist. I hope that's okay.

https://gist.github.com/Zeturic/7d0480a94352968c1fe92aa62e8adeaf

I wasn't able to trigger the pathological runtime behavior with other sequences of bytes, which is why I uploaded it in the first place. For example, if it is randomly generated, it doesn't trigger it.

I've verified that this happens on multiple versions of CPython (as well as PyPy) and on multiple computers / operating systems.

----------
messages: 378197
nosy: Zeturic
priority: normal
severity: normal
status: open
title: bytes.find consistently hangs in a particular scenario
type: performance
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:43:52 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 07 Oct 2020 23:43:52 +0000
Subject: [issue26680] Incorporating float.is_integer into Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1602114232.57.0.349107234092.issue26680@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 4e0ce820586e93cfcefb16c2a3df8eaefc54cbca by Raymond Hettinger in branch 'master':
Revert "bpo-26680: Incorporate is_integer in all built-in and standard library numeric types (GH-6121)" (GH-22584)
https://github.com/python/cpython/commit/4e0ce820586e93cfcefb16c2a3df8eaefc54cbca


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:45:05 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 07 Oct 2020 23:45:05 +0000
Subject: [issue26680] Incorporating float.is_integer into Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1602114305.28.0.469138882783.issue26680@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Applied the reversion and removed the "release blocker" designation.

When a new PR ready, we'll be more expeditious in getting reviewed.

----------
priority: release blocker -> 
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Wed Oct  7 19:46:10 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 07 Oct 2020 23:46:10 +0000
Subject: [issue38914] Clarify wording for warning message when checking a
 package
In-Reply-To: <1574761271.03.0.166396347338.issue38914@roundup.psfhosted.org>
Message-ID: <1602114370.57.0.340193094806.issue38914@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38914>
_______________________________________

From report at bugs.python.org  Wed Oct  7 20:03:02 2020
From: report at bugs.python.org (Dima Tisnek)
Date: Thu, 08 Oct 2020 00:03:02 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1602115382.87.0.553913484312.issue7946@roundup.psfhosted.org>


Dima Tisnek <dimaqq at gmail.com> added the comment:

My 2c as Python user:

Back in 2010, I've used multithreading extensively, both for concurrency and performance. Others used multiprocessing or just shelled out. People talked about using **the other** core, or sometimes the other socket on a server.

Now in 2020, I'm using asyncio exclusively. Some colleagues occasionally still shell out ?. None talking about using all cores on a single machine, rather, we'd spin up dozens of identical containers, which are randomly distributed across N machines, and the synchronisation is offloaded to some database (e.g. atomic ops in redis; transactions in sql).

In my imagination, I see future Python as single-threaded (from user's point of view, that is without multithreading api), that features speculative out-of-order async task execution (using hardware threads, maybe pinned) that's invisible to the user.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Wed Oct  7 20:06:38 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 08 Oct 2020 00:06:38 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602115598.57.0.89874421661.issue41967@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

For what it's worth, here's how f-strings with the "=" feature work:

I remember the char* pointer where the expression starts, then I parse the expression into an AST, then I note the char* pointer where the expression ended. The text between those is what's output before the equal sign []. This is how I preserve all of the whitespace inside the expression.

In my case I keep the AST to use when the expression gets evaluated, but in the string annotation case you'd throw it away. I don't think it would be very complicated to make this approach work across newlines.

[] Actually, I keep the equal sign itself and whitespace to the right of it, which is how f'{ x = }' produces " x = 42", instead of "x=42".

----------
nosy: +eric.smith
resolution: rejected -> 
stage: resolved -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 20:07:11 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 08 Oct 2020 00:07:11 +0000
Subject: [issue41968] 3.9 IDLE documentation.
In-Reply-To: <1602078849.36.0.609804596157.issue41968@roundup.psfhosted.org>
Message-ID: <1602115631.38.0.890313460706.issue41968@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I agree that the doc needs more, but I am closing this as a duplicate of #31329, which is specifically doc about starting IDLE.  You can still answer Paine's questions here if you want.

File association: IDLE is not Python.  It is one of many Python-oriented editors and IDEs.  .py files are and by default should be associated for running with something that runs the file with python.exe.  On Windows, this is done via C:/Windows/py.exe.  The default version for double clicking is determined by a checkmark in the installer.

The Windows installer does associate .py files with IDLE for editing: rt click, edit with IDLE ....

idle.exe is not needed for starting idle.

I don't know what you mean by 'source format'.  IDLE is written in Python.  The directory structure is mostly implementation detail not relevant to using IDLE.  File are described in idlelib/README.txt.  This might be mentioned in the doc.

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Add idlelib module entry to doc
type:  -> enhancement
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41968>
_______________________________________

From report at bugs.python.org  Wed Oct  7 20:07:34 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 08 Oct 2020 00:07:34 +0000
Subject: [issue31329] Add idlelib module entry to doc
In-Reply-To: <1504293847.95.0.524257228924.issue31329@psf.upfronthosting.co.za>
Message-ID: <1602115654.59.0.367419539721.issue31329@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I closed #41968 as a duplicate of this.

----------
nosy:  -louielu

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31329>
_______________________________________

From report at bugs.python.org  Wed Oct  7 20:13:05 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 00:13:05 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602115985.92.0.53661414353.issue41967@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> I remember the char* pointer where the expression starts, then I parse the expression into an AST, then I note the char* pointer where the expression ended. The text between those is what's output before the equal sign []. This is how I preserve all of the whitespace inside the expression.

Unless I am missing something, the problem is that the tokenizer has thrown away the extra newlines so we cannot keep the pointer where the expression starts. Also, I am not sure if this is the same scenario because f-strings cannot contain newlines in the expression brackets, can't they?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 20:15:15 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 08 Oct 2020 00:15:15 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602116115.94.0.00450191528123.issue41970@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I have also seen this and linked issue on running whole test suite while building python myself but running individual tests show no error and buildbots also never complained so I thought it's something wrong with my setup. I introduced the commit to silence deprecation warning due to lib2to3 and cannot reproduce the same running it individually.

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Wed Oct  7 20:16:00 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 08 Oct 2020 00:16:00 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
In-Reply-To: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>
Message-ID: <1602116160.45.0.25231717584.issue41971@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Wed Oct  7 20:17:47 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 00:17:47 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602116267.69.0.927658434435.issue41967@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

For instance, consider this:

x: (
   3 + 
     4
   + 5) = 3

Once the expression in the annotations is parsed, the value of parser->tok->buf is "   +5) = 3" and the tokenizer has thrown away the rest of the lines and the information there. There is no way for us to "grab" the other lines and save them as they are consumed unless we add custom logic into the parser, which is not immediately easy because is auto-generated.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 20:19:06 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 08 Oct 2020 00:19:06 +0000
Subject: [issue41967] Handle annotations in the parser to avoid the need for
 roundtrip
In-Reply-To: <1602072821.53.0.327570129065.issue41967@roundup.psfhosted.org>
Message-ID: <1602116346.6.0.44172169081.issue41967@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

It's true that f-string expressions can't contain newlines.

f-strings are definitely easier, because the tokenizer has already tokenized the string from the input, so I'm just remembering pointers inside the tokenized string.

I was thinking that maybe you could get access to the buffer that the tokenizer is using. I'd have to check to see if it's guaranteed to all be in one contiguous buffer or not.

Anyway, since the problem is at least superficially similar (at least to me!), I thought I'd mention how f-strings handle it. There might not be anything of value here to take away.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41967>
_______________________________________

From report at bugs.python.org  Wed Oct  7 20:24:41 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 00:24:41 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602116681.76.0.189111274152.issue41970@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> I have also seen this and linked issue on running whole test suite while building python myself but running individual tests show no error and buildbots also never complained so I thought it's something wrong with my setup. I introduced the commit to silence deprecation warning due to lib2to3 and cannot reproduce the same running it individually.

What I don't understand then is how the buildbots or the CI in Github that run all tests sequentially with the extra flags (-uall and friends) have not complained yet about this.

@Felix, how consistent is this failure you are experiencing?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Wed Oct  7 23:12:08 2020
From: report at bugs.python.org (Josh Rosenberg)
Date: Thu, 08 Oct 2020 03:12:08 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602126728.99.0.878503777696.issue41972@roundup.psfhosted.org>


Josh Rosenberg <shadowranger+python at gmail.com> added the comment:

Can reproduce on Alpine Linux, with CPython 3.8.2 (running under WSLv2), so it's not just you. CPU usage is high; seems like it must be stuck in an infinite loop.

----------
nosy: +josh.r

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Wed Oct  7 23:14:02 2020
From: report at bugs.python.org (Josh Rosenberg)
Date: Thu, 08 Oct 2020 03:14:02 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602126842.51.0.729915679111.issue41972@roundup.psfhosted.org>


Change by Josh Rosenberg <shadowranger+python at gmail.com>:


----------
type: performance -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Wed Oct  7 23:21:01 2020
From: report at bugs.python.org (Tim Peters)
Date: Thu, 08 Oct 2020 03:21:01 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602127261.85.0.144769274445.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Also reproduced on 64-bit Win10 with just-released 3.9.0.

Note that string search tries to incorporate a number of tricks (pieces of Boyer-Moore, Sunday, etc) to speed searches.  The "skip tables" here are probably computing a 0 by mistake. The file here contains only 2 distinct byte values, and the relatively huge string to search for has only 1, so there's plenty of opportunity for those tricks to get confused ;-)

----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Thu Oct  8 00:52:11 2020
From: report at bugs.python.org (pmp-p)
Date: Thu, 08 Oct 2020 04:52:11 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602132731.52.0.0552557759172.issue41972@roundup.psfhosted.org>


Change by pmp-p <pmpp.pub at gmail.com>:


----------
nosy: +pmpp

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Thu Oct  8 01:09:23 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 08 Oct 2020 05:09:23 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602133763.52.0.288193776657.issue41894@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> I have since changed the PR to use PyUnicode_DecodeFSDefault based on review feedback. I was going to say that you will have to fight it out with @methane on GH, but I see that that's you. :D Would have been nice if you would have left the updated feedback there as well so people who aren't familiar would know it's one person adjusting their recommendation vs two different people with conflicting recommendations.

OK, I changd my b.p.o username.


> The only issue I see with using backslashreplace is that users of non-UTF-8 locales would see message text that contains non-ASCII characters only as escape codes. eg, the message above would show "Il modulo dipendente libbz2.so non \xe8 stato caricato." instead of "Il modulo dipendente libbz2.so non ? stato caricato."

The issue is not caused by backslashreplace, but by UTF-8 instead of locale. I notice it of course, but:

* Using UTF-8 is status quo. UTF-8:backslashreplace is the simplest fix approach.
* There is no guarantee that the error message can be decoded by locale encoding. Backslash escape is much better than "ignore" or "surrogateescape".


> By using PyUnicode_DecodeFSDefault instead, the message should be properly decoded but any encoding errors (such as utf-8 paths, etc) would be handled by surrogateescape.
> 

There is no guranatee that the message is properly decoded with fsencoding.
And surrogateescape is for round-tripping bytes path, not for human readable.
Error message should be human readable. So backslashreplace is better than surrogateescape.

Additionally, non-UTF-8 locale is quite rare on Unix systems, and users of such systems would be able to handle backslash escaped message, because they might see such message often.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Thu Oct  8 02:26:47 2020
From: report at bugs.python.org (Bernat Gabor)
Date: Thu, 08 Oct 2020 06:26:47 +0000
Subject: [issue41973] Docs: TypedDict is now of type function instead of class
Message-ID: <1602138406.98.0.272652370144.issue41973@roundup.psfhosted.org>


New submission from Bernat Gabor <gaborjbernat at gmail.com>:

? py -3.8 -c 'from typing import TypedDict; print(type(TypedDict))'
<class 'typing._TypedDictMeta'>

? py -3.9 -c 'from typing import TypedDict; print(type(TypedDict))'
<class 'function'>

Python 3.9 changed the type of the TypedDict but the documentation still says it's a class - see https://docs.python.org/3.9/library/typing.html#typing.TypedDict. I must also say I'm suprised you can inherit from a function, but we should update the documentation to reflect that the type of the element in question is no longer class.

----------
messages: 378212
nosy: gaborjbernat
priority: normal
severity: normal
status: open
title: Docs: TypedDict is now of type function instead of class
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41973>
_______________________________________

From report at bugs.python.org  Thu Oct  8 02:32:59 2020
From: report at bugs.python.org (Anthony Sottile)
Date: Thu, 08 Oct 2020 06:32:59 +0000
Subject: [issue41973] Docs: TypedDict is now of type function instead of class
In-Reply-To: <1602138406.98.0.272652370144.issue41973@roundup.psfhosted.org>
Message-ID: <1602138779.73.0.681002465253.issue41973@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

Seems to be due to https://bugs.python.org/issue40187

----------
nosy: +Anthony Sottile, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41973>
_______________________________________

From report at bugs.python.org  Thu Oct  8 02:34:22 2020
From: report at bugs.python.org (Dean)
Date: Thu, 08 Oct 2020 06:34:22 +0000
Subject: [issue41966] datetime.time issue with pickling in PyPy
In-Reply-To: <1602065311.95.0.279586156365.issue41966@roundup.psfhosted.org>
Message-ID: <1602138862.72.0.264522912451.issue41966@roundup.psfhosted.org>


Dean <scaram at gmail.com> added the comment:

Code demonstrating the issue; the CTimeFoo class is pickled correctly, but TimeFoo isn't.


import builtins
from _datetime import time as ctime

original_importer = builtins.__import__

def my_importer(name, globals, locals, fromlist, level):
    if name == '_datetime':
        raise ImportError

    return original_importer(name, globals, locals, fromlist, level)

builtins.__import__ = my_importer

import datetime

builtins.__import__ = original_importer

import pickle


class CTimeFoo(ctime): pass
class TimeFoo(datetime.time): pass
class DateFoo(datetime.date): pass


if __name__ == "__main__":
    t = DateFoo(2001, 2, 3) 
    d = pickle.dumps(t)  # OK
    print(d)
    # b'\x80\x04\x95#\x00\x00\x00\x00\x00\x00\x00\x8c\x08__main__\x94\x8c\x07DateFoo\x94\x93\x94C\x04\x07\xd1\x02\x03\x94\x85\x94R\x94.'
    t = pickle.loads(d)

    t = CTimeFoo(1, 2, 3)  
    d = pickle.dumps(t)  # OK
    print(d)
    # b'\x80\x04\x95&\x00\x00\x00\x00\x00\x00\x00\x8c\x08__main__\x94\x8c\x08CTimeFoo\x94\x93\x94C\x06\x01\x02\x03\x00\x00\x00\x94\x85\x94R\x94.'
    t = pickle.loads(d)

    t = TimeFoo(1, 2, 3)
    d = pickle.dumps(t)  # :(
    print(d)
    # b'\x80\x04\x95"\x00\x00\x00\x00\x00\x00\x00\x8c\x08datetime\x94\x8c\x04time\x94\x93\x94C\x06\x01\x02\x03\x00\x00\x00\x94\x85\x94R\x94.'
    t = pickle.loads(d)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41966>
_______________________________________

From report at bugs.python.org  Thu Oct  8 02:38:05 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 08 Oct 2020 06:38:05 +0000
Subject: [issue41376] site.getusersitepackages() incorrectly claims that
 PYTHONNOUSERSITE is respected
In-Reply-To: <1595517731.78.0.301651868818.issue41376@roundup.psfhosted.org>
Message-ID: <1602139085.68.0.654609652402.issue41376@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 35f041dd0171f575fc3adce1709b31fdf45a5ff6 by Phil Elson in branch 'master':
bpo-41376: Fix the documentation of `site.getusersitepackages()` (GH-21602)
https://github.com/python/cpython/commit/35f041dd0171f575fc3adce1709b31fdf45a5ff6


----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41376>
_______________________________________

From report at bugs.python.org  Thu Oct  8 02:38:12 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 06:38:12 +0000
Subject: [issue41376] site.getusersitepackages() incorrectly claims that
 PYTHONNOUSERSITE is respected
In-Reply-To: <1595517731.78.0.301651868818.issue41376@roundup.psfhosted.org>
Message-ID: <1602139092.46.0.300519144784.issue41376@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21580
pull_request: https://github.com/python/cpython/pull/22591

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41376>
_______________________________________

From report at bugs.python.org  Thu Oct  8 02:38:21 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 06:38:21 +0000
Subject: [issue41376] site.getusersitepackages() incorrectly claims that
 PYTHONNOUSERSITE is respected
In-Reply-To: <1595517731.78.0.301651868818.issue41376@roundup.psfhosted.org>
Message-ID: <1602139101.18.0.283566290339.issue41376@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21581
pull_request: https://github.com/python/cpython/pull/22592

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41376>
_______________________________________

From report at bugs.python.org  Thu Oct  8 02:41:07 2020
From: report at bugs.python.org (Bernat Gabor)
Date: Thu, 08 Oct 2020 06:41:07 +0000
Subject: [issue41973] Docs: TypedDict is now of type function instead of class
In-Reply-To: <1602138406.98.0.272652370144.issue41973@roundup.psfhosted.org>
Message-ID: <1602139267.2.0.687072471233.issue41973@roundup.psfhosted.org>


Bernat Gabor <gaborjbernat at gmail.com> added the comment:

Static checkers/linters (see e.g. https://github.com/PyCQA/pylint/issues/3884) are caught of guard by being able to inherit from functions. They'll need to adapt, but let's update the documentation to reflect this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41973>
_______________________________________

From report at bugs.python.org  Thu Oct  8 02:44:25 2020
From: report at bugs.python.org (Bernat Gabor)
Date: Thu, 08 Oct 2020 06:44:25 +0000
Subject: [issue41973] Docs: TypedDict is now of type function instead of class
In-Reply-To: <1602138406.98.0.272652370144.issue41973@roundup.psfhosted.org>
Message-ID: <1602139465.62.0.279977014759.issue41973@roundup.psfhosted.org>


Bernat Gabor <gaborjbernat at gmail.com> added the comment:

This seem to apply to typing.NamedTuple too.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41973>
_______________________________________

From report at bugs.python.org  Thu Oct  8 02:55:25 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 08 Oct 2020 06:55:25 +0000
Subject: [issue41974] Remove complex.__float__, complex.__floordiv__, etc
Message-ID: <1602140125.13.0.506221233573.issue41974@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

The complex class has special methods which always raise a TypeError:

   __int__
   __float__
   __floordiv__
   __mod__
   __divmod__

After removing them the corresponding operations (converting to int and float, operators // and %, function divmod()) will still a TypeError.

Advantages of removing:

* Less code to maintain.
* More uniform error messages.
* Clearer output of help().
* Possibility to implement a type with __rfloordiv__, __rmod__ and __rdivmod__ which support complex numbers.

----------
components: Interpreter Core
messages: 378218
nosy: gvanrossum, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Remove complex.__float__, complex.__floordiv__, etc
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41974>
_______________________________________

From report at bugs.python.org  Thu Oct  8 03:00:03 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 08 Oct 2020 07:00:03 +0000
Subject: [issue41974] Remove complex.__float__, complex.__floordiv__, etc
In-Reply-To: <1602140125.13.0.506221233573.issue41974@roundup.psfhosted.org>
Message-ID: <1602140403.25.0.602285460509.issue41974@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21582
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22593

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41974>
_______________________________________

From report at bugs.python.org  Thu Oct  8 03:01:00 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 08 Oct 2020 07:01:00 +0000
Subject: [issue41974] Remove complex.__float__, complex.__floordiv__, etc
In-Reply-To: <1602140125.13.0.506221233573.issue41974@roundup.psfhosted.org>
Message-ID: <1602140460.56.0.932648646648.issue41974@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +lemburg, mark.dickinson, rhettinger, stutzbach

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41974>
_______________________________________

From report at bugs.python.org  Thu Oct  8 03:00:38 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 07:00:38 +0000
Subject: [issue41376] site.getusersitepackages() incorrectly claims that
 PYTHONNOUSERSITE is respected
In-Reply-To: <1595517731.78.0.301651868818.issue41376@roundup.psfhosted.org>
Message-ID: <1602140438.66.0.854148342389.issue41376@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 5b1fdcacfc36dfe36693f4c350c958df6600de14 by Miss Skeleton (bot) in branch '3.9':
bpo-41376: Fix the documentation of `site.getusersitepackages()` (GH-21602)
https://github.com/python/cpython/commit/5b1fdcacfc36dfe36693f4c350c958df6600de14


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41376>
_______________________________________

From report at bugs.python.org  Thu Oct  8 03:43:53 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 08 Oct 2020 07:43:53 +0000
Subject: [issue41966] datetime.time issue with pickling in PyPy
In-Reply-To: <1602065311.95.0.279586156365.issue41966@roundup.psfhosted.org>
Message-ID: <1602143033.23.0.0175871473728.issue41966@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +serhiy.storchaka
versions:  -Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41966>
_______________________________________

From report at bugs.python.org  Thu Oct  8 03:49:19 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 08 Oct 2020 07:49:19 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602143359.47.0.463921634951.issue41894@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I think that it is more correct to use the locale encoding. If error messages are translated for readability, we should not ruin this by outputting \xXX.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Thu Oct  8 03:58:10 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 08 Oct 2020 07:58:10 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602143890.63.0.415284924082.issue41972@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

What is the content of "data.bin"? How can we reproduce the issue?

----------
nosy: +serhiy.storchaka
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Thu Oct  8 04:03:49 2020
From: report at bugs.python.org (Ammar Askar)
Date: Thu, 08 Oct 2020 08:03:49 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602144229.81.0.780086925111.issue41972@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

It's available from the Github gist that Kevin posted. Here is a direct link that you can curl/wget:

https://gist.github.com/Zeturic/7d0480a94352968c1fe92aa62e8adeaf/raw/6daebaabedaa903016810c2c04d0d1f0b1af1ed3/data.bin

----------
nosy: +ammar2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Thu Oct  8 04:34:22 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 08 Oct 2020 08:34:22 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602146062.83.0.831044137678.issue41894@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> I think that it is more correct to use the locale encoding. If error messages are translated for readability, we should not ruin this by outputting \xXX.

* PyUnicode_DecodeLocale() doesn't support "backslashescape" error handler.
* Error message is usually encoded in locale encoding, but it is not guaranteed.
* Error message may contain path, it may be not locale encoding too.
* \xXX is far better than UnicodeDecodeError, anyway. We need to fix the UnicodeDecodeError first.
* non-UTF-8 locale is rare. We used this code for long time but we haven't reported this issue until now.

I don't against adding "backslashescape" to PyUnicode_DecodeLocale(). But to backport the bugfix for UnicodeDecodeError, change should be minimum.

So the main problem is: should we allow surrogateescape in error message?

For the record, PyUnicode_DecodeLocale() is using mbstowcs(). I don't know how reliable the function is in various platforms. That is why I had suggested PyUnicode_DecodeFSDefault() at first.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Thu Oct  8 04:42:42 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 08 Oct 2020 08:42:42 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602146562.57.0.603831124009.issue41894@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> So the main problem is: should we allow surrogateescape in error message?

Note that error message may be written to file, stream, structured log (JSON). They may be UTF-8:strict. We can not write surrogateescape-d string to them.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Thu Oct  8 05:09:01 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Thu, 08 Oct 2020 09:09:01 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602148141.7.0.959963365329.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

Adding some hasty printf-debugging to fastsearch.h, I see this:

    >>> with open('data.bin', 'rb') as f:
    ...     s = f.read()
    ...
    >>> base = 15403807 * b'\xff'
    >>> longer = base + b'\xff'
    >>> base in s
    
    Bloom has 0x00: 0
    Bloom has 0xff: -2147483648
    skip = 0
    Checking bloom filter for next char 0x00... not found in pattern. Skipping a bunch.
    Candidate at 15403808

    True

    >>> longer in s

    Bloom has 0x00: No
    Bloom has 0xff: Yes
    skip = 0
    Checking bloom filter for next char 0xff... found in pattern; increment by only one.
    Candidate at 1
    Candidate at 2
    Candidate at 3
    Candidate at 4
    Candidate at 5
    Candidate at 6
    Candidate at 7
    (...)

Trying the same base, I also get this:

    >>> with open('data.bin', 'rb') as f:
    ...     s = f.read()
    ...
    >>> base = 15403807 * b'\xff'
    >>> s1 = s[1:]
    >>> base in s1

    Bloom has 0x00: No
    Bloom has 0xff: Yes
    skip = 0
    Checking bloom filter for next char 0xff... found in pattern; increment by only one.
    Candidate at 1
    Candidate at 2
    Candidate at 3
    Candidate at 4
    Candidate at 5
    Candidate at 6
    Candidate at 7
    (...)

So maybe part of the issue is just that the algorithm is getting particularly
unlucky regarding how the strings line up to start with.

The fact that "skip" is 0 in these cases seems to just be a limitation of the algorithm:
we only skip to line up the second-to-last occurrence of the last character,
but with these strings, that's just the second-to-last character.

Computing the entire Boyer-Moore table would be better in cases like these, but
that would require dynamic memory allocation (length of pattern) which I think is why it is avoided.

----------
nosy: +Dennis Sweeney

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Thu Oct  8 05:41:58 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 08 Oct 2020 09:41:58 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602150118.84.0.216136657762.issue41894@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

In os.strerror() and PyErr_SetFromErrnoWithFilenameObjects() we use PyUnicode_DecodeLocale(s, "surrogateescape") for decoding the result of strerror().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Thu Oct  8 05:49:18 2020
From: report at bugs.python.org (Robert Smallshire)
Date: Thu, 08 Oct 2020 09:49:18 +0000
Subject: [issue26680] Incorporating float.is_integer into Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1602150558.02.0.477308680707.issue26680@roundup.psfhosted.org>


Robert Smallshire <rob at sixty-north.com> added the comment:

Yes Raymond, I can prepare a new PR as soon as the faulty PR has been rolled back.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Thu Oct  8 05:55:22 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 08 Oct 2020 09:55:22 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602150922.47.0.686780775476.issue41894@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

OK. Let's use PyUnicode_DecodeLocale() with surrogateescape for consistency.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Thu Oct  8 05:59:28 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 08 Oct 2020 09:59:28 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602151168.26.0.397273091223.issue41972@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Does the code really hang? Or does it complete if you wait for an infinite amount of time?

I understand that your concern is that bytes.find() is inefficient for a very specific pattern.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Thu Oct  8 06:41:00 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 10:41:00 +0000
Subject: [issue41958] importlib has not util module
In-Reply-To: <1601989735.99.0.481225793113.issue41958@roundup.psfhosted.org>
Message-ID: <1602153660.65.0.446150374791.issue41958@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This can be closed as not a bug (it's a user error).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41958>
_______________________________________

From report at bugs.python.org  Thu Oct  8 06:42:02 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 10:42:02 +0000
Subject: [issue41483] Do not acquire lock in MemoryHandler.flush() if no
 target defined
In-Reply-To: <1596607573.95.0.247308930011.issue41483@roundup.psfhosted.org>
Message-ID: <1602153722.19.0.342651763712.issue41483@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This can be closed now - we all agree there is nothing left to do.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41483>
_______________________________________

From report at bugs.python.org  Thu Oct  8 06:56:18 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 08 Oct 2020 10:56:18 +0000
Subject: [issue41958] importlib has not util module
In-Reply-To: <1601989735.99.0.481225793113.issue41958@roundup.psfhosted.org>
Message-ID: <1602154578.15.0.817378642193.issue41958@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41958>
_______________________________________

From report at bugs.python.org  Thu Oct  8 06:57:29 2020
From: report at bugs.python.org (Federico Granata)
Date: Thu, 08 Oct 2020 10:57:29 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602154649.96.0.0257090816795.issue41970@roundup.psfhosted.org>


Federico Granata <federico.granata at gmail.com> added the comment:

I just experienced the very same issue.
I use pyenv and doing all tests gives me a failure on test_lib2to3 while running it individually end succesfully.

Tell me if I can provide any useful information

----------
nosy: +federico.granata

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Thu Oct  8 07:06:59 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Thu, 08 Oct 2020 11:06:59 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602155219.38.0.293310549875.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

Indeed, this is just a very unlucky case.

    >>> n = len(longer)
    >>> from collections import Counter
    >>> Counter(s[:n])
    Counter({0: 9056995, 255: 6346813})
    >>> s[n-30:n+30].replace(b'\x00', b'.').replace(b'\xff', b'@')
    b'..............................@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@'
    >>> Counter(s[n:])
    Counter({255: 18150624})


When checking "base", we're in this situation

    pattern:     @@@@@@@@
     string:     .........@@@@@@@@
    Algorithm says:     ^ these last characters don't match.
                         ^ this next character is not in the pattern
                         Therefore, skip ahead a bunch:

     pattern:              @@@@@@@@
      string:     .........@@@@@@@@

     This is a match!


Whereas when checking "longer", we're in this situation:

    pattern:     @@@@@@@@@
     string:     .........@@@@@@@@
    Algorithm says:      ^ these last characters don't match.
                          ^ this next character *is* in the pattern.
                          We can't jump forward.

     pattern:       @@@@@@@@
      string:     .........@@@@@@@@

     Start comparing at every single alignment...


I'm attaching reproducer.py, which replicates this from scratch without loading data from a file.

----------
Added file: https://bugs.python.org/file49499/reproducer.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Thu Oct  8 07:17:39 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 08 Oct 2020 11:17:39 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602155859.44.0.190860321545.issue41970@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Pablo, I can see the error in Travis. The difference I can see is that the tests are executed sequentially in coverage run but normal run has tests executing in parallel. Felix and Federico, can you please add the command you use to run the tests?

Sample error build : https://travis-ci.com/github/python/cpython/jobs/396688564#L2022

coverage run but has true in the end thus being always successful

xvfb-run ./venv/bin/python -m coverage run --branch --pylib -m test --fail-env-changed -uall,-cpu -x test_multiprocessing_fork -x test_multiprocessing_forkserver -x test_multiprocessing_spawn -x test_concurrent_futures || true

Normal run

/home/travis/build/python/cpython/python -u -W default -bb -E -m test -r -w -j 1 -u all -W --slowest --fail-env-changed --timeout=1200 -j4 -uall,-cpu

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Thu Oct  8 07:20:30 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 11:20:30 +0000
Subject: [issue26332] OSError: exception: access violation writing <...>
 (Windows 10 x64, Python 3.5.1)
In-Reply-To: <1455129398.68.0.407875580594.issue26332@psf.upfronthosting.co.za>
Message-ID: <1602156030.94.0.111176713939.issue26332@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Should this be closed? There wasn't enough information 4 years ago and I can't imagine anything happening with this now.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26332>
_______________________________________

From report at bugs.python.org  Thu Oct  8 07:24:22 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 08 Oct 2020 11:24:22 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1602156262.7.0.958269547923.issue7946@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

If someone wants to close this issue, I suggest to write a short section in the Python documentation to give some highlights on the available options and stategies to maximize performances and list drawbacks of each method. Examples:

* Multiple threads (threading): limited by the GIL
* Multiple processes (concurrent.futures, multiprocessing, distributed application): limited by shared data
* Concurrent programming (asyncio): limited to 1 thread

These architectures are not exclusive. asyncio can use multiple threads and be distributed in multiple processes.

I would be bad to go too deep into the technical details, but I think that we can describe some advantages and drawbacks which are common on all platforms.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Thu Oct  8 07:34:43 2020
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 08 Oct 2020 11:34:43 +0000
Subject: [issue26332] OSError: exception: access violation writing <...>
 (Windows 10 x64, Python 3.5.1)
In-Reply-To: <1455129398.68.0.407875580594.issue26332@psf.upfronthosting.co.za>
Message-ID: <1602156883.59.0.9727518427.issue26332@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

I see nothing to act on in this issue. A common cause of access violations with ctypes is truncated pointer values. There's a lot of sloppy ctypes code from the 32-bit era that assumes a C int can store a pointer.

----------
nosy: +eryksun
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26332>
_______________________________________

From report at bugs.python.org  Thu Oct  8 07:34:43 2020
From: report at bugs.python.org (Antoine Pitrou)
Date: Thu, 08 Oct 2020 11:34:43 +0000
Subject: [issue37881] __text_signature__ parser doesn't handle globals in
 extension module
In-Reply-To: <1566135236.59.0.315734223996.issue37881@roundup.psfhosted.org>
Message-ID: <1602156883.93.0.981666279317.issue37881@roundup.psfhosted.org>


Change by Antoine Pitrou <pitrou at free.fr>:


----------
nosy: +eric.snow

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37881>
_______________________________________

From report at bugs.python.org  Thu Oct  8 07:36:07 2020
From: report at bugs.python.org (Felix Yan)
Date: Thu, 08 Oct 2020 11:36:07 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602156967.73.0.850002936735.issue41970@roundup.psfhosted.org>


Felix Yan <felixonmars at archlinux.org> added the comment:

I use this in Arch's packaging:

LC_CTYPE=en_US.UTF-8 xvfb-run -s "-screen 0 1920x1080x16 -ac +extension GLX" -a -n "$servernum" \
    "${srcdir}/Python-${pkgver}/python" -m test.regrtest -v -uall -x test_tk

(test_tk is currently skipped due to https://bugs.python.org/issue41306)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Thu Oct  8 07:58:12 2020
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Thu, 08 Oct 2020 11:58:12 +0000
Subject: [issue40066] Enum._convert should change __repr__ and/or __str__ to
 use module name instead of class name
In-Reply-To: <1585165738.23.0.618463548627.issue40066@roundup.psfhosted.org>
Message-ID: <1602158292.9.0.595414719877.issue40066@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

> - do you think the change has merit?

Absolutely.

> - why /shouldn't/ we make the change?

Well, standard backward compatibility stuff. :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40066>
_______________________________________

From report at bugs.python.org  Thu Oct  8 08:02:13 2020
From: report at bugs.python.org (Federico Granata)
Date: Thu, 08 Oct 2020 12:02:13 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602158533.67.0.565008694653.issue41970@roundup.psfhosted.org>


Federico Granata <federico.granata at gmail.com> added the comment:

I just run "python -m test" for it to fail and "python -m test test_lib2to3" for it to succeded.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Thu Oct  8 08:13:56 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 08 Oct 2020 12:13:56 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602159236.05.0.868114488682.issue41970@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I can reproduce this by running test_lib2to3 twice or running test___all__ with test_lib2to3

./python -m test test_lib2to3 test_lib2to3
0:00:00 load avg: 0.03 Run tests sequentially
0:00:00 load avg: 0.03 [1/2] test_lib2to3
0:00:13 load avg: 0.25 [2/2] test_lib2to3
test test_lib2to3 crashed -- Traceback (most recent call last):
  File "/root/cpython/Lib/test/libregrtest/runtest.py", line 272, in _runtest_inner
    refleak = _runtest_inner2(ns, test_name)
  File "/root/cpython/Lib/test/libregrtest/runtest.py", line 223, in _runtest_inner2
    the_module = importlib.import_module(abstest)
  File "/root/cpython/Lib/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 790, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "/root/cpython/Lib/test/test_lib2to3.py", line 5, in <module>
    from lib2to3.tests import load_tests
  File "/root/cpython/Lib/contextlib.py", line 124, in __exit__
    next(self.gen)
  File "/root/cpython/Lib/test/support/warnings_helper.py", line 179, in _filterwarnings
    raise AssertionError("filter (%r, %s) did not catch any warning" %
AssertionError: filter ('', PendingDeprecationWarning) did not catch any warning

test_lib2to3 failed

== Tests result: FAILURE ==

1 test OK.

1 test failed:
    test_lib2to3

Total duration: 13.5 sec
Tests result: FAILURE

./python -m test test___all__ test_lib2to3     
0:00:00 load avg: 0.05 Run tests sequentially
0:00:00 load avg: 0.05 [1/2] test___all__
0:00:00 load avg: 0.05 [2/2] test_lib2to3
test test_lib2to3 crashed -- Traceback (most recent call last):
  File "/root/cpython/Lib/test/libregrtest/runtest.py", line 272, in _runtest_inner
    refleak = _runtest_inner2(ns, test_name)
  File "/root/cpython/Lib/test/libregrtest/runtest.py", line 223, in _runtest_inner2
    the_module = importlib.import_module(abstest)
  File "/root/cpython/Lib/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 790, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "/root/cpython/Lib/test/test_lib2to3.py", line 5, in <module>
    from lib2to3.tests import load_tests
  File "/root/cpython/Lib/contextlib.py", line 124, in __exit__
    next(self.gen)
  File "/root/cpython/Lib/test/support/warnings_helper.py", line 179, in _filterwarnings
    raise AssertionError("filter (%r, %s) did not catch any warning" %
AssertionError: filter ('', PendingDeprecationWarning) did not catch any warning

test_lib2to3 failed

== Tests result: FAILURE ==

1 test OK.

1 test failed:
    test_lib2to3

Total duration: 1.1 sec
Tests result: FAILURE

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Thu Oct  8 08:17:11 2020
From: report at bugs.python.org (Federico Granata)
Date: Thu, 08 Oct 2020 12:17:11 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602159431.02.0.0934671837864.issue41970@roundup.psfhosted.org>


Federico Granata <federico.granata at gmail.com> added the comment:

I can have the test to fails if I run "python -m test test_lib2to3 test_lib2to3" as well

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Thu Oct  8 08:30:42 2020
From: report at bugs.python.org (Leo kirotawa silva)
Date: Thu, 08 Oct 2020 12:30:42 +0000
Subject: [issue28874] test_logging fails and freezes
In-Reply-To: <1480923682.41.0.106352881958.issue28874@psf.upfronthosting.co.za>
Message-ID: <1602160242.33.0.834028999064.issue28874@roundup.psfhosted.org>


Leo kirotawa silva <kirotawa at gmail.com> added the comment:

I'm facing similar issue with test_logging in python3.5.2-2ubuntu0~16.04.12. Test just get hangs and so, our builders kill the build process without a successful ending.

[1/1] test_locale
1 test OK.
[1/1] test_logging
E: Build killed with signal TERM after 150 minutes of inactivity

Could someone provide any info in how to handle with this issue? Also, reopen this issue, if possible. 
It's affecting our 3.4 and 3.5 pythons.

Thanks!

----------
nosy: +Leo kirotawa silva
versions: +Python 3.5 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28874>
_______________________________________

From report at bugs.python.org  Thu Oct  8 08:38:46 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 08 Oct 2020 12:38:46 +0000
Subject: [issue28874] test_logging fails and freezes
In-Reply-To: <1480923682.41.0.106352881958.issue28874@psf.upfronthosting.co.za>
Message-ID: <1602160726.37.0.110199826393.issue28874@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Python 3.5 is no longer supported (no bugfix, no security fix). This issue is closed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28874>
_______________________________________

From report at bugs.python.org  Thu Oct  8 08:41:06 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 12:41:06 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602160866.4.0.361951936085.issue41970@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Ok, thanks everyone for the help reproducing this. I think I can work on a fix today

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Thu Oct  8 08:55:15 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 08 Oct 2020 12:55:15 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602161715.31.0.208207761021.issue41970@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I guess this could be due to loading the module twice where the warning is not emitted again on reimport which test__all__ seems to do so by importing lib2to3. One obvious fix would be to pass quiet=True. Else we need to find a way to import the module fresh like using import_fresh_module. Two possible patches. I assumed running tests sequentially will provide support for isolation too.

    Optional argument:
     - if 'quiet' is True, it does not fail if a filter catches nothing
        (default True without argument,
         default False if some filters are defined)

    Without argument, it defaults to:
        check_warnings(("", Warning), quiet=True)

# Using import fresh module

diff --git a/Lib/test/test_lib2to3.py b/Lib/test/test_lib2to3.py
index 159a8387e4..861ae5ad53 100644
--- a/Lib/test/test_lib2to3.py
+++ b/Lib/test/test_lib2to3.py
@@ -1,7 +1,9 @@
 import unittest
+from test.support.import_helper import import_fresh_module
 from test.support.warnings_helper import check_warnings
 
 with check_warnings(("", PendingDeprecationWarning)):
+    lib2to3 = import_fresh_module("lib2to3")
     from lib2to3.tests import load_tests
 
 if __name__ == '__main__':

# Passing quiet=True

diff --git a/Lib/test/test_lib2to3.py b/Lib/test/test_lib2to3.py
index 159a8387e4..e4c5cade8b 100644
--- a/Lib/test/test_lib2to3.py
+++ b/Lib/test/test_lib2to3.py
@@ -1,7 +1,7 @@
 import unittest
 from test.support.warnings_helper import check_warnings
 
-with check_warnings(("", PendingDeprecationWarning)):
+with check_warnings(("", PendingDeprecationWarning), quiet=True):
     from lib2to3.tests import load_tests
 
 if __name__ == '__main__':

?  cpython git:(master) ? ./python -m test test_lib2to3 test_lib2to3     
0:00:00 load avg: 0.01 Run tests sequentially
0:00:00 load avg: 0.01 [1/2] test_lib2to3
0:00:13 load avg: 0.23 [2/2] test_lib2to3

== Tests result: SUCCESS ==

All 2 tests OK.

Total duration: 27.3 sec
Tests result: SUCCESS

----------
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Thu Oct  8 09:01:15 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 13:01:15 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602162075.83.0.288874979609.issue41970@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +21583
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22595

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Thu Oct  8 09:19:58 2020
From: report at bugs.python.org (Julien Palard)
Date: Thu, 08 Oct 2020 13:19:58 +0000
Subject: [issue41975] Textwrap to conform to
 https://www.unicode.org/reports/tr14/tr14-45.html
Message-ID: <1602163198.82.0.518755458175.issue41975@roundup.psfhosted.org>


New submission from Julien Palard <julien+python at palard.fr>:

Currently it looks like our `textwrap.fill` implementation does not conforms to the Unicode Line Breaking Algorithm from the unicode standard.

Should this be enhanced?

If so, as a sidenote, it could be nice to have the override parameter of  libunistring [1] to prohibit line breaking at specific places where the algorithm would normally break but where a human don't expect it to.

[1]: https://www.gnu.org/software/libunistring/manual/html_node/unilbrk_002eh.html

----------
components: Library (Lib)
messages: 378247
nosy: mdk
priority: normal
severity: normal
status: open
title: Textwrap to conform to https://www.unicode.org/reports/tr14/tr14-45.html

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41975>
_______________________________________

From report at bugs.python.org  Thu Oct  8 09:20:59 2020
From: report at bugs.python.org (Julien Palard)
Date: Thu, 08 Oct 2020 13:20:59 +0000
Subject: [issue32397] textwrap output may change if you wrap a paragraph twice
In-Reply-To: <1513865443.17.0.213398074469.issue32397@psf.upfronthosting.co.za>
Message-ID: <1602163259.0.0.664353513402.issue32397@roundup.psfhosted.org>


Julien Palard <julien+python at palard.fr> added the comment:

Could be "related" to https://bugs.python.org/issue41975.

----------
nosy: +mdk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32397>
_______________________________________

From report at bugs.python.org  Thu Oct  8 09:24:37 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 13:24:37 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602163477.59.0.158679557054.issue41970@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 4a9f82f50d957b6cf3fd207de8b583d9137316b8 by Pablo Galindo in branch 'master':
bpo-41970: Avoid test failure in test_lib2to3 if the module is already imported (GH-22595)
https://github.com/python/cpython/commit/4a9f82f50d957b6cf3fd207de8b583d9137316b8


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Thu Oct  8 09:30:24 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 13:30:24 +0000
Subject: [issue41306] test_tk test_widgets.ScaleTest fails with Tk 8.6.10
In-Reply-To: <1594840353.83.0.567403527611.issue41306@roundup.psfhosted.org>
Message-ID: <1602163824.87.0.0884290936765.issue41306@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset aecf036738a404371303e770f4ce4fd9f7d43de7 by E-Paine in branch 'master':
bpo-41306: Allow scale value to not be rounded (GH-21715)
https://github.com/python/cpython/commit/aecf036738a404371303e770f4ce4fd9f7d43de7


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41306>
_______________________________________

From report at bugs.python.org  Thu Oct  8 09:30:31 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 13:30:31 +0000
Subject: [issue41306] test_tk test_widgets.ScaleTest fails with Tk 8.6.10
In-Reply-To: <1594840353.83.0.567403527611.issue41306@roundup.psfhosted.org>
Message-ID: <1602163831.82.0.0630176755226.issue41306@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21584
pull_request: https://github.com/python/cpython/pull/22596

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41306>
_______________________________________

From report at bugs.python.org  Thu Oct  8 09:55:45 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 08 Oct 2020 13:55:45 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
In-Reply-To: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>
Message-ID: <1602165345.84.0.675354154368.issue41971@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Thu Oct  8 10:37:30 2020
From: report at bugs.python.org (Kevin)
Date: Thu, 08 Oct 2020 14:37:30 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602167850.68.0.819223770205.issue41894@roundup.psfhosted.org>


Kevin <kadler at us.ibm.com> added the comment:

Ok, so should I switch the PR back from PyUnicode_DecodeFSDefault?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Thu Oct  8 11:12:08 2020
From: report at bugs.python.org (Grady Martin)
Date: Thu, 08 Oct 2020 15:12:08 +0000
Subject: [issue39273] ncurses does not include BUTTON5_* constants
In-Reply-To: <1578553141.45.0.141104357774.issue39273@roundup.psfhosted.org>
Message-ID: <1602169928.72.0.402628493103.issue39273@roundup.psfhosted.org>


Grady Martin <SunnyCemetery at gmail.com> added the comment:

This baffled me, as well.  Does the reason involve bit-field width?

By the way, look at what my Python installation does when just *pressing* button 5 (mouse wheel down) after calling `curses.mousemask()`:

```
_curses.error: getmouse() returned ERR
```

The curses program then crashes with an exit code of 1.

```
$ uname -srvmo
Linux 5.4.51-v7l+ #1333 SMP Mon Aug 10 16:51:40 BST 2020 armv7l GNU/Linux
$ python3 -V
Python 3.7.3
```

----------
nosy: +IronGrid
type: enhancement -> crash
versions: +Python 3.7 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39273>
_______________________________________

From report at bugs.python.org  Thu Oct  8 11:14:45 2020
From: report at bugs.python.org (Grady Martin)
Date: Thu, 08 Oct 2020 15:14:45 +0000
Subject: [issue39273] ncurses does not include BUTTON5_* constants
In-Reply-To: <1578553141.45.0.141104357774.issue39273@roundup.psfhosted.org>
Message-ID: <1602170085.78.0.661691954938.issue39273@roundup.psfhosted.org>


Change by Grady Martin <SunnyCemetery at gmail.com>:


----------
versions: +Python 3.6, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39273>
_______________________________________

From report at bugs.python.org  Thu Oct  8 11:54:35 2020
From: report at bugs.python.org (Anatoliy Platonov)
Date: Thu, 08 Oct 2020 15:54:35 +0000
Subject: [issue18163] Add a 'key' attribute to KeyError
In-Reply-To: <1370638316.1.0.167534610168.issue18163@psf.upfronthosting.co.za>
Message-ID: <1602172475.55.0.553276699953.issue18163@roundup.psfhosted.org>


Anatoliy Platonov <p4m.dev at gmail.com> added the comment:

I agree with Mark. I will be useful to provide ability to specify custom long message for error. And logically it would be better to do not allow users change key field in error so easy.

----------
nosy: +p4m-dev

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18163>
_______________________________________

From report at bugs.python.org  Thu Oct  8 11:56:28 2020
From: report at bugs.python.org (ahiijny)
Date: Thu, 08 Oct 2020 15:56:28 +0000
Subject: [issue21506] Windows MSI installer should mklink (symlink) python.exe
 to python2.7.exe
In-Reply-To: <1400067370.68.0.607872004364.issue21506@psf.upfronthosting.co.za>
Message-ID: <1602172588.25.0.774106050619.issue21506@roundup.psfhosted.org>


Change by ahiijny <ahiijny at gmail.com>:


----------
nosy: +ahiijny

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21506>
_______________________________________

From report at bugs.python.org  Thu Oct  8 12:15:02 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 16:15:02 +0000
Subject: [issue41306] test_tk test_widgets.ScaleTest fails with Tk 8.6.10
In-Reply-To: <1594840353.83.0.567403527611.issue41306@roundup.psfhosted.org>
Message-ID: <1602173702.26.0.888249136094.issue41306@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 3d103e06951324680c587d4fe1135f06367c9d3d by Miss Skeleton (bot) in branch '3.8':
bpo-41306: Allow scale value to not be rounded (GH-21715)
https://github.com/python/cpython/commit/3d103e06951324680c587d4fe1135f06367c9d3d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41306>
_______________________________________

From report at bugs.python.org  Thu Oct  8 12:15:22 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 16:15:22 +0000
Subject: [issue41306] test_tk test_widgets.ScaleTest fails with Tk 8.6.10
In-Reply-To: <1594840353.83.0.567403527611.issue41306@roundup.psfhosted.org>
Message-ID: <1602173722.27.0.868289751123.issue41306@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21585
pull_request: https://github.com/python/cpython/pull/22597

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41306>
_______________________________________

From report at bugs.python.org  Thu Oct  8 12:19:24 2020
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Thu, 08 Oct 2020 16:19:24 +0000
Subject: [issue41877] Check against misspellings of assert etc. in mock
In-Reply-To: <1601317157.88.0.730935461305.issue41877@roundup.psfhosted.org>
Message-ID: <1602173964.91.0.778628798813.issue41877@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

Sorry, but 

1) Stability policy is great when we hold on to it. If we add new spellings of assert every few years, what kind of stability it is? "My" solution is of the same type: just add one more thing to the API. But that solution is better, because a) it doesn't clash, and b) it must be done only once.

2) Soundex has nothing to do with it. It was invented to mitigate errors when transferring _sounds_ (phonemes) over the telephone wire. It would surprise me very much if those were in any useful sense correlated with errors encountered typing graphemes on the mechanical keyboard.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41877>
_______________________________________

From report at bugs.python.org  Thu Oct  8 12:25:30 2020
From: report at bugs.python.org (Justin Arthur)
Date: Thu, 08 Oct 2020 16:25:30 +0000
Subject: [issue33533] Provide an async iterator version of as_completed
In-Reply-To: <1526453333.0.0.682650639539.issue33533@psf.upfronthosting.co.za>
Message-ID: <1602174330.56.0.312271330616.issue33533@roundup.psfhosted.org>


Change by Justin Arthur <justinarthur at gmail.com>:


----------
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33533>
_______________________________________

From report at bugs.python.org  Thu Oct  8 12:34:52 2020
From: report at bugs.python.org (Velson Horie)
Date: Thu, 08 Oct 2020 16:34:52 +0000
Subject: [issue41968] 3.9 IDLE documentation.
In-Reply-To: <1602115631.38.0.890313460706.issue41968@roundup.psfhosted.org>
Message-ID: <CALUK9Y9_7QHE6ZtdS1O6RiU8p3YFveaZ7kbfm_1zkwdgqNr-qQ@mail.gmail.com>


Velson Horie <c.v.horie at gmail.com> added the comment:

As Terry said, the issue of Idle not starting by a .py file association was
raised in another thread. That parenthesis was mentioned to give context to
the documentation enquiry.  In my new 3.9 installation, I could find
idle.bat, but I had just been told by the Microsoft help engineer that it
was possible to make an association with a file type only by pointing to an
.exe file.  (I could find idle.exe in a 3.8 installation on a different
computer, buried deep in hidden AppData folders.)

This post was specifically about the documentation.  One of the
difficulties of a Python installation is that it is really difficult to
find where and how all the many and various strands of Python interact, how
the sources are linked into a structure [I grew up pre-Windows with
MS-DOS]. I was trying to find where the idle.exe was placed in the
installation, since Windows requires (apparently) an explicitly stated
folder/application.

So I went to the IDLE documentation page to find how IDLE was implemented
as a program, and how I might find "it", and where "it" was placed in the
folder structure in my new installation.
But those mechanics are not mentioned on that page.
So-  my post on documentation.

I apologise for the confusion.  However in the past, I had a similar
experience loading anaconda etc, where the files disappeared without trace
onto a hard drive. So I deleted the package (as best I can) because I don't
know what is happening.

On Thu, 8 Oct 2020 at 01:07, Terry J. Reedy <report at bugs.python.org> wrote:

>
> Terry J. Reedy <tjreedy at udel.edu> added the comment:
>
> I agree that the doc needs more, but I am closing this as a duplicate of
> #31329, which is specifically doc about starting IDLE.  You can still
> answer Paine's questions here if you want.
>
> File association: IDLE is not Python.  It is one of many Python-oriented
> editors and IDEs.  .py files are and by default should be associated for
> running with something that runs the file with python.exe.  On Windows,
> this is done via C:/Windows/py.exe.  The default version for double
> clicking is determined by a checkmark in the installer.
>
> The Windows installer does associate .py files with IDLE for editing: rt
> click, edit with IDLE ....
>
> idle.exe is not needed for starting idle.
>
> I don't know what you mean by 'source format'.  IDLE is written in
> Python.  The directory structure is mostly implementation detail not
> relevant to using IDLE.  File are described in idlelib/README.txt.  This
> might be mentioned in the doc.
>
> ----------
> resolution:  -> duplicate
> stage:  -> resolved
> status: open -> closed
> superseder:  -> Add idlelib module entry to doc
> type:  -> enhancement
> versions: +Python 3.10 -Python 3.9
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue41968>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41968>
_______________________________________

From report at bugs.python.org  Thu Oct  8 12:51:01 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 16:51:01 +0000
Subject: [issue41306] test_tk test_widgets.ScaleTest fails with Tk 8.6.10
In-Reply-To: <1594840353.83.0.567403527611.issue41306@roundup.psfhosted.org>
Message-ID: <1602175861.08.0.251025782698.issue41306@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 15e091f63f12b659ad17563a4ce7f5188aceae0a by Miss Skeleton (bot) in branch '3.9':
bpo-41306: Allow scale value to not be rounded (GH-21715)
https://github.com/python/cpython/commit/15e091f63f12b659ad17563a4ce7f5188aceae0a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41306>
_______________________________________

From report at bugs.python.org  Thu Oct  8 13:16:27 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 17:16:27 +0000
Subject: [issue41306] test_tk test_widgets.ScaleTest fails with Tk 8.6.10
In-Reply-To: <1594840353.83.0.567403527611.issue41306@roundup.psfhosted.org>
Message-ID: <1602177387.98.0.47826870535.issue41306@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41306>
_______________________________________

From report at bugs.python.org  Thu Oct  8 13:17:51 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 17:17:51 +0000
Subject: [issue41976] ctypes.util.find_library fails with gcc 9
Message-ID: <1602177471.33.0.207499643707.issue41976@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

Running ctypes.util.find_library with gcc-9, if ldconfig is not available, it falls back to check the output of gcc -Wl,-t -lc to locate the library and then runs objdump on the file it's found to parse out the SONAME. With the gcc-9 the output of that gcc command is slightly perturbed so that /lib64/libc.so is listed before /libc64/libc.so.6. The former is a linker script not and ELF file so objdump fails.

----------
assignee: pablogsal
components: ctypes
messages: 378258
nosy: pablogsal
priority: normal
severity: normal
status: open
title: ctypes.util.find_library fails with gcc 9
versions: Python 3.10, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41976>
_______________________________________

From report at bugs.python.org  Thu Oct  8 13:23:43 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 17:23:43 +0000
Subject: [issue41976] ctypes.util.find_library fails with gcc 9
In-Reply-To: <1602177471.33.0.207499643707.issue41976@roundup.psfhosted.org>
Message-ID: <1602177823.58.0.542665359647.issue41976@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +21586
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22598

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41976>
_______________________________________

From report at bugs.python.org  Thu Oct  8 13:27:32 2020
From: report at bugs.python.org (Velson Horie)
Date: Thu, 08 Oct 2020 17:27:32 +0000
Subject: [issue41968] 3.9 IDLE documentation.
In-Reply-To: <1602091185.2.0.62279861013.issue41968@roundup.psfhosted.org>
Message-ID: <CALUK9Y-PhKU2Rst3F9X4m_B+5_LvGpPg1HgKHExXw3WRfk4OgA@mail.gmail.com>


Velson Horie <c.v.horie at gmail.com> added the comment:

Paine: thank you for your offer to sort the problem out.
See my answer to Terry for a  further introduction to the situation.

My laptop's operating system Win10 64 bit was mashed by Windows update
1909. I deleted 3.6, loaded 3.8 (but that didn't work because the system
had been converted from 64 to 32 bit). Deleted 3.8, installed update 2004,
then 3.9.  I then tried to run my (simple and small) .py code by double
clicking, and that failed.  So I tried to associate the .py files with any
of the various python options presented by Windows - didn't work. I then
found buried in the folder structure a copy of idle.bat so I made the
association. That didn't work.  Meanwhile the option to edit with IDLE,
which I noticed early on but which did not appear in "open with" options,
had disappeared.  So I asked the Microsoft help chat.  Who said that
idle.bat would not work anyway.  I tried to copy idle.exe from my desktop
(3.8) to my laptop (3.9). but no luck.
I was stuck, so raised my query on the topic of idle.exe.

I have installed 3.9 for all users and clicking the PATH box, and on
C:\Program Files\Python39, which is declared on the environmental variable
list.

I had gone to the documentation page to sort the problem myself, but that
provided no relevant help, so raised the query about that page.

You have made clear that it is not really a Python issue, but my initial
mistake with Windows.
Have you any idea how I might undo the various wrong associations to get
back to the "edit with IDLE option" - reinstall 3.9?.  If not, I shall have
another go with Microsoft help.

Thank you

On Wed, 7 Oct 2020 at 18:20, E. Paine <report at bugs.python.org> wrote:

>
> E. Paine <paineelisha at gmail.com> added the comment:
>
> I am not touching the issue nosy and components for now but suspect this
> is a Windows installation issue. As you said, there is no `idle.exe` file
> and instead file association is done through a `idle.bat` file found at
> Lib/idlelib/idle.bat. I have a few of questions that I would appreciate if
> you could answer to give some more context:
>  - What behaviour is incorrect? Is it that double clicking doesn't launch
> python.exe or there is no "edit with IDLE" entry in the right-click menu?
>  - Did you install it for different users compared to the other versions
> (all users / admin vs. just for this user)
>  - Do you have any other Python versions installed simultaneously with 3.9?
>
> I agree it may be nice to give a brief overview on IDLE's
> "behind-the-scenes" though I am slightly confused why you raised this issue
> as a documentation issue.
>
> ----------
> nosy: +epaine
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue41968>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41968>
_______________________________________

From report at bugs.python.org  Thu Oct  8 13:31:43 2020
From: report at bugs.python.org (Tim Peters)
Date: Thu, 08 Oct 2020 17:31:43 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602178303.7.0.636471941566.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Good sleuthing, Dennis! Yes, Fredrik was not willing to add "potentially expensive" (in time or in space) tricks:

http://effbot.org/zone/stringlib.htm

So worst-case time is proportional to the product of the arguments' lengths, and the cases here appear to, essentially, hit that.  It _was_ a goal that it always be at least as fast as the dirt-dumb search algorithm it replaced, and in good real-life (not just contrived) cases to be much faster.  It met the goals it had.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Thu Oct  8 13:33:46 2020
From: report at bugs.python.org (Colin Watson)
Date: Thu, 08 Oct 2020 17:33:46 +0000
Subject: [issue38634] Symbol resolution conflict when embeding python in an
 application using libedit
In-Reply-To: <1572362225.21.0.644355885677.issue38634@roundup.psfhosted.org>
Message-ID: <1602178426.36.0.470871731179.issue38634@roundup.psfhosted.org>


Colin Watson <cjwatson at users.sourceforge.net> added the comment:

FWIW I just ran into what I believe to be this bug with the Launchpad test suite on Python 3.6.9.  The output shows some normal test output followed by:

No entry for terminal type "unknown";
using dumb terminal settings.
bind: Invalid command `enable-meta-key'.
No entry for terminal type "unknown";
using dumb terminal settings.
No entry for terminal type "unknown";
using dumb terminal settings.
Segmentation fault

The test suite imports a lot of stuff, but it includes something which links against libLLVM which links against libedit (I haven't worked out exactly what, but probably GTK-related).  Then something else much later imports readline - again, I haven't worked out what yet, as it's taken me a day just to set up the exact right environment in which to reproduce this at all and an strace doesn't make the cause of the import especially clear.

So I understand why you see this as a rare use case, but it's *extremely* confusing and a massive time sink when you do run across it, as the cause is a long way distant from the effect and it can arise in situations where it is in no way deliberate to have this sort of setup, but rather an emergent effect of several other things.

----------
nosy: +cjwatson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38634>
_______________________________________

From report at bugs.python.org  Thu Oct  8 13:49:07 2020
From: report at bugs.python.org (Maximilian Pichler)
Date: Thu, 08 Oct 2020 17:49:07 +0000
Subject: [issue41977] ctypes array inside structure requires explicit garbage
 collection
Message-ID: <1602179347.57.0.693191135909.issue41977@roundup.psfhosted.org>


New submission from Maximilian Pichler <maxim.pichler at gmail.com>:

If we initialize a `Structure` with two fields as...
```python
s = S()
s.x = (c_int * 10**8)()
s.y = s.x
```
...and then delete it with ```del s```, the memory allocated for the array is not freed until `gc.collect()` is called.

If instead we initalize `s` as...
```python
s = S()
a = (c_int * 10**8)()
s.x = a
s.y = a
del a
```
the memory is freed immediately, no need to garbage collect.

This behaviour seems inconsistent.

Also, if instead of `del s` we do...
```python
s.x = None
s.y = None
```
...memory usage remains high even after garbage collection.

Full code:
```python
import os, sys, gc
from ctypes import *

class S(Structure):
    _fields_ = [ ("x", POINTER(c_int)), ("y", POINTER(c_int)) ]

    def __del__(self):
        print("__del__ was called")

def dump_mem(): os.system(f"ps -o rss {os.getpid()}")

dump_mem() # ~ 6 MB

s = S()
s.x = (c_int * 10**8)()
s.y = s.x

dump_mem() # ~ 397 MB

del s # prints "__del__ was called" immediatly

dump_mem() # ~ 397 MB

gc.collect()

dump_mem() # ~ 6 MB
```

----------
components: ctypes
messages: 378262
nosy: maxim.pichler
priority: normal
severity: normal
status: open
title: ctypes array inside structure requires explicit garbage collection
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41977>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:01:24 2020
From: report at bugs.python.org (Tim Peters)
Date: Thu, 08 Oct 2020 18:01:24 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602180084.13.0.811594982692.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Just FYI, the original test program did get the right answer for the second search on my box - after about 3 1/2 hours :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:31:25 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 18:31:25 +0000
Subject: [issue41976] ctypes.util.find_library fails with gcc 9
In-Reply-To: <1602177471.33.0.207499643707.issue41976@roundup.psfhosted.org>
Message-ID: <1602181885.4.0.498367016928.issue41976@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 27ac19cca2c639caaf6fedf3632fe6beb265f24f by Pablo Galindo in branch 'master':
bpo-41976: Fix the fallback to gcc of ctypes.util.find_library when using gcc>9 (GH-22598)
https://github.com/python/cpython/commit/27ac19cca2c639caaf6fedf3632fe6beb265f24f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41976>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:31:37 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 18:31:37 +0000
Subject: [issue41976] ctypes.util.find_library fails with gcc 9
In-Reply-To: <1602177471.33.0.207499643707.issue41976@roundup.psfhosted.org>
Message-ID: <1602181897.61.0.51784328268.issue41976@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 1.0 -> 2.0
pull_requests: +21587
pull_request: https://github.com/python/cpython/pull/22599

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41976>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:33:11 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 18:33:11 +0000
Subject: [issue41976] ctypes.util.find_library fails with gcc 9
In-Reply-To: <1602177471.33.0.207499643707.issue41976@roundup.psfhosted.org>
Message-ID: <1602181991.77.0.832461465685.issue41976@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +21588
pull_request: https://github.com/python/cpython/pull/22600

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41976>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:33:49 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 18:33:49 +0000
Subject: [issue41976] ctypes.util.find_library fails with gcc 9
In-Reply-To: <1602177471.33.0.207499643707.issue41976@roundup.psfhosted.org>
Message-ID: <1602182029.79.0.0320802263392.issue41976@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +21589
pull_request: https://github.com/python/cpython/pull/22601

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41976>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:32:31 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 08 Oct 2020 18:32:31 +0000
Subject: [issue41968] 3.9 IDLE documentation.
In-Reply-To: <1602078849.36.0.609804596157.issue41968@roundup.psfhosted.org>
Message-ID: <1602181951.08.0.526647582593.issue41968@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Velson, when you respond to a post by email, rather than on the web page, please delete the post you are responding to, except for maybe a quoted line or two.  When your response is added to the web page below previous posts, posts quoted in full constitute noise that makes the stream of posts harder to read.

I forgot to mention above that I added a link to this issue on #31329 so that when I work on that, I will be reminded to read comments here also.
They will be helpful.

IDLE is intended for learning to write Python programs and to develop programs that can be run directly with Python, without IDLE.  It is not intended for production runs (though there are a few cases where that might be sensible).  So, to run with IDLE, edit with IDLE and hit F5.

I installed 3.9.0 with the python.org Windows installer and clicked "[X] make this default" (or however that is worded, top of second page, I believe).  Double-clicking file.py or right-clicking and clicking Open runs the file with C:/Windows/py.exe, as I said in my first response.  py.exe then runs the file with the default python.exe.  Right-click also shows Edit with IDLE and a choice of versions.  To get this on your system, you probably best delete all pythons on your system and start over with the python.org installer.  For any more help on installing and using Python, please post to the python-list mail list.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41968>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:34:27 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 18:34:27 +0000
Subject: [issue33431] Change description about doc in programming, faq.
Message-ID: <1602182067.73.0.207030870524.issue33431@roundup.psfhosted.org>


New submission from Irit Katriel <iritkatriel at yahoo.com>:

lvhuiyang, I think the change you propose is correct and should be made. Why did you abandon the PR?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33431>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:38:51 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 18:38:51 +0000
Subject: [issue33431] Change description about doc in programming, faq.
In-Reply-To: <1602182067.73.0.207030870524.issue33431@roundup.psfhosted.org>
Message-ID: <1602182331.0.0.381219770496.issue33431@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I think the intention was "a method that mutates an argument".  As in, an arg other than self.

Nevertheless, I agree with removing the sweeping promise about the standard libraries.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33431>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:40:33 2020
From: report at bugs.python.org (Steve Dower)
Date: Thu, 08 Oct 2020 18:40:33 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1602182433.88.0.767820110257.issue41557@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset bfe6e03cd6931813dd61b50f5fdf7d8a8848f4cd by Erlend Egeberg Aasland in branch 'master':
bpo-41557: Update Windows installer to use SQLite 3.33.0 (GH-21960)
https://github.com/python/cpython/commit/bfe6e03cd6931813dd61b50f5fdf7d8a8848f4cd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:40:42 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 18:40:42 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1602182442.85.0.165853671692.issue41557@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21590
pull_request: https://github.com/python/cpython/pull/22602

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:40:52 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 18:40:52 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1602182452.14.0.481963964389.issue41557@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21591
pull_request: https://github.com/python/cpython/pull/22603

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:43:46 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 18:43:46 +0000
Subject: [issue33894] tempfile.tempdir cannot be unset
In-Reply-To: <1529307283.94.0.56676864532.issue33894@psf.upfronthosting.co.za>
Message-ID: <1602182626.65.0.987318100626.issue33894@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This is complete and can be closed.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33894>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:50:37 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 18:50:37 +0000
Subject: [issue41976] ctypes.util.find_library fails with gcc 9
In-Reply-To: <1602177471.33.0.207499643707.issue41976@roundup.psfhosted.org>
Message-ID: <1602183037.09.0.878882262626.issue41976@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 6ceb5232aeb1943dacbbdb87e7dddfaa716678bc by Pablo Galindo in branch '3.8':
[3.8] bpo-41976: Fix the fallback to gcc of ctypes.util.find_library when using gcc>9 (GH-22598). (GH-22600)
https://github.com/python/cpython/commit/6ceb5232aeb1943dacbbdb87e7dddfaa716678bc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41976>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:50:41 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 18:50:41 +0000
Subject: [issue41976] ctypes.util.find_library fails with gcc 9
In-Reply-To: <1602177471.33.0.207499643707.issue41976@roundup.psfhosted.org>
Message-ID: <1602183041.25.0.490704356907.issue41976@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 9b5a023a5dc3127da15253f7acad71019395ebe1 by Pablo Galindo in branch '3.7':
[3.7] bpo-41976: Fix the fallback to gcc of ctypes.util.find_library when using gcc>9 (GH-22598). (GH-22601)
https://github.com/python/cpython/commit/9b5a023a5dc3127da15253f7acad71019395ebe1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41976>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:51:56 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 18:51:56 +0000
Subject: [issue31432] Documention for CERT_OPTIONAL is misleading
In-Reply-To: <1505232519.67.0.963615295738.issue31432@psf.upfronthosting.co.za>
Message-ID: <1602183116.98.0.526825881308.issue31432@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31432>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:54:50 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 18:54:50 +0000
Subject: [issue33167] RFC Documentation Updates to urllib.parse.rst
In-Reply-To: <1522237726.19.0.467229070634.issue33167@psf.upfronthosting.co.za>
Message-ID: <1602183290.16.0.657570394745.issue33167@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Since the PR was abandoned as out of date, should this issue be closed as well?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33167>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:55:32 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 18:55:32 +0000
Subject: [issue41976] ctypes.util.find_library fails with gcc 9
In-Reply-To: <1602177471.33.0.207499643707.issue41976@roundup.psfhosted.org>
Message-ID: <1602183332.02.0.105154268924.issue41976@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset a4ac5fadf55a9743c6812dea8d31ca4f05f33829 by Miss Skeleton (bot) in branch '3.9':
bpo-41976: Fix the fallback to gcc of ctypes.util.find_library when using gcc>9 (GH-22598)
https://github.com/python/cpython/commit/a4ac5fadf55a9743c6812dea8d31ca4f05f33829


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41976>
_______________________________________

From report at bugs.python.org  Thu Oct  8 14:57:40 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 18:57:40 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1602183460.81.0.413894021037.issue41557@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 30a788990af55b950db424b9cc5408b51e0b24ed by Miss Skeleton (bot) in branch '3.8':
bpo-41557: Update Windows installer to use SQLite 3.33.0 (GH-21960)
https://github.com/python/cpython/commit/30a788990af55b950db424b9cc5408b51e0b24ed


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Thu Oct  8 15:02:40 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 08 Oct 2020 19:02:40 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1602183760.09.0.965862753444.issue41557@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 089c38677d2269ab52924e4eb117394a74dfd2d9 by Miss Skeleton (bot) in branch '3.9':
bpo-41557: Update Windows installer to use SQLite 3.33.0 (GH-21960)
https://github.com/python/cpython/commit/089c38677d2269ab52924e4eb117394a74dfd2d9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Thu Oct  8 15:04:28 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 19:04:28 +0000
Subject: [issue21257] Document parse_headers function of http.client
In-Reply-To: <1397666699.47.0.0992171618243.issue21257@psf.upfronthosting.co.za>
Message-ID: <1602183868.94.0.946072205444.issue21257@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete. Can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21257>
_______________________________________

From report at bugs.python.org  Thu Oct  8 15:04:10 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 19:04:10 +0000
Subject: [issue41976] ctypes.util.find_library fails with gcc 9
In-Reply-To: <1602177471.33.0.207499643707.issue41976@roundup.psfhosted.org>
Message-ID: <1602183850.15.0.398556364534.issue41976@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41976>
_______________________________________

From report at bugs.python.org  Thu Oct  8 15:09:47 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 19:09:47 +0000
Subject: [issue27351] Unexpected ConfigParser.read() behavior when passed
 fileobject
In-Reply-To: <1466311827.21.0.0107030173129.issue27351@psf.upfronthosting.co.za>
Message-ID: <1602184187.45.0.34996815598.issue27351@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27351>
_______________________________________

From report at bugs.python.org  Thu Oct  8 15:18:18 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 19:18:18 +0000
Subject: [issue23984] Documentation error: Descriptors
In-Reply-To: <1429245728.01.0.810263114275.issue23984@psf.upfronthosting.co.za>
Message-ID: <1602184698.37.0.550112004529.issue23984@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23984>
_______________________________________

From report at bugs.python.org  Thu Oct  8 15:21:08 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 19:21:08 +0000
Subject: [issue37209] Add what's new entries for pickle enhancements
In-Reply-To: <1560083927.43.0.0939739725641.issue37209@roundup.psfhosted.org>
Message-ID: <1602184868.62.0.279920158699.issue37209@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37209>
_______________________________________

From report at bugs.python.org  Thu Oct  8 15:21:16 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 08 Oct 2020 19:21:16 +0000
Subject: [issue39337] codecs.lookup() ignores non-ASCII characters,
 whereas encodings.normalize_encoding() copies them
In-Reply-To: <1579038882.16.0.589810918272.issue39337@roundup.psfhosted.org>
Message-ID: <1602184876.35.0.373833586511.issue39337@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 3f342376ab0da3b4c8a38a27edfafba8e8cdf52d by Hai Shi in branch 'master':
bpo-39337: Add a test case for normalizing of codec names (GH-19069)
https://github.com/python/cpython/commit/3f342376ab0da3b4c8a38a27edfafba8e8cdf52d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39337>
_______________________________________

From report at bugs.python.org  Thu Oct  8 15:24:54 2020
From: report at bugs.python.org (Patrick Reader)
Date: Thu, 08 Oct 2020 19:24:54 +0000
Subject: [issue41805] types.GenericAlias and types.Union have no documentation
In-Reply-To: <1600370908.0.0.224627521485.issue41805@roundup.psfhosted.org>
Message-ID: <1602185094.98.0.656346250003.issue41805@roundup.psfhosted.org>


Patrick Reader <pxeger at protonmail.com> added the comment:

Sorry, I'd completely forgotten about doing a PR for this. Go ahead!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41805>
_______________________________________

From report at bugs.python.org  Thu Oct  8 15:27:29 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 19:27:29 +0000
Subject: [issue37456] FAQ says positional arguments aren't a thing
In-Reply-To: <1561939777.04.0.384153036015.issue37456@roundup.psfhosted.org>
Message-ID: <1602185249.21.0.0958813423082.issue37456@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37456>
_______________________________________

From report at bugs.python.org  Thu Oct  8 15:34:11 2020
From: report at bugs.python.org (Sergey Nudnou)
Date: Thu, 08 Oct 2020 19:34:11 +0000
Subject: [issue38905] venv python reports wrong sys.executable in a subprocess
 on Windows
In-Reply-To: <1574583460.3.0.94905817038.issue38905@roundup.psfhosted.org>
Message-ID: <1602185651.2.0.0253021629311.issue38905@roundup.psfhosted.org>


Sergey Nudnou <nsmcan at belintech.com> added the comment:

Hello,

I've just run into a related issue. I have a python script, which starts an another python script using subprocess.Popen(). The parent script gets pid of the child and monitors up its activity through a database by this pid. The child script updates its activity in the database using the pid it gotten from os.getpid()

Both scripts live in a virtual environment.

It worked fine in Python 3.5 and stopped working after migration to Python 3.8.

My base Python location: D:\Python\Python38\pythonw.exe
Virtual Environment: D:\test\venv\Scripts\pythonw.exe

I have realized, that when I run the following from a command prompt:
D:\test\venv\Scripts\pythonw.exe test.py

2 processes with the different PIDs are created:
PID:                   97040
Parent PID:            12004  (cmd.exe)
Command Line:          D:\test\venv\Scripts\pythonw.exe test.py

PID:                   85548
Parent PID:            97040  (pythonw.exe)
Command Line:          D:\Python\Python38\pythonw.exe test.py

It is definitely a regression, and will potentially break a lot of applications expecting a child Python process to be a direct descendant of its parent.

Also it is a waste of system resources

----------
nosy: +nsmcan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38905>
_______________________________________

From report at bugs.python.org  Thu Oct  8 15:45:44 2020
From: report at bugs.python.org (Colin Watson)
Date: Thu, 08 Oct 2020 19:45:44 +0000
Subject: [issue38634] Symbol resolution conflict when embeding python in an
 application using libedit
In-Reply-To: <1572362225.21.0.644355885677.issue38634@roundup.psfhosted.org>
Message-ID: <1602186344.68.0.71565850884.issue38634@roundup.psfhosted.org>


Colin Watson <cjwatson at users.sourceforge.net> added the comment:

Here's a reasonably minimal reproduction recipe reduced from real code in the Launchpad test suite that doesn't require compiling a separate C extension.  It fails on Ubuntu 18.04 with the gir1.2-gtk-3.0, python3-gi, and xvfb packages installed.  (The xvfb-run part is just so that it works on a headless system; you can omit it if you have a working $DISPLAY.)

  xvfb-run python3 -c 'from gi.repository import Gtk; import readline'

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38634>
_______________________________________

From report at bugs.python.org  Thu Oct  8 16:11:50 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 08 Oct 2020 20:11:50 +0000
Subject: [issue33894] tempfile.tempdir cannot be unset
In-Reply-To: <1529307283.94.0.56676864532.issue33894@psf.upfronthosting.co.za>
Message-ID: <1602187910.95.0.499691031705.issue33894@roundup.psfhosted.org>


Change by Eric V. Smith <eric at trueblade.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33894>
_______________________________________

From report at bugs.python.org  Thu Oct  8 16:12:57 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 08 Oct 2020 20:12:57 +0000
Subject: [issue37456] FAQ says positional arguments aren't a thing
In-Reply-To: <1561939777.04.0.384153036015.issue37456@roundup.psfhosted.org>
Message-ID: <1602187977.4.0.302172801774.issue37456@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37456>
_______________________________________

From report at bugs.python.org  Thu Oct  8 16:28:59 2020
From: report at bugs.python.org (Florian Bruhin)
Date: Thu, 08 Oct 2020 20:28:59 +0000
Subject: [issue40747] sysconfig.get_config_var("py_version_nodot") should
 return 3_10
In-Reply-To: <1590266866.08.0.16909581495.issue40747@roundup.psfhosted.org>
Message-ID: <1602188939.94.0.815427502199.issue40747@roundup.psfhosted.org>


Change by Florian Bruhin <python.org at the-compiler.org>:


----------
nosy: +The Compiler

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40747>
_______________________________________

From report at bugs.python.org  Thu Oct  8 17:36:01 2020
From: report at bugs.python.org (Chris Jerdonek)
Date: Thu, 08 Oct 2020 21:36:01 +0000
Subject: [issue33647] Add re.replace(string, replacement_map)
In-Reply-To: <1527252737.56.0.682650639539.issue33647@psf.upfronthosting.co.za>
Message-ID: <1602192961.07.0.0535162718448.issue33647@roundup.psfhosted.org>


Chris Jerdonek <chris.jerdonek at gmail.com> added the comment:

Another API option is to use str.replace's existing arguments: str.replace(old, new[, count]). In addition to "old" and "new" being strings, they could also be lists of strings of equal length, similar to how str.maketrans() can accept two strings of equal length. Then, like maketrans(), each string in "old" would be replaced by the corresponding string at the same position in "new."

----------
nosy: +chris.jerdonek

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33647>
_______________________________________

From report at bugs.python.org  Thu Oct  8 17:46:34 2020
From: report at bugs.python.org (Chris Jerdonek)
Date: Thu, 08 Oct 2020 21:46:34 +0000
Subject: [issue33647] Add str.replace(replacement_map)
In-Reply-To: <1527252737.56.0.682650639539.issue33647@psf.upfronthosting.co.za>
Message-ID: <1602193594.85.0.133398121334.issue33647@roundup.psfhosted.org>


Change by Chris Jerdonek <chris.jerdonek at gmail.com>:


----------
title: Add re.replace(string, replacement_map) -> Add str.replace(replacement_map)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33647>
_______________________________________

From report at bugs.python.org  Thu Oct  8 17:53:09 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 21:53:09 +0000
Subject: [issue34552] Clarify built-in types comparisons
In-Reply-To: <1535693872.67.0.56676864532.issue34552@psf.upfronthosting.co.za>
Message-ID: <1602193989.87.0.561686683126.issue34552@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34552>
_______________________________________

From report at bugs.python.org  Thu Oct  8 17:58:33 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 21:58:33 +0000
Subject: [issue35404] Document how to import _structure in email.message
In-Reply-To: <1543914095.32.0.788709270274.issue35404@psf.upfronthosting.co.za>
Message-ID: <1602194313.35.0.435857055255.issue35404@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35404>
_______________________________________

From report at bugs.python.org  Thu Oct  8 18:06:03 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 08 Oct 2020 22:06:03 +0000
Subject: [issue34552] Clarify built-in types comparisons
In-Reply-To: <1535693872.67.0.56676864532.issue34552@psf.upfronthosting.co.za>
Message-ID: <1602194763.7.0.818041265839.issue34552@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Yup. Thanks for catching this!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34552>
_______________________________________

From report at bugs.python.org  Thu Oct  8 18:28:52 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 22:28:52 +0000
Subject: [issue20582] socket.getnameinfo() does not document flags
In-Reply-To: <1392042265.22.0.885252016144.issue20582@psf.upfronthosting.co.za>
Message-ID: <1602196132.46.0.477980965116.issue20582@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20582>
_______________________________________

From report at bugs.python.org  Thu Oct  8 18:37:36 2020
From: report at bugs.python.org (Mariatta)
Date: Thu, 08 Oct 2020 22:37:36 +0000
Subject: [issue35404] Document how to import _structure in email.message
In-Reply-To: <1543914095.32.0.788709270274.issue35404@psf.upfronthosting.co.za>
Message-ID: <1602196656.86.0.802453017029.issue35404@roundup.psfhosted.org>


Change by Mariatta <mariatta at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35404>
_______________________________________

From report at bugs.python.org  Thu Oct  8 19:09:16 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 23:09:16 +0000
Subject: [issue27141] Fix collections.UserList shallow copy
In-Reply-To: <1464384542.41.0.303372176211.issue27141@psf.upfronthosting.co.za>
Message-ID: <1602198556.34.0.72122262352.issue27141@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27141>
_______________________________________

From report at bugs.python.org  Thu Oct  8 19:14:59 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 23:14:59 +0000
Subject: [issue24538] os.setxattr PermissionError on panfs propagates up
 causing `copystat`, `copytree`, and `pip install .` to fail unhepfully
In-Reply-To: <1435666041.75.0.103684760482.issue24538@psf.upfronthosting.co.za>
Message-ID: <1602198899.21.0.380680092103.issue24538@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24538>
_______________________________________

From report at bugs.python.org  Thu Oct  8 19:29:59 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 08 Oct 2020 23:29:59 +0000
Subject: [issue39450] unittest TestCase shortDescription does not strip
 whitespace
In-Reply-To: <1579914213.48.0.14030240002.issue39450@roundup.psfhosted.org>
Message-ID: <1602199799.1.0.88611814166.issue39450@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39450>
_______________________________________

From report at bugs.python.org  Thu Oct  8 19:39:16 2020
From: report at bugs.python.org (Saiyang Gou)
Date: Thu, 08 Oct 2020 23:39:16 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1602200356.38.0.0154462381193.issue41192@roundup.psfhosted.org>


Saiyang Gou <gousaiyang223 at gmail.com> added the comment:

Hi Steve. If you had time could you review PR 21308, PR 21310 and PR 21322? Thanks!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Thu Oct  8 19:53:03 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 08 Oct 2020 23:53:03 +0000
Subject: [issue23984] Documentation error: Descriptors
In-Reply-To: <1429245728.01.0.810263114275.issue23984@psf.upfronthosting.co.za>
Message-ID: <1602201183.93.0.0572230085126.issue23984@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23984>
_______________________________________

From report at bugs.python.org  Thu Oct  8 19:54:31 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 08 Oct 2020 23:54:31 +0000
Subject: [issue26680] Incorporating float.is_integer into Decimal
In-Reply-To: <1459452864.35.0.120403756979.issue26680@psf.upfronthosting.co.za>
Message-ID: <1602201271.63.0.981922460979.issue26680@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Thanks.  I'm hoping that this will easy now the most of the details have already been worked out.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26680>
_______________________________________

From report at bugs.python.org  Thu Oct  8 20:48:29 2020
From: report at bugs.python.org (Chris Jerdonek)
Date: Fri, 09 Oct 2020 00:48:29 +0000
Subject: [issue39450] unittest TestCase shortDescription does not strip
 whitespace
In-Reply-To: <1579914213.48.0.14030240002.issue39450@roundup.psfhosted.org>
Message-ID: <1602204509.68.0.266505184724.issue39450@roundup.psfhosted.org>


Chris Jerdonek <chris.jerdonek at gmail.com> added the comment:

I believe this also resolves issue 30181 (which was the same issue).

----------
nosy: +chris.jerdonek
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39450>
_______________________________________

From report at bugs.python.org  Thu Oct  8 20:51:18 2020
From: report at bugs.python.org (Chris Jerdonek)
Date: Fri, 09 Oct 2020 00:51:18 +0000
Subject: [issue30181] Correct the parsing of a test case docstring.
In-Reply-To: <1493261074.73.0.807341942876.issue30181@psf.upfronthosting.co.za>
Message-ID: <1602204678.24.0.484747423156.issue30181@roundup.psfhosted.org>


Chris Jerdonek <chris.jerdonek at gmail.com> added the comment:

I believe this was addressed by issue 39450, which I think was technically a duplicate of this issue.

----------
nosy: +chris.jerdonek

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30181>
_______________________________________

From report at bugs.python.org  Thu Oct  8 22:19:53 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 09 Oct 2020 02:19:53 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602209993.16.0.978224739695.issue41894@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Yes, please.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Thu Oct  8 23:01:41 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 09 Oct 2020 03:01:41 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602212501.51.0.287650307301.issue41970@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
pull_requests: +21592
pull_request: https://github.com/python/cpython/pull/22609

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Thu Oct  8 23:12:56 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 09 Oct 2020 03:12:56 +0000
Subject: [issue41877] Check against misspellings of assert etc. in mock
In-Reply-To: <1601317157.88.0.730935461305.issue41877@roundup.psfhosted.org>
Message-ID: <1602213176.01.0.146210778395.issue41877@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

See also below issues for previous discussion on making the assert helpers as top level functions : 

https://bugs.python.org/issue24651
https://bugs.python.org/issue30949

----------
nosy: +cjw296, lisroach, mariocj89, rbcollins, xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41877>
_______________________________________

From report at bugs.python.org  Thu Oct  8 23:51:28 2020
From: report at bugs.python.org (Olexa Bilaniuk)
Date: Fri, 09 Oct 2020 03:51:28 +0000
Subject: [issue24538] os.setxattr PermissionError on panfs propagates up
 causing `copystat`, `copytree`, and `pip install .` to fail unhepfully
In-Reply-To: <1435666041.75.0.103684760482.issue24538@psf.upfronthosting.co.za>
Message-ID: <1602215488.68.0.0211422177284.issue24538@roundup.psfhosted.org>


Olexa Bilaniuk <obilaniu at gmail.com> added the comment:

Yes, it may be closed. The fix was merged in time to make it into Python 3.7.4 and 3.8.0, and solved the problems we were facing with fancy filesystem xattrs on read-only files.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24538>
_______________________________________

From report at bugs.python.org  Thu Oct  8 23:53:47 2020
From: report at bugs.python.org (Tim Peters)
Date: Fri, 09 Oct 2020 03:53:47 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602215627.97.0.76804330938.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

BTW, this initialization in the FASTSEARCH code appears to me to be a mistake:

    skip = mlast - 1;

That's "mistake" in the sense of "not quite what was intended, and so confusing", not in the sense of "leads to a wrong result".

I believe `skip` should be initialized to plain `mlast` instead.  Setting it to something smaller than that (like to `mlast - 1`) doesn't cause an error, but fails to exploit as much skipping as possible.

`mlast - 1` is the same value `skip` is set to if the following loop finds that the last character of the pattern is also the pattern's first character, but doesn't appear elsewhere in the pattern. It can be one larger if the last pattern character is unique in the pattern (which is the initial value of `skip` set by the line shown above).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Fri Oct  9 00:11:48 2020
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Fri, 09 Oct 2020 04:11:48 +0000
Subject: [issue41877] Check against misspellings of assert etc. in mock
In-Reply-To: <1601317157.88.0.730935461305.issue41877@roundup.psfhosted.org>
Message-ID: <1602216708.13.0.23712199708.issue41877@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

Of course, that's why I wrote "my" in quotes above. It's not my solution, it's the idea that many people independently had. Because it is _the_ solution, of course. :-]

I'd just like to point out in the above thread (first link you provided), how _many_ people operate under the assumption that "misspelling problems are now solved". I'm sure many of their opinions would be different if they knew we'd be having this discussion now.

Let's not make the same mistake again. I assure you that in few more years we'll find some other creative ways to misspell arrest_* methods. ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41877>
_______________________________________

From report at bugs.python.org  Fri Oct  9 01:10:30 2020
From: report at bugs.python.org (Thomas M. Alldread)
Date: Fri, 09 Oct 2020 05:10:30 +0000
Subject: [issue41978] numpy,
 scipy packages failed to install via pip - Windows 10 Pro 64 bit
Message-ID: <1602220230.71.0.716274521226.issue41978@roundup.psfhosted.org>


New submission from Thomas M. Alldread <tma.7ta at gmail.com>:

Several attempts to install numpy/scipy packages failed. Pip reported pages of error information. Reverting back to version 3.8.5 resolved the issue using the exact same procedure.

----------
components: Extension Modules, Installation, Windows
messages: 378303
nosy: paul.moore, steve.dower, tim.golden, tma, zach.ware
priority: normal
severity: normal
status: open
title: numpy, scipy packages failed to install via pip - Windows 10 Pro 64 bit
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41978>
_______________________________________

From report at bugs.python.org  Fri Oct  9 01:57:12 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Fri, 09 Oct 2020 05:57:12 +0000
Subject: [issue26389] Expand traceback module API to accept just an exception
 as an argument
In-Reply-To: <1455836350.85.0.0162824201978.issue26389@psf.upfronthosting.co.za>
Message-ID: <1602223032.12.0.548479568956.issue26389@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
nosy: +ZackerySpytz
nosy_count: 6.0 -> 7.0
pull_requests: +21593
pull_request: https://github.com/python/cpython/pull/22610

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26389>
_______________________________________

From report at bugs.python.org  Fri Oct  9 02:20:16 2020
From: report at bugs.python.org (=?utf-8?q?J=C3=BCrgen_Gmach?=)
Date: Fri, 09 Oct 2020 06:20:16 +0000
Subject: [issue41978] numpy,
 scipy packages failed to install via pip - Windows 10 Pro 64 bit
In-Reply-To: <1602220230.71.0.716274521226.issue41978@roundup.psfhosted.org>
Message-ID: <1602224416.31.0.441494301498.issue41978@roundup.psfhosted.org>


J?rgen Gmach <juergen.gmach at googlemail.com> added the comment:

While e.g. numpy already shows Python 3.9 support on their GitHub repository ( https://github.com/numpy/numpy/blob/master/setup.py ), there is no Python 3.9 compatible package on PyPI yet ( https://pypi.org/project/numpy/#files ).

I guess you have to wait a bit more until there will be a new release.

Also, this is the cpython issue tracker. When you have problems with a specific package, it is best to seek help at their issue tracker. For numpy this would be https://github.com/numpy/numpy/issues

Actually, there is already an issue on their tracker about support for Python 3.9
https://github.com/numpy/numpy/issues/17482

I suggest to close this issue here.

----------
nosy: +jugmac00

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41978>
_______________________________________

From report at bugs.python.org  Fri Oct  9 02:56:54 2020
From: report at bugs.python.org (Joshua Oreman)
Date: Fri, 09 Oct 2020 06:56:54 +0000
Subject: [issue41979] PEG parser doesn't accept extended unpacking in with
 statement
Message-ID: <1602226614.34.0.867074819586.issue41979@roundup.psfhosted.org>


New submission from Joshua Oreman <oremanj at gmail.com>:

On Python 3.9.0 with the new PEG parser, the following statement produces a SyntaxError:

with contextlib.nullcontext(range(1, 5)) as (first, *rest, last):
    print(first, rest, last)

On 3.8.x, or 3.9.0 with -X oldparser, it succeeds and prints "1 [2, 3] 4" as expected.

As I understand it, the thing after 'as' is an assignment target and should accept anything that can go on the LHS of an equals sign.

----------
components: Interpreter Core
messages: 378305
nosy: Joshua Oreman
priority: normal
severity: normal
status: open
title: PEG parser doesn't accept extended unpacking in with statement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41979>
_______________________________________

From report at bugs.python.org  Fri Oct  9 03:23:10 2020
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 09 Oct 2020 07:23:10 +0000
Subject: [issue41978] numpy,
 scipy packages failed to install via pip - Windows 10 Pro 64 bit
In-Reply-To: <1602220230.71.0.716274521226.issue41978@roundup.psfhosted.org>
Message-ID: <1602228190.77.0.528831575104.issue41978@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

As J?rgen said numpy does not provide binaries for Python 3.9 yet. Please report the issue with numpy and request builds for Python 3.9.

----------
nosy: +christian.heimes
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41978>
_______________________________________

From report at bugs.python.org  Fri Oct  9 03:23:26 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 07:23:26 +0000
Subject: [issue41979] PEG parser doesn't accept extended unpacking in with
 statement
In-Reply-To: <1602226614.34.0.867074819586.issue41979@roundup.psfhosted.org>
Message-ID: <1602228206.49.0.506580368227.issue41979@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +benjamin.peterson, gvanrossum, pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41979>
_______________________________________

From report at bugs.python.org  Fri Oct  9 03:54:58 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Fri, 09 Oct 2020 07:54:58 +0000
Subject: [issue41979] PEG parser doesn't accept extended unpacking in with
 statement
In-Reply-To: <1602226614.34.0.867074819586.issue41979@roundup.psfhosted.org>
Message-ID: <1602230098.48.0.986313998732.issue41979@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41979>
_______________________________________

From report at bugs.python.org  Fri Oct  9 04:00:59 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Fri, 09 Oct 2020 08:00:59 +0000
Subject: [issue41979] PEG parser doesn't accept extended unpacking in with
 statement
In-Reply-To: <1602226614.34.0.867074819586.issue41979@roundup.psfhosted.org>
Message-ID: <1602230459.2.0.527431578638.issue41979@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
keywords: +patch
pull_requests: +21594
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22611

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41979>
_______________________________________

From report at bugs.python.org  Fri Oct  9 04:12:47 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 09 Oct 2020 08:12:47 +0000
Subject: [issue41974] Remove complex.__float__, complex.__floordiv__, etc
In-Reply-To: <1602140125.13.0.506221233573.issue41974@roundup.psfhosted.org>
Message-ID: <1602231167.3.0.477838284447.issue41974@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

+1 This makes sense.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41974>
_______________________________________

From report at bugs.python.org  Fri Oct  9 05:24:41 2020
From: report at bugs.python.org (=?utf-8?q?J=C3=BCrgen_Gmach?=)
Date: Fri, 09 Oct 2020 09:24:41 +0000
Subject: [issue41963] ConfigParser: stripping of comments should be documented
In-Reply-To: <1602055269.91.0.0897084304522.issue41963@roundup.psfhosted.org>
Message-ID: <1602235481.92.0.767870203996.issue41963@roundup.psfhosted.org>


J?rgen Gmach <juergen.gmach at googlemail.com> added the comment:

The Python wiki mentions that "writing to an INI file will wipe out all comments".

https://wiki.python.org/moin/ConfigParserExamples

So, when updating the docstrings, it may be a good idea to both add a note at the read methods, that comments get ignored and to the write method(s) that on writing, the possible previous existing comments get removed.

Are there any thoughts on this or should I go forward and create a pull request?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41963>
_______________________________________

From report at bugs.python.org  Fri Oct  9 05:56:57 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 09 Oct 2020 09:56:57 +0000
Subject: [issue41979] PEG parser doesn't accept extended unpacking in with
 statement
In-Reply-To: <1602226614.34.0.867074819586.issue41979@roundup.psfhosted.org>
Message-ID: <1602237417.53.0.523925812893.issue41979@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 48f305fd122080a9181cbda33bdb42ea36a0136f by Batuhan Taskaya in branch 'master':
bpo-41979: Accept star-unpacking on with-item targets (GH-22611)
https://github.com/python/cpython/commit/48f305fd122080a9181cbda33bdb42ea36a0136f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41979>
_______________________________________

From report at bugs.python.org  Fri Oct  9 05:58:18 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Fri, 09 Oct 2020 09:58:18 +0000
Subject: [issue41979] PEG parser doesn't accept extended unpacking in with
 statement
In-Reply-To: <1602226614.34.0.867074819586.issue41979@roundup.psfhosted.org>
Message-ID: <1602237498.25.0.472911168319.issue41979@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41979>
_______________________________________

From report at bugs.python.org  Fri Oct  9 06:05:38 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Fri, 09 Oct 2020 10:05:38 +0000
Subject: [issue41979] PEG parser doesn't accept extended unpacking in with
 statement
In-Reply-To: <1602226614.34.0.867074819586.issue41979@roundup.psfhosted.org>
Message-ID: <1602237938.44.0.896450345766.issue41979@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
pull_requests: +21595
pull_request: https://github.com/python/cpython/pull/22612

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41979>
_______________________________________

From report at bugs.python.org  Fri Oct  9 06:08:49 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 09 Oct 2020 10:08:49 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602238129.65.0.883470354189.issue41970@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset c6f41e62f55933f9735e9b9c103c6860685b028a by Karthikeyan Singaravelan in branch '3.9':
[3.9] bpo-41970: Avoid test failure in test_lib2to3 if the module is already imported (GH-22595) (GH-22609)
https://github.com/python/cpython/commit/c6f41e62f55933f9735e9b9c103c6860685b028a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Fri Oct  9 06:09:01 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 09 Oct 2020 10:09:01 +0000
Subject: [issue41970] test_lib2to3 fails since Python 3.9
In-Reply-To: <1602111957.98.0.0630069409673.issue41970@roundup.psfhosted.org>
Message-ID: <1602238141.38.0.408571204464.issue41970@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41970>
_______________________________________

From report at bugs.python.org  Fri Oct  9 06:31:15 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 09 Oct 2020 10:31:15 +0000
Subject: [issue41979] PEG parser doesn't accept extended unpacking in with
 statement
In-Reply-To: <1602226614.34.0.867074819586.issue41979@roundup.psfhosted.org>
Message-ID: <1602239475.59.0.120757871035.issue41979@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 42157b9eaa7f4de69a5f5f65d4403d70efa6a5c2 by Batuhan Taskaya in branch '3.9':
[3.9] bpo-41979: Accept star-unpacking on with-item targets (GH-22611) (GH-22612)
https://github.com/python/cpython/commit/42157b9eaa7f4de69a5f5f65d4403d70efa6a5c2


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41979>
_______________________________________

From report at bugs.python.org  Fri Oct  9 06:37:30 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 09 Oct 2020 10:37:30 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1602239850.22.0.400690043365.issue41557@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Fri Oct  9 06:37:45 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 09 Oct 2020 10:37:45 +0000
Subject: [issue41557] Upgrade Windows and macOS builds to use SQLite 3.33
In-Reply-To: <1597485864.38.0.170390742774.issue41557@roundup.psfhosted.org>
Message-ID: <1602239865.83.0.0903983274112.issue41557@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Merged to 3.10, 3.9, 3.8 on both builds. Closing this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41557>
_______________________________________

From report at bugs.python.org  Fri Oct  9 07:00:19 2020
From: report at bugs.python.org (=?utf-8?q?J=C3=BCrgen_Gmach?=)
Date: Fri, 09 Oct 2020 11:00:19 +0000
Subject: [issue41963] ConfigParser: stripping of comments should be documented
In-Reply-To: <1602055269.91.0.0897084304522.issue41963@roundup.psfhosted.org>
Message-ID: <1602241219.43.0.977586914643.issue41963@roundup.psfhosted.org>


J?rgen Gmach <juergen.gmach at googlemail.com> added the comment:

pymotw.com shows a big red warning about comments not being preserved:

https://pymotw.com/3/configparser/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41963>
_______________________________________

From report at bugs.python.org  Fri Oct  9 07:08:44 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 09 Oct 2020 11:08:44 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1602241724.88.0.854750252567.issue41490@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

setuptools is still more recent in 3.9 than in master. Look at PR 21748.

Can someone try to update setuptools in master?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Fri Oct  9 07:14:49 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 11:14:49 +0000
Subject: [issue41974] Remove complex.__float__, complex.__floordiv__, etc
In-Reply-To: <1602140125.13.0.506221233573.issue41974@roundup.psfhosted.org>
Message-ID: <1602242089.56.0.0220114216858.issue41974@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset e2ec0b27c02a158d0007c11dcc1f2d7a95948712 by Serhiy Storchaka in branch 'master':
bpo-41974: Remove complex.__float__, complex.__floordiv__, etc (GH-22593)
https://github.com/python/cpython/commit/e2ec0b27c02a158d0007c11dcc1f2d7a95948712


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41974>
_______________________________________

From report at bugs.python.org  Fri Oct  9 07:15:51 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 11:15:51 +0000
Subject: [issue41974] Remove complex.__float__, complex.__floordiv__, etc
In-Reply-To: <1602140125.13.0.506221233573.issue41974@roundup.psfhosted.org>
Message-ID: <1602242151.61.0.950497432157.issue41974@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41974>
_______________________________________

From report at bugs.python.org  Fri Oct  9 08:34:19 2020
From: report at bugs.python.org (Yannick Gingras)
Date: Fri, 09 Oct 2020 12:34:19 +0000
Subject: [issue41980] Argparse documentation is slightly misleading
Message-ID: <1602246859.95.0.133972345732.issue41980@roundup.psfhosted.org>


New submission from Yannick Gingras <ygingras at ygingras.net>:

In argparse.rst, while documenting ArgumentParser.add_subparsers, ``prog`` is described on line 1630 as:
  usage information that will be displayed with sub-command help,
  by default the name of the program and any positional arguments 
  before the subparser argument

This is confusing since ``prog`` is actually a very small prefix of the usage message.  Describing this parameter as "name of the program" or event "name of the program with sub-commands" would be more clear.

----------
components: Library (Lib)
messages: 378316
nosy: ygingras
priority: normal
severity: normal
status: open
title: Argparse documentation is slightly misleading
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41980>
_______________________________________

From report at bugs.python.org  Fri Oct  9 09:19:51 2020
From: report at bugs.python.org (Federico Tesser)
Date: Fri, 09 Oct 2020 13:19:51 +0000
Subject: [issue41981] Errors building python 3.9.0 from source
Message-ID: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>


New submission from Federico Tesser <federico.tesser at polito.it>:

Good afternoon.

I have some problems building python 3.9.0 from source.

Here's my configuration:

CC=/usr/local/gcc-10.2.0/bin/gcc CXX=/usr/local/gcc-10.2.0/bin/g++ CFLAGS="-I/usr/local/libuuid-1.0.3/include/ -I/usr/local/libuuid-1.0.3/include/uuid/ -I/usr/local/xz-utils-5.2.4/include/ -I/usr/local/bzip2-1.0.8/include/ -I/usr/local/gdbm-1.18.1/include/ -I/usr/local/libffi-3.3/include/ -I/usr/local/openssl-1.1.1d/openssl-1.1.1d/include/ -I/usr/local/ncurses-6.2/include/ncursestw/ -I/usr/local/readline-8.0/include/readline/ -I/usr/local/x11-7.7/libx11-1.5.0/include/ -I/usr/local/tk-8.7a3/include/ -I/usr/local/tcl-8.7a3/include/" CPPFLAGS="-I/usr/local/libuuid-1.0.3/include/ -I/usr/local/libuuid-1.0.3/include/uuid/ -I/usr/local/xz-utils-5.2.4/include/ -I/usr/local/bzip2-1.0.8/include/ -I/usr/local/gdbm-1.18.1/include/ -I/usr/local/libffi-3.3/include/ -I/usr/local/openssl-1.1.1d/openssl-1.1.1d/include/ -I/usr/local/ncurses-6.2/include/ncursestw/ -I/usr/local/readline-8.0/include/readline/ -I/usr/local/x11-7.7/libx11-1.5.0/include/ -I/usr/local/tk-8.7a3/include/ -I/usr/local/tcl-8.7a3/include/" LDFLAGS="-L/usr/local/libuuid-1.0.3/lib/ -L/usr/local/xz-utils-5.2.4/lib/ -L/usr/local/bzip2-1.0.8/lib/ -L/usr/local/gdbm-1.18.1/lib/ -L/usr/local/libffi-3.3/lib64/ -L/usr/local/openssl-1.1.1d/openssl-1.1.1d/lib/ -L/usr/local/ncurses-6.2/lib/ -L/usr/local/readline-8.0/lib/ -L/usr/local/x11-7.7/libx11-1.5.0/lib/ -L/usr/local/tk-8.7a3/lib/ -L/usr/local/tcl-8.7a3/lib/" PKG_CONFIG_PATH="/usr/local/libuuid-1.0.3/lib/pkgconfig/:/usr/local/xz-utils-5.2.4/lib/pkgconfig/:/usr/local/libffi-3.3/lib/pkgconfig/:/lib64/pkgconfig/:/usr/local/readline-8.0/lib/pkgconfig/:/usr/local/x11-7.7/libx11-1.5.0/lib/pkgconfig/:/usr/local/tk-8.7a3/lib/pkgconfig/:/usr/local/tcl-8.7a3/lib/pkgconfig/" ./configure --prefix=/usr/local/python-3.9.0/ --with-tcltk-includes="-I/usr/local/tcl-8.7a3/include/ -I/usr/local/tk-8.7a3/include/" --with-tcltk-libs="-L/usr/local/tcl-8.7a3/lib/ -L/usr/local/tk-8.7a3/lib/" --with-libs="-luuid -lX11 -ltcl8.7 -ltk8.7 -lpanelw -lbz2" --disable-ipv6 --enable-optimizations --with-lto

During the make process, I receive the following error:

Python/pytime.c: In function ?pymonotonic?:
Python/pytime.c:907:9: error: implicit declaration of function ?pytime_fromtimespec?; did you mean ?pytime_fromtimeval?? [-Werror=implicit-function-declaration]
  907 |     if (pytime_fromtimespec(tp, &ts, raise) < 0) {
      |         ^~~~~~~~~~~~~~~~~~~
      |         pytime_fromtimeval
cc1: some warnings being treated as errors

If in the Makefile I change the "-Werror=implicit-function-declaration"
as "-Wno-error=implicit-function-declaration", the building process continues, but then it get stuck at:

Python/strdup.c: In function ?strdup?:
Python/strdup.c:6:16: error: ?NULL? undeclared (first use in this function)
    6 |     if (str != NULL) {
      |                ^~~~
Python/strdup.c:1:1: note: ?NULL? is defined in header ?<stddef.h>?; did you forget to ?#include <stddef.h>??

If I add the "#include <stddef.h>" in file "Python/strdup.c:", then the process continues, until I receive the following error:

./Modules/getpath.c:1198:14: error: incompatible types when assigning to type ?PyStatus? from type ?int?

If I explicitly add in file "Include/internal/pycore_initconfig.h", just after line 25, the following 3 lines:

 .func = 0, \
 .err_msg = 0, \
 .exitcode = 0}

Addition wich does not help, because the building process stop itself again at the previous point.

Can you tell me where I am doing wrong?

Best regards,

Federico Tesser

----------
components: Installation
messages: 378317
nosy: ftesser
priority: normal
severity: normal
status: open
title: Errors building python 3.9.0 from source
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Fri Oct  9 09:28:15 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Fri, 09 Oct 2020 13:28:15 +0000
Subject: [issue41483] Do not acquire lock in MemoryHandler.flush() if no
 target defined
In-Reply-To: <1596607573.95.0.247308930011.issue41483@roundup.psfhosted.org>
Message-ID: <1602250095.34.0.731795612882.issue41483@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41483>
_______________________________________

From report at bugs.python.org  Fri Oct  9 09:31:39 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 09 Oct 2020 13:31:39 +0000
Subject: [issue41981] Errors building python 3.9.0 from source
In-Reply-To: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>
Message-ID: <1602250299.1.0.774045486115.issue41981@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

What is your operating system? Can you please attach your pyconfig.h file?

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Fri Oct  9 09:37:24 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 09 Oct 2020 13:37:24 +0000
Subject: [issue41981] Errors building python 3.9.0 from source
In-Reply-To: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>
Message-ID: <1602250644.32.0.623981536221.issue41981@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Python/strdup.c has been removed from the master branch in bpo-41340:

commit 5798f787779006a94a55ec74a86da4627de90146
Author: wasiher <watashiwaher at gmail.com>
Date:   Mon Jul 27 12:28:45 2020 +0900

    bpo-41340: Removed fallback implementation for strdup (GH-21634)

Your C library doesn't provide an implementation of strdup()?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Fri Oct  9 09:39:19 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 09 Oct 2020 13:39:19 +0000
Subject: [issue41981] Errors building python 3.9.0 from source
In-Reply-To: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>
Message-ID: <1602250759.07.0.397853942002.issue41981@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> ./Modules/getpath.c:1198:14: error: incompatible types when assigning to type ?PyStatus? from type ?int?

Do you have HAVE_READLINK defined? calculate_argv0_path() calls resolve_symlinks() without checking if HAVE_READLINK is defined.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Fri Oct  9 09:43:54 2020
From: report at bugs.python.org (iljah)
Date: Fri, 09 Oct 2020 13:43:54 +0000
Subject: [issue41982] Wrong location flagged as syntax error
Message-ID: <1602251034.78.0.495592912184.issue41982@roundup.psfhosted.org>


New submission from iljah <ilja.honkonen at protonmail.ch>:

File:
#! /usr/bin/env python3
with \
  open('file1', 'w') as file1,
  open('file2', 'w') as file2:

  print('ok')

gives error:
  File "./test.py", line 3
    open('file1', 'w') as file1,
                         ^
SyntaxError: invalid syntax

but adding \ after file1 fixes it:
  open('file1', 'w') as file1, \


Location flagged by syntax error (between as and file1) is not correct.

----------
components: Interpreter Core
messages: 378321
nosy: iljah
priority: normal
severity: normal
status: open
title: Wrong location flagged as syntax error
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41982>
_______________________________________

From report at bugs.python.org  Fri Oct  9 09:46:01 2020
From: report at bugs.python.org (iljah)
Date: Fri, 09 Oct 2020 13:46:01 +0000
Subject: [issue41982] Wrong location flagged as syntax error
In-Reply-To: <1602251034.78.0.495592912184.issue41982@roundup.psfhosted.org>
Message-ID: <1602251161.66.0.667507328313.issue41982@roundup.psfhosted.org>


iljah <ilja.honkonen at protonmail.ch> added the comment:

Python 3.8.5

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41982>
_______________________________________

From report at bugs.python.org  Fri Oct  9 09:47:25 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 09 Oct 2020 13:47:25 +0000
Subject: [issue41982] [Python 3.8] Wrong location flagged as syntax error
In-Reply-To: <1602251034.78.0.495592912184.issue41982@roundup.psfhosted.org>
Message-ID: <1602251245.06.0.392800901377.issue41982@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Python 3.9 parser seems to be more accurate. I don't think that it's worth it to attempt to enhance Python 3.8 error reporting, since Python 3.9 got a whole new parser.


@apu$ python3.8 x.py 
  File "x.py", line 4
    open('file1', 'w') as file1,
                         ^
SyntaxError: invalid syntax


$ python3.9 x.py 
  File "/home/vstinner/x.py", line 4
    open('file1', 'w') as file1,
                                ^
SyntaxError: invalid syntax

----------
nosy: +lys.nikolaou, pablogsal, vstinner
title: Wrong location flagged as syntax error -> [Python 3.8] Wrong location flagged as syntax error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41982>
_______________________________________

From report at bugs.python.org  Fri Oct  9 10:02:59 2020
From: report at bugs.python.org (Federico Tesser)
Date: Fri, 09 Oct 2020 14:02:59 +0000
Subject: [issue41981] Errors building python 3.9.0 from source
In-Reply-To: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>
Message-ID: <1602252179.4.0.399511237998.issue41981@roundup.psfhosted.org>


Federico Tesser <federico.tesser at polito.it> added the comment:

Operating System Centos 7.

Here attached the pyconfig.h.

Oddly, it seems that HAVE_READLINK is not configured.

Any suggestions?

----------
Added file: https://bugs.python.org/file49500/pyconfig.h

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Fri Oct  9 10:16:06 2020
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Fri, 09 Oct 2020 14:16:06 +0000
Subject: [issue35790] Correct the description of sys.exc_info() and add a code
 example
In-Reply-To: <1548002384.27.0.286179066843.issue35790@roundup.psfhosted.org>
Message-ID: <1602252966.56.0.092707836073.issue35790@roundup.psfhosted.org>


Change by G?ry <gery.ogam at gmail.com>:


----------
nosy: +cheryl.sabella -eric.araujo, ezio.melotti, willingc
title: Correct a statement about sys.exc_info() values restoration -> Correct the description of sys.exc_info() and add a code example
type:  -> enhancement
versions: +Python 3.6, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35790>
_______________________________________

From report at bugs.python.org  Fri Oct  9 10:19:43 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 09 Oct 2020 14:19:43 +0000
Subject: [issue41981] Errors building python 3.9.0 from source on Centos 7
 with GCC 10
In-Reply-To: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>
Message-ID: <1602253183.76.0.98740154355.issue41981@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Operating System Centos 7.

Oh. That's surprising: there are multiple RHEL7 buildbots and there is no build or test issue on this OS. I would expect Centos 7 to be support, except that you installed GCC 10. We also tested Python 3.9 on GCC 10. Again, I would expect no build issue.

> Oddly, it seems that HAVE_READLINK is not configured.

It might be something wrong with your build system.

In your pyconfig.h, I see can many issues:

/* #undef HAVE_STRDUP */
/* #undef HAVE_READLINK */
/* #undef HAVE_CLOCK_GETTIME */

Please check your compiler flags. Check also config.log: please attach it to the issue as well.

----------
title: Errors building python 3.9.0 from source -> Errors building python 3.9.0 from source on Centos 7 with GCC 10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Fri Oct  9 10:24:27 2020
From: report at bugs.python.org (Charalampos Stratakis)
Date: Fri, 09 Oct 2020 14:24:27 +0000
Subject: [issue41981] Errors building python 3.9.0 from source on Centos 7
 with GCC 10
In-Reply-To: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>
Message-ID: <1602253467.72.0.0627895489924.issue41981@roundup.psfhosted.org>


Charalampos Stratakis <cstratak at redhat.com> added the comment:

The RHEL7 buildbots test on the default system compiler (GCC 4.8). The combination of RHEL7 + GCC10 + Python 3.9 could do very weird stuff, and I don't think it would easy to support.

Generally the build environment of an OS is tied to the default compiler toolchain and that involves also the various compiler and linker flags which might be obsoleted in newer versions.

----------
nosy: +cstratak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Fri Oct  9 10:38:23 2020
From: report at bugs.python.org (Federico Tesser)
Date: Fri, 09 Oct 2020 14:38:23 +0000
Subject: [issue41981] Errors building python 3.9.0 from source on Centos 7
 with GCC 10
In-Reply-To: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>
Message-ID: <1602254303.72.0.72314303257.issue41981@roundup.psfhosted.org>


Federico Tesser <federico.tesser at polito.it> added the comment:

Same problems using gcc 4.8.5.
Attached you will find the corresponding "pyconfig.h" and "config.log"

It seems quite odd to me too

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Fri Oct  9 10:38:39 2020
From: report at bugs.python.org (Federico Tesser)
Date: Fri, 09 Oct 2020 14:38:39 +0000
Subject: [issue41981] Errors building python 3.9.0 from source on Centos 7
 with GCC 10
In-Reply-To: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>
Message-ID: <1602254319.64.0.280639839455.issue41981@roundup.psfhosted.org>


Change by Federico Tesser <federico.tesser at polito.it>:


Added file: https://bugs.python.org/file49501/pyconfig.h

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Fri Oct  9 10:42:20 2020
From: report at bugs.python.org (Federico Tesser)
Date: Fri, 09 Oct 2020 14:42:20 +0000
Subject: [issue41981] Errors building python 3.9.0 from source on Centos 7
 with GCC 10
In-Reply-To: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>
Message-ID: <1602254540.06.0.476414855814.issue41981@roundup.psfhosted.org>


Federico Tesser <federico.tesser at polito.it> added the comment:

Here the "config.log"

----------
Added file: https://bugs.python.org/file49502/config.log.tar.gz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Fri Oct  9 10:56:05 2020
From: report at bugs.python.org (Tim Peters)
Date: Fri, 09 Oct 2020 14:56:05 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602255365.34.0.522020934485.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

The attached fastsearch.diff removes the speed hit in the original test case and in the constructed one.

I don't know whether it "should be" applied, and really can't make time to dig into it.

The rationale:  when the last characters of the pattern string and the current search window don't match, this is what happens:  if the "Bloom filter" can prove that the character one beyond the search window isn't in the pattern at all, the search window is advanced by len(pattern) + 1 positions. Else it's advanced only 1 position.

What changes here: if the Bloom filter thinks the character one beyond the search window may be in the pattern, this goes on to see whether the Bloom filter thinks the last character in the search window may be in the pattern (by case assumption, we already know it's not the _last_ character in the pattern). If not, the search window can be advanced by len(pattern) positions.

So it adds an extra check in the last-characters-don't-match and next-character-may-be-in-the-pattern case:  if the last character is not in the pattern, it's irrelevant that the next character may be - there's no possible overall match including the last character, so we can move the search window beyond it.

The question is whether this costs more than it saves overall.  It saves literally hours of CPU time for one search in this report's case ;-)  But worst-case time remains O(m*n) regardless, just somewhat harder to provoke.

----------
keywords: +patch
Added file: https://bugs.python.org/file49503/fastsearch.diff

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Fri Oct  9 10:57:29 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 09 Oct 2020 14:57:29 +0000
Subject: [issue41981] Errors building python 3.9.0 from source on Centos 7
 with GCC 10
In-Reply-To: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>
Message-ID: <1602255449.27.0.865776208771.issue41981@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

config.log:

configure:11697: checking for readlink
configure:11697: gcc -pthread -(...) -lpanelw -lbz2 -lpthread -ldl  >&5
/bin/ld: cannot find -lpanelw

It seems like many tests are failing because of -lpanelw and the missing library.

According to config.log, you passed it explicitly to the configure command:

  $ ./configure --prefix=/usr/local/python-3.9.0/ --with-tcltk-includes=-I/usr/local/tcl-8.7a3/include/ -I/usr/local/tk-8.7a3/include/ --with-tcltk-libs=-L/usr/local/tcl-8.7a3/lib/ -L/usr/local/tk-8.7a3/lib/ --with-libs=-luuid -lX11 -ltcl8.7 -ltk8.7 -lpanelw -lbz2 --disable-ipv6 --enable-optimizations --with-lto

Try to remove -lpanelw.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Fri Oct  9 10:59:09 2020
From: report at bugs.python.org (Darnel T.)
Date: Fri, 09 Oct 2020 14:59:09 +0000
Subject: [issue41983] Missing Documentation AF_PACKET
Message-ID: <1602255549.69.0.358914707678.issue41983@roundup.psfhosted.org>


New submission from Darnel T. <darnelgt33 at gmail.com>:

Python documentation said AF_PACKET exists, but when I looked at the python script it was missing on Mac and Windows. I'm currently on Windows.

----------
assignee: docs at python
components: Documentation
messages: 378331
nosy: TheNuGuy, docs at python
priority: normal
severity: normal
status: open
title: Missing Documentation AF_PACKET
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41983>
_______________________________________

From report at bugs.python.org  Fri Oct  9 11:02:32 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 09 Oct 2020 15:02:32 +0000
Subject: [issue34067] Problem with contextlib.nullcontext
In-Reply-To: <1530984805.95.0.56676864532.issue34067@psf.upfronthosting.co.za>
Message-ID: <1602255752.62.0.889214959109.issue34067@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

For the original problem, how about this?

      def process_file(file_or_path):
          if isinstance(file_or_path, str):
              # If string, open file
              cm = open
          else:
              # Caller is responsible for closing file
              cm = nullcontext

          with cm(file_or_path) as file:
              # Perform processing on the file

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34067>
_______________________________________

From report at bugs.python.org  Fri Oct  9 11:04:17 2020
From: report at bugs.python.org (Federico Tesser)
Date: Fri, 09 Oct 2020 15:04:17 +0000
Subject: [issue41981] Errors building python 3.9.0 from source on Centos 7
 with GCC 10
In-Reply-To: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>
Message-ID: <1602255857.17.0.52076544093.issue41981@roundup.psfhosted.org>


Federico Tesser <federico.tesser at polito.it> added the comment:

I am sorry to have bothered you. I found the problem:

In "config.log" you can see that "/bin/ld" did not found "-lpanelw". The problem was that in ncurses-6.2 it was "-lpaneltw".

Pyhon has been succesfully installed, using gcc 4.8.5 toolchain, as suggested.

Best regards,

Federico Tesser

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Fri Oct  9 12:50:09 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 09 Oct 2020 16:50:09 +0000
Subject: [issue24653] Mock.assert_has_calls([]) is surprising for users
In-Reply-To: <1437126004.09.0.453747784975.issue24653@psf.upfronthosting.co.za>
Message-ID: <1602262209.86.0.939267842975.issue24653@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I agree that the confusion was probably due to assumptions rather than a misreading of the doc, and I would not object to closing this issue.

However, Robert did object so I would like to suggest an adjustment that may help:

Currently the documentation of assert_not_called is just after that of assert_has_calls.   If we reverse their order, then there can be less room for confusion about how to check that nothing was called - you would read that first. 

https://docs.python.org/3/library/unittest.mock.html#unittest.mock.Mock.assert_has_calls

----------
nosy: +iritkatriel
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.4, Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24653>
_______________________________________

From report at bugs.python.org  Fri Oct  9 13:52:21 2020
From: report at bugs.python.org (Ken Jin)
Date: Fri, 09 Oct 2020 17:52:21 +0000
Subject: [issue41805] types.GenericAlias and types.Union have no documentation
In-Reply-To: <1600370908.0.0.224627521485.issue41805@roundup.psfhosted.org>
Message-ID: <1602265941.29.0.474388765205.issue41805@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
keywords: +patch
pull_requests: +21596
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22615

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41805>
_______________________________________

From report at bugs.python.org  Fri Oct  9 14:45:57 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 18:45:57 +0000
Subject: [issue41831] Restore default __str__ of tkinter.EventType
In-Reply-To: <1600761728.11.0.806408234986.issue41831@roundup.psfhosted.org>
Message-ID: <1602269157.19.0.647179778498.issue41831@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset f25323a307a72c40862c87c2df822f83be6645da by Serhiy Storchaka in branch 'master':
bpo-41831: Add tests for tkinter.Event.__repr__ (GH-22354)
https://github.com/python/cpython/commit/f25323a307a72c40862c87c2df822f83be6645da


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41831>
_______________________________________

From report at bugs.python.org  Fri Oct  9 14:46:06 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 09 Oct 2020 18:46:06 +0000
Subject: [issue41831] Restore default __str__ of tkinter.EventType
In-Reply-To: <1600761728.11.0.806408234986.issue41831@roundup.psfhosted.org>
Message-ID: <1602269166.05.0.395205799487.issue41831@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21597
pull_request: https://github.com/python/cpython/pull/22616

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41831>
_______________________________________

From report at bugs.python.org  Fri Oct  9 14:49:18 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 09 Oct 2020 18:49:18 +0000
Subject: [issue41831] Restore default __str__ of tkinter.EventType
In-Reply-To: <1600761728.11.0.806408234986.issue41831@roundup.psfhosted.org>
Message-ID: <1602269358.3.0.0872453805518.issue41831@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21598
pull_request: https://github.com/python/cpython/pull/22617

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41831>
_______________________________________

From report at bugs.python.org  Fri Oct  9 15:04:58 2020
From: report at bugs.python.org (Saiyang Gou)
Date: Fri, 09 Oct 2020 19:04:58 +0000
Subject: [issue39481] Implement PEP 585 (Type Hinting Generics In Standard
 Collections)
In-Reply-To: <1580231817.93.0.47144630055.issue39481@roundup.psfhosted.org>
Message-ID: <1602270298.13.0.746452573688.issue39481@roundup.psfhosted.org>


Change by Saiyang Gou <gousaiyang223 at gmail.com>:


----------
nosy: +gousaiyang
nosy_count: 6.0 -> 7.0
pull_requests: +21599
pull_request: https://github.com/python/cpython/pull/22619

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39481>
_______________________________________

From report at bugs.python.org  Fri Oct  9 15:05:29 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 09 Oct 2020 19:05:29 +0000
Subject: [issue41831] Restore default __str__ of tkinter.EventType
In-Reply-To: <1600761728.11.0.806408234986.issue41831@roundup.psfhosted.org>
Message-ID: <1602270329.57.0.942978223949.issue41831@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 86938548d5829400065d2705e3d25604c14b23b7 by Miss Skeleton (bot) in branch '3.8':
bpo-41831: Add tests for tkinter.Event.__repr__ (GH-22354)
https://github.com/python/cpython/commit/86938548d5829400065d2705e3d25604c14b23b7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41831>
_______________________________________

From report at bugs.python.org  Fri Oct  9 15:17:48 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Fri, 09 Oct 2020 19:17:48 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
Message-ID: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>


New submission from Brandt Bucher <brandtbucher at gmail.com>:

Currently, we don't track instances of certain heap types based on the assumption that "no members" == "no reference cycles".

Unfortunately, it's still possible to create untracked reference cycles with one's parents. The following program leaks memory:

while True:
? ? class C:
? ? ? ? __slots__ = ()
? ? C.i = C()
? ? del C

The fix is simple: track all instances of user-defined classes, no exceptions. I'm not sure we were actually getting any real wins from the old behavior anyways.

----------
assignee: brandtbucher
components: Interpreter Core
messages: 378337
nosy: brandtbucher, pablogsal
priority: low
severity: normal
status: open
title: Empty __slots__ can create untracked reference cycles
type: resource usage
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Fri Oct  9 15:32:31 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 19:32:31 +0000
Subject: [issue41985] Argument Clinic: add converter for file descriptor
Message-ID: <1602271951.8.0.643355348973.issue41985@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

Local converters for file descriptors which uses PyObject_AsFileDescriptor() are defined and used in several files: Modules/fcntlmodule.c, Modules/posixmodule.c, Modules/selectmodule.c, Modules/termios.c.

The proposed PR replaces them all with a global private function _PyLong_FileDescriptor_Converter() and adds corresponding Argument Clinic converter "fildes".

In future it could be used in more places, allowing to pass a file with fileno() method to functions which accept file descriptor.

----------
components: Argument Clinic
messages: 378338
nosy: larry, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Argument Clinic: add converter for file descriptor
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41985>
_______________________________________

From report at bugs.python.org  Fri Oct  9 15:38:08 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 19:38:08 +0000
Subject: [issue41985] Argument Clinic: add converter for file descriptor
In-Reply-To: <1602271951.8.0.643355348973.issue41985@roundup.psfhosted.org>
Message-ID: <1602272288.23.0.229057695548.issue41985@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21600
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22620

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41985>
_______________________________________

From report at bugs.python.org  Fri Oct  9 15:46:26 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 09 Oct 2020 19:46:26 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602272786.82.0.951617252047.issue41984@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thanks for noticing this, Brandt!

> The fix is simple: track all instances of user-defined classes, no exceptions

I have the fear that this may increase the time of collections substantially because even if many of them won't have references at all, they still net to be visited and they count towards the time complexity of the algorithm that detects isolated sub-cycles. I mention this because this could affect an unbounded number of instances per type. For example, some of the types that are untracked.

Maybe I am missing something but we could mark them as having GC support unconditionally but still leave them untracking and unconditionally add a tracking call on setattribute.

----------
nosy: +nascheme, tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Fri Oct  9 15:48:03 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 19:48:03 +0000
Subject: [issue41986] Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode are not
 available with limited API
Message-ID: <1602272883.67.0.0325810953138.issue41986@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

Py_FileSystemDefaultEncodeErrors was added to limited API in 3.7 and Py_UTF8Mode -- in 3.7. But in 3.8 their declarations are not available if Py_LIMITED_API is defined because they were moved to different header file included only if Py_LIMITED_API is not defined.

----------
components: C API
messages: 378340
nosy: serhiy.storchaka, vstinner
priority: normal
severity: normal
status: open
title: Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode are not available with limited API
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41986>
_______________________________________

From report at bugs.python.org  Fri Oct  9 15:54:16 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 19:54:16 +0000
Subject: [issue41986] Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode are not
 available with limited API
In-Reply-To: <1602272883.67.0.0325810953138.issue41986@roundup.psfhosted.org>
Message-ID: <1602273256.52.0.537236744742.issue41986@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21601
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22621

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41986>
_______________________________________

From report at bugs.python.org  Fri Oct  9 15:56:27 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 19:56:27 +0000
Subject: [issue41831] Restore default __str__ of tkinter.EventType
In-Reply-To: <1600761728.11.0.806408234986.issue41831@roundup.psfhosted.org>
Message-ID: <1602273387.49.0.695565423911.issue41831@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 43c3eafa1bcdc522870e112d3e2d67ce2451c34b by Miss Skeleton (bot) in branch '3.9':
bpo-41831: Add tests for tkinter.Event.__repr__ (GH-22354) (GH-22617)
https://github.com/python/cpython/commit/43c3eafa1bcdc522870e112d3e2d67ce2451c34b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41831>
_______________________________________

From report at bugs.python.org  Fri Oct  9 15:58:03 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 09 Oct 2020 19:58:03 +0000
Subject: [issue41831] Restore default __str__ of tkinter.EventType
In-Reply-To: <1600761728.11.0.806408234986.issue41831@roundup.psfhosted.org>
Message-ID: <1602273483.76.0.826641287041.issue41831@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21603
pull_request: https://github.com/python/cpython/pull/22623

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41831>
_______________________________________

From report at bugs.python.org  Fri Oct  9 15:57:42 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 19:57:42 +0000
Subject: [issue41831] Restore default __str__ of tkinter.EventType
In-Reply-To: <1600761728.11.0.806408234986.issue41831@roundup.psfhosted.org>
Message-ID: <1602273462.18.0.869114220128.issue41831@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset eb38c6b7aa35d3003ec0958533421902d19ce408 by Serhiy Storchaka in branch 'master':
bpo-41831: Restore str implementation of __str__ in tkinter.EventType (GH-22355)
https://github.com/python/cpython/commit/eb38c6b7aa35d3003ec0958533421902d19ce408


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41831>
_______________________________________

From report at bugs.python.org  Fri Oct  9 15:57:54 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 09 Oct 2020 19:57:54 +0000
Subject: [issue41831] Restore default __str__ of tkinter.EventType
In-Reply-To: <1600761728.11.0.806408234986.issue41831@roundup.psfhosted.org>
Message-ID: <1602273474.09.0.460096603595.issue41831@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21602
pull_request: https://github.com/python/cpython/pull/22622

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41831>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:00:39 2020
From: report at bugs.python.org (Glyph Lefkowitz)
Date: Fri, 09 Oct 2020 20:00:39 +0000
Subject: [issue39679] functools: singledispatchmethod doesn't work with
 classmethod
In-Reply-To: <1582053375.25.0.178240077179.issue39679@roundup.psfhosted.org>
Message-ID: <1602273639.0.0.083519455895.issue39679@roundup.psfhosted.org>


Glyph Lefkowitz <glyph at twistedmatrix.com> added the comment:

I also just discovered this.  I thought it must have regressed at some point but I see the docs say "new in 3.8" and I'm using 3.8.

Is there a "no CI for examples in the docs" issue that this could be linked to?

----------
nosy: +glyph

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39679>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:00:52 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 20:00:52 +0000
Subject: [issue41985] Argument Clinic: add converter for file descriptor
In-Reply-To: <1602271951.8.0.643355348973.issue41985@roundup.psfhosted.org>
Message-ID: <1602273652.53.0.874969895796.issue41985@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 9975cc5008c795e069ce11e2dbed2110cc12e74e by Serhiy Storchaka in branch 'master':
bpo-41985: Add _PyLong_FileDescriptor_Converter and AC converter for "fildes". (GH-22620)
https://github.com/python/cpython/commit/9975cc5008c795e069ce11e2dbed2110cc12e74e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41985>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:00:28 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 09 Oct 2020 20:00:28 +0000
Subject: [issue39481] Implement PEP 585 (Type Hinting Generics In Standard
 Collections)
In-Reply-To: <1580231817.93.0.47144630055.issue39481@roundup.psfhosted.org>
Message-ID: <1602273628.48.0.580822220903.issue39481@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b2c0a43699bd9023a69e3fa554f5488a2e17e278 by Saiyang Gou in branch 'master':
bpo-39481: Fix duplicate SimpleQueue type in test_genericalias.py (GH-22619)
https://github.com/python/cpython/commit/b2c0a43699bd9023a69e3fa554f5488a2e17e278


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39481>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:01:30 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 20:01:30 +0000
Subject: [issue41985] Argument Clinic: add converter for file descriptor
In-Reply-To: <1602271951.8.0.643355348973.issue41985@roundup.psfhosted.org>
Message-ID: <1602273690.1.0.934104521723.issue41985@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41985>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:06:50 2020
From: report at bugs.python.org (Emmanuel Arias)
Date: Fri, 09 Oct 2020 20:06:50 +0000
Subject: [issue41940] AMD64 Debian root 3.x: tests fail because downloaded
 files start with: <!DOCTYPE
In-Reply-To: <1601887687.95.0.739602877312.issue41940@roundup.psfhosted.org>
Message-ID: <1602274010.17.0.997816692845.issue41940@roundup.psfhosted.org>


Change by Emmanuel Arias <eamanu at yaerobi.com>:


----------
nosy: +eamanu

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41940>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:11:43 2020
From: report at bugs.python.org (Glyph Lefkowitz)
Date: Fri, 09 Oct 2020 20:11:43 +0000
Subject: [issue41987] singledispatchmethod raises an error when relying on a
 forward declaration
Message-ID: <1602274303.54.0.362260014367.issue41987@roundup.psfhosted.org>


New submission from Glyph Lefkowitz <glyph at twistedmatrix.com>:

This example:


from __future__ import annotations
from functools import singledispatchmethod


class Comparable:
    @singledispatchmethod
    def compare(self, arg: object):
        raise NotImplementedError("what")

    @compare.register
    def _(self, arg: Comparable):
        return "somewhat similar"


print(Comparable().compare(Comparable()))


Produces this result:

  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/typing.py", line 518, in _evaluate
    eval(self.__forward_code__, globalns, localns),
  File "<string>", line 1, in <module>
NameError: name 'Comparable' is not defined

It seems like perhaps singledispatchmethod should defer its type evaluation to its first invocation?

----------
components: Library (Lib)
messages: 378346
nosy: glyph
priority: normal
severity: normal
stage: needs patch
status: open
title: singledispatchmethod raises an error when relying on a forward declaration
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41987>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:14:34 2020
From: report at bugs.python.org (Emmanuel Arias)
Date: Fri, 09 Oct 2020 20:14:34 +0000
Subject: [issue41940] AMD64 Debian root 3.x: tests fail because downloaded
 files start with: <!DOCTYPE
In-Reply-To: <1601887687.95.0.739602877312.issue41940@roundup.psfhosted.org>
Message-ID: <1602274474.4.0.715814722275.issue41940@roundup.psfhosted.org>


Emmanuel Arias <eamanu at yaerobi.com> added the comment:

Hi,

seems that this test doesn't occur ? or I'm very wrong? 

https://buildbot.python.org/all/#/builders/345

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41940>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:21:03 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 09 Oct 2020 20:21:03 +0000
Subject: [issue41831] Restore default __str__ of tkinter.EventType
In-Reply-To: <1600761728.11.0.806408234986.issue41831@roundup.psfhosted.org>
Message-ID: <1602274863.91.0.528009331632.issue41831@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 1f75fc7a9d9efbced2e0b0001ac148268a626d63 by Miss Skeleton (bot) in branch '3.9':
bpo-41831: Restore str implementation of __str__ in tkinter.EventType (GH-22355)
https://github.com/python/cpython/commit/1f75fc7a9d9efbced2e0b0001ac148268a626d63


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41831>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:21:18 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 09 Oct 2020 20:21:18 +0000
Subject: [issue41831] Restore default __str__ of tkinter.EventType
In-Reply-To: <1600761728.11.0.806408234986.issue41831@roundup.psfhosted.org>
Message-ID: <1602274878.79.0.879049629731.issue41831@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f8ebb7b62ea266df5c6e0f910b7a6b0eb73deee4 by Miss Skeleton (bot) in branch '3.8':
bpo-41831: Restore str implementation of __str__ in tkinter.EventType (GH-22355)
https://github.com/python/cpython/commit/f8ebb7b62ea266df5c6e0f910b7a6b0eb73deee4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41831>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:21:54 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 09 Oct 2020 20:21:54 +0000
Subject: [issue41831] Restore default __str__ of tkinter.EventType
In-Reply-To: <1600761728.11.0.806408234986.issue41831@roundup.psfhosted.org>
Message-ID: <1602274914.35.0.182232766755.issue41831@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41831>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:34:07 2020
From: report at bugs.python.org (Saiyang Gou)
Date: Fri, 09 Oct 2020 20:34:07 +0000
Subject: [issue39481] Implement PEP 585 (Type Hinting Generics In Standard
 Collections)
In-Reply-To: <1580231817.93.0.47144630055.issue39481@roundup.psfhosted.org>
Message-ID: <1602275647.99.0.646833794338.issue39481@roundup.psfhosted.org>


Change by Saiyang Gou <gousaiyang223 at gmail.com>:


----------
pull_requests: +21604
pull_request: https://github.com/python/cpython/pull/22624

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39481>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:38:25 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Fri, 09 Oct 2020 20:38:25 +0000
Subject: [issue41987] singledispatchmethod raises an error when relying on a
 forward declaration
In-Reply-To: <1602274303.54.0.362260014367.issue41987@roundup.psfhosted.org>
Message-ID: <1602275905.11.0.00295847576804.issue41987@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41987>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:44:30 2020
From: report at bugs.python.org (Henk-Jaap Wagenaar)
Date: Fri, 09 Oct 2020 20:44:30 +0000
Subject: [issue41988] No hyphen in broken up word in documentation
Message-ID: <1602276270.7.0.489043595778.issue41988@roundup.psfhosted.org>


New submission from Henk-Jaap Wagenaar <wagenaarhenkjaap at gmail.com>:

In the decimal module documentation:

https://docs.python.org/3/library/decimal.html

Arithmetic is broken up for me as "Arith\nmetic", not the missing hyphen, unless I am mistaken it should be "Arith-\nmetic". Is this a Sphinx issue? Is this a browser issue? Is this an issue on our end? Later it does break "Applications" correctly.

See attached screenshot.

----------
assignee: docs at python
components: Documentation
files: Screenshot 2020-10-09 at 21.43.50.png
messages: 378351
nosy: cryvate, docs at python
priority: normal
severity: normal
status: open
title: No hyphen in broken up word in documentation
versions: Python 3.10, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49504/Screenshot 2020-10-09 at 21.43.50.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41988>
_______________________________________

From report at bugs.python.org  Fri Oct  9 16:44:24 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Fri, 09 Oct 2020 20:44:24 +0000
Subject: [issue41987] singledispatchmethod raises an error when relying on a
 forward declaration
In-Reply-To: <1602274303.54.0.362260014367.issue41987@roundup.psfhosted.org>
Message-ID: <1602276264.63.0.51905196741.issue41987@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

AFAIK the normal way of registering types (dispatcher.register(<type>)) also requires that registered type be defined at the execution type. I guess, if we are going to support such a thing, we might end up with supporting passing strings into the .register() as the initial argument of matching type to be consistent. Anyways, this would be a feature request for 3.10+, so changing the version info.

----------
nosy: +gvanrossum
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41987>
_______________________________________

From report at bugs.python.org  Fri Oct  9 17:00:31 2020
From: report at bugs.python.org (Mariatta)
Date: Fri, 09 Oct 2020 21:00:31 +0000
Subject: [issue41988] No hyphen in broken up word in documentation
In-Reply-To: <1602276270.7.0.489043595778.issue41988@roundup.psfhosted.org>
Message-ID: <1602277231.48.0.288781643463.issue41988@roundup.psfhosted.org>


Mariatta <mariatta at python.org> added the comment:

In the source code, we wrote it as "arithmetic" in one word.

https://raw.githubusercontent.com/python/cpython/master/Doc/library/decimal.rst

So I think this is either Sphinx or Docutils issue.

----------
nosy: +Mariatta

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41988>
_______________________________________

From report at bugs.python.org  Fri Oct  9 17:27:20 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 09 Oct 2020 21:27:20 +0000
Subject: [issue41987] singledispatchmethod raises an error when relying on a
 forward declaration
In-Reply-To: <1602274303.54.0.362260014367.issue41987@roundup.psfhosted.org>
Message-ID: <1602278840.27.0.177153745374.issue41987@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

This behavior (only relevant with `from __future__ import annotations`) has been around since @singledispatchmethod was introduced in 3.8, so I agree we should treat it as a feature request.

In the meantime, maybe a workaround is to move the register call out of the class? It looks a little bit ugly but probably works.

(Disclaimer: I'm not familiar with singledispatchmethod.)

----------
nosy: +ethan smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41987>
_______________________________________

From report at bugs.python.org  Fri Oct  9 18:40:54 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 09 Oct 2020 22:40:54 +0000
Subject: [issue34706] Signature.from_callable sometimes drops subclassing
In-Reply-To: <1537132321.64.0.956365154283.issue34706@psf.upfronthosting.co.za>
Message-ID: <1602283254.55.0.192171965567.issue34706@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34706>
_______________________________________

From report at bugs.python.org  Fri Oct  9 18:45:05 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 09 Oct 2020 22:45:05 +0000
Subject: [issue38153] Normalize hashing algorithm names
In-Reply-To: <1568368232.54.0.0384008471773.issue38153@roundup.psfhosted.org>
Message-ID: <1602283505.17.0.00475493828184.issue38153@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38153>
_______________________________________

From report at bugs.python.org  Fri Oct  9 19:19:36 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Fri, 09 Oct 2020 23:19:36 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602285576.48.0.594991960676.issue41984@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

> Maybe I am missing something but we could mark them as having GC support unconditionally but still leave them untracking and unconditionally add a tracking call on setattribute.

Hm, I?m not sure that would be enough. Consider the case of a class that registers its instances in a collection of some sort:

while True:
    class D:
        __slots__ = ()
        registry = []
        def __init__(self):
            self.registry.append(self)
    for i in range(100):
        D() and None  # Suppress REPL output.
    del D

This is probably more common (and problematic) than my example above.

At the same time, I agree that it?s not *ideal* to track all of these objects automatically. Anyone setting __slots__ is probably planning on creating lots of ?cheap? instances. If they do accidentally create cycles, though, I feel the memory hit then would be worse than any collection overhead.

I?m just not sure I see a way to fix this without tracking them all.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Fri Oct  9 20:15:23 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Sat, 10 Oct 2020 00:15:23 +0000
Subject: [issue41756] Do not always use exceptions to return result from
 coroutine
In-Reply-To: <1599786636.95.0.884410425349.issue41756@roundup.psfhosted.org>
Message-ID: <1602288923.68.0.922444191828.issue41756@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:


New changeset 037245c5ac46c3436f617a1f5d965929754be239 by Vladimir Matveev in branch 'master':
bpo-41756: Add PyIter_Send function (#22443)
https://github.com/python/cpython/commit/037245c5ac46c3436f617a1f5d965929754be239


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41756>
_______________________________________

From report at bugs.python.org  Fri Oct  9 20:40:21 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 10 Oct 2020 00:40:21 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602290421.86.0.628218534121.issue41984@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> I?m just not sure I see a way to fix this without tracking them all.

IIRC we do skip the GC flags for user-created types only when the subtype is not adding new variables *and* the base class is not a GC class by itself. This includes the case with __slots__ but is not limited to. If I recall correctly, there is a bunch of metaclasses that fall into this category and some other minor things so maybe is not that bad to unconditionally make all user objects tracked.

In any case I think is prudent to run the performance test suite with PGO/LTO + CPU isolation to get an idea. Unfortinately we already have some unwanted 3.9 performance regressions of unknown origin and I would like to not add to it if we can.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Fri Oct  9 21:08:29 2020
From: report at bugs.python.org (Waylan Limberg)
Date: Sat, 10 Oct 2020 01:08:29 +0000
Subject: [issue41989] htmlparser unclosed script tag causes data loss
Message-ID: <1602292109.75.0.598084394689.issue41989@roundup.psfhosted.org>


New submission from Waylan Limberg <waylan.limberg at icloud.com>:

When the `close` method of the HtmlParser is called, any cached text data is generally flushed and passed to a `data` event; except when in `data_mode`. Specifically, if an unclosed `script` or `style` tag has been encountered, a call to `close` does not flush the data.

A simple test which demonstrates the issue is attached.

I see that in Lib/html/parser.py#L244-L249 there are two nested if statements which both check for `not self.cdata_elem`. Obviously, if we got past the first one, that situation will never exist for the nested one. Somehow this block of code needs a branch for when `self.cdata_elem` is True.

I should note that the input is invalid HTML. However, the existing behavior results in data loss. Within any other unclosed tag (other than `script` or `style`) any data is still flushed and passed to a `data` event. I would expect the same behavior here. Although, the data escaping behavior should perhaps be applied as it is with data within properly closed tags.

----------
components: Library (Lib)
files: test_html.py
messages: 378359
nosy: waylan
priority: normal
severity: normal
status: open
title: htmlparser unclosed script tag causes data loss
type: behavior
versions: Python 3.10, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49505/test_html.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41989>
_______________________________________

From report at bugs.python.org  Fri Oct  9 21:28:07 2020
From: report at bugs.python.org (Chih-Hsuan Yen)
Date: Sat, 10 Oct 2020 01:28:07 +0000
Subject: [issue39481] Implement PEP 585 (Type Hinting Generics In Standard
 Collections)
In-Reply-To: <1580231817.93.0.47144630055.issue39481@roundup.psfhosted.org>
Message-ID: <1602293287.45.0.981004211088.issue39481@roundup.psfhosted.org>


Change by Chih-Hsuan Yen <yan12125 at gmail.com>:


----------
nosy:  -yan12125

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39481>
_______________________________________

From report at bugs.python.org  Fri Oct  9 21:36:14 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 10 Oct 2020 01:36:14 +0000
Subject: [issue38153] Normalize hashing algorithm names
In-Reply-To: <1568368232.54.0.0384008471773.issue38153@roundup.psfhosted.org>
Message-ID: <1602293774.2.0.380888453265.issue38153@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

looks like it, thanks!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38153>
_______________________________________

From report at bugs.python.org  Fri Oct  9 21:37:03 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 10 Oct 2020 01:37:03 +0000
Subject: [issue34706] Signature.from_callable sometimes drops subclassing
In-Reply-To: <1537132321.64.0.956365154283.issue34706@psf.upfronthosting.co.za>
Message-ID: <1602293823.84.0.168809018665.issue34706@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34706>
_______________________________________

From report at bugs.python.org  Fri Oct  9 21:52:04 2020
From: report at bugs.python.org (Glyph Lefkowitz)
Date: Sat, 10 Oct 2020 01:52:04 +0000
Subject: [issue41987] singledispatchmethod raises an error when relying on a
 forward declaration
In-Reply-To: <1602274303.54.0.362260014367.issue41987@roundup.psfhosted.org>
Message-ID: <1602294724.41.0.00764285162279.issue41987@roundup.psfhosted.org>


Glyph Lefkowitz <glyph at twistedmatrix.com> added the comment:

The behavior is the same with a traditional quoted forward declaration, so it?s not specific to the __future__ import; I just phrased the example that way to show how it?s going to look in the future and to illustrate how it might crop up in a way which is maximally confusing to users less familiar with the internals of type annotations.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41987>
_______________________________________

From report at bugs.python.org  Sat Oct 10 00:18:09 2020
From: report at bugs.python.org (Ken Jin)
Date: Sat, 10 Oct 2020 04:18:09 +0000
Subject: [issue40814] Update typing module documentation based on PEP 585
In-Reply-To: <1590755313.42.0.558710518983.issue40814@roundup.psfhosted.org>
Message-ID: <1602303489.64.0.130005798048.issue40814@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

I've created a PR 22615 which partly addresses the documentation for GenericAlias in stdtypes.

I have a side question: should __args__, and __origin__ be documented somewhere as well? I noticed it has no documentation even though it's used to check generics. At the same time, I'm not fully sure that it's a standard Python thing rather than a CPython implementation detail.

----------
keywords: +patch
message_count: 3.0 -> 4.0
nosy: +kj
nosy_count: 5.0 -> 6.0
pull_requests: +21605
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22615

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40814>
_______________________________________

From report at bugs.python.org  Sat Oct 10 00:39:12 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 10 Oct 2020 04:39:12 +0000
Subject: [issue41371] test_zoneinfo fails when lzma module is unavailable
In-Reply-To: <1595449050.37.0.742582022147.issue41371@roundup.psfhosted.org>
Message-ID: <1602304752.59.0.374283828131.issue41371@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:


New changeset 20bdeedfb4ebd250dad9834c96cb858d83c896cb by Karthikeyan Singaravelan in branch '3.9':
[3.9] bpo-41371: Handle lzma lib import error in test_zoneinfo.py (GH-21734) (GH-22039)
https://github.com/python/cpython/commit/20bdeedfb4ebd250dad9834c96cb858d83c896cb


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41371>
_______________________________________

From report at bugs.python.org  Sat Oct 10 00:54:58 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 10 Oct 2020 04:54:58 +0000
Subject: [issue41371] test_zoneinfo fails when lzma module is unavailable
In-Reply-To: <1595449050.37.0.742582022147.issue41371@roundup.psfhosted.org>
Message-ID: <1602305698.44.0.20161826301.issue41371@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Thanks @doodspav for the report and Thanks nathan for the patch. This somehow missed 3.9.0 but will be available in 3.9.1. I am closing the issue. Feel free to reopen this or a new issue to implement suggestions by Paul in msg374822.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41371>
_______________________________________

From report at bugs.python.org  Sat Oct 10 00:58:01 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 10 Oct 2020 04:58:01 +0000
Subject: [issue41980] Argparse documentation is slightly misleading
In-Reply-To: <1602246859.95.0.133972345732.issue41980@roundup.psfhosted.org>
Message-ID: <1602305881.62.0.117755900703.issue41980@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +paul.j3, rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41980>
_______________________________________

From report at bugs.python.org  Sat Oct 10 01:31:20 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 10 Oct 2020 05:31:20 +0000
Subject: [issue41980] Argparse documentation is slightly misleading
In-Reply-To: <1602246859.95.0.133972345732.issue41980@roundup.psfhosted.org>
Message-ID: <1602307880.2.0.232515676353.issue41980@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

That sounds likes reasonable improvement.  Would you like to submit a PR?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41980>
_______________________________________

From report at bugs.python.org  Sat Oct 10 02:18:42 2020
From: report at bugs.python.org (lvhuiyang)
Date: Sat, 10 Oct 2020 06:18:42 +0000
Subject: [issue33431] Change description about doc in programming, faq.
In-Reply-To: <1602182067.73.0.207030870524.issue33431@roundup.psfhosted.org>
Message-ID: <1602310722.25.0.798585352907.issue33431@roundup.psfhosted.org>


lvhuiyang <ilvhuiyang at gmail.com> added the comment:

I has forgotten why I abandon the PR.

Sorry I have no time to follow up the issue recently. Would you like go on if you are interest in the issue?

----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33431>
_______________________________________

From report at bugs.python.org  Sat Oct 10 02:36:04 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 10 Oct 2020 06:36:04 +0000
Subject: [issue40814] Update typing module documentation based on PEP 585
In-Reply-To: <1590755313.42.0.558710518983.issue40814@roundup.psfhosted.org>
Message-ID: <1602311764.19.0.823130470469.issue40814@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Yes, let?s document __args__ and __origin__.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40814>
_______________________________________

From report at bugs.python.org  Sat Oct 10 03:24:45 2020
From: report at bugs.python.org (Bernd Wechner)
Date: Sat, 10 Oct 2020 07:24:45 +0000
Subject: [issue41990] venv module clashes with pip --user ... improve
 coordination.
Message-ID: <1602314685.15.0.298308328317.issue41990@roundup.psfhosted.org>


New submission from Bernd Wechner <bernd.wechner at gmail.com>:

When developing Python software it is highly discouraged to install python modules globally (risking adverse impacts upon the underlying OS where if has Python dependencies).

Project by project this typically done with venvs (and the venv module)

User by user it is typically done with the --user option.

In fact to make impacting system libraries less likely a pip.conf file can be written that contains:

[install]
user = true

I suspect this is an increasingly common practice which means pip installs are on a local user profile not into system dirs. 

Alas when in a venv now, pip bombs with a detected conflict:

ERROR: Can not perform a '--user' install. User site-packages are not visible in this virtualenv.

This was explored with pip here:

https://github.com/pypa/pip/issues/8977

It turns out that pip can be made to function by overriding this setting in the venv. That is depositing a pip.conf in the vend dir that contains:

[install]
user = true

and all is good once more. In the activated venv pip now works again. 

This is at its core a coordination issue then between the venv module and pip and the point to fix it seems most likely to be in the venv module which, knowing that this conflict can exist can as a safety precaution simply always, or optionally, write a pip.conf into newly created venvs that disables the user options. Given pip won't work in a venv if that option is enabled and we know that up front.

Why fix it in the venv module? Because discovering the cause of this conflict was time consuming and disorienting, poor UX by any definition and it should ideally not arise or if it must have an easily discovered fix. 

This is a request to prevent it arising altogether in newly created venvs.

----------
components: Library (Lib)
messages: 378368
nosy: bernd.wechner
priority: normal
severity: normal
status: open
title: venv module clashes with pip --user ... improve coordination.
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41990>
_______________________________________

From report at bugs.python.org  Sat Oct 10 03:32:11 2020
From: report at bugs.python.org (paul j3)
Date: Sat, 10 Oct 2020 07:32:11 +0000
Subject: [issue41980] Argparse documentation is slightly misleading
In-Reply-To: <1602246859.95.0.133972345732.issue41980@roundup.psfhosted.org>
Message-ID: <1602315131.88.0.77473699492.issue41980@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

For ArgumentParser, prog is defined as:

    prog - The name of the program (default: sys.argv[0])

The comment in the `add_subparsers` method is:

       # prog defaults to the usage message of this parser, skipping
       # optional arguments and with no "usage:" prefix

        if kwargs.get('prog') is None:
            formatter = self._get_formatter()
            positionals = self._get_positional_actions()
            groups = self._mutually_exclusive_groups
            formatter.add_usage(self.usage, positionals, groups, '')
            kwargs['prog'] = formatter.format_help().strip()

and this keyword is saved as the action `self._prog_prefix.

Later in `add_parser` this is amended with:

     kwargs['prog'] = '%s %s' % (self._prog_prefix, name)

The intent is to provide the string required to run a particular subparser (sub-command), the `prog` of the main, positionals, and the subcommand. (It doesn't handle all 'required' arguments correctly.) 

The programmer has three places where they can customize this 'prog'.

So the default 'prog' as the 'add_subarsers' level is indeed just the main 'prog' plus 'positionals'.  The default 'prog' display with the subcommand usage add the subcommand's name.

It's a complicated sequence, but I think the description for the 'add_subparsers' 'prog' is enough.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41980>
_______________________________________

From report at bugs.python.org  Sat Oct 10 03:47:11 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 07:47:11 +0000
Subject: [issue41991] Remove _PyObject_HasAttrId
Message-ID: <1602316031.88.0.412712857392.issue41991@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

_PyObject_HasAttrId() can return -1, 0 or 1. It returns -1 when cannot create a string (most likely due to MemoryError or UnicodeDecodeError), but returns 0 and silences all exceptions raised when look up the attribute (including MemoryError, KeybordInterruptError and RecursionError). Silencing arbitrary exceptions is bad, and the interface of the function is inconsistent, so it is better to remove it and replace all 5 of its occurrences in 3 files with _PyObject_LookupAttrId(). It is private API, so we can do it without breaking user code.

----------
components: Interpreter Core
messages: 378370
nosy: serhiy.storchaka
priority: normal
severity: normal
status: open
title: Remove _PyObject_HasAttrId
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41991>
_______________________________________

From report at bugs.python.org  Sat Oct 10 03:49:30 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 07:49:30 +0000
Subject: [issue41991] Remove _PyObject_HasAttrId
In-Reply-To: <1602316031.88.0.412712857392.issue41991@roundup.psfhosted.org>
Message-ID: <1602316170.88.0.708331938796.issue41991@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21606
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22629

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41991>
_______________________________________

From report at bugs.python.org  Sat Oct 10 03:54:47 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 07:54:47 +0000
Subject: [issue41991] Remove _PyObject_HasAttrId
In-Reply-To: <1602316031.88.0.412712857392.issue41991@roundup.psfhosted.org>
Message-ID: <1602316487.22.0.0937577835536.issue41991@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

This function was kept after previous clean because all its usages was in the code which silences all exceptions in any case, so using _PyObject_HasAttrId did not do additional harm. But now it is used also in the new code in Objects/unionobject.c. It is safer to not only fix Objects/unionobject.c, but remove _PyObject_HasAttrId at all.

----------
nosy: +pablogsal, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41991>
_______________________________________

From report at bugs.python.org  Sat Oct 10 04:25:19 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Sat, 10 Oct 2020 08:25:19 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602318319.88.0.282647736333.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

I agree that skip could could do 1 better.

---

> I don't know whether it "should be" applied

I don't think I'm convinced: the second check fixes only the very specific case when s[len(p):].startswith(p).
Perturbations of reproducer.py are still very slow with the patch:

    - pattern2 = b"B" * BIG
    + pattern2 = b"B" * (BIG + 10)

In fact, it's even slower than before due to the double-checking.

---

I'd be curious how something like Crochemore and Perrin's "two-way" algorithm would do (constant space, compares < 2n-m):

    http://www-igm.univ-mlv.fr/~lecroq/string/node26.html#SECTION00260
    https://en.wikipedia.org/wiki/Two-way_string-matching_algorithm

Apparently it's been used as glibc's memmem() since 2008. There, it additionally computes a table, but only for long needles where it really pays off:

    https://code.woboq.org/userspace/glibc/string/str-two-way.h.html
    https://code.woboq.org/userspace/glibc/string/memmem.c.html

Although there certainly seems to be a complexity rabbithole here that would be easy to over-do.
I might look more into this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sat Oct 10 05:58:43 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 10 Oct 2020 09:58:43 +0000
Subject: [issue26067] test_shutil fails when gid name is missing
In-Reply-To: <1452373835.73.0.278108988814.issue26067@psf.upfronthosting.co.za>
Message-ID: <1602323923.45.0.767538705864.issue26067@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26067>
_______________________________________

From report at bugs.python.org  Sat Oct 10 06:01:45 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 10:01:45 +0000
Subject: [issue38605] [typing] PEP 563: Postponed evaluation of annotations:
 enable it by default in Python 3.10
In-Reply-To: <1572192430.43.0.755831692199.issue38605@roundup.psfhosted.org>
Message-ID: <1602324105.19.0.12972530898.issue38605@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

test_grammar and test_pydoc became failed on my machine until I removed all .pyc files. We need to bump the magic number for .pyc files.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38605>
_______________________________________

From report at bugs.python.org  Sat Oct 10 06:29:36 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 10 Oct 2020 10:29:36 +0000
Subject: [issue38110] Use fdwalk() within os.closerange() impl if available
In-Reply-To: <1568209201.53.0.0873310068645.issue38110@roundup.psfhosted.org>
Message-ID: <1602325776.35.0.673626300073.issue38110@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38110>
_______________________________________

From report at bugs.python.org  Sat Oct 10 06:32:07 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 10 Oct 2020 10:32:07 +0000
Subject: [issue37840] bytearray_getitem() handles negative index incorrectly
In-Reply-To: <1565697002.74.0.85786305512.issue37840@roundup.psfhosted.org>
Message-ID: <1602325927.25.0.627263246341.issue37840@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37840>
_______________________________________

From report at bugs.python.org  Sat Oct 10 06:33:57 2020
From: report at bugs.python.org (Aruna Gopalan)
Date: Sat, 10 Oct 2020 10:33:57 +0000
Subject: [issue41992] Unable to install lxml using pip in Python 3.9
Message-ID: <1602326037.24.0.900103901321.issue41992@roundup.psfhosted.org>


New submission from Aruna Gopalan <a21678 at yahoo.com>:

Installed Python 3.9 from Python.org
Tried installing lxml package using the command
"pip install lxml"
It complains that it is unable to do so without libxml2 (which is not a python package). I do not have the same issue with 3.8.6.

----------
components: Library (Lib)
messages: 378377
nosy: agopalan
priority: normal
severity: normal
status: open
title: Unable to install lxml using pip in Python 3.9
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41992>
_______________________________________

From report at bugs.python.org  Sat Oct 10 06:35:32 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 10 Oct 2020 10:35:32 +0000
Subject: [issue33972] AttributeError in email.message.iter_attachments()
In-Reply-To: <1530024211.47.0.56676864532.issue33972@psf.upfronthosting.co.za>
Message-ID: <1602326132.18.0.299310642071.issue33972@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33972>
_______________________________________

From report at bugs.python.org  Sat Oct 10 06:35:37 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Sat, 10 Oct 2020 10:35:37 +0000
Subject: [issue38605] [typing] PEP 563: Postponed evaluation of annotations:
 enable it by default in Python 3.10
In-Reply-To: <1572192430.43.0.755831692199.issue38605@roundup.psfhosted.org>
Message-ID: <1602326137.5.0.729089843634.issue38605@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
pull_requests: +21607
pull_request: https://github.com/python/cpython/pull/22630

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38605>
_______________________________________

From report at bugs.python.org  Sat Oct 10 06:37:54 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 10 Oct 2020 10:37:54 +0000
Subject: [issue36520] Email header folded incorrectly
In-Reply-To: <1554333300.49.0.663084865399.issue36520@roundup.psfhosted.org>
Message-ID: <1602326274.21.0.0140466155274.issue36520@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36520>
_______________________________________

From report at bugs.python.org  Sat Oct 10 06:37:47 2020
From: report at bugs.python.org (Mark Shannon)
Date: Sat, 10 Oct 2020 10:37:47 +0000
Subject: [issue41756] Do not always use exceptions to return result from
 coroutine
In-Reply-To: <1599786636.95.0.884410425349.issue41756@roundup.psfhosted.org>
Message-ID: <1602326267.33.0.174174688353.issue41756@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Vladimir,
Thanks for adding PyIter_Send().

Don't forget to remove PyGen_Send() :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41756>
_______________________________________

From report at bugs.python.org  Sat Oct 10 06:41:00 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 10 Oct 2020 10:41:00 +0000
Subject: [issue26835] Add file-sealing ops to fcntl
In-Reply-To: <1461505999.3.0.387096384665.issue26835@psf.upfronthosting.co.za>
Message-ID: <1602326460.24.0.839659723197.issue26835@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26835>
_______________________________________

From report at bugs.python.org  Sat Oct 10 06:51:27 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 10:51:27 +0000
Subject: [issue41993] Possible issues when remove not completely initialized
 module from sys.module
Message-ID: <1602327087.97.0.628811045218.issue41993@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

There are several issues in remove_module() in Python/import.c.

1. PyMapping_HasKey() is used to determine if the module was in sys.modules before removing it. But it can return 0 not only when the key is absent in the mapping, but also when some exceptions was raised during checking (including MemoryError, KeybordInterraption and RecursionError). The corresponding exception will be silenced and the module will be left in sys.modules.

2. If PyMapping_DelItem() fails, a RuntimeError is raised. It is chained with the exception raised in PyMapping_DelItem(), but the original exception, raised before calling remove_module() will be lost.

3. There is a possible race condition between PyMapping_HasKey() and PyMapping_DelItem().

----------
components: Interpreter Core
messages: 378382
nosy: brett.cannon, eric.snow, ncoghlan, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Possible issues when remove not completely initialized module from sys.module
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41993>
_______________________________________

From report at bugs.python.org  Sat Oct 10 06:53:14 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 10 Oct 2020 10:53:14 +0000
Subject: [issue32885] Tools/scripts/pathfix.py leaves bunch of ~ suffixed
 files around with no opt-out
In-Reply-To: <1519124808.65.0.467229070634.issue32885@psf.upfronthosting.co.za>
Message-ID: <1602327194.4.0.860726593775.issue32885@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32885>
_______________________________________

From report at bugs.python.org  Sat Oct 10 06:57:49 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 10:57:49 +0000
Subject: [issue41993] Possible issues when remove not completely initialized
 module from sys.module
In-Reply-To: <1602327087.97.0.628811045218.issue41993@roundup.psfhosted.org>
Message-ID: <1602327469.41.0.772537609727.issue41993@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21608
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22631

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41993>
_______________________________________

From report at bugs.python.org  Sat Oct 10 07:14:48 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 11:14:48 +0000
Subject: [issue41994] Refcount issues in import
Message-ID: <1602328488.44.0.393274794411.issue41994@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

There is a reference leak in import_add_module(). PyDict_GetItemWithError() returns a borrowed reference, but PyObject_GetItem() return a non-borrowed reference. If sys.modules is not a dict, there is a reference leak. import_add_module() and several other function which return a borrowed reference should be made returning a non-borrowed reference, because there are no guaranties that general mapping keeps reference to value.

It is still not guarantee correctness of PyImport_AddModuleObject().

----------
components: Interpreter Core
messages: 378384
nosy: brett.cannon, eric.snow, ncoghlan, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Refcount issues in import
type: resource usage
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41994>
_______________________________________

From report at bugs.python.org  Sat Oct 10 07:17:14 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 11:17:14 +0000
Subject: [issue41994] Refcount issues in import
In-Reply-To: <1602328488.44.0.393274794411.issue41994@roundup.psfhosted.org>
Message-ID: <1602328634.35.0.897709001407.issue41994@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21609
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22632

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41994>
_______________________________________

From report at bugs.python.org  Sat Oct 10 07:49:40 2020
From: report at bugs.python.org (brightest star)
Date: Sat, 10 Oct 2020 11:49:40 +0000
Subject: [issue41995] five possible Null Pointer Dereference bugs.
Message-ID: <1602330580.94.0.791834118141.issue41995@roundup.psfhosted.org>


New submission from brightest star <brightest3379 at gmail.com>:

Hello everyone,

I have found five Null Pointer Dereference bugs in recent master branch.
Although it's impact could be slightly, i think it is better to fix it.

Bug 1:
In the file ; ./Modules/_tracemalloc.c:
static int
tracemalloc_copy_trace(_Py_hashtable_t *traces,
                       const void *key, const void *value,
                       void *user_data)
{
        _Py_hashtable_t *traces2 = (_Py_hashtable_t *)user_data;

        trace_t *trace = (trace_t *)value;

1201:    trace_t *trace2 = raw_malloc(sizeof(trace_t));
1202:    if (traces2 == NULL) {  <-----
            return -1;
        }
1205:   *trace2 = *trace;
        ...
        return 0;
}
At line 1201, we malloc a varible 'trace2' and then we should check whether the varible 'trace2' is NULL. But it checks 'traces2'(not 'trace2') in line 1202. The varible 'trace2' still could be NULL.I think it is a spelling mistake.

Bug 2 and 3:
In the file :Modules/_zoneinfo.c

static int
load_data(PyZoneInfo_ZoneInfo *self, PyObject *file_obj)
{
        ...
908:     self->trans_list_utc =
        PyMem_Malloc(self->num_transitions * sizeof(int64_t));
910:    trans_idx = PyMem_Malloc(self->num_transitions * sizeof(Py_ssize_t));
        ...
}
Line 908 alloc a memory to 'self->trans_list_utc' and line 910 alloc a memory to 'trans_idx'. But the paramters passed to PyMem_Malloc are not fixed,it means that we possible could control the size to malloc. If we pass a big size to PyMem_Malloc, it will return NULL.
So,we should add some checks for 'self->trans_list_utc' and 'trans_idx',such as 
    if (self->trans_list_utc == NULL) {
        goto error;
    }

Bug 4 and 5:
In the file :Modules/_zoneinfo.c

The problem same to bug 3 and 4.
line 991:    self->_ttinfos = PyMem_Malloc(self->num_ttinfos * sizeof(_ttinfo));
line 1005:   self->trans_ttinfos =
        PyMem_Calloc(self->num_transitions, sizeof(_ttinfo *));

We should add some checks below these lines.

----------
components: Extension Modules
messages: 378385
nosy: brightest3379
priority: normal
severity: normal
status: open
title: five possible Null Pointer Dereference bugs.
type: behavior
versions: Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41995>
_______________________________________

From report at bugs.python.org  Sat Oct 10 07:53:08 2020
From: report at bugs.python.org (Roundup Robot)
Date: Sat, 10 Oct 2020 11:53:08 +0000
Subject: [issue41995] five possible Null Pointer Dereference bugs.
In-Reply-To: <1602330580.94.0.791834118141.issue41995@roundup.psfhosted.org>
Message-ID: <1602330788.74.0.517190086768.issue41995@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 1.0 -> 2.0
pull_requests: +21610
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22635

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41995>
_______________________________________

From report at bugs.python.org  Sat Oct 10 08:07:49 2020
From: report at bugs.python.org (=?utf-8?q?J=C3=BCrgen_Gmach?=)
Date: Sat, 10 Oct 2020 12:07:49 +0000
Subject: [issue41992] Unable to install lxml using pip in Python 3.9
In-Reply-To: <1602326037.24.0.900103901321.issue41992@roundup.psfhosted.org>
Message-ID: <1602331669.01.0.179706425903.issue41992@roundup.psfhosted.org>


J?rgen Gmach <juergen.gmach at googlemail.com> added the comment:

There is no Python 3.9 compatible package on PyPI yet ( https://pypi.org/project/lxml/#files ).

I guess you have to wait a bit more until there will be a new release.

Also, this is the cpython issue tracker. When you have problems with a specific package, it is best to seek help at their issue tracker. For lxml this would be https://launchpad.net/lxml

Actually, there is already an issue on their tracker about support for Python 3.9
https://bugs.launchpad.net/lxml/+bug/1892261

I suggest to close this issue here.

----------
nosy: +jugmac00

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41992>
_______________________________________

From report at bugs.python.org  Sat Oct 10 08:21:05 2020
From: report at bugs.python.org (Patrick Reader)
Date: Sat, 10 Oct 2020 12:21:05 +0000
Subject: [issue41996] Should `make install` still install to /usr/bin/python3?
Message-ID: <1602332465.75.0.920875873231.issue41996@roundup.psfhosted.org>


New submission from Patrick Reader <pxeger at protonmail.com>:

Since Python 2 is now finally gone, should the Python executable not be installed to simply `/usr/bin/python` rather than `/usr/bin/python3` when running `make install`?

----------
components: Installation
messages: 378387
nosy: pxeger
priority: normal
severity: normal
status: open
title: Should `make install` still install to /usr/bin/python3?
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41996>
_______________________________________

From report at bugs.python.org  Sat Oct 10 08:37:38 2020
From: report at bugs.python.org (Emmanuel Arias)
Date: Sat, 10 Oct 2020 12:37:38 +0000
Subject: [issue41996] Should `make install` still install to /usr/bin/python3?
In-Reply-To: <1602332465.75.0.920875873231.issue41996@roundup.psfhosted.org>
Message-ID: <1602333458.1.0.179269141777.issue41996@roundup.psfhosted.org>


Emmanuel Arias <eamanu at yaerobi.com> added the comment:

Hi,

There're many people that still use py2, or both.
Also python2 (python) is incompatible with python3, so we cannot
call python == python3.

(There was some discussion on Debian, just if you want take a look
https://lists.debian.org/debian-python/2020/07/msg00042.html)

----------
nosy: +eamanu

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41996>
_______________________________________

From report at bugs.python.org  Sat Oct 10 08:39:32 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Sat, 10 Oct 2020 12:39:32 +0000
Subject: [issue41992] Unable to install lxml using pip in Python 3.9
In-Reply-To: <1602326037.24.0.900103901321.issue41992@roundup.psfhosted.org>
Message-ID: <1602333572.79.0.731455790051.issue41992@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Closing as third party.

----------
nosy: +eric.smith
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41992>
_______________________________________

From report at bugs.python.org  Sat Oct 10 08:44:11 2020
From: report at bugs.python.org (Bar Harel)
Date: Sat, 10 Oct 2020 12:44:11 +0000
Subject: [issue27141] Fix collections.UserList shallow copy
In-Reply-To: <1464384542.41.0.303372176211.issue27141@psf.upfronthosting.co.za>
Message-ID: <1602333851.13.0.949681456773.issue27141@roundup.psfhosted.org>


Change by Bar Harel <bzvi7919 at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27141>
_______________________________________

From report at bugs.python.org  Sat Oct 10 08:44:47 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Sat, 10 Oct 2020 12:44:47 +0000
Subject: [issue41996] Should `make install` still install to /usr/bin/python3?
In-Reply-To: <1602332465.75.0.920875873231.issue41996@roundup.psfhosted.org>
Message-ID: <1602333887.79.0.0475443579585.issue41996@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

There's a PEP for this: PEP 394. If you want to change this, I suggest discussing it on the python-dev mailing list. If that leads to changes in the PEP, this issue can be re-opened.

Personally I don't see this change happening until there are no systems left that install python2 as /usr/bin/python. Which is unfortunate, but such is life. Myself, I have a shell alias for python that points to python3. That solves 95% of my problems.

----------
nosy: +eric.smith
resolution:  -> postponed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41996>
_______________________________________

From report at bugs.python.org  Sat Oct 10 08:54:00 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 12:54:00 +0000
Subject: [issue41995] five possible Null Pointer Dereference bugs.
In-Reply-To: <1602330580.94.0.791834118141.issue41995@roundup.psfhosted.org>
Message-ID: <1602334440.78.0.238244778846.issue41995@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +vstinner
versions: +Python 3.10 -Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41995>
_______________________________________

From report at bugs.python.org  Sat Oct 10 08:53:49 2020
From: report at bugs.python.org (Emmanuel Arias)
Date: Sat, 10 Oct 2020 12:53:49 +0000
Subject: [issue40064] py38: document xml.etree.cElementTree will be removed in
 3.9
In-Reply-To: <1596867346.4.0.810060139535.issue40064@roundup.psfhosted.org>
Message-ID: <1602334429.06.0.507829603374.issue40064@roundup.psfhosted.org>


Emmanuel Arias <eamanu at yaerobi.com> added the comment:

Hi, 

This ticket should be closed or updated.

see disussion https://bugs.python.org/issue36543

----------
nosy: +eamanu

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40064>
_______________________________________

From report at bugs.python.org  Sat Oct 10 08:56:27 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 12:56:27 +0000
Subject: [issue41995] five possible Null Pointer Dereference bugs.
In-Reply-To: <1602330580.94.0.791834118141.issue41995@roundup.psfhosted.org>
Message-ID: <1602334587.05.0.292394751947.issue41995@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +p-ganssle

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41995>
_______________________________________

From report at bugs.python.org  Sat Oct 10 08:57:40 2020
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Sat, 10 Oct 2020 12:57:40 +0000
Subject: [issue32885] Tools/scripts/pathfix.py leaves bunch of ~ suffixed
 files around with no opt-out
In-Reply-To: <1519124808.65.0.467229070634.issue32885@psf.upfronthosting.co.za>
Message-ID: <1602334660.56.0.0571133870084.issue32885@roundup.psfhosted.org>


Change by Miro Hron?ok <miro at hroncok.cz>:


----------
resolution:  -> fixed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32885>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:01:43 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 10 Oct 2020 13:01:43 +0000
Subject: [issue32885] Tools/scripts/pathfix.py leaves bunch of ~ suffixed
 files around with no opt-out
In-Reply-To: <1519124808.65.0.467229070634.issue32885@psf.upfronthosting.co.za>
Message-ID: <1602334903.58.0.370137213899.issue32885@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Please change status to closed as well. Thanks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32885>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:07:37 2020
From: report at bugs.python.org (Yannick Gingras)
Date: Sat, 10 Oct 2020 13:07:37 +0000
Subject: [issue41980] Argparse documentation is slightly misleading
In-Reply-To: <1602246859.95.0.133972345732.issue41980@roundup.psfhosted.org>
Message-ID: <1602335257.35.0.403890880917.issue41980@roundup.psfhosted.org>


Yannick Gingras <ygingras at ygingras.net> added the comment:

Raymond, I would love to submit the PR if we reach a consensus on what the new message should be.  I'm a bit out of touch with how things work these days.  Is Github the best place to submit the PR?

Paul, very good digging!  Reading the coding and running a few examples, I understand that the ``prog`` of the subparser is always the name of the main program with the name of the subcommand *unless* a usage string is supplied, in which case it overrides prog.  I suspect that the intent is to favour the programmer supplied usage string and that copying the usage string in the prog of the subparser is an implementation detail.   I think we can reword the documentation to describe the expected behavior with more emphasis on the common cases.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41980>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:09:31 2020
From: report at bugs.python.org (Patrick Reader)
Date: Sat, 10 Oct 2020 13:09:31 +0000
Subject: [issue41997] Docs Standard Library index page has incorrect version
 in title
Message-ID: <1602335371.9.0.177302242721.issue41997@roundup.psfhosted.org>


New submission from Patrick Reader <pxeger at protonmail.com>:

The documentation page for the Standard Library, https://docs.python.org/3/library/, still says "Python 3.8.6 documentation" in the title. When visiting https://docs.python.org/3.9/library/ (emphasis on the 3.9) explicitly, the correct title is shown. I suspect there are other pages like this, perhaps ones that have not been modified since Python 3.8.6? This is possibly in fact some sort of bug in Sphinx, but I don't think so.

----------
assignee: docs at python
components: Documentation
messages: 378394
nosy: docs at python, pxeger
priority: normal
severity: normal
status: open
title: Docs Standard Library index page has incorrect version in title
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41997>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:22:37 2020
From: report at bugs.python.org (Dustin Moriarty)
Date: Sat, 10 Oct 2020 13:22:37 +0000
Subject: [issue41998] JSON Encoder Injection Using Indent
Message-ID: <1602336157.61.0.232979425714.issue41998@roundup.psfhosted.org>


New submission from Dustin Moriarty <dustin.moriarty at protonmail.com>:

It is possible to inject data while encoding json when a string is passed to the indent argument. 

Here is an example of an injection attack.

```python
import json

data = {"a": "original data"}
indent = '"b": "injected data",\n'
json_string = json.dumps(data, indent=indent)
print(json_string)
```

Output:
```
{
"b": "injected data",
"a": "original data"
}
```

This is a vulnerability because it is common for CLI and web frameworks to use string as the default data type for arguments. The vulnerability is more likely to be realized for CLI applications where there is more likely to be a use case for exposing the indent parameter to external users in order to control the json output. While this could be prevented by the application using the json encoder, the potential attach vector is not obvious or clear to developers. I cannot see any use case for allowing strings to be passed as indent, so I propose that indent is cast to integer on __init__ of the encoder. I will submit a corresponding PR.

----------
components: Library (Lib)
messages: 378395
nosy: DustinMoriarty
priority: normal
severity: normal
status: open
title: JSON Encoder Injection Using Indent
type: security
versions: Python 3.10, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41998>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:24:20 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 10 Oct 2020 13:24:20 +0000
Subject: [issue37461] email.parser.Parser hang
In-Reply-To: <1561951273.26.0.821144691276.issue37461@roundup.psfhosted.org>
Message-ID: <1602336260.65.0.963451736913.issue37461@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37461>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:28:00 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 10 Oct 2020 13:28:00 +0000
Subject: [issue32793] smtplib: duplicated debug message
In-Reply-To: <1518080718.92.0.467229070634.issue32793@psf.upfronthosting.co.za>
Message-ID: <1602336480.36.0.771718547089.issue32793@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Does this need to be backported to 3.8/3.7?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32793>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:31:19 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 10 Oct 2020 13:31:19 +0000
Subject: [issue41986] Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode are not
 available with limited API
In-Reply-To: <1602272883.67.0.0325810953138.issue41986@roundup.psfhosted.org>
Message-ID: <1602336679.07.0.0140918605403.issue41986@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I consider the global configuration variables as deprecated. I would prefer to slowly move towards PyConfig, since almost all Python functions now use PyInterpreterState.config.

The problem is that my idea to provide a stable ABI for PyConfig was rejected:
https://mail.python.org/archives/list/python-dev at python.org/thread/C7Z2NA2DTM3DLOZCFQAK5A2WFYO3PHHX/#2JAJQA5OANFPXAJ3327RRPHPQLKVP2EW

Which problem are you trying to solve your PR 22621?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41986>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:30:27 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 10 Oct 2020 13:30:27 +0000
Subject: [issue38077] IDLE leaking ARGV into globals() namespace
In-Reply-To: <1568063584.53.0.428247792791.issue38077@roundup.psfhosted.org>
Message-ID: <1602336627.45.0.387374273483.issue38077@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38077>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:33:34 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 13:33:34 +0000
Subject: [issue41998] JSON Encoder Injection Using Indent
In-Reply-To: <1602336157.61.0.232979425714.issue41998@roundup.psfhosted.org>
Message-ID: <1602336814.1.0.253974874191.issue41998@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

The code works as expected. I do not think there is a problem with the json module. If some application accepts user input and use it without validation to control the formatting of sensitive data, it is a vulnerability in this application, not in tools which it uses.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41998>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:38:01 2020
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Sat, 10 Oct 2020 13:38:01 +0000
Subject: [issue32885] Tools/scripts/pathfix.py leaves bunch of ~ suffixed
 files around with no opt-out
In-Reply-To: <1519124808.65.0.467229070634.issue32885@psf.upfronthosting.co.za>
Message-ID: <1602337081.71.0.170804318647.issue32885@roundup.psfhosted.org>


Change by Miro Hron?ok <miro at hroncok.cz>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32885>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:38:40 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 13:38:40 +0000
Subject: [issue41986] Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode are not
 available with limited API
In-Reply-To: <1602272883.67.0.0325810953138.issue41986@roundup.psfhosted.org>
Message-ID: <1602337120.86.0.497817398628.issue41986@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It solves the breaking of the C API. Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode were not deprecated, they were just suddenly excluded from the limited API. And seems this change was not intentional, otherwise surrounding #ifdef/#endif (which currently do not have effect) would be not preserved.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41986>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:39:13 2020
From: report at bugs.python.org (Dustin Moriarty)
Date: Sat, 10 Oct 2020 13:39:13 +0000
Subject: [issue41998] JSON Encoder Injection Using Indent
In-Reply-To: <1602336157.61.0.232979425714.issue41998@roundup.psfhosted.org>
Message-ID: <1602337153.19.0.117520540755.issue41998@roundup.psfhosted.org>


Dustin Moriarty <dustin.moriarty at protonmail.com> added the comment:

Sounds good. If this is the design intent, then we can close the issue.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41998>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:51:17 2020
From: report at bugs.python.org (Patrick Reader)
Date: Sat, 10 Oct 2020 13:51:17 +0000
Subject: [issue41997] Docs Standard Library index page has incorrect version
 in title
In-Reply-To: <1602335371.9.0.177302242721.issue41997@roundup.psfhosted.org>
Message-ID: <1602337877.89.0.896154821276.issue41997@roundup.psfhosted.org>


Patrick Reader <pxeger at protonmail.com> added the comment:

Sorry, it was a caching issue

----------
resolution:  -> works for me
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41997>
_______________________________________

From report at bugs.python.org  Sat Oct 10 09:52:49 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 10 Oct 2020 13:52:49 +0000
Subject: [issue41986] Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode are not
 available with limited API
In-Reply-To: <1602272883.67.0.0325810953138.issue41986@roundup.psfhosted.org>
Message-ID: <1602337969.0.0.0978301264102.issue41986@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Python 3.7 defines it in fileobject.h as:

#if !defined(Py_LIMITED_API) || Py_LIMITED_API+0 >= 0x03060000
PyAPI_DATA(const char *) Py_FileSystemDefaultEncodeErrors;
#endif

#if !defined(Py_LIMITED_API) || Py_LIMITED_API+0 >= 0x03070000
PyAPI_DATA(int) Py_UTF8Mode;
#endif


Python 3.8 defines them the same way, but in Include/cpython/fileobject.h:

#if !defined(Py_LIMITED_API) || Py_LIMITED_API+0 >= 0x03060000
PyAPI_DATA(const char *) Py_FileSystemDefaultEncodeErrors;
#endif

#if !defined(Py_LIMITED_API) || Py_LIMITED_API+0 >= 0x03070000
PyAPI_DATA(int) Py_UTF8Mode;
#endif


I am likely the one who moved these definitions. It was a mistake to move them inside Include/cpython/, since "Py_LIMITED_API+0 >= 0x03070000" became useless: cpython/fileobject.h is only included if Py_LIMITED_API is not defined.

In Include/cpython/, it seems like only 2 definitions are defined the wrong way, Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41986>
_______________________________________

From report at bugs.python.org  Sat Oct 10 10:09:52 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 14:09:52 +0000
Subject: [issue41986] Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode are not
 available with limited API
In-Reply-To: <1602272883.67.0.0325810953138.issue41986@roundup.psfhosted.org>
Message-ID: <1602338992.45.0.527396930967.issue41986@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 637a09b0d6e3ad4e34e0b5e0fc82f5afeae6f74b by Serhiy Storchaka in branch 'master':
bpo-41986: Add Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode back to limited API (GH-22621)
https://github.com/python/cpython/commit/637a09b0d6e3ad4e34e0b5e0fc82f5afeae6f74b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41986>
_______________________________________

From report at bugs.python.org  Sat Oct 10 10:10:00 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 10 Oct 2020 14:10:00 +0000
Subject: [issue41986] Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode are not
 available with limited API
In-Reply-To: <1602272883.67.0.0325810953138.issue41986@roundup.psfhosted.org>
Message-ID: <1602339000.05.0.600371874103.issue41986@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +21611
pull_request: https://github.com/python/cpython/pull/22637

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41986>
_______________________________________

From report at bugs.python.org  Sat Oct 10 10:10:08 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 10 Oct 2020 14:10:08 +0000
Subject: [issue41986] Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode are not
 available with limited API
In-Reply-To: <1602272883.67.0.0325810953138.issue41986@roundup.psfhosted.org>
Message-ID: <1602339008.75.0.650177827307.issue41986@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21612
pull_request: https://github.com/python/cpython/pull/22638

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41986>
_______________________________________

From report at bugs.python.org  Sat Oct 10 10:19:05 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 10 Oct 2020 14:19:05 +0000
Subject: [issue38792] IDLE calltips may not properly close on KeyboardInterrupt
In-Reply-To: <1573714051.12.0.86899018089.issue38792@roundup.psfhosted.org>
Message-ID: <1602339545.02.0.904909413393.issue38792@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38792>
_______________________________________

From report at bugs.python.org  Sat Oct 10 10:28:53 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 10 Oct 2020 14:28:53 +0000
Subject: [issue41986] Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode are not
 available with limited API
In-Reply-To: <1602272883.67.0.0325810953138.issue41986@roundup.psfhosted.org>
Message-ID: <1602340133.18.0.720823485701.issue41986@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ff6870f199511f09304e9d3ee7e7d8ed3902ffd1 by Miss Skeleton (bot) in branch '3.8':
bpo-41986: Add Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode back to limited API (GH-22621)
https://github.com/python/cpython/commit/ff6870f199511f09304e9d3ee7e7d8ed3902ffd1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41986>
_______________________________________

From report at bugs.python.org  Sat Oct 10 10:32:13 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 10 Oct 2020 14:32:13 +0000
Subject: [issue41986] Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode are not
 available with limited API
In-Reply-To: <1602272883.67.0.0325810953138.issue41986@roundup.psfhosted.org>
Message-ID: <1602340333.23.0.0778516705916.issue41986@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ebc5a6b59ece48b490987bdaa2af842c29f5b2f8 by Miss Skeleton (bot) in branch '3.9':
bpo-41986: Add Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode back to limited API (GH-22621)
https://github.com/python/cpython/commit/ebc5a6b59ece48b490987bdaa2af842c29f5b2f8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41986>
_______________________________________

From report at bugs.python.org  Sat Oct 10 10:40:53 2020
From: report at bugs.python.org (sajicek)
Date: Sat, 10 Oct 2020 14:40:53 +0000
Subject: [issue41999] imaplib Time2Internaldate crashing with time.struct_time
 supplied from datetime.timetuple()
Message-ID: <1602340853.75.0.0765560089646.issue41999@roundup.psfhosted.org>


New submission from sajicek <sajicek at gmail.com>:

Hello
first of all, I couldn't find any issue related to this, so sorry if it has been solved before.

There seems to be an issue with IMAPLIB in all versions I've checked, when using the Time2Internaldate function with time.struct_time created by datetime.timetuple() extracted from an EmailMessage object (using the email.utils.parsedate_to_datetime function), and even when created with datetime.now() the function crashes the app with
"TypeError: unsupported type for timedelta seconds component: NoneType"
on line 1530 in current master on GH. (delta = timedelta(seconds=gmtoff))

Crash happens because the "date_time.tm_gmtoff" from which the gmtoff variable is constructed, seems to default to None in all instances of time.struct_time object created by datetime.timetuple(), which still passes the try, except clausule on 1520, because it's not an AttributeError. The time.localtime() metioned in the docs asigns the correct value into tm_gmtoff, but the datetime.timetuple() does not.


Possible solutions I've found:
1) inside Time2Internaldate: surround the delta with try and except - in except make the delta = 0
2) inside Time2Internaldate: check the gmtoff for None and if yes, then change it to 0
3) change the default of tm_gmtoff in timetuple from None to 0 (or to a current timezone offset)

or just say in the docs, that time.struct_time created this way (using the datetime.timetuple()) is unsupported

PS: when writing this issue, I've started thinking this might be a datetime lib issue too

----------
components: Library (Lib)
messages: 378409
nosy: sajicek
priority: normal
severity: normal
status: open
title: imaplib Time2Internaldate crashing with time.struct_time supplied from datetime.timetuple()
type: behavior
versions: Python 3.10, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41999>
_______________________________________

From report at bugs.python.org  Sat Oct 10 10:47:34 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 10 Oct 2020 14:47:34 +0000
Subject: [issue38077] IDLE leaking ARGV into globals() namespace
In-Reply-To: <1568063584.53.0.428247792791.issue38077@roundup.psfhosted.org>
Message-ID: <1602341254.35.0.148556549939.issue38077@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Since I opened the followup issue, yes.  Thanks for noticing.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38077>
_______________________________________

From report at bugs.python.org  Sat Oct 10 10:51:11 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 10 Oct 2020 14:51:11 +0000
Subject: [issue38792] IDLE calltips may not properly close on KeyboardInterrupt
In-Reply-To: <1573714051.12.0.86899018089.issue38792@roundup.psfhosted.org>
Message-ID: <1602341471.28.0.279635886177.issue38792@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38792>
_______________________________________

From report at bugs.python.org  Sat Oct 10 11:27:06 2020
From: report at bugs.python.org (John Belmonte)
Date: Sat, 10 Oct 2020 15:27:06 +0000
Subject: [issue40213] contextlib.aclosing()
In-Reply-To: <1586225612.65.0.881233882976.issue40213@roundup.psfhosted.org>
Message-ID: <1602343626.92.0.980521368758.issue40213@roundup.psfhosted.org>


Change by John Belmonte <john at neggie.net>:


----------
keywords: +patch
nosy: +jbelmonte
nosy_count: 9.0 -> 10.0
pull_requests: +21613
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22640

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40213>
_______________________________________

From report at bugs.python.org  Sat Oct 10 11:58:31 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Sat, 10 Oct 2020 15:58:31 +0000
Subject: [issue42000] Small cleanups to AST-related code
Message-ID: <1602345511.41.0.393317645505.issue42000@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
components: Interpreter Core
nosy: BTaskaya
priority: normal
severity: normal
status: open
title: Small cleanups to AST-related code
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42000>
_______________________________________

From report at bugs.python.org  Sat Oct 10 12:50:37 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Sat, 10 Oct 2020 16:50:37 +0000
Subject: [issue42000] Small cleanups to AST-related code
Message-ID: <1602348637.14.0.774716557.issue42000@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
keywords: +patch
pull_requests: +21614
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22641

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42000>
_______________________________________

From report at bugs.python.org  Sat Oct 10 13:15:05 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 10 Oct 2020 17:15:05 +0000
Subject: [issue42000] Small cleanups to AST-related code
Message-ID: <1602350105.98.0.0513801719476.issue42000@roundup.psfhosted.org>


New submission from miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


New changeset 02a1603f918b9862e164e4fd050c505b16bc9f57 by Batuhan Taskaya in branch 'master':
bpo-42000: Cleanup the AST related C-code (GH-22641)
https://github.com/python/cpython/commit/02a1603f918b9862e164e4fd050c505b16bc9f57


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42000>
_______________________________________

From report at bugs.python.org  Sat Oct 10 13:15:20 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Sat, 10 Oct 2020 17:15:20 +0000
Subject: [issue42000] Small cleanups to AST-related code
In-Reply-To: <1602350105.98.0.0513801719476.issue42000@roundup.psfhosted.org>
Message-ID: <1602350120.21.0.0314751357144.issue42000@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42000>
_______________________________________

From report at bugs.python.org  Sat Oct 10 15:02:51 2020
From: report at bugs.python.org (Kaushal Rohit)
Date: Sat, 10 Oct 2020 19:02:51 +0000
Subject: [issue42001] Deprecate `typing.io` Wrapper Namespace
Message-ID: <1602356571.41.0.0517302628029.issue42001@roundup.psfhosted.org>


New submission from Kaushal Rohit <rohit.kg98 at gmail.com>:

The `typing` module has a wrapper namespace in it called `typing.io` which contain I/O stream types.

These types are now a part of the `typing` module itself.

While we are at it, should we also deprecate `typing.re`?

----------
components: Library (Lib)
messages: 378412
nosy: rohitkg98
priority: normal
severity: normal
status: open
title: Deprecate `typing.io` Wrapper Namespace
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42001>
_______________________________________

From report at bugs.python.org  Sat Oct 10 15:23:50 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 19:23:50 +0000
Subject: [issue41991] Remove _PyObject_HasAttrId
In-Reply-To: <1602316031.88.0.412712857392.issue41991@roundup.psfhosted.org>
Message-ID: <1602357830.27.0.608679237669.issue41991@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 98c4433a81a4cd88c7438adbee1f2aa486188ca3 by Serhiy Storchaka in branch 'master':
bpo-41991: Remove _PyObject_HasAttrId (GH-22629)
https://github.com/python/cpython/commit/98c4433a81a4cd88c7438adbee1f2aa486188ca3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41991>
_______________________________________

From report at bugs.python.org  Sat Oct 10 15:28:11 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 19:28:11 +0000
Subject: [issue41986] Py_FileSystemDefaultEncodeErrors and Py_UTF8Mode are not
 available with limited API
In-Reply-To: <1602272883.67.0.0325810953138.issue41986@roundup.psfhosted.org>
Message-ID: <1602358091.34.0.633624561234.issue41986@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41986>
_______________________________________

From report at bugs.python.org  Sat Oct 10 16:41:42 2020
From: report at bugs.python.org (Sebastian Rittau)
Date: Sat, 10 Oct 2020 20:41:42 +0000
Subject: [issue42001] Deprecate `typing.io` Wrapper Namespace
In-Reply-To: <1602356571.41.0.0517302628029.issue42001@roundup.psfhosted.org>
Message-ID: <1602362502.41.0.721877294243.issue42001@roundup.psfhosted.org>


Sebastian Rittau <srittau at rittau.biz> added the comment:

For reference, this came up in https://github.com/python/typeshed/issues/4639#issuecomment-706596656. `typing.io` has never been in typeshed and we decided not to include it. It looks as if it never gained any traction, especially since the types are available from `typing` directly.

----------
nosy: +srittau

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42001>
_______________________________________

From report at bugs.python.org  Sat Oct 10 17:01:19 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 21:01:19 +0000
Subject: [issue42002] Clean up initialization of the sys module
Message-ID: <1602363679.37.0.37649342786.issue42002@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

_PySys_InitCore() and _PySys_InitMain() in Python/sysmodule.c contains many invocations of macros for setting attributes of the sys module. The proposed PR changes these macros.

1. SET_SYS_FROM_STRING was renamed to just SET_SYS. It is much shorter and allow to write many invocations in one line. Also SET_SYS_FROM_STRING was not consistent with SET_SYS_FROM_WSTR.

2. Added new SET_SYS_FROM_STRING which sets attribute specified as C char string (similarly to SET_SYS_FROM_WSTR which sets attribute specified as C wchar_t string).

3. Added COPY_SYS_ATTR for making a copy of the attribute. It uses PyMapping_GetItemString() instead of PyDict_GetItemString() which silences all expressions.

4. Removed SET_SYS_FROM_STRING_BORROW. It no longer used, and it was used improperly.

5. SET_SYS_FROM_STRING_INT_RESULT replaced with SET_SYS.

6. All macros have been rewritten in term of SET_SYS that significantly simplifies the code.

All this makes the code clearer and makes errors handling more correct.

----------
components: Interpreter Core
messages: 378415
nosy: serhiy.storchaka
priority: normal
severity: normal
status: open
title: Clean up initialization of the sys module
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42002>
_______________________________________

From report at bugs.python.org  Sat Oct 10 17:01:30 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 21:01:30 +0000
Subject: [issue42002] Clean up initialization of the sys module
In-Reply-To: <1602363679.37.0.37649342786.issue42002@roundup.psfhosted.org>
Message-ID: <1602363690.94.0.601390884716.issue42002@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42002>
_______________________________________

From report at bugs.python.org  Sat Oct 10 17:03:05 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 21:03:05 +0000
Subject: [issue42002] Clean up initialization of the sys module
In-Reply-To: <1602363679.37.0.37649342786.issue42002@roundup.psfhosted.org>
Message-ID: <1602363785.1.0.498757781161.issue42002@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21616
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22642

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42002>
_______________________________________

From report at bugs.python.org  Sat Oct 10 17:07:06 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 10 Oct 2020 21:07:06 +0000
Subject: [issue41991] Remove _PyObject_HasAttrId
In-Reply-To: <1602316031.88.0.412712857392.issue41991@roundup.psfhosted.org>
Message-ID: <1602364026.16.0.519169106206.issue41991@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41991>
_______________________________________

From report at bugs.python.org  Sat Oct 10 18:19:53 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 10 Oct 2020 22:19:53 +0000
Subject: [issue38605] [typing] PEP 563: Postponed evaluation of annotations:
 enable it by default in Python 3.10
In-Reply-To: <1572192430.43.0.755831692199.issue38605@roundup.psfhosted.org>
Message-ID: <1602368393.85.0.847036306905.issue38605@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 22220ae216b11644b23511c6287a52e7d28aeb9f by Batuhan Taskaya in branch 'master':
bpo-38605: bump the magic number for 'annotations' future (#22630)
https://github.com/python/cpython/commit/22220ae216b11644b23511c6287a52e7d28aeb9f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38605>
_______________________________________

From report at bugs.python.org  Sat Oct 10 19:54:23 2020
From: report at bugs.python.org (foxpython_2020)
Date: Sat, 10 Oct 2020 23:54:23 +0000
Subject: [issue42003] After changing to list or tuple,
 will the original parameter change?
Message-ID: <1602374063.78.0.592326077925.issue42003@roundup.psfhosted.org>


New submission from foxpython_2020 <foxtable at qq.com>:

c = dict(zip(['one', 'two', 'three'], [1, 2, 3]))
print("1:",c) # right: {'one': 1, 'two': 2, 'three': 3}

b= zip(['one', 'two', 'three'], [1, 2, 3])
a= list(b) #Because of this line of code, the result is different
print("2:",dict(b)) #wrong: {}

b= zip(['one', 'two', 'three'], [1, 2, 3])
a= tuple(b) #Because of this line of code, the result is different
print("2:",dict(b)) #wrong: {}

----------
messages: 378417
nosy: foxpython_2020
priority: normal
severity: normal
status: open
title: After changing to list or tuple, will the original parameter change?

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42003>
_______________________________________

From report at bugs.python.org  Sat Oct 10 20:53:17 2020
From: report at bugs.python.org (Javier Ayres)
Date: Sun, 11 Oct 2020 00:53:17 +0000
Subject: [issue42004] Allow uploading files with SimpleHTTPRequestHandler
Message-ID: <1602377597.5.0.712668345738.issue42004@roundup.psfhosted.org>


New submission from Javier Ayres <javier at lufte.net>:

Hello. I'm a big fan of the http.server module to quickly serve some files in a local network with `python3 -m http.server`. I regularly needed to get some files from other people too, but getting everyone to install/run python3 was not such a simple task. Eventually I wrote a subclass of SimpleHTTPRequestHandler that added a form with a file input and accepted POST requests, so people could also upload files to my computer. I think this would be a fine addition to SimpleHTTPRequestHandler, so I'm attaching a potential patch that implements this and adds a new cli parameter so this feature is only enabled explicitly.

----------
components: Library (Lib)
files: patch
messages: 378418
nosy: lufte
priority: normal
severity: normal
status: open
title: Allow uploading files with SimpleHTTPRequestHandler
type: enhancement
versions: Python 3.10
Added file: https://bugs.python.org/file49506/patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42004>
_______________________________________

From report at bugs.python.org  Sat Oct 10 22:07:20 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 11 Oct 2020 02:07:20 +0000
Subject: [issue42003] After changing to list or tuple,
 will the original parameter change?
In-Reply-To: <1602374063.78.0.592326077925.issue42003@roundup.psfhosted.org>
Message-ID: <1602382040.19.0.236268861018.issue42003@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

This is not a bug. In Python 2, zip() returns a list, so you can use it over and over again. But in Python 3, zip() returns an iterator, and you can only use iterators once. After you have used the iterator, it is exhausted and there is nothing left.

So the behaviour you see is expected and intentional.

----------
nosy: +steven.daprano
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42003>
_______________________________________

From report at bugs.python.org  Sat Oct 10 23:37:47 2020
From: report at bugs.python.org (Tim Peters)
Date: Sun, 11 Oct 2020 03:37:47 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602387467.42.0.926321074584.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Ya, the case for the diff is at best marginal. Note that while it may be theoretically provable that the extra test would make the worst cases slower, that's almost certainly not measurable. The extra test would almost never be executed in the worst cases: in those the last characters of the needle and haystack DO match, and we spend almost all the total time in the

                for (j = 0; j < mlast; j++)

loop.  The extra test is only in the branch where the last characters _don't_ match.

In that branch, it's already certain that the last haystack character does not match the last needle character, so in a probabilistic sense, for "random" data that increases the odds that the last haystack character isn't in the needle at all. In which case the payoff is relatively large compared to the cost of the test (can skip len(needle) positions at once, instead of only 1).

I don't believe this can be out-thought. It would require timing on "typical" real-life searches. Which are likely impossible to obtain ;-)

Offhand do you know what the _best_ timing for two-way search is in a pattern-not-found case? The algorithm is too complicated for that to be apparent to me at a glance. As Fredrik said in the post of his I linked to, he was very keen to have an algorithm with best case sublinear time. For example, the one we have takes best-case not-found O(n/m) time (where n is the haystack length and m the needle length).  For example, searching for 'B' * 1_000_000 in 'A' * 10_000_000 fails after just 9 character comparisons (well, not counting the million less 1 compares to initialize `skip` to the ultimately useless 0).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sat Oct 10 23:49:17 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 11 Oct 2020 03:49:17 +0000
Subject: [issue42001] Deprecate `typing.io` Wrapper Namespace
In-Reply-To: <1602356571.41.0.0517302628029.issue42001@roundup.psfhosted.org>
Message-ID: <1602388157.49.0.12263858762.issue42001@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +gvanrossum, levkivskyi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42001>
_______________________________________

From report at bugs.python.org  Sun Oct 11 01:45:17 2020
From: report at bugs.python.org (Zhiming Wang)
Date: Sun, 11 Oct 2020 05:45:17 +0000
Subject: [issue42005] profile/cProfile CLI should catch BrokenPipeError
Message-ID: <1602395117.19.0.101668557354.issue42005@roundup.psfhosted.org>


New submission from Zhiming Wang <zmwangx at gmail.com>:

Since profile/cProfile CLI interface prints a sorted list of stats, using head to limit output to the most relevant entries should be a fairly natural thing to do. Unfortunately, BrokenPipeError isn't caught, causing quite a bit of pollution to the output:

$ python3 -m cProfile -m http.server -h | head
usage: http.server [-h] [--cgi] [--bind ADDRESS] [--directory DIRECTORY]
                   [port]

positional arguments:
  port                  Specify alternate port [default: 8000]

optional arguments:
  -h, --help            show this help message and exit
  --cgi                 Run as CGI Server
  --bind ADDRESS, -b ADDRESS
Traceback (most recent call last):
  File "/Users/zmwang/.pyenv/versions/3.9.0/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/Users/zmwang/.pyenv/versions/3.9.0/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/zmwang/.pyenv/versions/3.9.0/lib/python3.9/cProfile.py", line 180, in <module>
    main()
  File "/Users/zmwang/.pyenv/versions/3.9.0/lib/python3.9/cProfile.py", line 173, in main
    runctx(code, globs, None, options.outfile, options.sort)
  File "/Users/zmwang/.pyenv/versions/3.9.0/lib/python3.9/cProfile.py", line 19, in runctx
    return _pyprofile._Utils(Profile).runctx(statement, globals, locals,
  File "/Users/zmwang/.pyenv/versions/3.9.0/lib/python3.9/profile.py", line 66, in runctx
    self._show(prof, filename, sort)
  File "/Users/zmwang/.pyenv/versions/3.9.0/lib/python3.9/profile.py", line 72, in _show
    prof.print_stats(sort)
  File "/Users/zmwang/.pyenv/versions/3.9.0/lib/python3.9/cProfile.py", line 42, in print_stats
    pstats.Stats(self).strip_dirs().sort_stats(sort).print_stats()
  File "/Users/zmwang/.pyenv/versions/3.9.0/lib/python3.9/pstats.py", line 431, in print_stats
    self.print_line(func)
  File "/Users/zmwang/.pyenv/versions/3.9.0/lib/python3.9/pstats.py", line 513, in print_line
    print(f8(tt/nc), end=' ', file=self.stream)
BrokenPipeError: [Errno 32] Broken pipe
Exception ignored in: <_io.TextIOWrapper name='<stdout>' mode='w' encoding='utf-8'>
BrokenPipeError: [Errno 32] Broken pipe

I think the exception should be caught in order to suppress this noise.

----------
components: Library (Lib)
messages: 378421
nosy: zmwangx
priority: normal
severity: normal
status: open
title: profile/cProfile CLI should catch BrokenPipeError
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42005>
_______________________________________

From report at bugs.python.org  Sun Oct 11 01:53:53 2020
From: report at bugs.python.org (Zhiming Wang)
Date: Sun, 11 Oct 2020 05:53:53 +0000
Subject: [issue39828] json.tool should catch BrokenPipeError
In-Reply-To: <1583163028.53.0.26021214856.issue39828@roundup.psfhosted.org>
Message-ID: <1602395633.38.0.97627849785.issue39828@roundup.psfhosted.org>


Change by Zhiming Wang <zmwangx at gmail.com>:


----------
nosy: +zmwangx
nosy_count: 5.0 -> 6.0
pull_requests: +21618
pull_request: https://github.com/python/cpython/pull/22643

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39828>
_______________________________________

From report at bugs.python.org  Sun Oct 11 01:53:53 2020
From: report at bugs.python.org (Zhiming Wang)
Date: Sun, 11 Oct 2020 05:53:53 +0000
Subject: [issue42005] profile/cProfile CLI should catch BrokenPipeError
In-Reply-To: <1602395117.19.0.101668557354.issue42005@roundup.psfhosted.org>
Message-ID: <1602395633.31.0.516745422682.issue42005@roundup.psfhosted.org>


Change by Zhiming Wang <zmwangx at gmail.com>:


----------
keywords: +patch
pull_requests: +21617
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22643

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42005>
_______________________________________

From report at bugs.python.org  Sun Oct 11 02:18:50 2020
From: report at bugs.python.org (Ammar Askar)
Date: Sun, 11 Oct 2020 06:18:50 +0000
Subject: [issue42005] profile/cProfile CLI should catch BrokenPipeError
In-Reply-To: <1602395117.19.0.101668557354.issue42005@roundup.psfhosted.org>
Message-ID: <1602397130.04.0.496555210366.issue42005@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

Related:

https://bugs.python.org/issue39828

----------
nosy: +ammar2, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42005>
_______________________________________

From report at bugs.python.org  Sun Oct 11 02:51:33 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Sun, 11 Oct 2020 06:51:33 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602399093.18.0.0798662657201.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

> Offhand do you know what the _best_ timing for two-way search is in a pattern-not-found case?

Looking at the glibc implementation, in the top-level "else" clause
(for when the string isn't completely periodic),
we have:

    period = MAX (suffix, needle_len - suffix) + 1;

so period > needle_len / 2.

Then during each iteration of the j-loop (where j is the index into the haystack),
j is sometimes incremented by `period`, which would probably give O(n/m) best case.

Here's a sublinear example for the two-way algorithm:

    N = 10**7
    haystack = "ABC" * N
    needle1 = "ABC" * (N // 10) + "DDD"
    needle2 = "ABC" * 10 + "DDD"
    
    === Results ===
    Pure Python Two-Way, shorter needle:     1.7142754
    Pure Python Two-Way. Longer needle:      0.0018845000000000667
    Python builtin, shorter needle:          0.031071400000000082
    Python builtin, longer needle:           0.030566099999999707

This case is surprisingly better than the builtin:

    N = 10**7
    haystack = "ABC" * N
    needle1 = "DDD" + "ABC" * (N // 10)
    needle2 = "DDD" + "ABC" * 10

    === Results ===
    Pure Python Two-Way, shorter needle:     0.0020895000000000774
    Pure Python Two-Way. Longer needle:      0.0017878999999999534
    Python builtin, shorter needle:          0.029998100000000028
    Python builtin, longer needle:           0.02963439999999995

This was measured using the attached fastsearch.py. There are some manipulations in there like string slicing that would make more sense as pointer math in C, so especially accounting for that, I'm guessing it would be pretty competitive in a lot of cases.

A lot of the implementations look like they use a complete Boyer-Moore table to go sublinear in even more cases, which it seems we want to avoid. I'm not certain, but it's conceivable that the existing techniques of using just one one delta-value or the "Bloom filter" could be thrown in there to get some of the same improvements. Although that could be redundant -- I'm not sure.

----------
Added file: https://bugs.python.org/file49507/fastsearch.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sun Oct 11 03:29:14 2020
From: report at bugs.python.org (Chih-Hsuan Yen)
Date: Sun, 11 Oct 2020 07:29:14 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
In-Reply-To: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>
Message-ID: <1602401354.05.0.450966898869.issue41971@roundup.psfhosted.org>


Change by Chih-Hsuan Yen <yan12125 at gmail.com>:


----------
nosy: +yan12125

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Sun Oct 11 03:51:00 2020
From: report at bugs.python.org (=?utf-8?q?J=C3=BCrgen_Gmach?=)
Date: Sun, 11 Oct 2020 07:51:00 +0000
Subject: [issue42004] Allow uploading files with SimpleHTTPRequestHandler
In-Reply-To: <1602377597.5.0.712668345738.issue42004@roundup.psfhosted.org>
Message-ID: <1602402660.67.0.164122145337.issue42004@roundup.psfhosted.org>


J?rgen Gmach <juergen.gmach at googlemail.com> added the comment:

There is PEP 594 (draft), which - when accepted - will remove cgi.FieldStorage

https://www.python.org/dev/peps/pep-0594/

https://discuss.python.org/t/pep-594-removing-dead-batteries-from-the-standard-library/1704

This comes from an idea to relief the burden of maintenance for the maintainers.



Some off-topic comments...

cgi.FieldStorage has quite some unresolved issues, partially open for many years, although there are also some pull requests, waiting for review.

While cgi.FieldStorage is certainly a niche thing, it is used by Zope, by Plone, by webob... 

The latter even has a 250 line compat module to accomodate for current bugs ( https://github.com/Pylons/webob/blob/5c062aef9397b27915c5cc2ed2f202bff7494eca/src/webob/compat.py ).

If you, Javier, are also a fan of cgi.FieldStorage want to improve the situation with cgi.FieldStorage, maybe you could help reviewing the open issues and the open pull requests for cpython?

----------
nosy: +jugmac00

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42004>
_______________________________________

From report at bugs.python.org  Sun Oct 11 04:47:17 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Sun, 11 Oct 2020 08:47:17 +0000
Subject: [issue41756] Do not always use exceptions to return result from
 coroutine
In-Reply-To: <1599786636.95.0.884410425349.issue41756@roundup.psfhosted.org>
Message-ID: <1602406037.48.0.277501835883.issue41756@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

> Don't forget to remove PyGen_Send()

That's the function that allows sending data into a generator. It's also used internally by "PyIter_Send()". Are you really suggesting to remove it, or to make it underscore-private again? (As it was before.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41756>
_______________________________________

From report at bugs.python.org  Sun Oct 11 07:09:13 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 11 Oct 2020 11:09:13 +0000
Subject: [issue41845] Promote PyObject_GenericGetDict to the stable API
In-Reply-To: <1600871509.15.0.3993940648.issue41845@roundup.psfhosted.org>
Message-ID: <1602414553.4.0.438681942206.issue41845@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
nosy: +ZackerySpytz
nosy_count: 4.0 -> 5.0
pull_requests: +21619
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22646

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41845>
_______________________________________

From report at bugs.python.org  Sun Oct 11 07:10:57 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 11 Oct 2020 11:10:57 +0000
Subject: [issue41845] Promote PyObject_GenericGetDict to the stable API
In-Reply-To: <1600871509.15.0.3993940648.issue41845@roundup.psfhosted.org>
Message-ID: <1602414657.47.0.845383555882.issue41845@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

I have created PR 22646 to fix this issue.  Please consider taking a look.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41845>
_______________________________________

From report at bugs.python.org  Sun Oct 11 08:24:46 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 12:24:46 +0000
Subject: [issue41981] Errors building python 3.9.0 from source on Centos 7
 with GCC 10
In-Reply-To: <1602249591.17.0.670337051124.issue41981@roundup.psfhosted.org>
Message-ID: <1602419086.4.0.412125023172.issue41981@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> In "config.log" you can see that "/bin/ld" did not found "-lpanelw".

Yep, that's what I wrote in my previous message :-)

I understand that you solved your issue, so I close this issue.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41981>
_______________________________________

From report at bugs.python.org  Sun Oct 11 08:27:08 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 12:27:08 +0000
Subject: [issue41940] AMD64 Debian root 3.x: tests fail because downloaded
 files start with: <!DOCTYPE
In-Reply-To: <1601887687.95.0.739602877312.issue41940@roundup.psfhosted.org>
Message-ID: <1602419228.25.0.171541489273.issue41940@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Yeah, it seems like Chris's Internet issues are gone ;-)

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41940>
_______________________________________

From report at bugs.python.org  Sun Oct 11 08:26:12 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 12:26:12 +0000
Subject: [issue34067] Problem with contextlib.nullcontext
In-Reply-To: <1530984805.95.0.56676864532.issue34067@psf.upfronthosting.co.za>
Message-ID: <1602419172.66.0.354541982535.issue34067@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34067>
_______________________________________

From report at bugs.python.org  Sun Oct 11 08:30:42 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 12:30:42 +0000
Subject: [issue41991] Remove _PyObject_HasAttrId
In-Reply-To: <1602316031.88.0.412712857392.issue41991@roundup.psfhosted.org>
Message-ID: <1602419442.96.0.963158468075.issue41991@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Remark: the issue that you give in this issue is helpful. Next time, you may include such rationale directly in the commit message. IMO the Linux kernel is a great example on how commit message should be written: long commit message with tons of information, you don't need to go to an online website (like bugs.python.org) to get more context / the rationale.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41991>
_______________________________________

From report at bugs.python.org  Sun Oct 11 08:30:47 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 11 Oct 2020 12:30:47 +0000
Subject: [issue42002] Clean up initialization of the sys module
In-Reply-To: <1602363679.37.0.37649342786.issue42002@roundup.psfhosted.org>
Message-ID: <1602419447.36.0.461716374968.issue42002@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset fa1d83db62a545580d9a1a585b2c1fb55961a5c3 by Serhiy Storchaka in branch 'master':
bpo-42002: Clean up initialization of the sys module. (GH-22642)
https://github.com/python/cpython/commit/fa1d83db62a545580d9a1a585b2c1fb55961a5c3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42002>
_______________________________________

From report at bugs.python.org  Sun Oct 11 08:35:56 2020
From: report at bugs.python.org (Chris Angelico)
Date: Sun, 11 Oct 2020 12:35:56 +0000
Subject: [issue41940] AMD64 Debian root 3.x: tests fail because downloaded
 files start with: <!DOCTYPE
In-Reply-To: <1601887687.95.0.739602877312.issue41940@roundup.psfhosted.org>
Message-ID: <1602419756.23.0.723341290789.issue41940@roundup.psfhosted.org>


Chris Angelico <rosuav at gmail.com> added the comment:

That ducks the immediate issue, but I think the underlying issue would still be worth solving. How hard would it be to fetch this via an encrypted connection? It's still not 100% secure, but it would be resilient against some of these sorts of issues.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41940>
_______________________________________

From report at bugs.python.org  Sun Oct 11 08:36:50 2020
From: report at bugs.python.org (Mark Shannon)
Date: Sun, 11 Oct 2020 12:36:50 +0000
Subject: [issue41756] Do not always use exceptions to return result from
 coroutine
In-Reply-To: <1599786636.95.0.884410425349.issue41756@roundup.psfhosted.org>
Message-ID: <1602419810.48.0.472493096312.issue41756@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

What's the difference between removing it and making it properly private (i.e. static)?

It's an irrelevant detail whether the code is inlined or in a helper function.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41756>
_______________________________________

From report at bugs.python.org  Sun Oct 11 08:51:31 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 12:51:31 +0000
Subject: [issue41940] AMD64 Debian root 3.x: tests fail because downloaded
 files start with: <!DOCTYPE
In-Reply-To: <1601887687.95.0.739602877312.issue41940@roundup.psfhosted.org>
Message-ID: <1602420691.59.0.00566026101118.issue41940@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

If someone wants to use HTTPS on pythontest.net, please open a new issue. I don't recall who operates this service. Ask Ernest or Benjamin maybe? See https://github.com/python/pythontestdotnet/ project. https://pythontest.net/ has an invalid certificate. Ernest might be able to set up a valid certificate.

For buildbot failures, I prefer to be able to close issues as soon as possible, since I manage tons of buildbot failures. Otherwise, I'm quickly overwhelmed.

The initial issue "AMD64 Debian root 3.x fails" is fixed ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41940>
_______________________________________

From report at bugs.python.org  Sun Oct 11 09:51:18 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 11 Oct 2020 13:51:18 +0000
Subject: [issue41993] Possible issues when remove not completely initialized
 module from sys.module
In-Reply-To: <1602327087.97.0.628811045218.issue41993@roundup.psfhosted.org>
Message-ID: <1602424278.2.0.87362231198.issue41993@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 8287aadb75f6bd0154996424819334cd3839707c by Serhiy Storchaka in branch 'master':
bpo-41993: Fix possible issues in remove_module() (GH-22631)
https://github.com/python/cpython/commit/8287aadb75f6bd0154996424819334cd3839707c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41993>
_______________________________________

From report at bugs.python.org  Sun Oct 11 09:51:59 2020
From: report at bugs.python.org (E. Paine)
Date: Sun, 11 Oct 2020 13:51:59 +0000
Subject: [issue41968] 3.9 IDLE documentation.
In-Reply-To: <1602078849.36.0.609804596157.issue41968@roundup.psfhosted.org>
Message-ID: <1602424319.32.0.984215858889.issue41968@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

If you had a bad update, it is likely your registry is corrupt. If at all possible, I would recommend a Windows reinstall (it is quite likely other software has also been affected). However, in the past I have had similar problems and the Python installer does seem particularly susceptible to problems if corruption occurs (I resolved this without a Windows reinstall by uninstalling Python then deleting all registry entries related to it - though I would not recommend this more generally). I may take this up with Steve (in a separate issue) to see if we can make the installer more resilient.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41968>
_______________________________________

From report at bugs.python.org  Sun Oct 11 09:51:24 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 11 Oct 2020 13:51:24 +0000
Subject: [issue41993] Possible issues when remove not completely initialized
 module from sys.module
In-Reply-To: <1602327087.97.0.628811045218.issue41993@roundup.psfhosted.org>
Message-ID: <1602424284.93.0.0295578472403.issue41993@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21620
pull_request: https://github.com/python/cpython/pull/22647

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41993>
_______________________________________

From report at bugs.python.org  Sun Oct 11 10:06:22 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 11 Oct 2020 14:06:22 +0000
Subject: [issue42002] Clean up initialization of the sys module
In-Reply-To: <1602363679.37.0.37649342786.issue42002@roundup.psfhosted.org>
Message-ID: <1602425182.42.0.569452305456.issue42002@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42002>
_______________________________________

From report at bugs.python.org  Sun Oct 11 10:24:15 2020
From: report at bugs.python.org (John Belmonte)
Date: Sun, 11 Oct 2020 14:24:15 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1602426255.05.0.97296464738.issue38250@roundup.psfhosted.org>


John Belmonte <john at neggie.net> added the comment:

Part of this issue (#1) was intended to be addressed by https://github.com/python/cpython/pull/22221 which added an `__iter__` implementation to Flag and IntFlag.  (The PR did not reference this issue, and was already merged last month.)

However that PR seems problematic on several counts:
   1. `__iter__` diverges from the existing `__contains__`.  The latter includes 0 and compound values
   2. the implementation is fairly heavy
   3. len() on an enum instance is going to be O(n)

I've put post-merge comments on the PR.

I think it would be safer to have an explicitly named `bits()` iterator on flag instances, rather than use `__iter__()`.

----------
keywords: +patch
message_count: 3.0 -> 4.0
pull_requests: +21621
stage:  -> patch review
versions: +Python 3.10 -Python 3.9
pull_request: https://github.com/python/cpython/pull/22221

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Sun Oct 11 10:36:40 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 11 Oct 2020 14:36:40 +0000
Subject: [issue42006] Stop using PyDict_GetItem,
 PyDict_GetItemString and _PyDict_GetItemId
Message-ID: <1602427000.44.0.391654139767.issue42006@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

There are design flaws in PyDict_GetItem(), PyDict_GetItemString() and _PyDict_GetItemId().

1. They suppress all exceptions raised internally. Most common of are MemoryError, KeyboardInterrupt and RecursionError whose raising is out of control of the programmer. When an exception is suppressed the function returns incorrect result. For example PyDict_GetItem() can return NULL for existing key if the user press Ctrl-C.

This situation seems impossible if the key and all keys in the dict are exact strings, but we cannot be sure.

2. PyDict_GetItem() preserves the current exception, and therefore can be used in handling exception but PyDict_GetItemString() and _PyDict_GetItemId() clear it if the creation of string object is failed (due to MemoryError or, less likely, UnicodeDecodeError). It can leads to very unexpected result.

Most of uses of PyDict_GetItem() etc were fixed in issue35459 and other issues. But some occurrences were left, in cases when there is no any error handling, either errors are not expected or all exceptions are suppressed in any case. It is mainly in the compiler and symtable (where we look up in just created dicts), in structseq.c and in the sys module.

The proposed PR (it can be split on several smaller PRs if needed, see also issue41993 and issue42002) removes all calls of PyDict_GetItem, PyDict_GetItemString and _PyDict_GetItemId, replacing them with calls of PyDict_GetItemWithError, _PyDict_GetItemStringWithError and _PyDict_GetItemIdWithError or other functions if appropriate.

_PyDict_GetItemId is no longer used and can be removed.

----------
components: Extension Modules, Interpreter Core
messages: 378437
nosy: serhiy.storchaka, vstinner
priority: normal
severity: normal
status: open
title: Stop using PyDict_GetItem, PyDict_GetItemString and _PyDict_GetItemId
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42006>
_______________________________________

From report at bugs.python.org  Sun Oct 11 10:37:35 2020
From: report at bugs.python.org (Chih-Hsuan Yen)
Date: Sun, 11 Oct 2020 14:37:35 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
In-Reply-To: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>
Message-ID: <1602427055.51.0.112217595085.issue41971@roundup.psfhosted.org>


Chih-Hsuan Yen <yan12125 at gmail.com> added the comment:

Looks like those failures in test_tools happen only when test_check_c_globals is imported and a test in test_imp is run.

```
$ cat matchfile
test.test_tools.*
test.test_imp.ImportTests.test_load_from_source

$ ./python -m test --matchfile matchfile test_check_c_globals test_imp test_tools
0:00:00 load avg: 0.90 Run tests sequentially
0:00:00 load avg: 0.90 [1/3] test_check_c_globals
0:00:00 load avg: 0.90 [2/3] test_imp -- test_check_c_globals run no tests
0:00:00 load avg: 0.90 [3/3] test_tools
test test_tools failed -- multiple errors occurred; run in verbose mode for details
test_tools failed

== Tests result: FAILURE ==

1 test OK.

1 test failed:
    test_tools

1 test run no tests:
    test_check_c_globals

Total duration: 1.9 sec
Tests result: FAILURE
```

If I remove test_check_c_globals from the second command or test.test_imp.ImportTests.test_load_from_source from matchfile, test_tools does not fail.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Sun Oct 11 10:43:57 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 11 Oct 2020 14:43:57 +0000
Subject: [issue42006] Stop using PyDict_GetItem,
 PyDict_GetItemString and _PyDict_GetItemId
In-Reply-To: <1602427000.44.0.391654139767.issue42006@roundup.psfhosted.org>
Message-ID: <1602427437.86.0.712078792167.issue42006@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21622
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22648

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42006>
_______________________________________

From report at bugs.python.org  Sun Oct 11 11:32:33 2020
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Sun, 11 Oct 2020 15:32:33 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1602430353.27.0.203641598527.issue38250@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

Just a comment, (1) is analogous to str. iter('abc') gives only 'a', 'b' and 'c', while contains accepts '', 'ab', 'bc', and 'abc' too. At least in my mind, it's a pretty strong analogy.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Sun Oct 11 11:53:06 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 11 Oct 2020 15:53:06 +0000
Subject: [issue41993] Possible issues when remove not completely initialized
 module from sys.module
In-Reply-To: <1602327087.97.0.628811045218.issue41993@roundup.psfhosted.org>
Message-ID: <1602431586.9.0.256763228047.issue41993@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +21623
pull_request: https://github.com/python/cpython/pull/22649

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41993>
_______________________________________

From report at bugs.python.org  Sun Oct 11 12:21:50 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 11 Oct 2020 16:21:50 +0000
Subject: [issue41993] Possible issues when remove not completely initialized
 module from sys.module
In-Reply-To: <1602327087.97.0.628811045218.issue41993@roundup.psfhosted.org>
Message-ID: <1602433310.46.0.957323803206.issue41993@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41993>
_______________________________________

From report at bugs.python.org  Sun Oct 11 13:21:58 2020
From: report at bugs.python.org (Bug Reporter)
Date: Sun, 11 Oct 2020 17:21:58 +0000
Subject: [issue41561] test_ssl fails in Ubuntu 20.04:
 test_min_max_version_mismatch
In-Reply-To: <1597551049.14.0.0578030464715.issue41561@roundup.psfhosted.org>
Message-ID: <1602436918.74.0.723407947953.issue41561@roundup.psfhosted.org>


Bug Reporter <bugsrep at gmail.com> added the comment:

I started by asking a question at https://askubuntu.com/questions/1281942/pythons-test-ssl-fails-starting-from-ubuntu-20-04-i-need-to-find-a-person-at-c

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41561>
_______________________________________

From report at bugs.python.org  Sun Oct 11 13:59:27 2020
From: report at bugs.python.org (veganaiZe)
Date: Sun, 11 Oct 2020 17:59:27 +0000
Subject: [issue42007] Line continuation after Boolean operation
Message-ID: <1602439167.7.0.635101200661.issue42007@roundup.psfhosted.org>


New submission from veganaiZe <veganaiZe-bot at yahoo.com>:

I can't do something like this (regarding the `or`)...

    if (not position.x == 0 and velocity == -1) or
            (not position.x == 500 and velocity == 1)

Nor this...

    if (not position.x == 0 and velocity == -1) or (
            not position.x == 500 and velocity == 1)

I have to do something like this...

    if (not position.x == 0 and velocity == -1) \
           or (not position.x == 500 and velocity == 1)

I would like to be able to do it the first way.

----------
components: Interpreter Core
messages: 378441
nosy: veganaiZe
priority: normal
severity: normal
status: open
title: Line continuation after Boolean operation
type: enhancement
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42007>
_______________________________________

From report at bugs.python.org  Sun Oct 11 14:04:11 2020
From: report at bugs.python.org (veganaiZe)
Date: Sun, 11 Oct 2020 18:04:11 +0000
Subject: [issue42007] Line continuation after Boolean operation
In-Reply-To: <1602439167.7.0.635101200661.issue42007@roundup.psfhosted.org>
Message-ID: <1602439451.33.0.74071287002.issue42007@roundup.psfhosted.org>


veganaiZe <veganaiZe-bot at yahoo.com> added the comment:

Actually, I can do it the second way.  I must have typo'd when testing (my apologies)...  But I'd still like to do it the first way. ?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42007>
_______________________________________

From report at bugs.python.org  Sun Oct 11 14:07:33 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 11 Oct 2020 18:07:33 +0000
Subject: [issue26964] Incorrect documentation for `-u`-flag
In-Reply-To: <1462467997.8.0.490878249706.issue26964@psf.upfronthosting.co.za>
Message-ID: <1602439653.31.0.217403426125.issue26964@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I think this issue is out of date (the offending sentence is no longer there).

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26964>
_______________________________________

From report at bugs.python.org  Sun Oct 11 14:21:38 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 11 Oct 2020 18:21:38 +0000
Subject: [issue41376] site.getusersitepackages() incorrectly claims that
 PYTHONNOUSERSITE is respected
In-Reply-To: <1595517731.78.0.301651868818.issue41376@roundup.psfhosted.org>
Message-ID: <1602440498.65.0.202242264513.issue41376@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 1006f63a8b4327e8a74eb978b175b5234bb46c6c by Miss Skeleton (bot) in branch '3.8':
bpo-41376: Fix the documentation of `site.getusersitepackages()` (GH-21602) (GH-22592)
https://github.com/python/cpython/commit/1006f63a8b4327e8a74eb978b175b5234bb46c6c


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41376>
_______________________________________

From report at bugs.python.org  Sun Oct 11 14:35:11 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 11 Oct 2020 18:35:11 +0000
Subject: [issue41376] site.getusersitepackages() incorrectly claims that
 PYTHONNOUSERSITE is respected
In-Reply-To: <1595517731.78.0.301651868818.issue41376@roundup.psfhosted.org>
Message-ID: <1602441311.14.0.193246278139.issue41376@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41376>
_______________________________________

From report at bugs.python.org  Sun Oct 11 14:43:03 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 11 Oct 2020 18:43:03 +0000
Subject: [issue26964] Incorrect documentation for `-u`-flag
In-Reply-To: <1462467997.8.0.490878249706.issue26964@psf.upfronthosting.co.za>
Message-ID: <1602441783.0.0.0863721252634.issue26964@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> out of date
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26964>
_______________________________________

From report at bugs.python.org  Sun Oct 11 14:48:19 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 11 Oct 2020 18:48:19 +0000
Subject: [issue40423] Optimization: use close_range(2) if available
In-Reply-To: <1588083008.52.0.574583659738.issue40423@roundup.psfhosted.org>
Message-ID: <1602442099.98.0.0996774522491.issue40423@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

for reference, very recent Linux kernels appear to have gained a close_range syscall.  http://lkml.iu.edu/hypermail/linux/kernel/2008.0/02649.html

Your diff isn't quite sufficient as is.  When depending on a syscall that has a function provided by libc, the libc function may exist (thus HAVE_CLOSE_RANGE will be true at Python compile time) but the system the process is running on may not support the system call.  So it'll return an EINVAL (or something like that) error.

Special handling of that error to add an `else {...}` falling back to the other codepath is necessary.

----------
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40423>
_______________________________________

From report at bugs.python.org  Sun Oct 11 14:48:27 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 11 Oct 2020 18:48:27 +0000
Subject: [issue40423] Optimization: use close_range(2) if available
In-Reply-To: <1588083008.52.0.574583659738.issue40423@roundup.psfhosted.org>
Message-ID: <1602442107.86.0.706086112278.issue40423@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40423>
_______________________________________

From report at bugs.python.org  Sun Oct 11 14:49:01 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 11 Oct 2020 18:49:01 +0000
Subject: [issue40422] Light refactor: create a common _Py_closerange API
In-Reply-To: <1588080944.1.0.768613011974.issue40422@roundup.psfhosted.org>
Message-ID: <1602442141.4.0.802658651081.issue40422@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
assignee:  -> gregory.p.smith
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40422>
_______________________________________

From report at bugs.python.org  Sun Oct 11 14:52:15 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 11 Oct 2020 18:52:15 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
In-Reply-To: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>
Message-ID: <1602442335.4.0.0767481171038.issue41971@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Adding Eric Snow as this seems to be something going on on the c_analyzer

----------
nosy: +eric.snow

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Sun Oct 11 14:54:19 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 11 Oct 2020 18:54:19 +0000
Subject: [issue40422] Light refactor: create a common _Py_closerange API
In-Reply-To: <1588080944.1.0.768613011974.issue40422@roundup.psfhosted.org>
Message-ID: <1602442459.3.0.873630709705.issue40422@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c230fde8475e4e5581e74a4235654d17ccf4cff8 by Kyle Evans in branch 'master':
bpo-40422: create a common _Py_closerange API (GH-19754)
https://github.com/python/cpython/commit/c230fde8475e4e5581e74a4235654d17ccf4cff8


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40422>
_______________________________________

From report at bugs.python.org  Sun Oct 11 14:57:46 2020
From: report at bugs.python.org (Kyle Evans)
Date: Sun, 11 Oct 2020 18:57:46 +0000
Subject: [issue40423] Optimization: use close_range(2) if available
In-Reply-To: <1588083008.52.0.574583659738.issue40423@roundup.psfhosted.org>
Message-ID: <1602442666.97.0.688972560052.issue40423@roundup.psfhosted.org>


Kyle Evans <kevans at FreeBSD.org> added the comment:

Ah, I will fix this and then submit a PR, thanks... hopefully it returns ENOSYS.

----------
nosy: +kevans

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40423>
_______________________________________

From report at bugs.python.org  Sun Oct 11 15:03:20 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 11 Oct 2020 19:03:20 +0000
Subject: [issue40422] Light refactor: create a common _Py_closerange API
In-Reply-To: <1588080944.1.0.768613011974.issue40422@roundup.psfhosted.org>
Message-ID: <1602443000.85.0.497837734188.issue40422@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40422>
_______________________________________

From report at bugs.python.org  Sun Oct 11 15:13:46 2020
From: report at bugs.python.org (Kyle Evans)
Date: Sun, 11 Oct 2020 19:13:46 +0000
Subject: [issue40423] Optimization: use close_range(2) if available
In-Reply-To: <1588083008.52.0.574583659738.issue40423@roundup.psfhosted.org>
Message-ID: <1602443626.48.0.850356649802.issue40423@roundup.psfhosted.org>


Change by Kyle Evans <kevans at FreeBSD.org>:


----------
pull_requests: +21624
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22651

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40423>
_______________________________________

From report at bugs.python.org  Sun Oct 11 15:16:39 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 11 Oct 2020 19:16:39 +0000
Subject: [issue40423] Optimization: use close_range(2) if available
In-Reply-To: <1588083008.52.0.574583659738.issue40423@roundup.psfhosted.org>
Message-ID: <1602443799.14.0.363912736103.issue40423@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Ah, yeah ENOSYS is it.  I had to do this trick in older subprocess versions for something else.  Still visible here in the old 2.7 backport: https://github.com/google/python-subprocess32/blob/main/_posixsubprocess.c#L801

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40423>
_______________________________________

From report at bugs.python.org  Sun Oct 11 15:19:44 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 11 Oct 2020 19:19:44 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
In-Reply-To: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>
Message-ID: <1602443984.4.0.47570155913.issue41971@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Seems that the problem is that this check:

https://github.com/python/cpython/blob/master/Tools/c-analyzer/c_analyzer/common/files.py#L90

is done using a default value for "get_files":

https://github.com/python/cpython/blob/master/Tools/c-analyzer/c_analyzer/common/files.py#L63

But the import from source creates a new function for os.walk and therefore the comparison fails.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Sun Oct 11 15:20:45 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 11 Oct 2020 19:20:45 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
In-Reply-To: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>
Message-ID: <1602444045.9.0.783873050051.issue41971@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +21625
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22652

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Sun Oct 11 15:21:38 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 11 Oct 2020 19:21:38 +0000
Subject: [issue40423] Optimization: use close_range(2) if available
In-Reply-To: <1588083008.52.0.574583659738.issue40423@roundup.psfhosted.org>
Message-ID: <1602444098.2.0.552717122889.issue40423@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
assignee:  -> gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40423>
_______________________________________

From report at bugs.python.org  Sun Oct 11 15:23:32 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 11 Oct 2020 19:23:32 +0000
Subject: [issue38110] Use fdwalk() within os.closerange() impl if available
In-Reply-To: <1568209201.53.0.0873310068645.issue38110@roundup.psfhosted.org>
Message-ID: <1602444212.32.0.083608953958.issue38110@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38110>
_______________________________________

From report at bugs.python.org  Sun Oct 11 15:32:59 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 11 Oct 2020 19:32:59 +0000
Subject: [issue27635] pickle documentation says that unpickling may not call
 __new__
In-Reply-To: <1469639245.7.0.966654223743.issue27635@psf.upfronthosting.co.za>
Message-ID: <1602444779.4.0.469699478165.issue27635@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Ping (to close the issue).

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27635>
_______________________________________

From report at bugs.python.org  Sun Oct 11 16:18:56 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 11 Oct 2020 20:18:56 +0000
Subject: [issue40423] Optimization: use close_range(2) if available
In-Reply-To: <1588083008.52.0.574583659738.issue40423@roundup.psfhosted.org>
Message-ID: <1602447536.93.0.325687813596.issue40423@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 1800c600801709958af66bebfa683a4e7570810f by Kyle Evans in branch 'master':
bpo-40423: Optimization: use close_range(2) if available (GH-22651)
https://github.com/python/cpython/commit/1800c600801709958af66bebfa683a4e7570810f


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40423>
_______________________________________

From report at bugs.python.org  Sun Oct 11 16:22:32 2020
From: report at bugs.python.org (Alexandre Vassalotti)
Date: Sun, 11 Oct 2020 20:22:32 +0000
Subject: [issue27635] pickle documentation says that unpickling may not call
 __new__
In-Reply-To: <1469639245.7.0.966654223743.issue27635@psf.upfronthosting.co.za>
Message-ID: <1602447752.48.0.58393706975.issue27635@roundup.psfhosted.org>


Change by Alexandre Vassalotti <alexandre at peadrop.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27635>
_______________________________________

From report at bugs.python.org  Sun Oct 11 16:35:10 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 11 Oct 2020 20:35:10 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
In-Reply-To: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>
Message-ID: <1602448510.66.0.380959484471.issue41971@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 6.0 -> 7.0
pull_requests: +21626
pull_request: https://github.com/python/cpython/pull/22653

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Sun Oct 11 16:34:59 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 11 Oct 2020 20:34:59 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
In-Reply-To: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>
Message-ID: <1602448499.78.0.818587537074.issue41971@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 47ecfd8030c391779dd9d3b4b07e6b01a8392481 by Pablo Galindo in branch 'master':
bpo-41971: Fix test failure in test.test_tools.test_c_analyzer when mutating global state (GH-22652)
https://github.com/python/cpython/commit/47ecfd8030c391779dd9d3b4b07e6b01a8392481


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Sun Oct 11 16:35:33 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 11 Oct 2020 20:35:33 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
In-Reply-To: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>
Message-ID: <1602448533.92.0.233928956787.issue41971@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy:  -miss-islington
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Sun Oct 11 16:42:06 2020
From: report at bugs.python.org (Kyle Evans)
Date: Sun, 11 Oct 2020 20:42:06 +0000
Subject: [issue6721] Locks in the standard library should be sanitized on fork
In-Reply-To: <1250550378.97.0.072881968798.issue6721@psf.upfronthosting.co.za>
Message-ID: <1602448926.57.0.0425996350105.issue6721@roundup.psfhosted.org>


Change by Kyle Evans <kevans at FreeBSD.org>:


----------
nosy: +kevans
nosy_count: 28.0 -> 29.0
pull_requests: +21627
pull_request: https://github.com/python/cpython/pull/22651

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6721>
_______________________________________

From report at bugs.python.org  Sun Oct 11 16:42:06 2020
From: report at bugs.python.org (Kyle Evans)
Date: Sun, 11 Oct 2020 20:42:06 +0000
Subject: [issue36533] logging regression with threading + fork are mixed in
 3.7.1rc2 (deadlock potential)
In-Reply-To: <1554452151.49.0.211568667786.issue36533@roundup.psfhosted.org>
Message-ID: <1602448926.8.0.419966825429.issue36533@roundup.psfhosted.org>


Change by Kyle Evans <kevans at FreeBSD.org>:


----------
nosy: +kevans
nosy_count: 8.0 -> 9.0
pull_requests: +21628
pull_request: https://github.com/python/cpython/pull/22651

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36533>
_______________________________________

From report at bugs.python.org  Sun Oct 11 16:42:06 2020
From: report at bugs.python.org (Kyle Evans)
Date: Sun, 11 Oct 2020 20:42:06 +0000
Subject: [issue33802] Regression in logging configuration
In-Reply-To: <1528412435.4.0.592728768989.issue33802@psf.upfronthosting.co.za>
Message-ID: <1602448926.88.0.370467612154.issue33802@roundup.psfhosted.org>


Change by Kyle Evans <kevans at FreeBSD.org>:


----------
nosy: +kevans
nosy_count: 8.0 -> 9.0
pull_requests: +21629
pull_request: https://github.com/python/cpython/pull/22651

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33802>
_______________________________________

From report at bugs.python.org  Sun Oct 11 16:54:42 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 11 Oct 2020 20:54:42 +0000
Subject: [issue41971] multiple tests in test_tools fail since Python 3.9
In-Reply-To: <1602112076.31.0.668731548655.issue41971@roundup.psfhosted.org>
Message-ID: <1602449682.97.0.722194358731.issue41971@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 4af672921949b8a10340d5e29b456091060cedeb by Miss Skeleton (bot) in branch '3.9':
bpo-41971: Fix test failure in test.test_tools.test_c_analyzer when mutating global state (GH-22652) (GH-22653)
https://github.com/python/cpython/commit/4af672921949b8a10340d5e29b456091060cedeb


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41971>
_______________________________________

From report at bugs.python.org  Sun Oct 11 17:26:22 2020
From: report at bugs.python.org (John Belmonte)
Date: Sun, 11 Oct 2020 21:26:22 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1602451582.36.0.26779419543.issue38250@roundup.psfhosted.org>


John Belmonte <john at neggie.net> added the comment:

> Just a comment, (1) is analogous to str. iter('abc') gives only 'a', 'b' and 'c', while contains accepts '', 'ab', 'bc', and 'abc' too. At least in my mind, it's a pretty strong analogy.

I don't agree.  The "zero" bit does not exist, so having __contains__ return True on `Foo(0) in x` is misaligned with the iterator.  And having __contains__ return True for specific compound values just because they happen to be explicitly defined, while returning False for others, is arbitrary.  __contains__ seems to be of very little use, and moreover a trap for the unwary.  Assuming we have to live with that until Python 4, it's better to make an explicit iterator like `bits()` so that the API doesn't contradict itself.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Sun Oct 11 17:38:22 2020
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Sun, 11 Oct 2020 21:38:22 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1602452302.08.0.955880398582.issue38250@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

Of course, if it returns True only on _some_ bits combinations it doesn't make sense. I thought every element of a Boolean span would be _in_ the Foo.

But about "zero bit", I still think it's perfectly analogous to '' in 'abc'.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Sun Oct 11 17:41:00 2020
From: report at bugs.python.org (Lisa Roach)
Date: Sun, 11 Oct 2020 21:41:00 +0000
Subject: [issue39101] IsolatedAsyncioTestCase freezes when exception is raised
In-Reply-To: <1576784699.03.0.850711294275.issue39101@roundup.psfhosted.org>
Message-ID: <1602452460.38.0.915952044484.issue39101@roundup.psfhosted.org>


Change by Lisa Roach <lisaroach14 at gmail.com>:


----------
keywords: +patch
nosy: +lisroach
nosy_count: 3.0 -> 4.0
pull_requests: +21630
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22654

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39101>
_______________________________________

From report at bugs.python.org  Sun Oct 11 17:52:41 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 11 Oct 2020 21:52:41 +0000
Subject: [issue42008] Internal Random class calling seed() with incorrect
 argument
Message-ID: <1602453161.68.0.0739681342621.issue42008@roundup.psfhosted.org>


New submission from Raymond Hettinger <raymond.hettinger at gmail.com>:

The C code in random_new() incorrectly calls random_seed() with an args tuple. Instead, it should use first element of the args tuple.

This matters because we've deprecated using PyObject_Hash() in random_seed().  Once that is removed, _random.Random(someseed) won't work at all (there's a test for it).

# Public API is correct
>>> from random import Random
>>> r = Random()
>>> r.seed(8675309)
>>> r.random()
0.40224696110279223
>>> r = Random(8675309)
>>> r.random()
0.40224696110279223

# Private API is incorrect for Random(someseed)
>>> from _random import Random
>>> r = Random()
>>> r.seed(8675309)
>>> r.random()
0.40224696110279223
>>> r = Random(8675309)              
>>> r.random()
0.21095576307886765                  <=== This is wrong

----------
components: Extension Modules
keywords: easy (C)
messages: 378457
nosy: rhettinger
priority: normal
severity: normal
status: open
title: Internal Random class calling seed() with incorrect argument
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42008>
_______________________________________

From report at bugs.python.org  Sun Oct 11 18:01:17 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 22:01:17 +0000
Subject: [issue41739] test_logging: test_race_between_set_target_and_flush()
 leaks threads (threading_cleanup() failed to cleanup ...)
In-Reply-To: <1599493566.06.0.792070733484.issue41739@roundup.psfhosted.org>
Message-ID: <1602453677.92.0.129018710497.issue41739@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Cool, my threading change works as expected! The name of the target function was logged.

https://buildbot.python.org/all/#/builders/509/builds/172

0:00:28 load avg: 3.58 [ 36/424/1] test_logging failed (env changed)
Warning -- threading_cleanup() failed to cleanup 2 threads (count: 2, dangling: 3)
Warning -- Dangling thread: <Thread(Thread-4 (removeTarget), started daemon 4396862667024)>
Warning -- Dangling thread: <Thread(Thread-11 (removeTarget), started daemon 4396595259664)>
Warning -- Dangling thread: <_MainThread(MainThread, started 4396920310576)>

So leaked threads are running removeTarget() which come from MemoryHandlerTest.test_race_between_set_target_and_flush().

----------
title: test_logging: threading_cleanup() failed to cleanup 1 threads (count: 1, dangling: 2) -> test_logging: test_race_between_set_target_and_flush() leaks threads (threading_cleanup() failed to cleanup ...)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41739>
_______________________________________

From report at bugs.python.org  Sun Oct 11 18:05:58 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 22:05:58 +0000
Subject: [issue41739] test_logging: test_race_between_set_target_and_flush()
 leaks threads (threading_cleanup() failed to cleanup ...)
In-Reply-To: <1599493566.06.0.792070733484.issue41739@roundup.psfhosted.org>
Message-ID: <1602453958.48.0.870050010026.issue41739@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I'm able to reproduce the issue if I reduce the sleep:

diff --git a/Lib/test/test_logging.py b/Lib/test/test_logging.py
index 4cd8c7e25d..fc395dc473 100644
--- a/Lib/test/test_logging.py
+++ b/Lib/test/test_logging.py
@@ -1177,7 +1177,7 @@ class MemoryHandlerTest(BaseTest):
         self.mem_hdlr.setTarget(target)
 
         for _ in range(10):
-            time.sleep(0.005)
+            time.sleep(1e-9)
             self.mem_logger.info("not flushed")
             self.mem_logger.warning("flushed")
 


With the command:

$ ./python -m test test_logging -m test_race_between_set_target_and_flush -F -j10 --fail-env-changed 
(...)
0:00:03 load avg: 3.74 [ 18/1] test_logging failed (env changed)
Warning -- threading_cleanup() failed to cleanup 1 threads (count: 1, dangling: 2)
Warning -- Dangling thread: <Thread(Thread-1 (removeTarget), started daemon 139860955428608)>
Warning -- Dangling thread: <_MainThread(MainThread, started 139861194377024)>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41739>
_______________________________________

From report at bugs.python.org  Sun Oct 11 18:14:17 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 22:14:17 +0000
Subject: [issue41739] test_logging: test_race_between_set_target_and_flush()
 leaks threads (threading_cleanup() failed to cleanup ...)
In-Reply-To: <1599493566.06.0.792070733484.issue41739@roundup.psfhosted.org>
Message-ID: <1602454457.24.0.976780354248.issue41739@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +21631
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22655

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41739>
_______________________________________

From report at bugs.python.org  Sun Oct 11 18:17:56 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 22:17:56 +0000
Subject: [issue42006] Stop using PyDict_GetItem,
 PyDict_GetItemString and _PyDict_GetItemId
In-Reply-To: <1602427000.44.0.391654139767.issue42006@roundup.psfhosted.org>
Message-ID: <1602454676.27.0.739164244299.issue42006@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

See also old issues about PyDict_GetItemWithError():

* bpo-20615
* bpo-30475
* bpo-35459

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42006>
_______________________________________

From report at bugs.python.org  Sun Oct 11 18:23:49 2020
From: report at bugs.python.org (John Belmonte)
Date: Sun, 11 Oct 2020 22:23:49 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1602455029.52.0.199210220692.issue38250@roundup.psfhosted.org>


John Belmonte <john at neggie.net> added the comment:

I think https://github.com/python/cpython/pull/22221 should be reverted (considering the design issue, performance issue, and bugs), and lets have a proper design and review.

While just reading the code, I found an existing bug in Flag.  And the new __iter__ uses the buggy internal function, and so itself has bugs.

https://github.com/python/cpython/pull/22221#issuecomment-706776441

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Sun Oct 11 18:24:24 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 22:24:24 +0000
Subject: [issue42006] Stop using PyDict_GetItem,
 PyDict_GetItemString and _PyDict_GetItemId
In-Reply-To: <1602427000.44.0.391654139767.issue42006@roundup.psfhosted.org>
Message-ID: <1602455064.42.0.970715591586.issue42006@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

PyDict_GetItem() behavior is an old wart. Would it make sense to plan a migration plan to slowly move towards PyDict_GetItem() behaving as PyDict_GetItemWithError()?

CPython is an old code base full of corner cases. But outside CPython, is it common to rely on the current PyDict_GetItem() behavior (ignore errors, can be called with an exception raised)?

(A) For example, would it make sense to start to emit a DeprecationWarning when it's called with an exception raised? Currently, the function calls _PyErr_Fetch(): checking if exc_type is non-NULL requires to add an if which would add a cost to all PyDict_GetItem() calls. But IMO it would be interesting to fix this function in the long term.

(B) Also, would it make sense to start to no longer ignore base exceptions like SystemExit, KeyboardInterrupt or MemoryError in PyDict_GetItem()?

How can we take a decision on that? Analyze the C code base of a bunch of popular C extension? Make the change and await to see how many people complain?

In the long term, I would prefer that PyDict_GetItem() behaves as other C functions: it should not be called with an exception raised (the caller has to store/restore the current exception), and raises an exception on error. I expect better performance for such more regular and simpler behavior.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42006>
_______________________________________

From report at bugs.python.org  Sun Oct 11 18:26:15 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 22:26:15 +0000
Subject: [issue42006] Stop using PyDict_GetItem,
 PyDict_GetItemString and _PyDict_GetItemId
In-Reply-To: <1602427000.44.0.391654139767.issue42006@roundup.psfhosted.org>
Message-ID: <1602455175.8.0.623176083894.issue42006@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I don't want to hold fixing the code right now. If we decide to break the backward compatibility of the C API, a transition plan will likely take a few years anyway, whereas this issue should be first as soon as possible.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42006>
_______________________________________

From report at bugs.python.org  Sun Oct 11 18:34:54 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 22:34:54 +0000
Subject: [issue40422] Light refactor: create a common _Py_closerange API
In-Reply-To: <1588080944.1.0.768613011974.issue40422@roundup.psfhosted.org>
Message-ID: <1602455694.14.0.237147550049.issue40422@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Python/fileutils.c might be a better home for such helper function.

You might move _Py_BEGIN_SUPPRESS_IPH / _Py_END_SUPPRESS_IPH macros into _Py_closerange(), even if currently it makes no diffence. (_Py_BEGIN_SUPPRESS_IPH is specific to Windows, os.closerange() uses it, and _posixsubprocess doesn't need it since it's not used on Windows.)

See also the idea of reminding if the kernel supports the syscall or not:
https://github.com/python/cpython/pull/22651#pullrequestreview-506215041

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40422>
_______________________________________

From report at bugs.python.org  Sun Oct 11 18:37:27 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 22:37:27 +0000
Subject: [issue41739] test_logging: test_race_between_set_target_and_flush()
 leaks threads (threading_cleanup() failed to cleanup ...)
In-Reply-To: <1599493566.06.0.792070733484.issue41739@roundup.psfhosted.org>
Message-ID: <1602455847.93.0.559883999154.issue41739@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 13ff396c019d548ba181cf22c6f39309a300723c by Victor Stinner in branch 'master':
bpo-41739: Fix test_logging.test_race_between_set_target_and_flush() (GH-22655)
https://github.com/python/cpython/commit/13ff396c019d548ba181cf22c6f39309a300723c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41739>
_______________________________________

From report at bugs.python.org  Sun Oct 11 18:38:51 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 11 Oct 2020 22:38:51 +0000
Subject: [issue41739] test_logging: test_race_between_set_target_and_flush()
 leaks threads (threading_cleanup() failed to cleanup ...)
In-Reply-To: <1599493566.06.0.792070733484.issue41739@roundup.psfhosted.org>
Message-ID: <1602455931.82.0.950203194764.issue41739@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21632
pull_request: https://github.com/python/cpython/pull/22656

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41739>
_______________________________________

From report at bugs.python.org  Sun Oct 11 19:42:07 2020
From: report at bugs.python.org (John Belmonte)
Date: Sun, 11 Oct 2020 23:42:07 +0000
Subject: [issue40213] contextlib.aclosing()
In-Reply-To: <1586225612.65.0.881233882976.issue40213@roundup.psfhosted.org>
Message-ID: <1602459727.62.0.922397706775.issue40213@roundup.psfhosted.org>


Change by John Belmonte <john at neggie.net>:


----------
pull_requests: +21633
versions: +Python 3.10 -Python 3.9
pull_request: https://github.com/python/cpython/pull/21545

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40213>
_______________________________________

From report at bugs.python.org  Sun Oct 11 20:42:09 2020
From: report at bugs.python.org (Hassan Abouelela)
Date: Mon, 12 Oct 2020 00:42:09 +0000
Subject: [issue25567] shlex.quote doesn't work on bytestrings
In-Reply-To: <1446814343.82.0.823951892686.issue25567@psf.upfronthosting.co.za>
Message-ID: <1602463329.55.0.382235739927.issue25567@roundup.psfhosted.org>


Change by Hassan Abouelela <abouelelahassan at gmail.com>:


----------
nosy: +HassanAbouelela
nosy_count: 9.0 -> 10.0
pull_requests: +21634
pull_request: https://github.com/python/cpython/pull/22657

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25567>
_______________________________________

From report at bugs.python.org  Sun Oct 11 21:15:04 2020
From: report at bugs.python.org (Waylan Limberg)
Date: Mon, 12 Oct 2020 01:15:04 +0000
Subject: [issue41989] htmlparser unclosed script tag causes data loss
In-Reply-To: <1602292109.75.0.598084394689.issue41989@roundup.psfhosted.org>
Message-ID: <1602465304.15.0.0728978992881.issue41989@roundup.psfhosted.org>


Change by Waylan Limberg <waylan.limberg at icloud.com>:


----------
keywords: +patch
pull_requests: +21635
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22658

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41989>
_______________________________________

From report at bugs.python.org  Sun Oct 11 21:29:35 2020
From: report at bugs.python.org (wim glenn)
Date: Mon, 12 Oct 2020 01:29:35 +0000
Subject: [issue37449] Move ensurepip off of pkgutil and to importlib.resources
In-Reply-To: <1561860772.49.0.185483718697.issue37449@roundup.psfhosted.org>
Message-ID: <1602466175.49.0.111505363655.issue37449@roundup.psfhosted.org>


Change by wim glenn <wim.glenn at gmail.com>:


----------
nosy: +wim.glenn
nosy_count: 4.0 -> 5.0
pull_requests: +21636
pull_request: https://github.com/python/cpython/pull/22659

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37449>
_______________________________________

From report at bugs.python.org  Sun Oct 11 22:05:45 2020
From: report at bugs.python.org (Roundup Robot)
Date: Mon, 12 Oct 2020 02:05:45 +0000
Subject: [issue41995] five possible Null Pointer Dereference bugs.
In-Reply-To: <1602330580.94.0.791834118141.issue41995@roundup.psfhosted.org>
Message-ID: <1602468345.97.0.726996242495.issue41995@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
pull_requests: +21637
pull_request: https://github.com/python/cpython/pull/22660

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41995>
_______________________________________

From report at bugs.python.org  Sun Oct 11 22:58:07 2020
From: report at bugs.python.org (Kyle Evans)
Date: Mon, 12 Oct 2020 02:58:07 +0000
Subject: [issue40422] Light refactor: create a common _Py_closerange API
In-Reply-To: <1588080944.1.0.768613011974.issue40422@roundup.psfhosted.org>
Message-ID: <1602471487.83.0.0998161030324.issue40422@roundup.psfhosted.org>


Kyle Evans <kevans at FreeBSD.org> added the comment:

Would you like that on a distinct issue, or is it ok to reuse this BPO since it's a location improvement of an API just introduced?

I've got a local branch now that:

1. moves the suppress IPH stuff into _Py_closerange
2. moves the definition into Python/fileutils.c
3. moves the declaration into Include/fileutils h

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40422>
_______________________________________

From report at bugs.python.org  Sun Oct 11 23:53:20 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 12 Oct 2020 03:53:20 +0000
Subject: [issue42007] Line continuation after Boolean operation
In-Reply-To: <1602439167.7.0.635101200661.issue42007@roundup.psfhosted.org>
Message-ID: <1602474800.5.0.269833909474.issue42007@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Sorry, I don't think this proposal has a chance.  

Python doesn't require statement terminators like ";" in C.  Accordingly, it needs to have a clean and consistent rule to close a statement.  The rule that has worked well for us it that a statement is terminated by a newline unless there is a line continuation character, or a colon to begin a new suite, or an open expression delimiter (parenthesis, square bracket or curly brace). 

Adding a special case exception to the rule might look nice but would complicate learning the language, and it would complicate the implementation as well.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42007>
_______________________________________

From report at bugs.python.org  Sun Oct 11 23:55:39 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 12 Oct 2020 03:55:39 +0000
Subject: [issue40422] Light refactor: create a common _Py_closerange API
In-Reply-To: <1588080944.1.0.768613011974.issue40422@roundup.psfhosted.org>
Message-ID: <1602474939.14.0.98329836142.issue40422@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Just reuse this bpo issue.  I'll mark the PRs as "skip news"; don't worry about a new news blurb entry as it's all tied to the original one.

----------
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40422>
_______________________________________

From report at bugs.python.org  Mon Oct 12 00:31:00 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Mon, 12 Oct 2020 04:31:00 +0000
Subject: [issue41739] test_logging: test_race_between_set_target_and_flush()
 leaks threads (threading_cleanup() failed to cleanup ...)
In-Reply-To: <1599493566.06.0.792070733484.issue41739@roundup.psfhosted.org>
Message-ID: <1602477060.29.0.180053677341.issue41739@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset f5393dc2a0ced7bf670ebc56b5fd10a3eb328d1a by Victor Stinner in branch '3.9':
bpo-41739: Fix test_logging.test_race_between_set_target_and_flush() (GH-22655) (GH-22656)
https://github.com/python/cpython/commit/f5393dc2a0ced7bf670ebc56b5fd10a3eb328d1a


----------
nosy: +vinay.sajip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41739>
_______________________________________

From report at bugs.python.org  Mon Oct 12 00:31:05 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 12 Oct 2020 04:31:05 +0000
Subject: [issue41739] test_logging: test_race_between_set_target_and_flush()
 leaks threads (threading_cleanup() failed to cleanup ...)
In-Reply-To: <1599493566.06.0.792070733484.issue41739@roundup.psfhosted.org>
Message-ID: <1602477065.13.0.161980074751.issue41739@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21638
pull_request: https://github.com/python/cpython/pull/22662

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41739>
_______________________________________

From report at bugs.python.org  Mon Oct 12 00:54:32 2020
From: report at bugs.python.org (Vladimir Matveev)
Date: Mon, 12 Oct 2020 04:54:32 +0000
Subject: [issue41756] Do not always use exceptions to return result from
 coroutine
In-Reply-To: <1599786636.95.0.884410425349.issue41756@roundup.psfhosted.org>
Message-ID: <1602478472.57.0.670185737541.issue41756@roundup.psfhosted.org>


Change by Vladimir Matveev <desco.by at gmail.com>:


----------
pull_requests: +21639
pull_request: https://github.com/python/cpython/pull/22663

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41756>
_______________________________________

From report at bugs.python.org  Mon Oct 12 01:06:35 2020
From: report at bugs.python.org (Tim Peters)
Date: Mon, 12 Oct 2020 05:06:35 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602479195.36.0.472497848031.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Impressive, Dennis! Nice work.

FYI, on the OP's original test data, your fastsearch() completes each search in under 20 seconds using CPython, and in well under 1 second using PyPy.

Unfortunately, that's so promising it can't just be dismissed offhandedly ;-)  Looks like something quite worth pursuing here!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Mon Oct 12 02:25:42 2020
From: report at bugs.python.org (Chris Burr)
Date: Mon, 12 Oct 2020 06:25:42 +0000
Subject: [issue42009] Unable to compile with message compiler due to source
 order
Message-ID: <1602483942.71.0.834700001861.issue42009@roundup.psfhosted.org>


New submission from Chris Burr <christopher.burr at cern.ch>:

Since bpo-36302 was implemented, extension sources are now sorted for reproducibility. This is causing an issue in pywin32 as the *.mc files must be processed first to ensure the *.h files are generated before trying to compile the actual sources. I'm not very familiar with Windows but there are more details in: https://github.com/mhammond/pywin32/issues/1590

As suggested in the issue, the solution is probably to modify msvccompiler.py to process the .rc and .mc files before any C/C++ sources.

----------
components: Distutils
messages: 378471
nosy: chrisburr, dstufft, eric.araujo
priority: normal
severity: normal
status: open
title: Unable to compile with message compiler due to source order
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42009>
_______________________________________

From report at bugs.python.org  Mon Oct 12 03:00:37 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Mon, 12 Oct 2020 07:00:37 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602486037.37.0.432481970982.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

Here is a C implementation of the two-way algorithm that should work as a drop-in replacement for Objects/stringlib/fastsearch.h.

Benchmarking so far, it looks like it is a bit slower in a lot of cases. But it's also a bit faster in a some other cases and oodles faster in the really bad cases.

I wonder if there's a good heuristic cutoff (for the needle size?) where the two-way usually becomes better.

----------
Added file: https://bugs.python.org/file49508/fastsearch.h

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Mon Oct 12 03:12:57 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 12 Oct 2020 07:12:57 +0000
Subject: [issue41988] No hyphen in broken up word in documentation
In-Reply-To: <1602276270.7.0.489043595778.issue41988@roundup.psfhosted.org>
Message-ID: <1602486777.31.0.618938223628.issue41988@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I've been seeing this throughout the docs.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41988>
_______________________________________

From report at bugs.python.org  Mon Oct 12 03:27:04 2020
From: report at bugs.python.org (Ezio Melotti)
Date: Mon, 12 Oct 2020 07:27:04 +0000
Subject: [issue41989] htmlparser unclosed script tag causes data loss
In-Reply-To: <1602292109.75.0.598084394689.issue41989@roundup.psfhosted.org>
Message-ID: <1602487624.28.0.0330680924981.issue41989@roundup.psfhosted.org>


Change by Ezio Melotti <ezio.melotti at gmail.com>:


----------
assignee:  -> ezio.melotti
nosy: +ezio.melotti

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41989>
_______________________________________

From report at bugs.python.org  Mon Oct 12 03:33:16 2020
From: report at bugs.python.org (Snidhi Sofpro)
Date: Mon, 12 Oct 2020 07:33:16 +0000
Subject: [issue41964] difflib SequenceMatcher get_matching_blocks returns
 non-matching blocks in some cases
In-Reply-To: <1602056086.63.0.741821149494.issue41964@roundup.psfhosted.org>
Message-ID: <1602487996.89.0.269815340295.issue41964@roundup.psfhosted.org>


Snidhi Sofpro <Snidhi.Sofpro at gmail.com> added the comment:

Hello Tim Peters,

Like you pointed out:
(1) The test code clearly has a mistake.  
(2) With the mistake corrected, difflib.SequenceMatcher.get_matching_blocks() returns results as expected for the given test data.

I'm unable to readily recreate the issue where it was first observed because the application code from which the test code was derived has meanwhile gotten changed to make use of get_opcodes().

Will update this ticket if I find this to be an issue at all.

Thank you for looking into this so quickly & for the feedback.  
Contributors like you make working in the python ecosystem a professional pleasure.
Thanks again.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41964>
_______________________________________

From report at bugs.python.org  Mon Oct 12 03:46:12 2020
From: report at bugs.python.org (Ken Jin)
Date: Mon, 12 Oct 2020 07:46:12 +0000
Subject: [issue42010] GenericAlias accepts indexing/subscripting,
 causing confusion
Message-ID: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>


New submission from Ken Jin <kenjin4096 at gmail.com>:

While writing the docs for PEP 585's GenericAlias, I noticed that the following anti-pattern described in PEP 585 no longer throws an error when it should:

>>> l = list
>>> l[-1]

Whereas in versions of Python before 3.9, a "TypeError: 'type' object is not subscriptable" would have been thrown.

Quoting PEP 585 again: "Say, if a user is mistakenly passing a list type instead of a list object to a function, and that function is indexing the received object, the code would no longer raise an error."

Although the context of that statement isn't the same. I fully agree with its reasoning. This makes Python more confusing for beginners coming from other languages too:

// in c, makes a 10 element array 
int l[10];

# now in python, this is fine
l[10] 

This may give beginners the false impression that an empty 10 element list has been created.

I have created a PR and a test for this. The changed code blocks ints, floats, bools and complex from indexing for type objects. str is allowed since list['mytype'] seems analogous to typing.List[ForwardRef('mytype')]. Also, imo beginners are unlikely to accidentally write that code while intending to index a list.

Feedback is greatly appreciated, as I've not touched the C codebase in cpython before. Thanks!

----------
components: Interpreter Core
messages: 378475
nosy: kj
priority: normal
severity: normal
status: open
title: GenericAlias accepts indexing/subscripting, causing confusion
type: behavior
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Mon Oct 12 03:48:44 2020
From: report at bugs.python.org (Chris Burr)
Date: Mon, 12 Oct 2020 07:48:44 +0000
Subject: [issue39342] Expose X509_V_FLAG_ALLOW_PROXY_CERTS in ssl
In-Reply-To: <1579082580.52.0.275703305608.issue39342@roundup.psfhosted.org>
Message-ID: <1602488924.33.0.966110274992.issue39342@roundup.psfhosted.org>


Change by Chris Burr <christopher.burr at cern.ch>:


----------
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39342>
_______________________________________

From report at bugs.python.org  Mon Oct 12 03:49:28 2020
From: report at bugs.python.org (Chris Burr)
Date: Mon, 12 Oct 2020 07:49:28 +0000
Subject: [issue18233] SSLSocket.getpeercertchain()
In-Reply-To: <1371415195.44.0.636993698614.issue18233@psf.upfronthosting.co.za>
Message-ID: <1602488968.66.0.448516073994.issue18233@roundup.psfhosted.org>


Change by Chris Burr <christopher.burr at cern.ch>:


----------
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18233>
_______________________________________

From report at bugs.python.org  Mon Oct 12 03:59:55 2020
From: report at bugs.python.org (Ken Jin)
Date: Mon, 12 Oct 2020 07:59:55 +0000
Subject: [issue42010] GenericAlias accepts indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1602489595.07.0.916934253582.issue42010@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
keywords: +patch
pull_requests: +21640
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22667

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Mon Oct 12 04:05:42 2020
From: report at bugs.python.org (Ken Jin)
Date: Mon, 12 Oct 2020 08:05:42 +0000
Subject: [issue42010] Generic types accepts indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1602489942.55.0.331832040145.issue42010@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
title: GenericAlias accepts indexing/subscripting, causing confusion -> Generic types accepts indexing/subscripting, causing confusion

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Mon Oct 12 04:07:53 2020
From: report at bugs.python.org (Ken Jin)
Date: Mon, 12 Oct 2020 08:07:53 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1602490073.82.0.0434280786736.issue42010@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
title: Generic types accepts indexing/subscripting, causing confusion -> Generic types accept indexing/subscripting, causing confusion

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Mon Oct 12 04:49:53 2020
From: report at bugs.python.org (Ken Jin)
Date: Mon, 12 Oct 2020 08:49:53 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1602492593.5.0.689430531942.issue42010@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

I'd like to clarify the following too, currently:

(1)
>>> list[1]
list[1]

(2)
>>> list[1, 2, 3]
list[1, 2, 3]

The PR only solves (1) and not (2), is (2) intended behavior?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Mon Oct 12 04:51:40 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 12 Oct 2020 08:51:40 +0000
Subject: [issue41739] test_logging: test_race_between_set_target_and_flush()
 leaks threads (threading_cleanup() failed to cleanup ...)
In-Reply-To: <1599493566.06.0.792070733484.issue41739@roundup.psfhosted.org>
Message-ID: <1602492700.19.0.451287069993.issue41739@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 33057c70920787627f2c94d08eb5d33c31f8bdd9 by Miss Skeleton (bot) in branch '3.8':
bpo-41739: Fix test_logging.test_race_between_set_target_and_flush() (GH-22655) (GH-22656) (GH-22662)
https://github.com/python/cpython/commit/33057c70920787627f2c94d08eb5d33c31f8bdd9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41739>
_______________________________________

From report at bugs.python.org  Mon Oct 12 04:55:44 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 12 Oct 2020 08:55:44 +0000
Subject: [issue41739] test_logging: test_race_between_set_target_and_flush()
 leaks threads (threading_cleanup() failed to cleanup ...)
In-Reply-To: <1599493566.06.0.792070733484.issue41739@roundup.psfhosted.org>
Message-ID: <1602492944.09.0.384663078161.issue41739@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Ok, test_race_between_set_target_and_flush() should no longer leak dangling threads. I close the issue.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41739>
_______________________________________

From report at bugs.python.org  Mon Oct 12 04:58:07 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 12 Oct 2020 08:58:07 +0000
Subject: [issue41833] threading.Thread: use target name if the name parameter
 is omitted
In-Reply-To: <1600775255.57.0.261270212449.issue41833@roundup.psfhosted.org>
Message-ID: <1602493087.46.0.797369221739.issue41833@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Cool, my threading change works as expected! The name of the target function was logged in bpo-41739 issue.

https://buildbot.python.org/all/#/builders/509/builds/172

0:00:28 load avg: 3.58 [ 36/424/1] test_logging failed (env changed)
Warning -- threading_cleanup() failed to cleanup 2 threads (count: 2, dangling: 3)
Warning -- Dangling thread: <Thread(Thread-4 (removeTarget), started daemon 4396862667024)>
Warning -- Dangling thread: <Thread(Thread-11 (removeTarget), started daemon 4396595259664)>
Warning -- Dangling thread: <_MainThread(MainThread, started 4396920310576)>

See "<Thread(Thread-4 (removeTarget), started daemon 4396862667024)>": the two leaked threads are running the removeTarget() function which come from MemoryHandlerTest.test_race_between_set_target_and_flush().

By the way, Serhiy was right about the name of having an unique repr() even if the target is the same, since it's the case here ;-) Well "4396862667024" is different than "4396595259664", but it's more convinient to have short numbers like "Thread-4" and "Thread-11".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41833>
_______________________________________

From report at bugs.python.org  Mon Oct 12 05:00:43 2020
From: report at bugs.python.org (Riccardo Coccioli)
Date: Mon, 12 Oct 2020 09:00:43 +0000
Subject: [issue42011] Documentation for logging.Filter.filter reports the
 wrong return type
Message-ID: <1602493243.32.0.577845482202.issue42011@roundup.psfhosted.org>


New submission from Riccardo Coccioli <rcoccioli at gmail.com>:

The documentation for the logging.Filter().filter() method states:

#-----
Is the specified record to be logged? Returns 0 for no, nonzero for yes. If deemed appropriate, the record may be modified in-place.
#-----

While its implementation returns a boolean in Lib/logging/__init__.py.
Moreover the most recent version of mypy (0.790) reports it as an error if a custom class inherit from logging.Filter and implement a filter() method that returns an int as specified in the documentation:

#-----
error: Return type "int" of "filter" incompatible with return type "bool" in supertype "Filter"  [override]
#-----

P.S. As a side note, the API for filter() is quite counter-intuitive as it requires the filter() method to return False to filter out the record and True to include it.

----------
assignee: docs at python
components: Documentation
messages: 378480
nosy: Riccardo Coccioli, docs at python
priority: normal
severity: normal
status: open
title: Documentation for logging.Filter.filter reports the wrong return type
type: behavior
versions: Python 3.10, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42011>
_______________________________________

From report at bugs.python.org  Mon Oct 12 05:02:15 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 12 Oct 2020 09:02:15 +0000
Subject: [issue38912] test_asyncio altered the execution environment
In-Reply-To: <1574729421.23.0.927917235759.issue38912@roundup.psfhosted.org>
Message-ID: <1602493335.0.0.19948066565.issue38912@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Another failure on aarch64 RHEL7 Refleaks 3.9:
https://buildbot.python.org/all/#builders/122/builds/62

0:53:43 load avg: 0.97 [424/425/1] test_asyncio failed (env changed) (53 min 34 sec) -- running: test_pydoc (29 min 2 sec)
beginning 6 repetitions
123456
../home/buildbot/buildarea/3.9.cstratak-RHEL7-aarch64.refleak/build/Lib/asyncio/sslproto.py:320: ResourceWarning: unclosed transport <asyncio.sslproto._SSLProtocolTransport object at 0xffff77a58d00>
  _warn(f"unclosed transport {self!r}", ResourceWarning, source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
Warning -- Unraisable exception
Exception ignored in: <function _SSLProtocolTransport.__del__ at 0xffff802d6a50>
Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.9.cstratak-RHEL7-aarch64.refleak/build/Lib/asyncio/sslproto.py", line 321, in __del__
    self.close()
  File "/home/buildbot/buildarea/3.9.cstratak-RHEL7-aarch64.refleak/build/Lib/asyncio/sslproto.py", line 316, in close
    self._ssl_protocol._start_shutdown()
  File "/home/buildbot/buildarea/3.9.cstratak-RHEL7-aarch64.refleak/build/Lib/asyncio/sslproto.py", line 590, in _start_shutdown
    self._abort()
  File "/home/buildbot/buildarea/3.9.cstratak-RHEL7-aarch64.refleak/build/Lib/asyncio/sslproto.py", line 731, in _abort
    self._transport.abort()
  File "/home/buildbot/buildarea/3.9.cstratak-RHEL7-aarch64.refleak/build/Lib/asyncio/selector_events.py", line 680, in abort
    self._force_close(None)
  File "/home/buildbot/buildarea/3.9.cstratak-RHEL7-aarch64.refleak/build/Lib/asyncio/selector_events.py", line 731, in _force_close
    self._loop.call_soon(self._call_connection_lost, exc)
  File "/home/buildbot/buildarea/3.9.cstratak-RHEL7-aarch64.refleak/build/Lib/asyncio/base_events.py", line 746, in call_soon
    self._check_closed()
  File "/home/buildbot/buildarea/3.9.cstratak-RHEL7-aarch64.refleak/build/Lib/asyncio/base_events.py", line 510, in _check_closed
    raise RuntimeError('Event loop is closed')
RuntimeError: Event loop is closed
/home/buildbot/buildarea/3.9.cstratak-RHEL7-aarch64.refleak/build/Lib/asyncio/selector_events.py:704: ResourceWarning: unclosed transport <_SelectorSocketTransport closing fd=8>
  _warn(f"unclosed transport {self!r}", ResourceWarning, source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
Task was destroyed but it is pending!
task: <Task pending name='Task-8474' coro=<BaseSelectorEventLoop._accept_connection2() running at /home/buildbot/buildarea/3.9.cstratak-RHEL7-aarch64.refleak/build/Lib/asyncio/selector_events.py:218> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0xffff77a7d8d0>()]>>
....

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38912>
_______________________________________

From report at bugs.python.org  Mon Oct 12 05:03:24 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 12 Oct 2020 09:03:24 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1602493404.31.0.0267721394361.issue42010@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +gvanrossum, levkivskyi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Mon Oct 12 05:45:47 2020
From: report at bugs.python.org (Amir Mohamadi)
Date: Mon, 12 Oct 2020 09:45:47 +0000
Subject: [issue42008] Internal Random class calling seed() with incorrect
 argument
In-Reply-To: <1602453161.68.0.0739681342621.issue42008@roundup.psfhosted.org>
Message-ID: <1602495947.61.0.596189778459.issue42008@roundup.psfhosted.org>


Amir Mohamadi <amiremohamadi at yahoo.com> added the comment:

Can I open a PR for it?

----------
nosy: +Amir

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42008>
_______________________________________

From report at bugs.python.org  Mon Oct 12 05:59:18 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 12 Oct 2020 09:59:18 +0000
Subject: [issue35155] Clarify Protocol Handlers in urllib.request Docs
In-Reply-To: <1541286673.86.0.788709270274.issue35155@psf.upfronthosting.co.za>
Message-ID: <1602496758.81.0.946711604397.issue35155@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35155>
_______________________________________

From report at bugs.python.org  Mon Oct 12 06:17:09 2020
From: report at bugs.python.org (Sebastian Rittau)
Date: Mon, 12 Oct 2020 10:17:09 +0000
Subject: [issue42012] typing support in wsgiref
Message-ID: <1602497829.72.0.629140964099.issue42012@roundup.psfhosted.org>


New submission from Sebastian Rittau <srittau at rittau.biz>:

In typeshed (the repository for stdlib type annotations), we have defined a bunch of types to support annotating WSGI interfaces. See https://github.com/python/typeshed/blob/master/stdlib/2and3/_typeshed/wsgi.pyi for the current version. Unfortunately these types are only available at type check time, which means that users need to do some gymnastics to use them in their own code.

I think it would be worthwhile to add these types directly to wsgiref or to a new module (e.g. wsgiref.types). On the one hand users could use them at runtime easily, on the other hand they serve as additional documentation WSGI types. In my experience, WSGI applications and middleware often slightly misimplement the standard, which can make interoperability difficult. Both type checking and concrete documentation could help alleviate this problem.

If the maintainers think this would be a good idea, I could provide a PR for both the types and the Python documentation.

----------
components: Library (Lib)
messages: 378484
nosy: srittau
priority: normal
severity: normal
status: open
title: typing support in wsgiref
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42012>
_______________________________________

From report at bugs.python.org  Mon Oct 12 06:55:28 2020
From: report at bugs.python.org (Bernat Gabor)
Date: Mon, 12 Oct 2020 10:55:28 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
Message-ID: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>


New submission from Bernat Gabor <gaborjbernat at gmail.com>:

Here's a small reproducible, run it on a Windows OS that has symlinks enabled:

import shutil
import venv
import subprocess

shutil.rmtree("venv", ignore_errors=True)
venv.EnvBuilder(with_pip=False, symlinks=True).create("venv")

# works
subprocess.check_call(["venv\\Scripts\\python.exe", "-c", "import sys; print(sys.executable)"])

# fails with No module named 'encodings'
subprocess.check_call(["venv\\Scripts\\python.exe", "-Ic", "import sys; print(sys.executable)"])

----------
messages: 378485
nosy: gaborjbernat
priority: normal
severity: normal
status: open
title: venv on Windows with symlinks is broken if invoked with -I
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 06:58:43 2020
From: report at bugs.python.org (Bernat Gabor)
Date: Mon, 12 Oct 2020 10:58:43 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602500323.38.0.262940614669.issue42013@roundup.psfhosted.org>


Change by Bernat Gabor <gaborjbernat at gmail.com>:


----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 07:43:24 2020
From: report at bugs.python.org (Amir Mohamadi)
Date: Mon, 12 Oct 2020 11:43:24 +0000
Subject: [issue42008] Internal Random class calling seed() with incorrect
 argument
In-Reply-To: <1602453161.68.0.0739681342621.issue42008@roundup.psfhosted.org>
Message-ID: <1602503004.22.0.364854922467.issue42008@roundup.psfhosted.org>


Change by Amir Mohamadi <amiremohamadi at yahoo.com>:


----------
keywords: +patch
pull_requests: +21641
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22668

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42008>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:05:00 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 12 Oct 2020 12:05:00 +0000
Subject: [issue38912] test_asyncio altered the execution environment
In-Reply-To: <1574729421.23.0.927917235759.issue38912@roundup.psfhosted.org>
Message-ID: <1602504300.32.0.255996912501.issue38912@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +aeros

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38912>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:08:08 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 12 Oct 2020 12:08:08 +0000
Subject: [issue21927] BOM appears in stdin when using Powershell
In-Reply-To: <1404657562.39.0.323212380566.issue21927@psf.upfronthosting.co.za>
Message-ID: <1602504488.02.0.550079592999.issue21927@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

I'm closing this as a third-party issue with older versions of PowerShell. Newer versions of PowerShell set the output encoding to UTF-8 without a BOM preamble. For example:

    PS C:\> $PSVersionTable.PSVersion

    Major  Minor  Patch  PreReleaseLabel BuildLabel
    -----  -----  -----  --------------- ----------
    7      0      3

    PS C:\> $OutputEncoding.EncodingName
    Unicode (UTF-8)

    PS C:\> echo ????? | py -3 -X utf8 -c "print(ascii(input()))"
    '\xa1\xa2\xa3\xa4\xa5'

It's still possible to manually set the output encoding to include a BOM preamble. For example:

    PS C:\> $OutputEncoding = [System.Text.Encoding]::UTF8
    PS C:\> $OutputEncoding.GetPreamble()
    239
    187
    191
    PS C:\> echo ????? | py -3 -X utf8 -c "print(ascii(input()))"
    '\ufeff\xa1\xa2\xa3\xa4\xa5'

I don't know what would be appropriate for Python's I/O stack in terms of detecting and handling a UTF-8 preamble on any type of file (console/terminal, pipe, disk), i.e. using the "utf-8-sig" encoding instead of "utf-8", as opposed to just letting scripts detect and handle an initial BOM character (U+FEFF) however they see fit. But that discussion needs a new issue if people are interested in supporting new behavior.

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21927>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:26:42 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 12 Oct 2020 12:26:42 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602505602.91.0.0555725837148.issue42013@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

I can't reproduce the issue with the normal 3.9.0 distribution from python.org. For example:

    >>> venv.EnvBuilder(with_pip=False, symlinks=True).create("venv")
    >>> subprocess.check_call(["venv\\Scripts\\python.exe", "-Ic", "import sys; print(sys.executable)"])
    C:\Temp\env\venv\Scripts\python.exe
    0

Which Python version(s) and distribution(s) did you test? Do you have the PYTHONHOME and/or PYTHONPATH environment variables set?

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:33:24 2020
From: report at bugs.python.org (Bernat Gabor)
Date: Mon, 12 Oct 2020 12:33:24 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602506004.48.0.671368971117.issue42013@roundup.psfhosted.org>


Bernat Gabor <gaborjbernat at gmail.com> added the comment:

? py -c 'import sys; print(sys.version)'
3.9.0 (tags/v3.9.0:9cf6752, Oct  5 2020, 15:34:40) [MSC v.1927 64 bit (AMD64)]

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:38:39 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 12 Oct 2020 12:38:39 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602506319.05.0.987139149243.issue42013@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

What about the PYTHONHOME and PYTHONPATH environment variables?

    >>> 'PYTHONHOME' in os.environ
    False
    >>> 'PYTHONPATH' in os.environ
    False

PYTHONHOME should not be set all. PYTHONPATH needs to be set carefully. It should never include standard-library paths.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:41:42 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Mon, 12 Oct 2020 12:41:42 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602506502.26.0.750606078903.issue42013@roundup.psfhosted.org>


Filipe La?ns <filipe.lains at gmail.com> added the comment:

This error most likely happens because sys.path isn't being set properly and the standard library isn't being included.

We need more information about the specific environment this is triggering.

Which CPython build are you using? The one from Github Actions, right?
We also need the environment variables.

----------
nosy: +FFY00

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:43:58 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Mon, 12 Oct 2020 12:43:58 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602506638.91.0.478005677743.issue42013@roundup.psfhosted.org>


Filipe La?ns <filipe.lains at gmail.com> added the comment:

Well, actually the environment variables /should/ not matter as -I implies -E.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:45:04 2020
From: report at bugs.python.org (Bernat Gabor)
Date: Mon, 12 Oct 2020 12:45:04 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602506704.36.0.882585480077.issue42013@roundup.psfhosted.org>


Bernat Gabor <gaborjbernat at gmail.com> added the comment:

Ok, the missing link is that the python you run into needs to be also a symlink venv:

? py -m venv env --without-pip --clear --symlinks
? .\env\Scripts\python.exe -c "import venv, subprocess; venv.EnvBuilder(with_pip=False, symlinks=True).create('venv'); subprocess.check_call(['venv\\Scripts\\python.exe', '-Ic', 'import sys; print(sys.executable)'])"

Fatal Python error: init_fs_encoding: failed to get the Python codec of the filesystem encoding
Python runtime state: core initialized
ModuleNotFoundError: No module named 'encodings'

----------
nosy:  -FFY00

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:48:03 2020
From: report at bugs.python.org (Bernat Gabor)
Date: Mon, 12 Oct 2020 12:48:03 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602506883.85.0.435420926526.issue42013@roundup.psfhosted.org>


Bernat Gabor <gaborjbernat at gmail.com> added the comment:

> We need more information about the specific environment this is triggering.

Both Gitub Actions Windows CPython3.9 or installer as downloaded from (on Windows 10) https://www.python.org/downloads/release/python-390/.

> PYTHONHOME should not be set all. PYTHONPATH needs to be set carefully. It should never include standard-library path

The issue manifests independent of those environment variables, netiher of them are set.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:50:22 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 12 Oct 2020 12:50:22 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602507022.23.0.545735664384.issue42013@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> Well, actually the environment variables /should/ not matter as -I 
> implies -E.

The operative word there is "should". I was grasping for anything that might explain why I couldn't reproduce the issue.

> Ok, the missing link is that the python you run into needs to 
> be also a symlink venv

Thank you, that reproduces the problem for me.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:50:37 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 12 Oct 2020 12:50:37 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602507037.49.0.14667681564.issue42013@roundup.psfhosted.org>


Change by Eryk Sun <eryksun at gmail.com>:


----------
Removed message: https://bugs.python.org/msg378489

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:50:25 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Mon, 12 Oct 2020 12:50:25 +0000
Subject: [issue39679] functools: singledispatchmethod doesn't work with
 classmethod
In-Reply-To: <1582053375.25.0.178240077179.issue39679@roundup.psfhosted.org>
Message-ID: <1602507025.21.0.0134880119922.issue39679@roundup.psfhosted.org>


Change by Filipe La?ns <filipe.lains at gmail.com>:


----------
nosy: +FFY00

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39679>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:52:23 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Mon, 12 Oct 2020 12:52:23 +0000
Subject: [issue41990] venv module clashes with pip --user ... improve
 coordination.
In-Reply-To: <1602314685.15.0.298308328317.issue41990@roundup.psfhosted.org>
Message-ID: <1602507143.09.0.324985158205.issue41990@roundup.psfhosted.org>


Change by Filipe La?ns <filipe.lains at gmail.com>:


----------
nosy: +FFY00

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41990>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:54:15 2020
From: report at bugs.python.org (=?utf-8?b?TWljaGFsIMSMaWhhxZk=?=)
Date: Mon, 12 Oct 2020 12:54:15 +0000
Subject: [issue42014] shutil.rmtree calls onerror with different function than
 failed
Message-ID: <1602507255.43.0.726203818853.issue42014@roundup.psfhosted.org>


New submission from Michal ?iha? <michal at cihar.com>:

The onerror callback is called with os.lstat when the actual failing function is os.open.

To reproduce create directory that can not be listed:

import os
import shutil

def onerror(func, path, exc_info):
    print(func)

os.mkdir("test")
os.chmod("test", 0)
shutil.rmtree("test", onerror=onerror)

----------
components: Library (Lib)
messages: 378495
nosy: nijel
priority: normal
pull_requests: 21642
severity: normal
status: open
title: shutil.rmtree calls onerror with different function than failed
type: behavior
versions: Python 3.10, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42014>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:55:19 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Mon, 12 Oct 2020 12:55:19 +0000
Subject: [issue41977] ctypes array inside structure requires explicit garbage
 collection
In-Reply-To: <1602179347.57.0.693191135909.issue41977@roundup.psfhosted.org>
Message-ID: <1602507319.35.0.537542365411.issue41977@roundup.psfhosted.org>


Change by Filipe La?ns <filipe.lains at gmail.com>:


----------
nosy: +FFY00

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41977>
_______________________________________

From report at bugs.python.org  Mon Oct 12 08:58:18 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 12 Oct 2020 12:58:18 +0000
Subject: [issue42007] Line continuation after Boolean operation
In-Reply-To: <1602439167.7.0.635101200661.issue42007@roundup.psfhosted.org>
Message-ID: <1602507498.55.0.918157464199.issue42007@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Agreed that this isn't likely to change.

If you have a concrete proposal for how the language parsing rules would change in order to support this, you should post it to the python-ideas mailing list.

If that discussion results in a consensus, then we can re-open this issue. But unless you have a very compelling rationale, I don't expect any language changes here.

----------
nosy: +eric.smith
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42007>
_______________________________________

From report at bugs.python.org  Mon Oct 12 09:03:07 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 12 Oct 2020 13:03:07 +0000
Subject: [issue42011] Documentation for logging.Filter.filter reports the
 wrong return type
In-Reply-To: <1602493243.32.0.577845482202.issue42011@roundup.psfhosted.org>
Message-ID: <1602507787.53.0.224920552335.issue42011@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +vinay.sajip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42011>
_______________________________________

From report at bugs.python.org  Mon Oct 12 09:07:00 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Mon, 12 Oct 2020 13:07:00 +0000
Subject: [issue41282] Deprecate and remove distutils
In-Reply-To: <1594542625.3.0.789939298104.issue41282@roundup.psfhosted.org>
Message-ID: <1602508020.23.0.390416853271.issue41282@roundup.psfhosted.org>


Change by Filipe La?ns <filipe.lains at gmail.com>:


----------
nosy: +FFY00

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41282>
_______________________________________

From report at bugs.python.org  Mon Oct 12 09:22:29 2020
From: report at bugs.python.org (Kyle Evans)
Date: Mon, 12 Oct 2020 13:22:29 +0000
Subject: [issue40422] Light refactor: create a common _Py_closerange API
In-Reply-To: <1588080944.1.0.768613011974.issue40422@roundup.psfhosted.org>
Message-ID: <1602508949.38.0.412503242278.issue40422@roundup.psfhosted.org>


Kyle Evans <kevans at FreeBSD.org> added the comment:

Excellent, thank you.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40422>
_______________________________________

From report at bugs.python.org  Mon Oct 12 10:14:09 2020
From: report at bugs.python.org (Javier Ayres)
Date: Mon, 12 Oct 2020 14:14:09 +0000
Subject: [issue42004] Allow uploading files with SimpleHTTPRequestHandler
In-Reply-To: <1602377597.5.0.712668345738.issue42004@roundup.psfhosted.org>
Message-ID: <1602512049.99.0.907186669568.issue42004@roundup.psfhosted.org>


Javier Ayres <javier at lufte.net> added the comment:

I see. To be honest I didn't know FieldStorage at all, it was the best way I found of dealing with file data in requests using just the standard library. If you think this feature makes sense and it could be included, I could look into removing the FieldStorage dependency.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42004>
_______________________________________

From report at bugs.python.org  Mon Oct 12 10:14:48 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 12 Oct 2020 14:14:48 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602512088.16.0.251528994177.issue42013@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

This issue is partly due to bpo-8901, which changed the behavior of the -E and -I command-line options to make them ignore the default PythonPath value in the registry key "Software\Python\PythonCore\X.Y\PythonPath". The change itself is not wrong. It's just exposing an underlying problem.

The `home` path in pyvenv.cfg is from sys._base_executable. In a launcher-based environment that's created from the base installation, sys._base_executable is the real base executable. OTOH, in a symlink-based virtual environment, sys._base_executable is the same as sys.executable. Consequently, if a virtual environment is created from a symlink-based virtual environment, the `home` path in pyvenv.cfg refers to the creating environment instead of the base installation. In this case, with the current implementation, the standard library can only be found by falling back on the default PythonPath in the registry.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 10:23:44 2020
From: report at bugs.python.org (Yannick Jadoul)
Date: Mon, 12 Oct 2020 14:23:44 +0000
Subject: [issue42015] Order of decrementing reference counts in meth_dealloc
Message-ID: <1602512624.15.0.894803367223.issue42015@roundup.psfhosted.org>


New submission from Yannick Jadoul <yannick.jadoul at gmail.com>:

In Python 3.9, the line `Py_XDECREF(PyCFunction_GET_CLASS(m));` was added to `meth_dealloc` (in `methodobject.c`). Unfortunately for pybind11, it's inserted exactly two lines too low, since it accesses the `PyMethodDef` and we store the `PyMethodDef` instance in the capsule that's used as `self`-argument of the `PyCFunction`.

Result: UB, since `Py_XDECREF(m->m_self);` brings down the refcount of the capsule to 0 and (indirectly) frees the `PyMethodDef`, while its contents are now still accessed.

>From the pybind11 perspective, it would be optimal if this could be fixed in CPython itself, by moving up this one `Py_XDECREF` 2 lines. This would a) be more efficient than creating a workaround, and b) allow old, existing versions of pybind11 to work with Python 3.9 (well, 3.9.1, then, hopefully); the user base of pybind11 has grown quite a bit and now includes giants like scipy or some Google libraries.
I will make a PR implementing this, soon.

If there's a different, recommended way of creating these `PyCFunctionObject`s dynamically and cleaning up the `PyMethodDef`, we'd be interested as well, to make sure these kinds of breakages are avoided in the future.

Apologies for only figuring out now how to debug this, using valgrind. Up until yesterday, we only saw some failures in CI on macOS, but it was hard to reproduce and debug locally.


- Related issue: https://bugs.python.org/issue41237
- pybind11 issue: https://github.com/pybind/pybind11/issues/2558
- pybind11 PR: https://github.com/pybind/pybind11/pull/2576

----------
components: C API, Interpreter Core
messages: 378500
nosy: YannickJadoul
priority: normal
severity: normal
status: open
title: Order of decrementing reference counts in meth_dealloc
type: crash
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42015>
_______________________________________

From report at bugs.python.org  Mon Oct 12 10:47:54 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Mon, 12 Oct 2020 14:47:54 +0000
Subject: [issue42011] Documentation for logging.Filter.filter reports the
 wrong return type
In-Reply-To: <1602493243.32.0.577845482202.issue42011@roundup.psfhosted.org>
Message-ID: <1602514074.91.0.717162027791.issue42011@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
versions:  -Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42011>
_______________________________________

From report at bugs.python.org  Mon Oct 12 10:47:14 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Mon, 12 Oct 2020 14:47:14 +0000
Subject: [issue42011] Documentation for logging.Filter.filter reports the
 wrong return type
In-Reply-To: <1602493243.32.0.577845482202.issue42011@roundup.psfhosted.org>
Message-ID: <1602514034.17.0.932629084127.issue42011@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

I agree that the documentation now should use Booleans rather than ints for the return type. It's a hangover from the pre-bool days of Python 1.5.2 ...

> P.S. As a side note, the API for filter() is quite counter-intuitive

That depends on if you consider the "filter" operation as "filter in" or "filter out", but the documentation is clear on what needs to be returned for a particular outcome.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42011>
_______________________________________

From report at bugs.python.org  Mon Oct 12 10:54:47 2020
From: report at bugs.python.org (Henry Schreiner)
Date: Mon, 12 Oct 2020 14:54:47 +0000
Subject: [issue42015] Order of decrementing reference counts in meth_dealloc
In-Reply-To: <1602512624.15.0.894803367223.issue42015@roundup.psfhosted.org>
Message-ID: <1602514487.33.0.535470978345.issue42015@roundup.psfhosted.org>


Change by Henry Schreiner <henryschreineriii at gmail.com>:


----------
nosy: +Henry Schreiner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42015>
_______________________________________

From report at bugs.python.org  Mon Oct 12 11:26:28 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 12 Oct 2020 15:26:28 +0000
Subject: [issue42015] Order of decrementing reference counts in meth_dealloc
In-Reply-To: <1602512624.15.0.894803367223.issue42015@roundup.psfhosted.org>
Message-ID: <1602516388.71.0.471641120907.issue42015@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Do you mind to create a PR Yannick?

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42015>
_______________________________________

From report at bugs.python.org  Mon Oct 12 11:29:06 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Mon, 12 Oct 2020 15:29:06 +0000
Subject: [issue21927] BOM appears in stdin when using Powershell
In-Reply-To: <1404657562.39.0.323212380566.issue21927@psf.upfronthosting.co.za>
Message-ID: <1602516546.85.0.176264760482.issue21927@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

Thanks Eryk for following up. Glad to hear the issue has been fixed upstream!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21927>
_______________________________________

From report at bugs.python.org  Mon Oct 12 11:29:24 2020
From: report at bugs.python.org (Fibonacci)
Date: Mon, 12 Oct 2020 15:29:24 +0000
Subject: [issue42016] Add ksh to venv examples
Message-ID: <1602516564.28.0.841153508443.issue42016@roundup.psfhosted.org>


New submission from Fibonacci <python at academicsolutions.ch>:

Add an example on how to source with the korn shell (tested on OpenBSD). Maybe the bash/zsh example can be changed to use the dot to source the file, then it could be included there.

Diff attached.

----------
assignee: docs at python
components: Documentation
files: python_venv_ksh
messages: 378504
nosy: docs at python, fibonacci
priority: normal
severity: normal
status: open
title: Add ksh to venv examples
type: enhancement
Added file: https://bugs.python.org/file49509/python_venv_ksh

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42016>
_______________________________________

From report at bugs.python.org  Mon Oct 12 11:41:05 2020
From: report at bugs.python.org (ThatXliner)
Date: Mon, 12 Oct 2020 15:41:05 +0000
Subject: [issue42017] Add new type in typing
Message-ID: <1602517265.37.0.00250446603223.issue42017@roundup.psfhosted.org>


New submission from ThatXliner <bryan.hu.2020 at gmail.com>:

Because there is a typing.AnyStr (which is equal to AnyStr = TypeVar("AnyStr", str, bytes)), I think there should be a AnyNum which is equivalent to

from decimal import Decimal
from fractions import Fraction
AnyNum = TypeVar("AnyNum", int, float, complex, Decimal, Fraction)

----------
components: Library (Lib)
messages: 378505
nosy: ThatXliner
priority: normal
severity: normal
status: open
title: Add new type in typing
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42017>
_______________________________________

From report at bugs.python.org  Mon Oct 12 12:10:49 2020
From: report at bugs.python.org (Yannick Jadoul)
Date: Mon, 12 Oct 2020 16:10:49 +0000
Subject: [issue42015] Order of decrementing reference counts in meth_dealloc
In-Reply-To: <1602512624.15.0.894803367223.issue42015@roundup.psfhosted.org>
Message-ID: <1602519049.69.0.0642675123218.issue42015@roundup.psfhosted.org>


Change by Yannick Jadoul <yannick.jadoul at gmail.com>:


----------
keywords: +patch
pull_requests: +21643
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22670

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42015>
_______________________________________

From report at bugs.python.org  Mon Oct 12 12:12:05 2020
From: report at bugs.python.org (Yannick Jadoul)
Date: Mon, 12 Oct 2020 16:12:05 +0000
Subject: [issue42015] Order of decrementing reference counts in meth_dealloc
In-Reply-To: <1602512624.15.0.894803367223.issue42015@roundup.psfhosted.org>
Message-ID: <1602519125.67.0.167957775315.issue42015@roundup.psfhosted.org>


Yannick Jadoul <yannick.jadoul at gmail.com> added the comment:

Yes, sorry for the delay; I got caught up in something else.

Meanwhile, https://github.com/python/cpython/pull/22670 should solve our issues. I think Henry confirmed this locally?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42015>
_______________________________________

From report at bugs.python.org  Mon Oct 12 12:15:01 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 12 Oct 2020 16:15:01 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602519301.78.0.856418182795.issue42013@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Thanks for figuring that out, Eryk.

Probably we should just update venv to do a realpath(sys._base_executable) to handle the venv-from-symlinked-venv scenario.

Though I'd also be quite happy to just disallow that entirely (as we used to?). If you enable system site packages thinking you're chaining venvs together, you may be surprised, so it might just be better to error out here. (On the *other* hand, if you're programmatically invoking venv, maybe you know what you're doing and we should allow it?)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 12:21:08 2020
From: report at bugs.python.org (Kevin Wojniak)
Date: Mon, 12 Oct 2020 16:21:08 +0000
Subject: [issue42018] winreg SetValue(Ex) should mention integer as an
 acceptable value
Message-ID: <1602519668.67.0.657607814391.issue42018@roundup.psfhosted.org>


New submission from Kevin Wojniak <kwojniak at box.com>:

On https://docs.python.org/3/library/winreg.html

For SetValue and SetValueEx is says:

> value is a string that specifies the new value.

but value can also be an integer if the type is DWORD. Here's a test that shows that: https://github.com/python/cpython/blob/3.9/Lib/test/test_winreg.py#L339

Suggested update:

> value is a string or integer that specifies the new value.

----------
assignee: docs at python
components: Documentation
messages: 378508
nosy: docs at python, kwojniak_box
priority: normal
severity: normal
status: open
title: winreg SetValue(Ex) should mention integer as an acceptable value
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42018>
_______________________________________

From report at bugs.python.org  Mon Oct 12 12:24:28 2020
From: report at bugs.python.org (Roundup Robot)
Date: Mon, 12 Oct 2020 16:24:28 +0000
Subject: [issue42018] winreg SetValue(Ex) should mention integer as an
 acceptable value
In-Reply-To: <1602519668.67.0.657607814391.issue42018@roundup.psfhosted.org>
Message-ID: <1602519868.36.0.0445635783209.issue42018@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 2.0 -> 3.0
pull_requests: +21644
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22671

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42018>
_______________________________________

From report at bugs.python.org  Mon Oct 12 12:46:44 2020
From: report at bugs.python.org (ThatXliner)
Date: Mon, 12 Oct 2020 16:46:44 +0000
Subject: [issue42017] Add new type in typing
In-Reply-To: <1602517265.37.0.00250446603223.issue42017@roundup.psfhosted.org>
Message-ID: <1602521204.05.0.966801474756.issue42017@roundup.psfhosted.org>


Change by ThatXliner <bryan.hu.2020 at gmail.com>:


----------
versions: +Python 3.9 -Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42017>
_______________________________________

From report at bugs.python.org  Mon Oct 12 12:46:55 2020
From: report at bugs.python.org (ThatXliner)
Date: Mon, 12 Oct 2020 16:46:55 +0000
Subject: [issue42017] Add new type in typing
In-Reply-To: <1602517265.37.0.00250446603223.issue42017@roundup.psfhosted.org>
Message-ID: <1602521215.23.0.21052922808.issue42017@roundup.psfhosted.org>


Change by ThatXliner <bryan.hu.2020 at gmail.com>:


----------
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42017>
_______________________________________

From report at bugs.python.org  Mon Oct 12 13:03:42 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 12 Oct 2020 17:03:42 +0000
Subject: [issue35155] Clarify Protocol Handlers in urllib.request Docs
In-Reply-To: <1541286673.86.0.788709270274.issue35155@psf.upfronthosting.co.za>
Message-ID: <1602522222.76.0.746777568502.issue35155@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35155>
_______________________________________

From report at bugs.python.org  Mon Oct 12 13:17:17 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 12 Oct 2020 17:17:17 +0000
Subject: [issue34976] IDLE: Replace the search dialog with a search bar
In-Reply-To: <1539464539.46.0.788709270274.issue34976@psf.upfronthosting.co.za>
Message-ID: <1602523037.78.0.432173664937.issue34976@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Notepad++, which I use, uses a tabbed dialog for search and replace, which I think I would like to somewhat imitate.  Or just have one search and replace dialog.  I need to experiment.  I don't like the Firefox toolbar and consider it buggy.  In any case, it and browsers in general do not do replace.  Maybe yours is better.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34976>
_______________________________________

From report at bugs.python.org  Mon Oct 12 13:31:19 2020
From: report at bugs.python.org (Bug Reporter)
Date: Mon, 12 Oct 2020 17:31:19 +0000
Subject: [issue41561] test_ssl fails in Ubuntu 20.04:
 test_min_max_version_mismatch
In-Reply-To: <1597551049.14.0.0578030464715.issue41561@roundup.psfhosted.org>
Message-ID: <1602523879.53.0.318177591908.issue41561@roundup.psfhosted.org>


Bug Reporter <bugsrep at gmail.com> added the comment:

I got an advice and posted the question at https://answers.launchpad.net/ubuntu/+source/openssl/+question/693423

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41561>
_______________________________________

From report at bugs.python.org  Mon Oct 12 13:51:38 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 12 Oct 2020 17:51:38 +0000
Subject: [issue42015] Order of decrementing reference counts in meth_dealloc
In-Reply-To: <1602512624.15.0.894803367223.issue42015@roundup.psfhosted.org>
Message-ID: <1602525098.78.0.289752453916.issue42015@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Thank you Yannick for your report and PR!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42015>
_______________________________________

From report at bugs.python.org  Mon Oct 12 14:04:31 2020
From: report at bugs.python.org (Paul Moore)
Date: Mon, 12 Oct 2020 18:04:31 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602525871.07.0.556536080947.issue42013@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

I'm inclined to think that creating a venv from within another venv should be allowed. Tools like pipx can result in *other* tools being run from within a virtual environment, and I don't think it's good to disallow that usage - as an example, I have virtualenv, tox and nox installed via pipx, and all of them create virtual environments.

So I'm +1 on fixing this by calling realpath.

I don't think we need to do anything special for --system-site-packages. The docs say "Give the virtual environment access to the system site-packages dir". If people are trying to chain venvs using it, they are misreading that comment - and the best they could hope for is to request that it's made clearer.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 14:07:57 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 12 Oct 2020 18:07:57 +0000
Subject: [issue42018] winreg SetValue(Ex) should mention integer as an
 acceptable value
In-Reply-To: <1602519668.67.0.657607814391.issue42018@roundup.psfhosted.org>
Message-ID: <1602526077.8.0.679671151161.issue42018@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +serhiy.storchaka
type:  -> enhancement
versions: +Python 3.10, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42018>
_______________________________________

From report at bugs.python.org  Mon Oct 12 14:08:05 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 12 Oct 2020 18:08:05 +0000
Subject: [issue42018] winreg SetValue(Ex) should mention integer as an
 acceptable value
In-Reply-To: <1602519668.67.0.657607814391.issue42018@roundup.psfhosted.org>
Message-ID: <1602526085.57.0.665399757564.issue42018@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42018>
_______________________________________

From report at bugs.python.org  Mon Oct 12 14:10:48 2020
From: report at bugs.python.org (Kyle Evans)
Date: Mon, 12 Oct 2020 18:10:48 +0000
Subject: [issue40422] Light refactor: create a common _Py_closerange API
In-Reply-To: <1588080944.1.0.768613011974.issue40422@roundup.psfhosted.org>
Message-ID: <1602526248.23.0.590327194858.issue40422@roundup.psfhosted.org>


Change by Kyle Evans <kevans at FreeBSD.org>:


----------
pull_requests: +21646
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/22672

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40422>
_______________________________________

From report at bugs.python.org  Mon Oct 12 14:26:39 2020
From: report at bugs.python.org (Aristotelis Mikropoulos)
Date: Mon, 12 Oct 2020 18:26:39 +0000
Subject: [issue42019] Override MagicMock special methods
Message-ID: <1602527199.87.0.454087859253.issue42019@roundup.psfhosted.org>


New submission from Aristotelis Mikropoulos <amikrop at gmail.com>:

This is more of a question whether the following is intended behavior:
Subclassing unittest.mock.MagicMock and overriding one of the special (double underscore) methods has no effect. The default MagicMock method implementation still stands. This isn't the case with subclassing Mock.
It is understood that the purpose of MagicMock is to offer stub implementations of certain special methods, but isn't defining them yourself in the body of a subclass supposed to override those stubs?
There is an example in the file attached.

----------
components: Tests
files: mockcase.py
messages: 378513
nosy: Indy
priority: normal
severity: normal
status: open
title: Override MagicMock special methods
type: behavior
versions: Python 3.9
Added file: https://bugs.python.org/file49510/mockcase.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42019>
_______________________________________

From report at bugs.python.org  Mon Oct 12 14:40:51 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 12 Oct 2020 18:40:51 +0000
Subject: [issue42017] Add new type in typing
In-Reply-To: <1602517265.37.0.00250446603223.issue42017@roundup.psfhosted.org>
Message-ID: <1602528051.42.0.923660272256.issue42017@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
nosy: +gvanrossum, levkivskyi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42017>
_______________________________________

From report at bugs.python.org  Mon Oct 12 14:50:52 2020
From: report at bugs.python.org (denis)
Date: Mon, 12 Oct 2020 18:50:52 +0000
Subject: [issue42020] interpreter hangs forever on invalid input
Message-ID: <1602528652.49.0.982690015105.issue42020@roundup.psfhosted.org>


New submission from denis <gantsevdenis at gmail.com>:

Python 3.8.5, Python 3.7.3
When trying to print invalid unicode, interpreter goes to a completely unresponsive state

>>> print("\x9b")


eyboardInterrupt
>>> print("\xa5")
?
>>> print("\x95")

>>> print("\x90")
denis at debian:~$ <interpreter hangs forever, ctrl+d was pressed to exit>

----------
components: Unicode
messages: 378514
nosy: dgan, ezio.melotti, vstinner
priority: normal
severity: normal
status: open
title: interpreter hangs forever on invalid input
type: behavior
versions: Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42020>
_______________________________________

From report at bugs.python.org  Mon Oct 12 15:10:10 2020
From: report at bugs.python.org (Antoine Pitrou)
Date: Mon, 12 Oct 2020 19:10:10 +0000
Subject: [issue37209] Add what's new entries for pickle enhancements
In-Reply-To: <1560083927.43.0.0939739725641.issue37209@roundup.psfhosted.org>
Message-ID: <1602529810.54.0.556692531679.issue37209@roundup.psfhosted.org>


Change by Antoine Pitrou <pitrou at free.fr>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37209>
_______________________________________

From report at bugs.python.org  Mon Oct 12 15:11:55 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Mon, 12 Oct 2020 19:11:55 +0000
Subject: [issue41756] Do not always use exceptions to return result from
 coroutine
In-Reply-To: <1599786636.95.0.884410425349.issue41756@roundup.psfhosted.org>
Message-ID: <1602529915.15.0.799477650604.issue41756@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

With the latest PR now merged this issue can be closed. Please reopen if there are any other action items left.

----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41756>
_______________________________________

From report at bugs.python.org  Mon Oct 12 15:18:40 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 12 Oct 2020 19:18:40 +0000
Subject: [issue42021] Fix possible ref. leaks in _sqlite3 module initialisation
Message-ID: <1602530320.77.0.149303517961.issue42021@roundup.psfhosted.org>


New submission from Erlend Egeberg Aasland <erlend.aasland at innova.no>:

Handle PyDict_SetItemString() errors in _sqlite3 init by dereferencing the item object and then goto error.

----------
components: Library (Lib)
messages: 378516
nosy: erlendaasland
priority: normal
severity: normal
status: open
title: Fix possible ref. leaks in _sqlite3 module initialisation
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42021>
_______________________________________

From report at bugs.python.org  Mon Oct 12 15:21:57 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 12 Oct 2020 19:21:57 +0000
Subject: [issue42020] interpreter hangs forever on invalid input
In-Reply-To: <1602528652.49.0.982690015105.issue42020@roundup.psfhosted.org>
Message-ID: <1602530517.15.0.676362454785.issue42020@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

The terminal you're using apparently implements C1 controls [1]. U+009B is the Control Sequence Introducer (CSI) for ANSI escape sequences. U+0090 starts a Device Control String (DCS), and it gets terminated by U+009C, a String Terminator (ST). For example, in GNOME Terminal in Linux:

    >>> print('spam\x9b4Deggs')
    eggs

    >>> print('spam\x90some DCS string\x9c')
    spam

---

[1] https://en.wikipedia.org/wiki/C0_and_C1_control_codes

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42020>
_______________________________________

From report at bugs.python.org  Mon Oct 12 15:22:29 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 12 Oct 2020 19:22:29 +0000
Subject: [issue41756] Do not always use exceptions to return result from
 coroutine
In-Reply-To: <1599786636.95.0.884410425349.issue41756@roundup.psfhosted.org>
Message-ID: <1602530549.46.0.496079479144.issue41756@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Few things I forget about. The new C API function should be exported in PC/python3dll.c.

Also, in Include/abstract.h it should only be available for limited C API >= 3.10:

#if !defined(Py_LIMITED_API) || Py_LIMITED_API+0 >= 0x030A0000
...
#endif

We now should discuss the behavior of PySend_Iter() if value is NULL. It is not documented, the current behavior differs from the behavior for non-NULL value, and it is used in the ceval loop. We should document this case explicitly and maybe change the behavior if it would be more appropriate.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41756>
_______________________________________

From report at bugs.python.org  Mon Oct 12 15:22:59 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 12 Oct 2020 19:22:59 +0000
Subject: [issue42021] Fix possible ref. leaks in _sqlite3 module initialisation
In-Reply-To: <1602530320.77.0.149303517961.issue42021@roundup.psfhosted.org>
Message-ID: <1602530579.08.0.17356142361.issue42021@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
keywords: +patch
pull_requests: +21647
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22673

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42021>
_______________________________________

From report at bugs.python.org  Mon Oct 12 15:27:00 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 12 Oct 2020 19:27:00 +0000
Subject: [issue42020] interpreter hangs forever on invalid input
In-Reply-To: <1602528652.49.0.982690015105.issue42020@roundup.psfhosted.org>
Message-ID: <1602530820.39.0.0372185127733.issue42020@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

In Windows 10 2004, CSI is currently supported by the console host (conhost.exe) if virtual-terminal mode is enabled. Windows Terminal Preview supports many more C1 control codes, as will conhost.exe in the next release of Windows 10. This should be 'fun' considering the C1 controls block isn't reserved by Windows filesystems. CMD and PowerShell depend on the C0 controls being reserved and depend on the C1 controls not being implemented. They don't implement any escaping of control characters when listing filenames in a directory, unlike a tradition POSIX shell. Now that the console and Windows Terminal implement C1 controls, maybe PowerShell can be updated to escape them in file listings, but I don't see what can be done for CMD, which doesn't support string literals with escape sequences.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42020>
_______________________________________

From report at bugs.python.org  Mon Oct 12 15:39:31 2020
From: report at bugs.python.org (Tal Einat)
Date: Mon, 12 Oct 2020 19:39:31 +0000
Subject: [issue34976] IDLE: Replace the search dialog with a search bar
In-Reply-To: <1539464539.46.0.788709270274.issue34976@psf.upfronthosting.co.za>
Message-ID: <1602531571.69.0.744322619916.issue34976@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

The version in the PR is modeled after similar features in IDEs, not browsers. I mentioned browsers since they are very commonly used, and to the best of my knowledge all modern browsers use search bars. Therefore, as a UI element, search bars are now commonplace, unsurprising, and require no training to use.

As for replace, while many IDEs use a bar, many word processors do indeed still use a dialog for search/replace, and I've seen text editors use a bar for search but a dialog for replace.

I first implemented this for my personal use, since I much prefer bars to dialogs. But I can see the argument that they can be harder to use for novice users.

If we decide not to go with this path, I'll try to extract some of the improvements made to the search engine, such as highlighting all matches, into a PR improving the existing search and replace dialogs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34976>
_______________________________________

From report at bugs.python.org  Mon Oct 12 15:43:57 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 12 Oct 2020 19:43:57 +0000
Subject: [issue42021] Fix possible ref. leaks in _sqlite3 module initialisation
In-Reply-To: <1602530320.77.0.149303517961.issue42021@roundup.psfhosted.org>
Message-ID: <1602531837.74.0.890738291525.issue42021@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42021>
_______________________________________

From report at bugs.python.org  Mon Oct 12 15:44:20 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 12 Oct 2020 19:44:20 +0000
Subject: [issue42021] Fix possible ref. leaks in _sqlite3 module initialisation
In-Reply-To: <1602530320.77.0.149303517961.issue42021@roundup.psfhosted.org>
Message-ID: <1602531860.39.0.964874279877.issue42021@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
nosy: +berker.peksag

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42021>
_______________________________________

From report at bugs.python.org  Mon Oct 12 15:44:40 2020
From: report at bugs.python.org (Tal Einat)
Date: Mon, 12 Oct 2020 19:44:40 +0000
Subject: [issue34976] IDLE: Replace the search dialog with a search bar
In-Reply-To: <1539464539.46.0.788709270274.issue34976@psf.upfronthosting.co.za>
Message-ID: <1602531880.31.0.179211245648.issue34976@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

I should mention one *major* advantage of using a search/replace bar: Live highlighting of matches *as you type*. It really is a vastly better experience; if you haven't tried it yet, please do.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34976>
_______________________________________

From report at bugs.python.org  Mon Oct 12 16:24:20 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 12 Oct 2020 20:24:20 +0000
Subject: [issue34976] IDLE: Replace the search dialog with a search bar
In-Reply-To: <1539464539.46.0.788709270274.issue34976@psf.upfronthosting.co.za>
Message-ID: <1602534260.27.0.671288724653.issue34976@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Notepad++ Find by marks all matches in the current doc as 'found', with a distinct (darker) highlight for the 'selected' found.  Double clicking selects a word, as in IDLE, *and* finds all matches.  One can then either cut/copy/replace the selection, as in IDLE, *or* look at other matches in the file.

Notepad++ also offers options to (in addition) 'Find all' in current doc or all opened docs.  This lists the hits in a separate box, as with IDLE's Find all.  Double clicking on a hit line goes to that line.  (Easier than RtClick/goto.)

I suspect I would find live highlighting annoying.  Why would having all 'a's on a page light up when I type 'a' be a plus?  But I will try your patch when we are ready to focus on search/replace/find.  

I have mentioned elsewhere that I might go for a minimal search box on the status line separate from the dialog(s).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34976>
_______________________________________

From report at bugs.python.org  Mon Oct 12 16:43:04 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 12 Oct 2020 20:43:04 +0000
Subject: [issue42017] Add new type in typing
In-Reply-To: <1602517265.37.0.00250446603223.issue42017@roundup.psfhosted.org>
Message-ID: <1602535384.0.0.0672303237721.issue42017@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

You can easily define that yourself if you need it, though honestly the utility seems marginal.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42017>
_______________________________________

From report at bugs.python.org  Mon Oct 12 16:43:50 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Mon, 12 Oct 2020 20:43:50 +0000
Subject: [issue42022] Allow ensurepip to work without bundled wheels
Message-ID: <1602535430.83.0.251660396877.issue42022@roundup.psfhosted.org>


New submission from Filipe La?ns <lains at riseup.net>:

Some Linux distributions, such as Debian, have guidelines against shipping things like prebuilt wheels.

Taking Debian as an example, they remove the pip and setuptools wheels and consequently break ensurepip. This also has some implications in the venv module.

As a way to fix this, I would like to propose for ensurepip to install .pth files pointing to the pip and setuptools packages in purelib/platlib.

This behavior could either be switched on by a flag in the makefile or, maybe, if the wheels are not found.

Do you think this would be a reasonable approach?
Currently, we cannot rely on the ensurepip to work. Some projects that really need it are shipping a vendored version of the module.

----------
components: Library (Lib)
messages: 378524
nosy: FFY00, dstufft, ncoghlan, p-ganssle, pradyunsg
priority: normal
severity: normal
status: open
title: Allow ensurepip to work without bundled wheels
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42022>
_______________________________________

From report at bugs.python.org  Mon Oct 12 17:06:27 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 12 Oct 2020 21:06:27 +0000
Subject: [issue42015] Order of decrementing reference counts in meth_dealloc
In-Reply-To: <1602512624.15.0.894803367223.issue42015@roundup.psfhosted.org>
Message-ID: <1602536787.97.0.310337811014.issue42015@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 04b8631d84a870dda456ef86039c1baf34d08500 by Yannick Jadoul in branch 'master':
bpo-42015: Reorder dereferencing calls in meth_dealloc, to make sure m_self is kept alive long enough (GH-22670)
https://github.com/python/cpython/commit/04b8631d84a870dda456ef86039c1baf34d08500


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42015>
_______________________________________

From report at bugs.python.org  Mon Oct 12 17:06:43 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 12 Oct 2020 21:06:43 +0000
Subject: [issue42015] Order of decrementing reference counts in meth_dealloc
In-Reply-To: <1602512624.15.0.894803367223.issue42015@roundup.psfhosted.org>
Message-ID: <1602536803.11.0.968964157774.issue42015@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21648
pull_request: https://github.com/python/cpython/pull/22674

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42015>
_______________________________________

From report at bugs.python.org  Mon Oct 12 17:18:16 2020
From: report at bugs.python.org (ThatXliner)
Date: Mon, 12 Oct 2020 21:18:16 +0000
Subject: [issue42023] Argparse: Add a "display" arg
Message-ID: <1602537496.16.0.894148688163.issue42023@roundup.psfhosted.org>


New submission from ThatXliner <bryan.hu.2020 at gmail.com>:

In argparse, I've always wanted a way to make colored help text like those of poetry and pipenv. But argparse's show help isn't well documented (Therefore, I can't find a way to completely modify the help text), and the metavar arg isn't really helpful. I want to do something like this:

>>> import argparse
>>> parser = argparse.ArgumentParser()
>>> parser.add_argument("foo", help="To foo a bar", display="FOO!!!!")
>>> parser.print_help()

usage: main.py [-h] foo

positional arguments:
  FOO!!!!     To foo a bar

optional arguments:
  -h, --help  show this help message and exit

>>>

That way, I can colorize the help output.

----------
components: Library (Lib)
messages: 378526
nosy: ThatXliner
priority: normal
severity: normal
status: open
title: Argparse: Add a "display" arg
type: enhancement
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42023>
_______________________________________

From report at bugs.python.org  Mon Oct 12 17:21:44 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Mon, 12 Oct 2020 21:21:44 +0000
Subject: [issue41756] Do not always use exceptions to return result from
 coroutine
In-Reply-To: <1599786636.95.0.884410425349.issue41756@roundup.psfhosted.org>
Message-ID: <1602537704.73.0.00178625872285.issue41756@roundup.psfhosted.org>


Change by Yury Selivanov <yselivanov at gmail.com>:


----------
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41756>
_______________________________________

From report at bugs.python.org  Mon Oct 12 17:28:06 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Mon, 12 Oct 2020 21:28:06 +0000
Subject: [issue41756] Do not always use exceptions to return result from
 coroutine
In-Reply-To: <1599786636.95.0.884410425349.issue41756@roundup.psfhosted.org>
Message-ID: <1602538086.82.0.380529205033.issue41756@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

> Also, in Include/abstract.h it should only be available for limited C API >= 3.10:

Vladimir, could you please submit a PR?

> We now should discuss the behavior of PySend_Iter() if value is NULL. It is not documented, the current behavior differs from the behavior for non-NULL value, and it is used in the ceval loop.

IMO: I'd keep the behavior and just document it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41756>
_______________________________________

From report at bugs.python.org  Mon Oct 12 17:29:10 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 12 Oct 2020 21:29:10 +0000
Subject: [issue42015] Order of decrementing reference counts in meth_dealloc
In-Reply-To: <1602512624.15.0.894803367223.issue42015@roundup.psfhosted.org>
Message-ID: <1602538150.81.0.493071392899.issue42015@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8a12503b4532e33d590ecea7eb94cd0e6b0f1488 by Miss Skeleton (bot) in branch '3.9':
bpo-42015: Reorder dereferencing calls in meth_dealloc, to make sure m_self is kept alive long enough (GH-22670)
https://github.com/python/cpython/commit/8a12503b4532e33d590ecea7eb94cd0e6b0f1488


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42015>
_______________________________________

From report at bugs.python.org  Mon Oct 12 17:51:24 2020
From: report at bugs.python.org (Henry Schreiner)
Date: Mon, 12 Oct 2020 21:51:24 +0000
Subject: [issue42015] Order of decrementing reference counts in meth_dealloc
In-Reply-To: <1602512624.15.0.894803367223.issue42015@roundup.psfhosted.org>
Message-ID: <1602539484.64.0.890737140149.issue42015@roundup.psfhosted.org>


Henry Schreiner <henryschreineriii at gmail.com> added the comment:

I tested before the patch, and I got 17 segfaults running a pybind11 module 20 times. After the patch, I ran about 50 times and had no segfaults!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42015>
_______________________________________

From report at bugs.python.org  Mon Oct 12 18:03:47 2020
From: report at bugs.python.org (Shantanu)
Date: Mon, 12 Oct 2020 22:03:47 +0000
Subject: [issue28002] ast.unparse can't roundtrip some f-strings
In-Reply-To: <1473268698.62.0.800338957351.issue28002@psf.upfronthosting.co.za>
Message-ID: <1602540227.05.0.615963172254.issue28002@roundup.psfhosted.org>


Shantanu <hauntsaninja at gmail.com> added the comment:

Bumping again!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28002>
_______________________________________

From report at bugs.python.org  Mon Oct 12 18:21:20 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 12 Oct 2020 22:21:20 +0000
Subject: [issue42020] interpreter hangs forever on invalid input
In-Reply-To: <1602528652.49.0.982690015105.issue42020@roundup.psfhosted.org>
Message-ID: <1602541280.59.0.905434762457.issue42020@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I don't see anything wrong with Python itself and I suggest to close the issue as "not a bug".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42020>
_______________________________________

From report at bugs.python.org  Mon Oct 12 18:39:02 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 12 Oct 2020 22:39:02 +0000
Subject: [issue42013] venv on Windows with symlinks is broken if invoked with
 -I
In-Reply-To: <1602500128.27.0.409801171694.issue42013@roundup.psfhosted.org>
Message-ID: <1602542342.55.0.356523937968.issue42013@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> So I'm +1 on fixing this by calling realpath.

In POSIX, calculate_path() in Modules/getpath.c calls calculate_argv0_path() before it calls calculate_read_pyenv(), and calculate_argv0_path() in turn calls resolve_symlinks(&calculate->argv0_path). Thus "pyvenv.cfg" isn't found and isn't used to find the standard library in POSIX when a virtual environment uses symlinks. Later on, "pyvenv.cfg" gets read by the site module, if importing the latter isn't skipped via -S. The site module sets sys._home to the `home` value, but sys._home only appears to be used by sysconfig when running from the build directory.

In Windows, calculate_path() in PC/getpathp.c could get the final (real) path for argv0_path before calling calculate_pyvenv_file(). Then, just like in POSIX, the environment's "pyvenv.cfg" file won't be found and won't be used to find the standard library when a virtual environment uses symlinks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42013>
_______________________________________

From report at bugs.python.org  Mon Oct 12 19:22:24 2020
From: report at bugs.python.org (Vladimir Matveev)
Date: Mon, 12 Oct 2020 23:22:24 +0000
Subject: [issue41756] Do not always use exceptions to return result from
 coroutine
In-Reply-To: <1599786636.95.0.884410425349.issue41756@roundup.psfhosted.org>
Message-ID: <1602544944.1.0.0596922553399.issue41756@roundup.psfhosted.org>


Change by Vladimir Matveev <desco.by at gmail.com>:


----------
pull_requests: +21649
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/22677

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41756>
_______________________________________

From report at bugs.python.org  Mon Oct 12 19:22:52 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 12 Oct 2020 23:22:52 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1602544972.67.0.317758800495.issue42010@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Have you observed actual users getting confused by this? (E.g. StackOverflow or mailing list posts.) I would assume that if you try to *do* anything with the resulting object it's going to cause a traceback, and from there it's pretty straightforward to debug the situation. (Maybe not for absolute beginners, but they have a lot of ways to confuse themselves. :-)

There are people working on proposals for "integer variadics" that would actually give meaning to things like list[10] (or at least to A[10] and A[N, M] where A is a tensor type) so I am reluctant to forbid this now -- we might have to allow it in the next release.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Mon Oct 12 19:43:33 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Mon, 12 Oct 2020 23:43:33 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602546213.19.0.406063167466.issue41972@roundup.psfhosted.org>


Change by Dennis Sweeney <sweeney.dennis650 at gmail.com>:


----------
pull_requests: +21650
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22679

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Mon Oct 12 19:50:35 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Mon, 12 Oct 2020 23:50:35 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602546635.12.0.22082934821.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

PR 22679 is a draft that does the two-way algorithm but also adds both of the tricks from Fredrik's implementation: a bit-set "bloom filter" and remembering the skip-distance between some pair of characters.

----------
Added file: https://bugs.python.org/file49511/bench_results.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Mon Oct 12 19:52:11 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 12 Oct 2020 23:52:11 +0000
Subject: [issue39481] Implement PEP 585 (Type Hinting Generics In Standard
 Collections)
In-Reply-To: <1580231817.93.0.47144630055.issue39481@roundup.psfhosted.org>
Message-ID: <1602546731.6.0.133243604959.issue39481@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 1c217652b690c184b43d8e2b6529a60a14e64328 by Saiyang Gou in branch '3.9':
[3.9] bpo-39481: Fix duplicate SimpleQueue type in test_genericalias.py (GH-22619) (#22624)
https://github.com/python/cpython/commit/1c217652b690c184b43d8e2b6529a60a14e64328


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39481>
_______________________________________

From report at bugs.python.org  Mon Oct 12 19:53:23 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 12 Oct 2020 23:53:23 +0000
Subject: [issue40422] Light refactor: create a common _Py_closerange API
In-Reply-To: <1588080944.1.0.768613011974.issue40422@roundup.psfhosted.org>
Message-ID: <1602546803.82.0.0571081199723.issue40422@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset 64eb259cc1e42a5f74b5911a518d2c50daa8d50b by Kyle Evans in branch 'master':
bpo-40422: Move _Py_*_SUPPRESS_IPH bits into _Py_closerange (GH-22672)
https://github.com/python/cpython/commit/64eb259cc1e42a5f74b5911a518d2c50daa8d50b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40422>
_______________________________________

From report at bugs.python.org  Mon Oct 12 19:55:51 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Mon, 12 Oct 2020 23:55:51 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602546951.24.0.156606383001.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

I used random_bench.py to compare PR 22679 to Master, and the results are in bench_results.txt. Results were varied. I suppose this depends on what cases we want to optimize for.

----------
Added file: https://bugs.python.org/file49512/random_bench.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Mon Oct 12 19:58:33 2020
From: report at bugs.python.org (Kyle Evans)
Date: Mon, 12 Oct 2020 23:58:33 +0000
Subject: [issue40422] Light refactor: create a common _Py_closerange API
In-Reply-To: <1588080944.1.0.768613011974.issue40422@roundup.psfhosted.org>
Message-ID: <1602547113.0.0.877426722033.issue40422@roundup.psfhosted.org>


Change by Kyle Evans <kevans at FreeBSD.org>:


----------
pull_requests: +21651
pull_request: https://github.com/python/cpython/pull/22680

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40422>
_______________________________________

From report at bugs.python.org  Mon Oct 12 20:37:09 2020
From: report at bugs.python.org (Ken Jin)
Date: Tue, 13 Oct 2020 00:37:09 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1602549429.5.0.597922980218.issue42010@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

Partly due to Python 3.9.0's nascency, I've not been able to find online cases of beginners getting confused by this specific behavior.

Wow I didn't know about integer variadics, assuming they make their way into 3.11, I can see why it'd be better to leave that in for now.

I'm going to close the PR, and if there are no more discussions in the next 30 days, I'll close this bug report too. Thanks for clarifying.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Mon Oct 12 20:53:21 2020
From: report at bugs.python.org (Emmanuel Arias)
Date: Tue, 13 Oct 2020 00:53:21 +0000
Subject: [issue37461] email.parser.Parser hang
In-Reply-To: <1561951273.26.0.821144691276.issue37461@roundup.psfhosted.org>
Message-ID: <1602550401.61.0.473158089472.issue37461@roundup.psfhosted.org>


Change by Emmanuel Arias <eamanu at yaerobi.com>:


----------
nosy: +eamanu

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37461>
_______________________________________

From report at bugs.python.org  Mon Oct 12 20:58:07 2020
From: report at bugs.python.org (Emmanuel Arias)
Date: Tue, 13 Oct 2020 00:58:07 +0000
Subject: [issue41822] Document the meaning of values for sys.float_info.rounds
In-Reply-To: <1600648706.73.0.507862170012.issue41822@roundup.psfhosted.org>
Message-ID: <1602550687.09.0.278744403351.issue41822@roundup.psfhosted.org>


Change by Emmanuel Arias <eamanu at yaerobi.com>:


----------
nosy: +eamanu

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41822>
_______________________________________

From report at bugs.python.org  Mon Oct 12 21:26:34 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 13 Oct 2020 01:26:34 +0000
Subject: [issue42023] Argparse: Add a "display" arg
In-Reply-To: <1602537496.16.0.894148688163.issue42023@roundup.psfhosted.org>
Message-ID: <1602552394.64.0.423740345241.issue42023@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +paul.j3, rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42023>
_______________________________________

From report at bugs.python.org  Tue Oct 13 01:15:39 2020
From: report at bugs.python.org (jayesh)
Date: Tue, 13 Oct 2020 05:15:39 +0000
Subject: [issue42024] Exception ignored in: <function
 WeakValueDictionary.__init__.<locals>.remove at 0x7f6a325f2ea0>
Message-ID: <1602566139.42.0.455519135805.issue42024@roundup.psfhosted.org>


New submission from jayesh <jaymahajan28 at gmail.com>:

Team,

I am getting python warning messages while run ansible.
Previously I was using python 3.5.3, but after read the below article, I upgraded it with python 3.5.4. 

ref: https://github.com/ansible/ansible/issues/21982

Still facing the same issues. Kindly find attached logs for the same and help us to solve this issue.

Thanks

----------
files: pthon-warning-3.5.4.txt
messages: 378539
nosy: jayesh007
priority: normal
severity: normal
status: open
title: Exception ignored in: <function WeakValueDictionary.__init__.<locals>.remove at 0x7f6a325f2ea0>
type: compile error
versions: Python 3.5
Added file: https://bugs.python.org/file49513/pthon-warning-3.5.4.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42024>
_______________________________________

From report at bugs.python.org  Tue Oct 13 01:55:13 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 13 Oct 2020 05:55:13 +0000
Subject: [issue42015] Order of decrementing reference counts in meth_dealloc
In-Reply-To: <1602512624.15.0.894803367223.issue42015@roundup.psfhosted.org>
Message-ID: <1602568513.55.0.756719742234.issue42015@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42015>
_______________________________________

From report at bugs.python.org  Tue Oct 13 02:46:47 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 13 Oct 2020 06:46:47 +0000
Subject: [issue41995] five possible Null Pointer Dereference bugs.
In-Reply-To: <1602330580.94.0.791834118141.issue41995@roundup.psfhosted.org>
Message-ID: <1602571607.18.0.0704437482487.issue41995@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 66c28f50c76e4f23af7146e0e580457c5fd6bde7 by Yunlongs in branch 'master':
bpo-41995: Fix null ptr deref in tracemalloc_copy_trace() (GH-22660)
https://github.com/python/cpython/commit/66c28f50c76e4f23af7146e0e580457c5fd6bde7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41995>
_______________________________________

From report at bugs.python.org  Tue Oct 13 02:47:43 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 13 Oct 2020 06:47:43 +0000
Subject: [issue41995] five possible Null Pointer Dereference bugs.
In-Reply-To: <1602330580.94.0.791834118141.issue41995@roundup.psfhosted.org>
Message-ID: <1602571663.16.0.60545487111.issue41995@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21652
pull_request: https://github.com/python/cpython/pull/22681

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41995>
_______________________________________

From report at bugs.python.org  Tue Oct 13 03:06:15 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 13 Oct 2020 07:06:15 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602572775.43.0.467538765927.issue41972@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> I used random_bench.py to compare PR 22679 to Master, and the results are in bench_results.txt. Results were varied. I suppose this depends on what cases we want to optimize for.

Lazy me: can you please use render results as a table? Use something like:

./python random_bench.py -o ref.json # master reference
# apply your change, rebuild Python
./python random_bench.py -o change.json # your change
python3 -m pyperf compare_to --table ref.json change.json

https://pyperf.readthedocs.io/en/latest/cli.html#compare-to-cmd

See also -G option.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 03:09:16 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 13 Oct 2020 07:09:16 +0000
Subject: [issue41995] five possible Null Pointer Dereference bugs.
In-Reply-To: <1602330580.94.0.791834118141.issue41995@roundup.psfhosted.org>
Message-ID: <1602572956.27.0.0516244447884.issue41995@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset afe86066e748076f970ccd277fc64fc51bea189b by Miss Skeleton (bot) in branch '3.9':
bpo-41995: Fix null ptr deref in tracemalloc_copy_trace() (GH-22660)
https://github.com/python/cpython/commit/afe86066e748076f970ccd277fc64fc51bea189b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41995>
_______________________________________

From report at bugs.python.org  Tue Oct 13 03:13:44 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 13 Oct 2020 07:13:44 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602573224.78.0.9016562552.issue41972@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

random_bench.py has really weird timings. Example:

(...)
Run 15: 1 warmup, 3 values, 2^15 loops
- warmup 1: 3.05 us (+504%)
- value 1: 42.8 ns (-92%)
- value 2: 1.18 us (+133%)
- value 3: 293 ns (-42%)
(...)
Run 21: 1 warmup, 3 values, 2^15 loops
- warmup 1: 167 us (+1073%)
- value 1: 162 ns (-99%)
- value 2: 39.1 us (+174%)
- value 3: 3.53 us (-75%)
needle=3: Mean +- std dev: 17.2 us +- 39.6 us

How is it possible that in the same process (same "Run"), timing changes between 42 ns and 1 180 ns? The std dev is really large.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 03:21:19 2020
From: report at bugs.python.org (denis)
Date: Tue, 13 Oct 2020 07:21:19 +0000
Subject: [issue42020] interpreter hangs forever on invalid input
In-Reply-To: <1602528652.49.0.982690015105.issue42020@roundup.psfhosted.org>
Message-ID: <1602573679.88.0.748146390937.issue42020@roundup.psfhosted.org>


denis <gantsevdenis at gmail.com> added the comment:

I do confirm that different terminals react differently (xterm doesn't hang)

Definitely not a python bug

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42020>
_______________________________________

From report at bugs.python.org  Tue Oct 13 04:24:23 2020
From: report at bugs.python.org (Tal Einat)
Date: Tue, 13 Oct 2020 08:24:23 +0000
Subject: [issue37903] IDLE Shell sidebar.
In-Reply-To: <1566370033.98.0.615651298891.issue37903@roundup.psfhosted.org>
Message-ID: <1602577463.71.0.322651452311.issue37903@roundup.psfhosted.org>


Change by Tal Einat <taleinat+python at gmail.com>:


----------
pull_requests: +21653
pull_request: https://github.com/python/cpython/pull/22682

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37903>
_______________________________________

From report at bugs.python.org  Tue Oct 13 05:01:16 2020
From: report at bugs.python.org (David Grellscheid)
Date: Tue, 13 Oct 2020 09:01:16 +0000
Subject: [issue42025] zoneinfo: fold not taken into account in time difference
 when tzinfo is equal
Message-ID: <1602579676.45.0.837169580708.issue42025@roundup.psfhosted.org>


New submission from David Grellscheid <d.grellscheid at gmail.com>:

I'm comparing two aware timestamps during a clock transition that differ only in their fold= value.

When taking the difference of two aware timestamps with the *same* tzinfo, the fold parameter is ignored. 

A difference between two timestamps with different tzinfo works correctly, with fold taken into account.

For the attached code I would expect all timedeltas to be the same, but I get:

0:00:00 Oslo_1   - Oslo_0
1:00:00 Berlin_1 - Oslo_0
1:00:00 Oslo_1   - Berlin_0
0:00:00 Berlin_1 - Berlin_0

----------
components: Library (Lib)
files: fold_bug.py
messages: 378545
nosy: d.grellscheid
priority: normal
severity: normal
status: open
title: zoneinfo: fold not taken into account in time difference when tzinfo is equal
versions: Python 3.9
Added file: https://bugs.python.org/file49514/fold_bug.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42025>
_______________________________________

From report at bugs.python.org  Tue Oct 13 05:11:58 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 13 Oct 2020 09:11:58 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1602580318.06.0.825220347723.issue40956@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +21654
pull_request: https://github.com/python/cpython/pull/22478

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Tue Oct 13 05:13:28 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 13 Oct 2020 09:13:28 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1602580408.13.0.991533319754.issue40956@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
nosy: +berker.peksag, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Tue Oct 13 05:28:18 2020
From: report at bugs.python.org (Chetan Palliwal)
Date: Tue, 13 Oct 2020 09:28:18 +0000
Subject: [issue42026] index function return first index for same element if
 repetitive in a list
Message-ID: <1602581298.61.0.984431029548.issue42026@roundup.psfhosted.org>


New submission from Chetan Palliwal <Chetanjain1313 at gmail.com>:

In [1]: po=[11,22,33,44,11,55,66,11,88]


In [2]: for lm in po:
   ...:     if lm==11:
   ...:         print("value is = {} and index is = {}".format(lm,po.index(lm)))
   ...:     else:
   ...:         print("value is = {} and index is = {}".format(lm,po.index(lm)))
   ...:
value is = 11 and index is = 0
value is = 22 and index is = 1
value is = 33 and index is = 2
value is = 44 and index is = 3
value is = 11 and index is = 0
value is = 55 and index is = 5
value is = 66 and index is = 6
value is = 11 and index is = 0
value is = 88 and index is = 8

----------
components: Library (Lib)
messages: 378546
nosy: chetanpalliwal13
priority: normal
severity: normal
status: open
title: index function return first index for same element if repetitive in a list
type: behavior
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42026>
_______________________________________

From report at bugs.python.org  Tue Oct 13 05:31:32 2020
From: report at bugs.python.org (Chetan Palliwal)
Date: Tue, 13 Oct 2020 09:31:32 +0000
Subject: [issue42026] index function return first index for same element if
 repetitive in a list
In-Reply-To: <1602581298.61.0.984431029548.issue42026@roundup.psfhosted.org>
Message-ID: <1602581492.14.0.918809826225.issue42026@roundup.psfhosted.org>


Chetan Palliwal <Chetanjain1313 at gmail.com> added the comment:

if an element in the list present more than 1 times in different order and we try to get the index of it python 3.6 is returning only the first index value for all places of that element in that list.

----------
Added file: https://bugs.python.org/file49515/index-python-issue.JPG

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42026>
_______________________________________

From report at bugs.python.org  Tue Oct 13 05:32:30 2020
From: report at bugs.python.org (David Grellscheid)
Date: Tue, 13 Oct 2020 09:32:30 +0000
Subject: [issue42025] zoneinfo: fold not taken into account in time difference
 when tzinfo is equal
In-Reply-To: <1602579676.45.0.837169580708.issue42025@roundup.psfhosted.org>
Message-ID: <1602581550.73.0.643291751232.issue42025@roundup.psfhosted.org>


David Grellscheid <d.grellscheid at gmail.com> added the comment:

To make it clear that this issue is not covered by ...

"Two such instances that differ only by the value of the fold attribute will not be distinguishable by any means other than an explicit access to the fold value." (PEP 495)

I have modified the timestamps by one minute, so that they differ in more than just the fold attribute.

All these should be 1:01:00 apart
0:01:00 Oslo_1   - Oslo_0
1:01:00 Berlin_1 - Oslo_0
1:01:00 Oslo_1   - Berlin_0
0:01:00 Berlin_1 - Berlin_0

----------
Added file: https://bugs.python.org/file49516/fold_bug_1minute.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42025>
_______________________________________

From report at bugs.python.org  Tue Oct 13 05:41:21 2020
From: report at bugs.python.org (David Grellscheid)
Date: Tue, 13 Oct 2020 09:41:21 +0000
Subject: [issue42025] zoneinfo: wrong time difference across transition when
 tzinfo is equal
In-Reply-To: <1602579676.45.0.837169580708.issue42025@roundup.psfhosted.org>
Message-ID: <1602582081.25.0.374748451768.issue42025@roundup.psfhosted.org>


David Grellscheid <d.grellscheid at gmail.com> added the comment:

Here's a third example, without fold= involved. The spring transition also does not work when the timezone in the difference is equal:

01:59:00 to 03:01:00 should be 2 minutes

All these should be 0:02:00 apart
1:02:00 Oslo_1   - Oslo_0
0:02:00 Berlin_1 - Oslo_0
0:02:00 Oslo_1   - Berlin_0
1:02:00 Berlin_1 - Berlin_0

----------
title: zoneinfo: fold not taken into account in time difference when tzinfo is equal -> zoneinfo: wrong time difference across transition when tzinfo is equal
Added file: https://bugs.python.org/file49517/spring_bug.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42025>
_______________________________________

From report at bugs.python.org  Tue Oct 13 05:43:25 2020
From: report at bugs.python.org (=?utf-8?q?J=C3=BCrgen_Gmach?=)
Date: Tue, 13 Oct 2020 09:43:25 +0000
Subject: [issue42004] Allow uploading files with SimpleHTTPRequestHandler
In-Reply-To: <1602377597.5.0.712668345738.issue42004@roundup.psfhosted.org>
Message-ID: <1602582205.82.0.227806940958.issue42004@roundup.psfhosted.org>


J?rgen Gmach <juergen.gmach at googlemail.com> added the comment:

Disclaimer: I am not cpython maintainer - I just wanted to give a bit of context for using `cgi.FieldStorage`.

Personally, I'd rather not include this in the std, but create a small package for PyPI. But that's only me.

Wait until you get feedback from a cpython maintainer.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42004>
_______________________________________

From report at bugs.python.org  Tue Oct 13 06:00:41 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 13 Oct 2020 10:00:41 +0000
Subject: [issue42026] index function return first index for same element if
 repetitive in a list
In-Reply-To: <1602581298.61.0.984431029548.issue42026@roundup.psfhosted.org>
Message-ID: <1602583241.15.0.591493391388.issue42026@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42026>
_______________________________________

From report at bugs.python.org  Tue Oct 13 06:00:22 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 13 Oct 2020 10:00:22 +0000
Subject: [issue42026] index function return first index for same element if
 repetitive in a list
In-Reply-To: <1602581298.61.0.984431029548.issue42026@roundup.psfhosted.org>
Message-ID: <1602583222.05.0.121669022776.issue42026@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

The index() method is working as expected.  This isn't a bug.

The easiest way to accomplish your goal is to use enumerate() with a list comprehension:

    >>> po = [11,22,33,44,11,55,66,11,88]
    >>> [i for i, value in enumerate(po) if value == 11]
    [0, 4, 7]

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42026>
_______________________________________

From report at bugs.python.org  Tue Oct 13 06:13:12 2020
From: report at bugs.python.org (John Belmonte)
Date: Tue, 13 Oct 2020 10:13:12 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1602583992.36.0.864256588446.issue38250@roundup.psfhosted.org>


John Belmonte <john at neggie.net> added the comment:

It's completely undocumented, but today I noticed that Flag.__contains__() is actually a subset operation.


    def __contains__(self, other):
        ...
        return other._value_ & self._value_ == other._value_

It's an unfortunate departure from the `set` type, which uses `in` for membership test and issubset() / `<=` for subset test.

For set operations, the Flag individual bits should be considered the members of a set (not Flag compound values, which are themselves equivalent to a set).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Tue Oct 13 06:19:45 2020
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Tue, 13 Oct 2020 10:19:45 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1602584385.99.0.761706019376.issue38250@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

Again, I disagree. `str` used to work like this in Py2.0 (or somewhere around then), only 'x' was in 'xyz', not 'xy'. Then Guido came to his senses. :-)

This is not set theory, this is mereology. You don't differentiate between a digit and a one-digit number, a char and a one-char string, and in the same way you shouldn't differentiate between a bit and a one-bit flag.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Tue Oct 13 06:24:21 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 13 Oct 2020 10:24:21 +0000
Subject: [issue42025] zoneinfo: wrong time difference across transition when
 tzinfo is equal
In-Reply-To: <1602579676.45.0.837169580708.issue42025@roundup.psfhosted.org>
Message-ID: <1602584661.18.0.403111256933.issue42025@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +p-ganssle

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42025>
_______________________________________

From report at bugs.python.org  Tue Oct 13 07:22:12 2020
From: report at bugs.python.org (David Grellscheid)
Date: Tue, 13 Oct 2020 11:22:12 +0000
Subject: [issue42025] zoneinfo: wrong time difference across transition when
 tzinfo is equal
In-Reply-To: <1602579676.45.0.837169580708.issue42025@roundup.psfhosted.org>
Message-ID: <1602588132.55.0.538051931854.issue42025@roundup.psfhosted.org>


David Grellscheid <d.grellscheid at gmail.com> added the comment:

OK, having read https://blog.ganssle.io/articles/2018/02/aware-datetime-arithmetic.html, this bizarreness is actually intended behaviour. It goes completely against my intuitive understanding of how this should come out. No additions are involved, just subtractions and equalities.

Can we get some big warning boxes in the documentation about this? :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42025>
_______________________________________

From report at bugs.python.org  Tue Oct 13 07:27:21 2020
From: report at bugs.python.org (John Belmonte)
Date: Tue, 13 Oct 2020 11:27:21 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1602588441.11.0.141327285902.issue38250@roundup.psfhosted.org>


John Belmonte <john at neggie.net> added the comment:

I agree that a bit and one-bit flag are the same.

> only 'x' was in 'xyz', not 'xy

I don't understand the comparison, because str 'a in b' tests if 'a' is a subsequence of 'b'.  It is not a subset operation ('xz' in 'xyz' is false).

I can understand the argument that Flag has a subset operator (currently __contains__), and given that one-bit flags can be used freely with the subset operator, there is no reason to add a bit membership operator.

However, since flag values are arguably a set of enabled bits, I think the use of `in` for subset is a confusing departure from the `set` API.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Tue Oct 13 07:42:16 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 13 Oct 2020 11:42:16 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602589336.02.0.56310137987.issue41972@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

FYI after I saw bench_results.txt, I wrote a pyperf PR to add geometric mean, to more easily summarize a benchmark suite :-D
https://github.com/psf/pyperf/pull/79

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 09:55:02 2020
From: report at bugs.python.org (Samuel Freilich)
Date: Tue, 13 Oct 2020 13:55:02 +0000
Subject: [issue41114] "TypeError: unhashable type" could often be more clear
In-Reply-To: <1593089297.5.0.960414313622.issue41114@roundup.psfhosted.org>
Message-ID: <1602597302.81.0.709881713279.issue41114@roundup.psfhosted.org>


Samuel Freilich <sfreilich at google.com> added the comment:

python-ideas thread: https://mail.python.org/archives/list/python-ideas at python.org/thread/B6OMGYIM47OVGOCZLEY3MEUJDFURJRDV/

The most minimal ideas from that seem to be:

1. Maybe link to the glossary from the error message (if links to documentation in error messages are permissible).

2. Add a glossary entry for "unhashable" for the sake of completeness (similar to how there are entries for both "immutable" and "mutable").

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41114>
_______________________________________

From report at bugs.python.org  Tue Oct 13 09:57:04 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 13 Oct 2020 13:57:04 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602597424.06.0.496320707189.issue41972@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 10:00:56 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 13 Oct 2020 14:00:56 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1602597656.81.0.354904914049.issue40956@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

What's the purpose of using AC, did the change improve performance?
It can make hard to track the code history.

----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Tue Oct 13 10:29:50 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 13 Oct 2020 14:29:50 +0000
Subject: [issue32793] smtplib: duplicated debug message
In-Reply-To: <1518080718.92.0.467229070634.issue32793@psf.upfronthosting.co.za>
Message-ID: <1602599390.15.0.777623431519.issue32793@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

3.7 only can be applied security fix.

https://cpython-devguide.readthedocs.io/#branchstatus

----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32793>
_______________________________________

From report at bugs.python.org  Tue Oct 13 10:32:17 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 13 Oct 2020 14:32:17 +0000
Subject: [issue32793] smtplib: duplicated debug message
In-Reply-To: <1518080718.92.0.467229070634.issue32793@psf.upfronthosting.co.za>
Message-ID: <1602599537.37.0.34074712189.issue32793@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
pull_requests: +21655
pull_request: https://github.com/python/cpython/pull/22683

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32793>
_______________________________________

From report at bugs.python.org  Tue Oct 13 10:35:34 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 13 Oct 2020 14:35:34 +0000
Subject: [issue32793] smtplib: duplicated debug message
In-Reply-To: <1518080718.92.0.467229070634.issue32793@psf.upfronthosting.co.za>
Message-ID: <1602599734.33.0.695823858876.issue32793@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
versions:  -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32793>
_______________________________________

From report at bugs.python.org  Tue Oct 13 10:38:04 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 13 Oct 2020 14:38:04 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1602599884.8.0.814614709501.issue40956@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

The primary reason is that it will be provide easy access to module state.

The first step in making sqlite3 support multiphase init was to create heap types. The second step is argument clinic. The third will be to use AC for module state. The last step will then be final multiphase support.

Also, IMHO, AC greatly improves the body of methods (readability => maintainability, hardened parsing of arguments)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Tue Oct 13 10:47:47 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 13 Oct 2020 14:47:47 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1602600467.0.0.105811237376.issue40956@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Also, see the comment from Victor here: https://github.com/python/cpython/pull/22478#issuecomment-702201260

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Tue Oct 13 11:02:08 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 13 Oct 2020 15:02:08 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1602601328.75.0.88202886027.issue40956@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

> Also, see the comment from Victor here: https://github.com/python/cpython/pull/22478#issuecomment-702201260

Okay got it

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Tue Oct 13 11:10:44 2020
From: report at bugs.python.org (Piotr Dobrogost)
Date: Tue, 13 Oct 2020 15:10:44 +0000
Subject: [issue36318] Adding support for setting the "disabled" attribute of
 loggers from logging.config.dictConfig
In-Reply-To: <1552761329.43.0.180278602772.issue36318@roundup.psfhosted.org>
Message-ID: <1602601844.46.0.953389144361.issue36318@roundup.psfhosted.org>


Piotr Dobrogost <bugs.python.org at p.dobrogost.net> added the comment:

I strongly agree with arguments given by the original poster. Stackoverflow's questions cited show the functionality of disabling logger is something people are looking for.
Disabling logger by setting high enough level seems to be a workaround at best (sys.maxsize - 
 really?). More in the spirit of an on/off toggle is a filter blocking all records but this clearly feels like another workaround for something which should have been (and in fact already is, albeit unofficially) a simple boolean flag.
Not hiding "disabled" property behind underscore might have been a good thing after all. Making it official and supported by dictConfig() would remove clearly expressed pain point of users of the logging module.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36318>
_______________________________________

From report at bugs.python.org  Tue Oct 13 11:19:22 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 13 Oct 2020 15:19:22 +0000
Subject: [issue32793] smtplib: duplicated debug message
In-Reply-To: <1518080718.92.0.467229070634.issue32793@psf.upfronthosting.co.za>
Message-ID: <1602602362.94.0.101994667615.issue32793@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:


New changeset 76b1913daf883b6592815d139f62f3a7fbe3c322 by Dong-hee Na in branch '3.8':
[3.8] bpo-32793: Fix a duplicate debug message in smtplib (GH-15341) (GH-22683)
https://github.com/python/cpython/commit/76b1913daf883b6592815d139f62f3a7fbe3c322


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32793>
_______________________________________

From report at bugs.python.org  Tue Oct 13 11:19:46 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 13 Oct 2020 15:19:46 +0000
Subject: [issue32793] smtplib: duplicated debug message
In-Reply-To: <1518080718.92.0.467229070634.issue32793@psf.upfronthosting.co.za>
Message-ID: <1602602386.75.0.0782905800615.issue32793@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

@ZackerySpytz Thank you for work :)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32793>
_______________________________________

From report at bugs.python.org  Tue Oct 13 11:41:02 2020
From: report at bugs.python.org (Kapil Sinha)
Date: Tue, 13 Oct 2020 15:41:02 +0000
Subject: [issue41917] Python 3.9rc2 fails to install matplotlib
In-Reply-To: <1601711365.63.0.761607861812.issue41917@roundup.psfhosted.org>
Message-ID: <1602603662.07.0.442515543933.issue41917@roundup.psfhosted.org>


Kapil Sinha <kapil.sinha at gmail.com> added the comment:

It still fails. its two weeks after it was first reported. matplotlib is the reason I installed python. I guess I will rollback to older versions one by one to find which one works.

----------
nosy: +kapil.sinha

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41917>
_______________________________________

From report at bugs.python.org  Tue Oct 13 12:12:16 2020
From: report at bugs.python.org (Zachary Ware)
Date: Tue, 13 Oct 2020 16:12:16 +0000
Subject: [issue42024] Exception ignored in: <function
 WeakValueDictionary.__init__.<locals>.remove at 0x7f6a325f2ea0>
In-Reply-To: <1602566139.42.0.455519135805.issue42024@roundup.psfhosted.org>
Message-ID: <1602605536.97.0.711197306499.issue42024@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

Python 3.5 is now at end-of-life as of September 5, 2020 with the release of 3.5.10, and will not be receiving any more changes.  3.5.4 itself has been obsolete since 3.5.5 was released in February 2018.

You'll need to update to at least Python 3.8.6 (which is the earliest version in bugfix support mode) to get anything changed in Python, but looking at the ansible issue you referenced, it seems likely that this has already been fixed.

----------
nosy: +zach.ware
resolution:  -> out of date
status: open -> pending
type: compile error -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42024>
_______________________________________

From report at bugs.python.org  Tue Oct 13 12:54:46 2020
From: report at bugs.python.org (=?utf-8?b?VsOhY2xhdiBCcm/FvmVr?=)
Date: Tue, 13 Oct 2020 16:54:46 +0000
Subject: [issue24651] Mock.assert* API is in user namespace
In-Reply-To: <1437119760.12.0.974021198911.issue24651@psf.upfronthosting.co.za>
Message-ID: <1602608086.44.0.926301448212.issue24651@roundup.psfhosted.org>


V?clav Bro?ek <vabr at google.com> added the comment:

As for the assert misspellings raising AttributeError -- that's not true of all of them, only those starting with "assret" or "assert" [1].

In my company, we recently cleaned up a bunch of other assert-misspellings, including cases where a real bug was masked in the code by that. That's why I filed https://bugs.python.org/issue41877.

IMO, the fact that the assert-misspellings issue is not completely fixed seems to increase the motivation to add a module-level assert.

While it's easy to add further misspellings to the check in [1], the general solution proposed in this ticket avoids a length whack-a-mole for code owners who would be able / willing to switch to a module-level assert.

[1] https://github.com/python/cpython/blob/master/Lib/unittest/mock.py#L634

----------
nosy: +vabr2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24651>
_______________________________________

From report at bugs.python.org  Tue Oct 13 13:10:31 2020
From: report at bugs.python.org (=?utf-8?b?VsOhY2xhdiBCcm/FvmVr?=)
Date: Tue, 13 Oct 2020 17:10:31 +0000
Subject: [issue41877] Check against misspellings of assert etc. in mock
In-Reply-To: <1601317157.88.0.730935461305.issue41877@roundup.psfhosted.org>
Message-ID: <1602609031.31.0.590339947694.issue41877@roundup.psfhosted.org>


V?clav Bro?ek <vabr at google.com> added the comment:

Thank you all for the informative replies (and sorry for my long silence, I was sick).

I agree that the general solution (module-level assert) is worth doing, and I just added the current motivation to https://bugs.python.org/issue24651.

I still think that the cost associated with bad misspellings compared to the effort to extend the existing solution (adding patterns to [1]) is strongly in favour of extending the solution: the recent clean-up we had cost us many hours of work and involved several people (especially cases with potential or real bugs being discovered after the fixed typos). Adding a pattern to [1] seems much cheaper than the cost it saves.

The general solution is unlikely to be implemented soon, and even once it is, migrating existing code to use it seems unrealistic from the cost perspective. That's why I think that adding the newly found patterns to [1] makes sense.


[1] https://github.com/python/cpython/blob/master/Lib/unittest/mock.py#L634

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41877>
_______________________________________

From report at bugs.python.org  Tue Oct 13 13:27:00 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Tue, 13 Oct 2020 17:27:00 +0000
Subject: [issue41756] Do not always use exceptions to return result from
 coroutine
In-Reply-To: <1599786636.95.0.884410425349.issue41756@roundup.psfhosted.org>
Message-ID: <1602610020.71.0.642577281433.issue41756@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:


New changeset cfb0f57ff876ab3d04ff144f19eda58844981643 by Vladimir Matveev in branch 'master':
bpo-41756: Export PyGen_Send and wrap it in if-defs (#22677)
https://github.com/python/cpython/commit/cfb0f57ff876ab3d04ff144f19eda58844981643


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41756>
_______________________________________

From report at bugs.python.org  Tue Oct 13 14:16:14 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 13 Oct 2020 18:16:14 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1602612974.51.0.178698275957.issue40956@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

By the way, what's the preferred way to benchmark performance?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Tue Oct 13 14:36:52 2020
From: report at bugs.python.org (Colin)
Date: Tue, 13 Oct 2020 18:36:52 +0000
Subject: [issue42027] /passive run of Windows installer fail silently on Win7
Message-ID: <1602614212.55.0.749302354325.issue42027@roundup.psfhosted.org>


New submission from Colin <colin.bounouar at gmail.com>:

As expected, Python 3.9.0 cannot be installed on Windows 7. 

Running the installer displays a message clearly stating this. 

However, running the installer in passive mode (/passive) is expected to display errors that might occur. As stated in https://docs.python.org//3.9/using/windows.html#installing-without-ui

But this is not the case, nothing is displayed when launching the installer in passive mode.

I would expect the same message as in the UI.

----------
components: Installation, Windows
messages: 378572
nosy: colin-b, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: /passive run of Windows installer fail silently on Win7
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42027>
_______________________________________

From report at bugs.python.org  Tue Oct 13 16:04:50 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 13 Oct 2020 20:04:50 +0000
Subject: [issue40422] Light refactor: create a common _Py_closerange API
In-Reply-To: <1588080944.1.0.768613011974.issue40422@roundup.psfhosted.org>
Message-ID: <1602619490.36.0.262059423306.issue40422@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 7992579cd27f14f472acc37aca537eec55f681ef by Kyle Evans in branch 'master':
bpo-40422: Move _Py_closerange to fileutils.c (GH-22680)
https://github.com/python/cpython/commit/7992579cd27f14f472acc37aca537eec55f681ef


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40422>
_______________________________________

From report at bugs.python.org  Tue Oct 13 16:06:17 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 13 Oct 2020 20:06:17 +0000
Subject: [issue40422] Light refactor: create a common _Py_closerange API
In-Reply-To: <1588080944.1.0.768613011974.issue40422@roundup.psfhosted.org>
Message-ID: <1602619577.0.0.107139760183.issue40422@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks Kyle Evans!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40422>
_______________________________________

From report at bugs.python.org  Tue Oct 13 16:42:11 2020
From: report at bugs.python.org (Hassan Abouelela)
Date: Tue, 13 Oct 2020 20:42:11 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1601567658.27.0.420109981563.issue41904@roundup.psfhosted.org>
Message-ID: <1602621731.68.0.416678338781.issue41904@roundup.psfhosted.org>


Hassan Abouelela <abouelelahassan at gmail.com> added the comment:

If having an arbitrary time returned from the function is an issue, why not use a fixed time, say 0 UTC, representing the start of the day. This would mean that datetime.today is date.today, with an (arguably) meaningless timestamp to make it a datetime object.

----------
nosy: +HassanAbouelela

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Tue Oct 13 17:04:17 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 13 Oct 2020 21:04:17 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602623057.51.0.41332997237.issue41972@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I compared PR 22679 using the commit 77f0a23e7a9fb247101b9b14a060c4ba1c4b87a5 as the reference using random_bench.py.

For a bunch of cases it's slower, for some others it's faster.

My modified pyperf computes a geometric mean of: 0.70 (faster).

$ PYTHONPATH=~/myprojects/pyperf/ python3 -m pyperf compare_to ref.json pr22679.json -G
Slower (4):
- needle=8: 816 us +- 227 us -> 1.13 ms +- 0.60 ms: 1.38x slower (+38%)
- needle=16: 579 us +- 208 us -> 780 us +- 391 us: 1.35x slower (+35%)
- needle=7: 865 us +- 301 us -> 1.15 ms +- 0.70 ms: 1.33x slower (+33%)
- needle=9: 827 us +- 250 us -> 1.04 ms +- 0.53 ms: 1.26x slower (+26%)

Faster (18):
- needle=3442: 2.24 ms +- 1.17 ms -> 846 us +- 895 us: 2.65x faster (-62%)
- needle=301: 1.72 ms +- 1.13 ms -> 652 us +- 774 us: 2.64x faster (-62%)
- needle=5164: 2.51 ms +- 1.24 ms -> 991 us +- 972 us: 2.53x faster (-60%)
- needle=1529: 2.43 ms +- 1.14 ms -> 967 us +- 841 us: 2.51x faster (-60%)
- needle=2: 660 ns +- 1060 ns -> 263 ns +- 627 ns: 2.50x faster (-60%)
- needle=11621: 2.40 ms +- 1.02 ms -> 960 us +- 931 us: 2.50x faster (-60%)
- needle=679: 2.48 ms +- 1.11 ms -> 1.03 ms +- 0.95 ms: 2.42x faster (-59%)
- needle=1019: 2.48 ms +- 1.28 ms -> 1.08 ms +- 0.99 ms: 2.30x faster (-56%)
- needle=2294: 2.47 ms +- 1.17 ms -> 1.07 ms +- 0.93 ms: 2.30x faster (-56%)
- needle=452: 2.14 ms +- 0.99 ms -> 963 us +- 956 us: 2.23x faster (-55%)
- needle=17432: 2.24 ms +- 1.00 ms -> 1.12 ms +- 0.90 ms: 2.00x faster (-50%)
- needle=7747: 2.24 ms +- 1.18 ms -> 1.14 ms +- 0.99 ms: 1.97x faster (-49%)
- needle=26149: 2.29 ms +- 0.85 ms -> 1.33 ms +- 0.98 ms: 1.72x faster (-42%)
- needle=58837: 2.24 ms +- 1.00 ms -> 1.35 ms +- 0.94 ms: 1.66x faster (-40%)
- needle=88256: 2.40 ms +- 0.97 ms -> 1.52 ms +- 0.88 ms: 1.58x faster (-37%)
- needle=39224: 2.20 ms +- 1.00 ms -> 1.50 ms +- 0.92 ms: 1.46x faster (-32%)
- needle=88: 584 us +- 271 us -> 462 us +- 324 us: 1.26x faster (-21%)
- needle=1: 24.7 ns +- 2.4 ns -> 23.8 ns +- 2.1 ns: 1.04x faster (-4%)
Benchmark hidden because not significant (10): needle=3, needle=4, needle=5, needle=6, needle=10, needle=25, needle=38, needle=58, needle=133, needle=200

Geometric mean: 0.70 (faster)


22:12:11 vstinner at apu$ PYTHONPATH=~/myprojects/pyperf/ python3 -m pyperf compare_to ref.json pr22679.json --table -G
+----------------+---------+------------------------------+
| Benchmark      | ref     | pr22679                      |
+================+=========+==============================+
| needle=8       | 816 us  | 1.13 ms: 1.38x slower (+38%) |
+----------------+---------+------------------------------+
| needle=16      | 579 us  | 780 us: 1.35x slower (+35%)  |
+----------------+---------+------------------------------+
| needle=7       | 865 us  | 1.15 ms: 1.33x slower (+33%) |
+----------------+---------+------------------------------+
| needle=9       | 827 us  | 1.04 ms: 1.26x slower (+26%) |
+----------------+---------+------------------------------+
| needle=1       | 24.7 ns | 23.8 ns: 1.04x faster (-4%)  |
+----------------+---------+------------------------------+
| needle=88      | 584 us  | 462 us: 1.26x faster (-21%)  |
+----------------+---------+------------------------------+
| needle=39224   | 2.20 ms | 1.50 ms: 1.46x faster (-32%) |
+----------------+---------+------------------------------+
| needle=88256   | 2.40 ms | 1.52 ms: 1.58x faster (-37%) |
+----------------+---------+------------------------------+
| needle=58837   | 2.24 ms | 1.35 ms: 1.66x faster (-40%) |
+----------------+---------+------------------------------+
| needle=26149   | 2.29 ms | 1.33 ms: 1.72x faster (-42%) |
+----------------+---------+------------------------------+
| needle=7747    | 2.24 ms | 1.14 ms: 1.97x faster (-49%) |
+----------------+---------+------------------------------+
| needle=17432   | 2.24 ms | 1.12 ms: 2.00x faster (-50%) |
+----------------+---------+------------------------------+
| needle=452     | 2.14 ms | 963 us: 2.23x faster (-55%)  |
+----------------+---------+------------------------------+
| needle=2294    | 2.47 ms | 1.07 ms: 2.30x faster (-56%) |
+----------------+---------+------------------------------+
| needle=1019    | 2.48 ms | 1.08 ms: 2.30x faster (-56%) |
+----------------+---------+------------------------------+
| needle=679     | 2.48 ms | 1.03 ms: 2.42x faster (-59%) |
+----------------+---------+------------------------------+
| needle=11621   | 2.40 ms | 960 us: 2.50x faster (-60%)  |
+----------------+---------+------------------------------+
| needle=2       | 660 ns  | 263 ns: 2.50x faster (-60%)  |
+----------------+---------+------------------------------+
| needle=1529    | 2.43 ms | 967 us: 2.51x faster (-60%)  |
+----------------+---------+------------------------------+
| needle=5164    | 2.51 ms | 991 us: 2.53x faster (-60%)  |
+----------------+---------+------------------------------+
| needle=301     | 1.72 ms | 652 us: 2.64x faster (-62%)  |
+----------------+---------+------------------------------+
| needle=3442    | 2.24 ms | 846 us: 2.65x faster (-62%)  |
+----------------+---------+------------------------------+
| Geometric mean | (ref)   | 0.70 (faster)                |
+----------------+---------+------------------------------+

Not significant (10): needle=5; needle=4; needle=38; needle=10; needle=6; needle=200; needle=58; needle=25; needle=3; needle=133

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 17:15:02 2020
From: report at bugs.python.org (xpdseth)
Date: Tue, 13 Oct 2020 21:15:02 +0000
Subject: [issue42028] Regression in mimetypes for image/bmp
Message-ID: <1602623702.59.0.922962266093.issue42028@roundup.psfhosted.org>


New submission from xpdseth <xpdseth at gmail.com>:

Please check the following short examples of the issue:

Status: Downloaded newer image for python:3.7.4
Python 3.7.4 (default, Oct 17 2019, 05:59:21)
[GCC 8.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import mimetypes
>>> str(mimetypes.guess_extension('image/bmp'))
'.bmp'


Status: Downloaded newer image for python:3.7.5
Python 3.7.5 (default, Nov 23 2019, 05:59:34)
[GCC 8.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import mimetypes
>>> str(mimetypes.guess_extension('image/bmp'))
'None'
>>>

Status: Downloaded newer image for python:latest
Python 3.9.0 (default, Oct  6 2020, 21:52:53)
[GCC 8.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import mimetypes
>>> str(mimetypes.guess_extension('image/bmp'))
'None'


I believe the issue is introduced here by duplicating the bmp key in types_map/_types_map_default

'.bmp'    : 'image/bmp'
https://github.com/python/cpython/pull/14375/files#diff-aed43839a49bace08b60186baa4b27ad69ecd6b61f928bd696b4fb670750774fR490

 '.bmp'    : 'image/x-ms-bmp',
https://github.com/python/cpython/pull/14375/files#diff-aed43839a49bace08b60186baa4b27ad69ecd6b61f928bd696b4fb670750774fR502

----------
components: Library (Lib)
messages: 378577
nosy: xpdseth
priority: normal
pull_requests: 21656
severity: normal
status: open
title: Regression in mimetypes for image/bmp
type: behavior
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42028>
_______________________________________

From report at bugs.python.org  Tue Oct 13 17:30:39 2020
From: report at bugs.python.org (Tim Peters)
Date: Tue, 13 Oct 2020 21:30:39 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602624639.18.0.877103319497.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

> For a bunch of cases it's slower, for some others it's faster.

I have scant real idea what you're doing, but in the output you showed 4 output lines are labelled "slower" but 18 are labelled "faster".

What you wrote just above appears to say the reverse (I'd call 18 "a bunch" compared to 4 "some others").

Could please state plainly which of {status quo, PR} is faster on an output line labelled "faster"?

My a priori guess was that the PR had the highest chance of being slower when the needle is short and is found in the haystack early on. Then preprocessing time accounts for a relatively higher percentage of the total time taken, and the PR's preprocessing is more expensive than the status quo's.

The alphabet size here is small (just 26 possible letters, from `ascii_uppercase`), so it's quite likely that a short needle _will_ be found early on in a long haystack.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 17:42:49 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Tue, 13 Oct 2020 21:42:49 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602625369.85.0.309239722979.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

bench_table.txt gives my results (`ref` is Master, `change` is with PR 22679).
The change gives 342 faster cases and 275 slower cases, and 9 cases with no change.

I chose a random word of length 10**6 with a zipf character distribution for the haystack, then 20 random needles (also zipf) of each length and tested those same needles and haystack for both.

I ran then with this:

from lots_of_benches import needles, haystack
needles: list[str]
haystack: str

from pyperf import Runner
runner = Runner()

for needle in needles:
    n = len(needle)
    abbrev = needle if n <= 10 else f"{needle[:10]}..."
    runner.timeit(
        name=f"length={n}, value={abbrev}",
        stmt=f"needle in haystack",
        globals=globals(),
    )

----------
Added file: https://bugs.python.org/file49518/bench_table.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 17:45:25 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 13 Oct 2020 21:45:25 +0000
Subject: [issue30934] Document how to run coverage for repository idlelib
 files.
In-Reply-To: <1500081585.35.0.923637622202.issue30934@psf.upfronthosting.co.za>
Message-ID: <1602625525.33.0.663695786863.issue30934@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Tal, this is an existing issue about documenting how to run IDLE coverage.  It was left open to add something about the *nix equivalent of my Windows instructions.  I would like to finish this, with updates elsewhere in the text.

I'm dubious about Louie's patch (PR 2733) for multiple reasons: it starts with venv's, which I consider a separate issue; it gives the commands that might go in a script, but does not comprise a script itself; I cannot tell if it uses an IDLE specific .coverage.  Louie ceased IDLE involvement in Sept 2017, so I am closing his patch in favor of whatever you might contribute.

The .coveragerc copied into the README is missing some additions, and I plan to add some annotations to the original.  Do you think it better to have a copy in README.txt, or a separate .coveragerc file in idle_test?  Same question for cover.bat.

"5. Test Coverage" begins with "Install the coverage package into your Python 3.6 site-packages directory."  That should be '3.x' or 'the most recent installed Python possible', so it is most likely to be compatible with current master branch python.  I should also mention that we only need coverage on master, and have other revisions in mind.

Cheryl mentioned above instructions for coverage of all IDLE tests.  I have the command, commented out, in my original cover.bat.  After retesting, I could add it, commented out, to the copy.

----------
nosy: +taleinat -wohlganger
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30934>
_______________________________________

From report at bugs.python.org  Tue Oct 13 17:59:23 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 13 Oct 2020 21:59:23 +0000
Subject: [issue41625] Add splice() to the os module
In-Reply-To: <1598284638.54.0.211220433787.issue41625@roundup.psfhosted.org>
Message-ID: <1602626363.02.0.552810106955.issue41625@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Heads up: I plant to land this next week in case someone could to do a review or has something against

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41625>
_______________________________________

From report at bugs.python.org  Tue Oct 13 18:03:35 2020
From: report at bugs.python.org (Tim Peters)
Date: Tue, 13 Oct 2020 22:03:35 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602626615.95.0.701668883293.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Dennis, would it be possible to isolate some of the cases with more extreme results and run them repeatedly under the same timing framework, as a test of how trustworthy the _framework_ is? From decades of bitter experience, most benchmarking efforts end up chasing ghosts ;-)

For example, this result:

length=3442, value=ASXABCDHAB...  | 289 us  | 2.36 ms: 8.19x slower (+719%) 

Is that real, or an illusion?

Since the alphabet has only 26 letters, it's all but certain that a needle that long has more than one instance of every letter. So the status quo's "Bloom filter" will have every relevant bit set, rendering its _most_ effective speedup trick useless. That makes it hard (but not impossible) to imagine how it ends up being so much faster than a method with more powerful analysis to exploit.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 18:47:20 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Tue, 13 Oct 2020 22:47:20 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602629240.85.0.745692176318.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

Another algorithmic possibility: Instead of the bitset, we could have a stack-allocated

    uint8_t jump[32]; // maybe 64? Maybe uint16_t?

It would say this: If the last character lined up in the haystack is congruent to i mod (1 << 8), then jump ahead by (neede_len if jump[i]==255 else jump[i]), where jump[i] gives the distance between the end of the needle and the last occurrence in the needle of a character congruent to i.

Is this sort of constant-but-more-than-a-few-bytes stack-space an acceptable constant memory cost? If so, I believe that could be a big improvement.

There are also a bunch of little tweaks that could be done here: For example, should a hypothetical jump-table jump to line up the last character in the needle, or jump to line up the middle character in the needle? The max from two tables? Should we search for the last characters to be equal, or just make sure the last character is in the needle-bit-set (like in the PR)? Should there be a second bit-set for the right half of the string? Should there be a skip value computed for the last character as well as the middle character (middle character only in the PR)? etc. etc. I'll be sure to try some of these things.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 18:51:18 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Tue, 13 Oct 2020 22:51:18 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602629478.65.0.786615343243.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

@Tim I got this again for that benchmark:

length=3442, value=ASXABCDHAB...: Mean +- std dev: 2.39 ms +- 0.01 ms

Unfortunately not a ghost.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 18:56:10 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Tue, 13 Oct 2020 22:56:10 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602629770.64.0.874726438939.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

That test needle happened to end with a G and not have another G until much earlier. The status quo took advantage of that, but the PR only takes advantage of the skip value for a certain middle character. Perhaps it could do both.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 19:57:55 2020
From: report at bugs.python.org (Kevin)
Date: Tue, 13 Oct 2020 23:57:55 +0000
Subject: [issue42029] Remove dynload_dl.c
Message-ID: <1602633475.18.0.479019652279.issue42029@roundup.psfhosted.org>


New submission from Kevin <kadler at us.ibm.com>:

dynload_dl.c is no longer referenced anywhere in the code. It was used to support dynamic loading on IRIX 4 and DYNIX, but those platforms were dropped in https://github.com/cpython/cpython/commit/b9949dbe6c20537b7821f25fc1eeb4e7f3faabff. Considering that commit removes all references to dynload_dl, I suspect it was an oversight that it was not removed in that commit.

----------
components: Interpreter Core
messages: 378586
nosy: kadler
priority: normal
severity: normal
status: open
title: Remove dynload_dl.c

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42029>
_______________________________________

From report at bugs.python.org  Tue Oct 13 19:59:09 2020
From: report at bugs.python.org (Kevin)
Date: Tue, 13 Oct 2020 23:59:09 +0000
Subject: [issue42029] Remove dynload_dl.c
In-Reply-To: <1602633475.18.0.479019652279.issue42029@roundup.psfhosted.org>
Message-ID: <1602633549.66.0.906779263542.issue42029@roundup.psfhosted.org>


Kevin <kadler at us.ibm.com> added the comment:

Sorry, the correct link is https://github.com/python/cpython/commit/b9949dbe6c20537b7821f25fc1eeb4e7f3faabff

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42029>
_______________________________________

From report at bugs.python.org  Tue Oct 13 20:02:02 2020
From: report at bugs.python.org (Kevin)
Date: Wed, 14 Oct 2020 00:02:02 +0000
Subject: [issue42029] Remove dynload_dl.c
In-Reply-To: <1602633475.18.0.479019652279.issue42029@roundup.psfhosted.org>
Message-ID: <1602633722.5.0.669118741462.issue42029@roundup.psfhosted.org>


Change by Kevin <kadler at us.ibm.com>:


----------
keywords: +patch
pull_requests: +21657
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22687

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42029>
_______________________________________

From report at bugs.python.org  Tue Oct 13 20:08:54 2020
From: report at bugs.python.org (Kevin)
Date: Wed, 14 Oct 2020 00:08:54 +0000
Subject: [issue42030] Drop support for dynload_aix
Message-ID: <1602634134.46.0.704375608696.issue42030@roundup.psfhosted.org>


New submission from Kevin <kadler at us.ibm.com>:

Python has supported using dynload_shlib (using dlopen) on AIX since https://github.com/python/cpython/commit/c19c5a62aef7dce0e8147655b0d2f087965fae75 in 2003. While I have not found a definitive timeline of when AIX gained support for dlopen, I have found references going back to at least 2000. Considering this is now 20 years later and all supported AIX versions support dlopen, I suspect nobody has used or tested this code path in quite some time. I propose removing this support under PEP 11.

----------
components: Interpreter Core
messages: 378588
nosy: kadler
priority: normal
severity: normal
status: open
title: Drop support for dynload_aix

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42030>
_______________________________________

From report at bugs.python.org  Tue Oct 13 20:45:55 2020
From: report at bugs.python.org (Damian Yurzola)
Date: Wed, 14 Oct 2020 00:45:55 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1601567658.27.0.420109981563.issue41904@roundup.psfhosted.org>
Message-ID: <1602636355.71.0.447041375461.issue41904@roundup.psfhosted.org>


Damian Yurzola <damian at yurzola.net> added the comment:

I searched all of github and there seem to be ~350K entries for datetime.today
I think this supports steven.daprano point against removal.

I could not spot any major library in a quick cursory look.

However I do see many calls that look a lot like they should have been

datetime.date.today rather than datetime.datetime.today.

You see people basically dropping the hours, minutes, secs.

And you also see people doing date math on datetime.date.today which will result in different answers through out the day.

I like HassanAbouelela's idea that datetime.datetime.today should return   an arbitrary fixed time rather than an arbitrary variable time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Tue Oct 13 20:53:16 2020
From: report at bugs.python.org (Ned Deily)
Date: Wed, 14 Oct 2020 00:53:16 +0000
Subject: [issue21572] Use generic license web page rather than requiring
 release-specific license pages
In-Reply-To: <1400972536.12.0.296163327906.issue21572@psf.upfronthosting.co.za>
Message-ID: <1602636796.04.0.611192431473.issue21572@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
pull_requests: +21659
pull_request: https://github.com/python/cpython/pull/22688

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21572>
_______________________________________

From report at bugs.python.org  Tue Oct 13 20:53:15 2020
From: report at bugs.python.org (Ned Deily)
Date: Wed, 14 Oct 2020 00:53:15 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1602636795.92.0.0602613591659.issue41939@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
pull_requests: +21658
pull_request: https://github.com/python/cpython/pull/22688

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Tue Oct 13 21:06:06 2020
From: report at bugs.python.org (Tim Peters)
Date: Wed, 14 Oct 2020 01:06:06 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602637566.35.0.0761568422299.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Dennis, I'm delighted that the timing harness pointed out an actual glitch, and that it was so (seemingly) straightforward to identify the algorithmic cause. This gives me increased confidence that this project can be pushed to adoption, and your name will be hallowed in Python's history :-)

I have no problem with increasing the constant space. Fredrik was Python's Unicode pioneer too, so was naturally repelled by any scheme that required additional space proportional to the alphabet size. The "Bloom filter" is the tiny bit left of Daniel Sunday's algorithm, which actually has no such thing ;-) Along the lines you suggested, Sunday precomputes a vector indexed by characters, each entry giving the distance to that character's rightmost index in the needle.  The "Bloom filter" throws that vector away and only saves hashes of the indices where the vector holds its maximum possible value.

Note that there's nothing magical about "right to left" in Sunday's algorithm (or, really, in our current use of the Bloom filter). Characters can be compared in any order, and when there's a mismatch, the skip vector can be indexed by the character one beyond the search window to often find a decent amount to skip.  Indeed, in apps where the expected frequency of characters is known, Sunday's algorithm is often adapted to compare the least-frequently expected needle character first.

The downside isn't really the space, but that stack space is uninitialized trash. Initializing it to a known value increases preprocessing overhead, albeit independent of needle length. So the relative overhead is higher the shorter the needle.

I agree expanding it beyond the tiny bit vector is likely to be significantly helpful.  There's no discomfort at all to me if, e.g., it stored 32-bit counts and is indexed by the last 6 bits of the character.  That's a measly 256 bytes in all.

It's also possible that a more capable "Sunday-ish vector" of this kind would render the current `skip` trick usually useless by comparison. Or not ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 21:11:02 2020
From: report at bugs.python.org (Dobatymo)
Date: Wed, 14 Oct 2020 01:11:02 +0000
Subject: [issue36439] Inconsistencies with datetime.fromtimestamp(t) when t < 0
In-Reply-To: <1553613506.18.0.935251324399.issue36439@roundup.psfhosted.org>
Message-ID: <1602637862.36.0.29855689809.issue36439@roundup.psfhosted.org>


Dobatymo <the-real-hazzard at outlook.com> added the comment:

> I've encountered an issue on anaconda python on windows 10 v1909 which I suspect is related. It looks like no dates in 1970 can be converted to datetime.timestamp():

Yeah... there is more related weirdness going on.

>>> datetime(1970, 1, 3).astimezone(timezone.utc)
datetime.datetime(1970, 1, 2, 16, 0, tzinfo=datetime.timezone.utc)
>>> datetime(1970, 1, 2).astimezone(timezone.utc)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
OSError: [Errno 22] Invalid argument
>>> datetime(1970, 1, 1, 16, 0, tzinfo=timezone.utc)
datetime.datetime(1970, 1, 1, 16, 0, tzinfo=datetime.timezone.utc)

----------
nosy: +Dobatymo

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36439>
_______________________________________

From report at bugs.python.org  Tue Oct 13 21:18:42 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 14 Oct 2020 01:18:42 +0000
Subject: [issue27351] Update ConfigParser doc: accepts iterables,
 not just lists
In-Reply-To: <1466311827.21.0.0107030173129.issue27351@psf.upfronthosting.co.za>
Message-ID: <1602638322.54.0.729744594298.issue27351@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
title: Unexpected ConfigParser.read() behavior when passed fileobject -> Update ConfigParser doc: accepts iterables, not just lists
versions:  -Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27351>
_______________________________________

From report at bugs.python.org  Tue Oct 13 21:39:03 2020
From: report at bugs.python.org (Ned Deily)
Date: Wed, 14 Oct 2020 01:39:03 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1602639543.94.0.463428463476.issue41939@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 6a48518e8dac3521ff387ee67cdf33783114a257 by Ned Deily in branch 'master':
bpo-41939: always enable test_site.test_license_exists_at_url (GH-22688)
https://github.com/python/cpython/commit/6a48518e8dac3521ff387ee67cdf33783114a257


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Tue Oct 13 21:39:26 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 14 Oct 2020 01:39:26 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1602639566.47.0.883264076483.issue41939@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21660
pull_request: https://github.com/python/cpython/pull/22689

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Tue Oct 13 21:39:31 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Wed, 14 Oct 2020 01:39:31 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1602636355.71.0.447041375461.issue41904@roundup.psfhosted.org>
Message-ID: <20201014013902.GS3669@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

On Wed, Oct 14, 2020 at 12:45:55AM +0000, Damian Yurzola wrote:

> And you also see people doing date math on datetime.date.today which 
> will result in different answers through out the day.

Yes? Is this a problem? If I ask the question "How long is it until 
Christmas?" the answer should be different if I ask on one minute past 
midnight on December 24 or one minute to midnight.

I daresay that you are correct that many (maybe a majority) of uses of 
datetime.today are conceptually better as date.today, but not all of 
them.

> I like HassanAbouelela's idea that datetime.datetime.today should 
> return an arbitrary fixed time rather than an arbitrary variable time.

But it's not an arbitrary variable time. It is just a high-resolution 
(down to the microsecond) version of "today", instead of the 
low-resolution (down to a single day) date.today.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Tue Oct 13 21:39:38 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 14 Oct 2020 01:39:38 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1602639578.03.0.61689275312.issue41939@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21661
pull_request: https://github.com/python/cpython/pull/22690

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Tue Oct 13 21:49:32 2020
From: report at bugs.python.org (Benjamin Peterson)
Date: Wed, 14 Oct 2020 01:49:32 +0000
Subject: [issue42029] Remove dynload_dl.c
In-Reply-To: <1602633475.18.0.479019652279.issue42029@roundup.psfhosted.org>
Message-ID: <1602640172.32.0.309654768073.issue42029@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset 0cafcd3c56c9475913d8d4fd0223c297dbb70ac6 by Kevin Adler in branch 'master':
closes bpo-42029: Remove dynload_dl (GH-22687)
https://github.com/python/cpython/commit/0cafcd3c56c9475913d8d4fd0223c297dbb70ac6


----------
nosy: +benjamin.peterson
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42029>
_______________________________________

From report at bugs.python.org  Tue Oct 13 21:59:20 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 14 Oct 2020 01:59:20 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1602640760.58.0.638077667756.issue41939@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8b4642d3288e187faad24283c949ecf53fecad5b by Miss Skeleton (bot) in branch '3.8':
bpo-41939: always enable test_site.test_license_exists_at_url (GH-22688)
https://github.com/python/cpython/commit/8b4642d3288e187faad24283c949ecf53fecad5b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Tue Oct 13 21:59:50 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 14 Oct 2020 01:59:50 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1602640790.09.0.222524892743.issue41939@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 881a13cad534cf3fe4474579c22235a15d3ba27b by Miss Skeleton (bot) in branch '3.9':
bpo-41939: always enable test_site.test_license_exists_at_url (GH-22688)
https://github.com/python/cpython/commit/881a13cad534cf3fe4474579c22235a15d3ba27b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Tue Oct 13 22:12:03 2020
From: report at bugs.python.org (Ned Deily)
Date: Wed, 14 Oct 2020 02:12:03 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1602641523.03.0.466055522898.issue41939@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thanks for the fix, Victor.

Sometime after filing this, I remembered that we had seen a similar problem some years ago and found bpo-21572 in which I had changed Lib/site.py to no longer use a release-dependent URL for the license file - which is why the check to skip if on a pre-release had been added previously to test_license_exists_at_url. So I should have removed the skip in test_site at the same time as it is no longer needed and hides problems like this until the final release.  PR 22688 and its backports remove the skip.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Tue Oct 13 22:34:55 2020
From: report at bugs.python.org (Hassan Abouelela)
Date: Wed, 14 Oct 2020 02:34:55 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1601567658.27.0.420109981563.issue41904@roundup.psfhosted.org>
Message-ID: <1602642895.04.0.736283117078.issue41904@roundup.psfhosted.org>


Hassan Abouelela <abouelelahassan at gmail.com> added the comment:

> "How long is it until Christmas?" the answer should be different if I ask on one minute past midnight on December 24 or one minute to midnight.

No disagreement there, but that doesn't change based on having the current precise time (the current implementation) vs the start of the current day (my recommendation), especially if you are just calculating the difference in days. In both cases, running it one minute before midnight would return the 23rd, running it one minute after would return the 24th.

The only difference between both is that a direct subtraction from the beginning of the day, with the current implementation, would result in one-point-something days, instead of one day. If that is the case, what is the point of having datetime.today? It should be, like the original issue suggested, phased out.

The benefit doesn't lie there, rather it lies in having direct access to date.today in a datetime format, so you can perform math on it with datetime objects. This, in my opinion, would be more consistent with other languages, and more importantly would make datetime.today logical, as it would be date.today in datetime form, instead of datetime.now.

> many (maybe a majority) of uses of datetime.today are conceptually better as date.today, but not all of them.

In what cases would having the current time be better? Should those cases instead use datetime.now for legibility?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Tue Oct 13 22:54:14 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 14 Oct 2020 02:54:14 +0000
Subject: [issue42023] Argparse: Add a "display" arg
In-Reply-To: <1602537496.16.0.894148688163.issue42023@roundup.psfhosted.org>
Message-ID: <1602644054.51.0.913641879443.issue42023@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> and the metavar arg isn't really helpful.

Is your issue with *metavar* that it changes the help() output in two places?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42023>
_______________________________________

From report at bugs.python.org  Tue Oct 13 23:03:55 2020
From: report at bugs.python.org (Tim Peters)
Date: Wed, 14 Oct 2020 03:03:55 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602644635.56.0.0442839518228.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

> There's no discomfort at all to me if, e.g., it stored
> 32-bit counts and is indexed by the last 6 bits of the
> character.  That's a measly 256 bytes in all.

Or, for the same space, 16-bit counts indexed by the last 7 bits. Then there's no aliasing for 7-bit ASCII, which is still very common in my world ;-)  Needles over 64K characters aren't.

Which is a weird rule of thumb that's served me well, although for no solid reason I can detect:  when faced with a universe of tradeoff possibilities for which it appears impossible to get a handle on "the typical" case, optimize for _your_ cases. Then at least one user will be delighted in the end :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Tue Oct 13 23:13:23 2020
From: report at bugs.python.org (paul j3)
Date: Wed, 14 Oct 2020 03:13:23 +0000
Subject: [issue42023] Argparse: Add a "display" arg
In-Reply-To: <1602537496.16.0.894148688163.issue42023@roundup.psfhosted.org>
Message-ID: <1602645203.55.0.152526301429.issue42023@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

I'm not following this request either, especially the colored part.

However, I can imagine adding a variable that gives the user full control over the action-invocation.  In:

    argparse.HelpFormatter._format_action_invocation method.

Currently it accepts the metavar (but not the tuple version) for a positional, but for optionals constructs:

  -s ARGS, --long ARGS

This can be quite long and ugly if the ARGS is a long choices, or there are many flag alternatives.  A number of SO users have asked for something simpler, usually with just on flag or

  -s, --long ARGS

There may even be a bug/issue(s) related to this already.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42023>
_______________________________________

From report at bugs.python.org  Wed Oct 14 00:21:10 2020
From: report at bugs.python.org (Justin Arthur)
Date: Wed, 14 Oct 2020 04:21:10 +0000
Subject: [issue38912] test_asyncio altered the execution environment
In-Reply-To: <1574729421.23.0.927917235759.issue38912@roundup.psfhosted.org>
Message-ID: <1602649270.9.0.0139673360219.issue38912@roundup.psfhosted.org>


Change by Justin Arthur <justinarthur at gmail.com>:


----------
nosy: +JustinTArthur
nosy_count: 5.0 -> 6.0
pull_requests: +21662
pull_request: https://github.com/python/cpython/pull/22691

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38912>
_______________________________________

From report at bugs.python.org  Wed Oct 14 00:31:47 2020
From: report at bugs.python.org (Justin Arthur)
Date: Wed, 14 Oct 2020 04:31:47 +0000
Subject: [issue38912] test_asyncio altered the execution environment
In-Reply-To: <1574729421.23.0.927917235759.issue38912@roundup.psfhosted.org>
Message-ID: <1602649907.63.0.465483653487.issue38912@roundup.psfhosted.org>


Justin Arthur <justinarthur at gmail.com> added the comment:

The "'NoneType' object has no attribute 'close'" error is likely caused by a race against the loop calling the test protocol object's connection_made callback. I was able to reproduce this case occasionally on macOS and it's likely platform-agnostic. Given server/connection cleanup isn't context-managed or finally-driven on the affected tests, raising the NoneType error will skip cleanup and we see additional exceptions from unclosed networking components being garbage collected.

Tests using this test protocol pattern were either waiting for the callback already or were waiting on network i/o that happens long after connection establishment with the exception of:
- `test_create_server_ssl_verified`
- `test_create_unix_server_ssl_verified`

PR 22691 ensures those two tests wait for the connect callbacks as well.

This may not address the env changed error from recent msg378481, as the initial error is not necessarily disclosed in that log.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38912>
_______________________________________

From report at bugs.python.org  Wed Oct 14 00:52:04 2020
From: report at bugs.python.org (Kevin Kuan)
Date: Wed, 14 Oct 2020 04:52:04 +0000
Subject: [issue42031] os.makedirs() introduces high memory usage for
 explorer.exe
Message-ID: <1602651124.31.0.715592568811.issue42031@roundup.psfhosted.org>


New submission from Kevin Kuan <kevin.kuan.trend at gmail.com>:

Hi,
I would like to report bug for os.makedirs().
I am running this script on Windows 10 1909 (most win10 work), python 3.8.1.

 
os.makedirs() is making explorer.exe huge amount of memory and crashing the system after only 3 hours.
After changing that line to subprocess.run('mkdir ...') memory usage is reduced significantly.After changing all shutil functions as well, memory usage will not grow. 

(This is my first time community contribution. If anything, please let me know.)
Kevin Kuan 
(kevin.kuan.trend at gmail.com)


-------script.txt------
import time
import logging
import uuid
import subprocess

REPEAT = 10

def new_target_folder():
        TARGET_BASE,
        str(uuid.uuid4().hex)
    )
    os.makedirs(target)
    return target


def delete_folder(target):
    if os.path.exists(target):
        shutil.rmtree(target)



def copy_samples(target):
    shutil.copytree(
        SOURCE_FOLDER, 
        os.path.join(target, 'file_copy_clean_samples')


def copy_file_test():
    for i in range(REPEAT):
        t = new_target_folder()
        copy_samples(t)
        delete_folder(t)

------after.txt------
import os
import shutil
import time
import logging
import uuid
import subprocess

REPEAT = 10

SOURCE_FOLDER = os.path.abspath(
    os.path.join(
        __file__,
        '..',
        '..',
        '_VolumeTestSamples',
        'file_copy_clean_samples',
    )
)

TARGET_BASE = os.path.join(
    os.environ['USERPROFILE'],
    r'Desktop',
    r'sample_file_copy',
    str(uuid.uuid4().hex)
)

PAUSE = 1


def run_for_one_week(func, pause):
    time_start = time.time()
    while True:
        time_now = time.time()
        logging.debug('{}'.format(time_now))
        if time_now - time_start > 1 * 7 * 24 * 60 * 60:
            break
        func()
        time.sleep(pause)


def new_target_folder():
    target = os.path.join(
        TARGET_BASE,
        str(uuid.uuid4().hex)
    )
    subprocess.run(
        ['mkdir', target],
        shell=True
    )
    return target


def delete_folder(target):
    if os.path.exists(target):
        subprocess.run(
            ['rmdir', '/s', '/q', target],
            shell=True
        )


def copy_samples(target):
    subprocess.run(
        ['echo', 'D', '|', 'xcopy', '/s', '/y', SOURCE_FOLDER, target],
        shell=True
    )


def copy_file_test():
    for i in range(REPEAT):
        t = new_target_folder()
        print (t)
        copy_samples(t)
        delete_folder(t)
    

if __name__ == '__main__':
    r = logging.getLogger()
    r.setLevel(logging.DEBUG)
    run_for_one_week(copy_file_test, PAUSE)

----------
components: Windows
files: Image20201014125025.png
messages: 378603
nosy: kevin.kuan.trend, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: os.makedirs() introduces high memory usage for explorer.exe
versions: Python 3.8
Added file: https://bugs.python.org/file49519/Image20201014125025.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42031>
_______________________________________

From report at bugs.python.org  Wed Oct 14 00:57:02 2020
From: report at bugs.python.org (jayesh)
Date: Wed, 14 Oct 2020 04:57:02 +0000
Subject: [issue42024] Exception ignored in: <function
 WeakValueDictionary.__init__.<locals>.remove at 0x7f6a325f2ea0>
In-Reply-To: <1602566139.42.0.455519135805.issue42024@roundup.psfhosted.org>
Message-ID: <1602651422.08.0.0614143062744.issue42024@roundup.psfhosted.org>


jayesh <jaymahajan28 at gmail.com> added the comment:

Dear Team,

are you sure if we upgrade to python 3.8.6 then we will not get these warnings?

For 3.5.4, if this bug is fixed then why i am getting these warnign messages?.

Thanks

----------
status: pending -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42024>
_______________________________________

From report at bugs.python.org  Wed Oct 14 01:54:04 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Wed, 14 Oct 2020 05:54:04 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602654844.62.0.527327226869.issue41972@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Wed Oct 14 02:56:37 2020
From: report at bugs.python.org (Kevin Kuan)
Date: Wed, 14 Oct 2020 06:56:37 +0000
Subject: [issue42031] os.makedirs() introduces high memory usage for
 explorer.exe
In-Reply-To: <1602651124.31.0.715592568811.issue42031@roundup.psfhosted.org>
Message-ID: <1602658597.3.0.251374937614.issue42031@roundup.psfhosted.org>


Kevin Kuan <kevin.kuan.trend at gmail.com> added the comment:

After further investigation. It seems that explorer.exe will use lots of memory when folders are rapidly created. The code change simply slows down folder creation. Since it is unrelated to python. I am closing this case.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42031>
_______________________________________

From report at bugs.python.org  Wed Oct 14 03:13:33 2020
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Wed, 14 Oct 2020 07:13:33 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1602659613.34.0.139481954119.issue38250@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

Flag values are _not_ a set of enabled bits.

At least, it is a weird kind of set where a is the same as {a}. That's why I mentioned mereology... there is no reasonable "membership", just "inclusion". I understand that str is not a perfect analogy, but sets are even more wrong.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Wed Oct 14 04:02:53 2020
From: report at bugs.python.org (Necdet Can Atesman)
Date: Wed, 14 Oct 2020 08:02:53 +0000
Subject: [issue42011] Documentation for logging.Filter.filter reports the
 wrong return type
In-Reply-To: <1602493243.32.0.577845482202.issue42011@roundup.psfhosted.org>
Message-ID: <1602662573.28.0.942883582477.issue42011@roundup.psfhosted.org>


Change by Necdet Can Atesman <can at atesman.at>:


----------
keywords: +patch
nosy: +soulmerge
nosy_count: 3.0 -> 4.0
pull_requests: +21663
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22692

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42011>
_______________________________________

From report at bugs.python.org  Wed Oct 14 04:27:09 2020
From: report at bugs.python.org (Veronica Olsen)
Date: Wed, 14 Oct 2020 08:27:09 +0000
Subject: [issue42032] Setting PYTHONPYCACHEPREFIX using ~ (tilde) creates a
 "~" folder
Message-ID: <1602664029.5.0.459362621128.issue42032@roundup.psfhosted.org>


New submission from Veronica Olsen <jadzia626 at gmail.com>:

On Debian Bullseye (testing):

Setting

export PYTHONPYCACHEPREFIX=~/.pycache

has previously worked. With Python 3.8.6, this still works in practice, when running python code (the pycache is still redirected), but during initialisation, the python3 executable creates an empty folder named "~" in the folder where the python exec or a python script is run.

Changing the environment variable to:

export PYTHONPYCACHEPREFIX=$HOME/.pycache

resolves the issue.

Expansion of ~ is of course a bit fickly in general, but 

I assume this is not intended. Deleting those folders from command line is rather tricky!

----------
components: Interpreter Core
messages: 378607
nosy: vkbo
priority: normal
severity: normal
status: open
title: Setting PYTHONPYCACHEPREFIX using ~ (tilde) creates a "~" folder
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42032>
_______________________________________

From report at bugs.python.org  Wed Oct 14 05:10:13 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 14 Oct 2020 09:10:13 +0000
Subject: [issue41993] Possible issues when remove not completely initialized
 module from sys.module
In-Reply-To: <1602327087.97.0.628811045218.issue41993@roundup.psfhosted.org>
Message-ID: <1602666613.93.0.1059718653.issue41993@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 391a544f2a52673f6630c672e89840fd6ac36723 by Miss Skeleton (bot) in branch '3.9':
bpo-41993: Fix possible issues in remove_module() (GH-22631) (GH-22647)
https://github.com/python/cpython/commit/391a544f2a52673f6630c672e89840fd6ac36723


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41993>
_______________________________________

From report at bugs.python.org  Wed Oct 14 05:13:00 2020
From: report at bugs.python.org (Veronica Olsen)
Date: Wed, 14 Oct 2020 09:13:00 +0000
Subject: [issue42032] Setting PYTHONPYCACHEPREFIX using ~ (tilde) creates a
 "~" folder
In-Reply-To: <1602664029.5.0.459362621128.issue42032@roundup.psfhosted.org>
Message-ID: <1602666780.35.0.123593170196.issue42032@roundup.psfhosted.org>


Veronica Olsen <jadzia626 at gmail.com> added the comment:

Correction: The pycache is in fact redirected to the new '~' folder.

In any case, I tested a bit on Debian Bullseye (Python 3.8.6) and Ubuntu 20.04 (Python 3.8.5) and it seems ~ is not expanded in the environment variable Debian. I'm a little uncertain what is the expected behaviour here, but the sys.pycache_prefix variable returns different results on the two platforms:

With environment variable set to ~/.pycache on 3.8.6 (on debian testing), I get the following:

Python 3.8.6 (default, Sep 25 2020, 09:36:53) 
[GCC 10.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import sys
>>> sys.pycache_prefix
'~/.pycache'
>>> 

Doing the same on 3.8.5 on ubuntu 20.04 produces:

Python 3.8.5 (default, Jul 28 2020, 12:59:40) 
[GCC 9.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import sys
>>> sys.pycache_prefix
'/home/******/.pycache'
>>> 

Still, perhaps the pycache_prefix should expand the ~ on linux?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42032>
_______________________________________

From report at bugs.python.org  Wed Oct 14 05:16:03 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 14 Oct 2020 09:16:03 +0000
Subject: [issue42014] shutil.rmtree calls onerror with different function than
 failed
In-Reply-To: <1602507255.43.0.726203818853.issue42014@roundup.psfhosted.org>
Message-ID: <1602666963.61.0.799435229732.issue42014@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Added Hynek, the original committer of this code.

----------
nosy: +giampaolo.rodola, hynek, serhiy.storchaka, tarek
versions:  -Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42014>
_______________________________________

From report at bugs.python.org  Wed Oct 14 05:51:09 2020
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 14 Oct 2020 09:51:09 +0000
Subject: [issue42029] Remove dynload_dl.c
In-Reply-To: <1602633475.18.0.479019652279.issue42029@roundup.psfhosted.org>
Message-ID: <1602669069.57.0.35619452728.issue42029@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Poor IRIX platform :-( Not so long ago (2 years ago?), the bitesnake service provided IRIX machines!

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42029>
_______________________________________

From report at bugs.python.org  Wed Oct 14 06:02:58 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 14 Oct 2020 10:02:58 +0000
Subject: [issue41876] Add __repr__ for Tkinter Font objects
In-Reply-To: <1601307207.95.0.784900613947.issue41876@roundup.psfhosted.org>
Message-ID: <1602669778.66.0.702552418091.issue41876@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset b4d895336a4692c95b4533adcc5c63a489e5e4e4 by Anatoliy Platonov in branch 'master':
bpo-41876: Overload __repr__ for tkinter Font objects (GH-22450)
https://github.com/python/cpython/commit/b4d895336a4692c95b4533adcc5c63a489e5e4e4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41876>
_______________________________________

From report at bugs.python.org  Wed Oct 14 06:03:12 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 14 Oct 2020 10:03:12 +0000
Subject: [issue41876] Add __repr__ for Tkinter Font objects
In-Reply-To: <1601307207.95.0.784900613947.issue41876@roundup.psfhosted.org>
Message-ID: <1602669792.07.0.805119786233.issue41876@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41876>
_______________________________________

From report at bugs.python.org  Wed Oct 14 06:48:31 2020
From: report at bugs.python.org (Xavier Morel)
Date: Wed, 14 Oct 2020 10:48:31 +0000
Subject: [issue42033] Seemingly unnecessary complexification of foo(**kw)
Message-ID: <1602672511.92.0.360571035375.issue42033@roundup.psfhosted.org>


New submission from Xavier Morel <xavier.morel at masklinn.net>:

Following bpo-39320 the highly specialised bytecode for vararg calls were replaced by simpler ones, but there seems to be at least one area where the generated bytecode regressed for possibly no reason?

In Python 3.8, foo(**var) compiles to:

0 LOAD_GLOBAL              0 (foo)
2 BUILD_TUPLE              0
4 LOAD_FAST                2 (var)
6 CALL_FUNCTION_EX         1

In Python 3.9, it compiles to:

0 LOAD_GLOBAL              0 (foo)
2 BUILD_TUPLE              0
4 BUILD_MAP                0
6 LOAD_FAST                2 (var)
8 DICT_MERGE               1
0 CALL_FUNCTION_EX         1

The PR 18141 does not seem to change the implementation of CALL_FUNCTION_EX so I would expect that if it was fine with taking the `var` arbitrary mapping before it stil is now, and the extra two opcodes (and creation of a dict) is unnecessary?

----------
messages: 378613
nosy: Mark.Shannon, xmorel
priority: normal
severity: normal
status: open
title: Seemingly unnecessary complexification of foo(**kw)
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42033>
_______________________________________

From report at bugs.python.org  Wed Oct 14 07:57:25 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 14 Oct 2020 11:57:25 +0000
Subject: [issue20184] Derby #16: Convert 50 sites to Argument Clinic across 9
 files
In-Reply-To: <1389140504.71.0.617730511292.issue20184@psf.upfronthosting.co.za>
Message-ID: <1602676645.44.0.305779215966.issue20184@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +21664
pull_request: https://github.com/python/cpython/pull/22693

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20184>
_______________________________________

From report at bugs.python.org  Wed Oct 14 09:33:59 2020
From: report at bugs.python.org (Quentin Peter)
Date: Wed, 14 Oct 2020 13:33:59 +0000
Subject: [issue41918] exec fails to take locals into account when running list
 comprehensions or functions
In-Reply-To: <1601716004.0.0.802801393199.issue41918@roundup.psfhosted.org>
Message-ID: <1602682439.18.0.974388420301.issue41918@roundup.psfhosted.org>


Quentin Peter <qpeter at bluewin.ch> added the comment:

Fails for functions as well:
```
In [4]: exec(compile('print(my_var)\ndef a():\n print(my_var)\na()', '<stdin>', 'exec'), globals(), {"my_var": 0})
0
Traceback (most recent call last):

File "<ipython-input-4-f091e49f2781>", line 1, in <module>
exec(compile('print(my_var)\ndef a():\n print(my_var)\na()', '<stdin>', 'exec'), globals(), {"my_var": 0})

File "<stdin>", line 4, in <module>

 File "<stdin>", line 3, in a

NameError: name 'my_var' is not defined
```

----------
title: exec fails to take locals into account when running list comprehensions -> exec fails to take locals into account when running list comprehensions or functions

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41918>
_______________________________________

From report at bugs.python.org  Wed Oct 14 09:47:28 2020
From: report at bugs.python.org (Sagar Pant)
Date: Wed, 14 Oct 2020 13:47:28 +0000
Subject: [issue42034] Unchecked return in Objects/typeobject.c and possible
 uninitialized variables in cls and new_mro
Message-ID: <1602683248.52.0.780024334642.issue42034@roundup.psfhosted.org>


New submission from Sagar Pant <sagpant at microsoft.com>:

The return value of a function that is potentially used to initialize a local variable is not checked. Therefore, reading the local variable may result in undefined behavior.

Our AI analyzer found that this function is called for a total of 43 times. Out of these 43 times, the return value from the function call is checked at 42 instances. This is the only instance where the code misses to check the return value for success or failure.

Once such correct reference usage found in Python/hamt.c at line 2805 .

----------
components: C API
messages: 378615
nosy: sagar
priority: normal
severity: normal
status: open
title: Unchecked return in Objects/typeobject.c and possible uninitialized variables in cls and new_mro
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42034>
_______________________________________

From report at bugs.python.org  Wed Oct 14 09:52:05 2020
From: report at bugs.python.org (fancitron)
Date: Wed, 14 Oct 2020 13:52:05 +0000
Subject: [issue42035] PyType_GetSlot cannot get tp_name
Message-ID: <1602683525.08.0.938781399322.issue42035@roundup.psfhosted.org>


New submission from fancitron <fancitron at gmail.com>:

In the Limited API (where PyTypeObject is opaque), there is no way to retrieve the tp_name of a type object.  The PyType_GetSlot() function doesn?t define a slot ID Py_tp_name.  This makes it inconvenient to port existing code to the Limited API.  Is this intentional?  How to work around this?

----------
components: C API
messages: 378616
nosy: fancitron
priority: normal
severity: normal
status: open
title: PyType_GetSlot cannot get tp_name
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42035>
_______________________________________

From report at bugs.python.org  Wed Oct 14 09:55:04 2020
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 14 Oct 2020 13:55:04 +0000
Subject: [issue42035] [C API] PyType_GetSlot cannot get tp_name
In-Reply-To: <1602683525.08.0.938781399322.issue42035@roundup.psfhosted.org>
Message-ID: <1602683704.82.0.632416026584.issue42035@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +corona10, petr.viktorin
title: PyType_GetSlot cannot get tp_name -> [C API] PyType_GetSlot cannot get tp_name

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42035>
_______________________________________

From report at bugs.python.org  Wed Oct 14 10:04:24 2020
From: report at bugs.python.org (Zachary Ware)
Date: Wed, 14 Oct 2020 14:04:24 +0000
Subject: [issue42032] Setting PYTHONPYCACHEPREFIX using ~ (tilde) creates a
 "~" folder
In-Reply-To: <1602664029.5.0.459362621128.issue42032@roundup.psfhosted.org>
Message-ID: <1602684264.71.0.543834424725.issue42032@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

AFAIK, tilde expansion is entirely up to your shell rather than Python (unless you use something like `os.path.expanduser` in your own program).

A few debugging questions:
1) What version of what shell(s) do you have on each system?

2) What value do you get from `TESTVAR=~/test python3 -c 'import os;print(os.environ["TESTVAR"])'` on each system?  Is it the same as `TESTVAR=~/test printenv | grep TESTVAR`?

3) What results do you get from the same tests as above, but with `TESTVAR='~/test'`?

----------
nosy: +zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42032>
_______________________________________

From report at bugs.python.org  Wed Oct 14 10:12:58 2020
From: report at bugs.python.org (Zachary Ware)
Date: Wed, 14 Oct 2020 14:12:58 +0000
Subject: [issue42024] Exception ignored in: <function
 WeakValueDictionary.__init__.<locals>.remove at 0x7f6a325f2ea0>
In-Reply-To: <1602566139.42.0.455519135805.issue42024@roundup.psfhosted.org>
Message-ID: <1602684778.78.0.401057615593.issue42024@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

Unfortunately, no guarantees that upgrading will fix things for you.  However, there's nothing we can do here until you can show that the issue still exists in a supported version of Python.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42024>
_______________________________________

From report at bugs.python.org  Wed Oct 14 10:17:13 2020
From: report at bugs.python.org (Tal Einat)
Date: Wed, 14 Oct 2020 14:17:13 +0000
Subject: [issue30934] Document how to run coverage for repository idlelib
 files.
In-Reply-To: <1500081585.35.0.923637622202.issue30934@psf.upfronthosting.co.za>
Message-ID: <1602685033.03.0.60284336289.issue30934@roundup.psfhosted.org>


Change by Tal Einat <taleinat+python at gmail.com>:


----------
keywords: +patch
pull_requests: +21665
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22694

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30934>
_______________________________________

From report at bugs.python.org  Wed Oct 14 10:18:48 2020
From: report at bugs.python.org (Tal Einat)
Date: Wed, 14 Oct 2020 14:18:48 +0000
Subject: [issue30934] Document how to run coverage for repository idlelib
 files.
In-Reply-To: <1500081585.35.0.923637622202.issue30934@psf.upfronthosting.co.za>
Message-ID: <1602685128.44.0.394427219549.issue30934@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

See a cross-platform script in PR GH-22694.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30934>
_______________________________________

From report at bugs.python.org  Wed Oct 14 10:29:21 2020
From: report at bugs.python.org (Roundup Robot)
Date: Wed, 14 Oct 2020 14:29:21 +0000
Subject: [issue42034] Unchecked return in Objects/typeobject.c and possible
 uninitialized variables in cls and new_mro
In-Reply-To: <1602683248.52.0.780024334642.issue42034@roundup.psfhosted.org>
Message-ID: <1602685761.87.0.984315601144.issue42034@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 1.0 -> 2.0
pull_requests: +21666
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22695

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42034>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:09:42 2020
From: report at bugs.python.org (Veronica Olsen)
Date: Wed, 14 Oct 2020 15:09:42 +0000
Subject: [issue42032] Setting PYTHONPYCACHEPREFIX using ~ (tilde) creates a
 "~" folder
In-Reply-To: <1602664029.5.0.459362621128.issue42032@roundup.psfhosted.org>
Message-ID: <1602688182.52.0.38045208578.issue42032@roundup.psfhosted.org>


Veronica Olsen <jadzia626 at gmail.com> added the comment:

> AFAIK, tilde expansion is entirely up to your shell rather than Python

Yes, I am uncertain what exactly is going on here. Whatever ends up in the sys.pycache_prefix variable is different with the same environment variable setting on the two systems. It may simply be an OS quirk. I am running on Debian testing after all.

It is clear from the CPython source that Python does nothing with the tilde. It eventually calls os.makedirs() in the compile() function, which I guess is when my tilde folder was made.

It would perhaps be useful if the os.path.expanduser call was added in the cache_from_source() function in importlib?

As for the results from the debug checks:

1)
Debian: GNU bash, version 5.0.18(1)-release (x86_64-pc-linux-gnu)
Ubuntu: GNU bash, version 5.0.17(1)-release (x86_64-pc-linux-gnu)

2)
They both expand ~ to the home folder

3)
They both return ~/test

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42032>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:14:37 2020
From: report at bugs.python.org (Damian Yurzola)
Date: Wed, 14 Oct 2020 15:14:37 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1601567658.27.0.420109981563.issue41904@roundup.psfhosted.org>
Message-ID: <1602688477.72.0.304564614684.issue41904@roundup.psfhosted.org>


Damian Yurzola <damian at yurzola.net> added the comment:

It took me a while to collect my thoughts but here you go.

Advanced users don't have a problem. They'll trade in date or datetime objects explicitly. The "proof" is I could not find any github repo with more than one start that'll call datetime.today().

The less advanced users are sometime doing datetime.today and then all kinds of weird things.

HassanAbouelela has a good point: datetime.today() is a straight forward way to get today in a datetime object.


On the topic of:

> "How long is it until Christmas?"

# Current
In [7]: datetime.datetime.today() - datetime.datetime.now()
Out[7]: datetime.timedelta(days=-1, seconds=86399, microseconds=999991)

# Hassan's
In [16]: datetime.datetime(2020, 12, 25) - datetime.datetime(datetime.datetime.today().year, datetime.datetime.today().month, datetime.datetime.today().day)
Out[16]: datetime.timedelta(days=72)


Optimizing for the less advanced user, I believe Hassan's proposal yields the more intuitive result.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:17:51 2020
From: report at bugs.python.org (Damian Yurzola)
Date: Wed, 14 Oct 2020 15:17:51 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1601567658.27.0.420109981563.issue41904@roundup.psfhosted.org>
Message-ID: <1602688671.19.0.410284893947.issue41904@roundup.psfhosted.org>


Damian Yurzola <damian at yurzola.net> added the comment:

Sorry I got my "current" wrong and I can't find the edit button
Here again:


> "How long is it until Christmas?"

# Current implementation
In [23]: datetime.datetime(2020, 12, 25) - datetime.datetime.today()
Out[23]: datetime.timedelta(days=71, seconds=53018, microseconds=941806)

# Hassan's
In [16]: datetime.datetime(2020, 12, 25) - datetime.datetime(datetime.datetime.today().year, datetime.datetime.today().month, datetime.datetime.today().day)
Out[16]: datetime.timedelta(days=72)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:21:10 2020
From: report at bugs.python.org (Sagar Pant)
Date: Wed, 14 Oct 2020 15:21:10 +0000
Subject: [issue42036] Unchecked return in Modules/posixmodule.c from multiple
 function calls
Message-ID: <1602688870.73.0.257118876464.issue42036@roundup.psfhosted.org>


New submission from Sagar Pant <sagpant at microsoft.com>:

The return value of a function that is potentially used to initialize a local variable is not checked. Therefore, reading the local variable may result in undefined behavior.

Our AI analyzer flagged it to be a potential bug as it found another usage of the function in the codebase where the return value of the function was checked for success/failure before using it?s parameters.

----------
components: C API
messages: 378623
nosy: sagar
priority: normal
severity: normal
status: open
title: Unchecked return in Modules/posixmodule.c from multiple function calls
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42036>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:23:42 2020
From: report at bugs.python.org (Markus Israelsson)
Date: Wed, 14 Oct 2020 15:23:42 +0000
Subject: [issue42037] Documentation confusion in CookieJar functions
Message-ID: <1602689022.88.0.876415237077.issue42037@roundup.psfhosted.org>


New submission from Markus Israelsson <markus.israelsson at surgicalscience.com>:

The documentation in https://docs.python.org/3.8/library/http.cookiejar.html#http.cookiejar.CookieJar
claims the following for functions add_cookie_header and extract_cookies.

***
The request object (usually a urllib.request.Request instance) must support the methods get_full_url(), get_host(), get_type(), unverifiable(), has_header(), get_header(), header_items(), add_unredirected_header() and origin_req_host attribute as documented by urllib.request.
***


When reading the documentation for Request Objects https://docs.python.org/3.8/library/urllib.request.html?highlight=requests#request-objects
there is this:
***
Changed in version 3.4: The request methods add_data, has_data, get_data, get_type, get_host, get_selector, get_origin_req_host and is_unverifiable that were deprecated since 3.3 have been removed.
***

So basically the documentation claims that if the request object does not support functions that are removed then the headers will not be added. The code itself seem to do the correct thing however and add the header.

----------
assignee: docs at python
components: Documentation
messages: 378624
nosy: docs at python, markus
priority: normal
severity: normal
status: open
title: Documentation confusion in CookieJar functions
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42037>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:36:25 2020
From: report at bugs.python.org (Oleg Nykolyn)
Date: Wed, 14 Oct 2020 15:36:25 +0000
Subject: [issue40352] SocketHandler silently drops log messages on re-connect
In-Reply-To: <1587474127.52.0.907489557829.issue40352@roundup.psfhosted.org>
Message-ID: <1602689785.49.0.933635775811.issue40352@roundup.psfhosted.org>


Oleg Nykolyn <juravel2 at gmail.com> added the comment:

There are multiple servers running in Kubrnetes cluster - API servers based on Django, celery workers, etc. All of them send logs to AWS TCP balancer, which acts as balancer for vector service[1], which send logs to Elasticsearch.
Basically we have following logging pipeline: python-based services -> AWS TCP network balancer -> vector -> Elasticsearch.
AWS network balancer has an option called "Idle timeout" with max value of 3600 seconds[2].
Log messages are logged successfully at first, but fail(one message gets lost on re-connect) if there is gap between messages, corresponding to "Idle timeout".

1: https://github.com/timberio/vector
2: https://docs.aws.amazon.com/elasticloadbalancing/latest/network/network-load-balancers.html#connection-idle-timeout

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40352>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:42:40 2020
From: report at bugs.python.org (Roundup Robot)
Date: Wed, 14 Oct 2020 15:42:40 +0000
Subject: [issue42036] Unchecked return in Modules/posixmodule.c from multiple
 function calls
In-Reply-To: <1602688870.73.0.257118876464.issue42036@roundup.psfhosted.org>
Message-ID: <1602690160.43.0.969186397407.issue42036@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 1.0 -> 2.0
pull_requests: +21668
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22696

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42036>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:43:38 2020
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 14 Oct 2020 15:43:38 +0000
Subject: [issue39337] codecs.lookup() ignores non-ASCII characters,
 whereas encodings.normalize_encoding() copies them
In-Reply-To: <1579038882.16.0.589810918272.issue39337@roundup.psfhosted.org>
Message-ID: <1602690218.19.0.434967319858.issue39337@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset c5b049b91ca50c615f9a5425055c2b79a82ac547 by Hai Shi in branch 'master':
bpo-39337: encodings.normalize_encoding() now ignores non-ASCII characters (GH-22219)
https://github.com/python/cpython/commit/c5b049b91ca50c615f9a5425055c2b79a82ac547


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39337>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:46:22 2020
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 14 Oct 2020 15:46:22 +0000
Subject: [issue41939] 3.9.0 test_site warning: "urllib.requests._opener was
 modified by test_site"
In-Reply-To: <1601881263.18.0.474767166198.issue41939@roundup.psfhosted.org>
Message-ID: <1602690382.05.0.473771881204.issue41939@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

You're welcome ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41939>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:46:55 2020
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 14 Oct 2020 15:46:55 +0000
Subject: [issue39337] codecs.lookup() ignores non-ASCII characters,
 whereas encodings.normalize_encoding() copies them
In-Reply-To: <1579038882.16.0.589810918272.issue39337@roundup.psfhosted.org>
Message-ID: <1602690415.47.0.0924421669823.issue39337@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks Hai Shi for the change and for new codecs and encodings tests.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39337>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:49:35 2020
From: report at bugs.python.org (Alexander Belopolsky)
Date: Wed, 14 Oct 2020 15:49:35 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1601567658.27.0.420109981563.issue41904@roundup.psfhosted.org>
Message-ID: <1602690575.25.0.378094825835.issue41904@roundup.psfhosted.org>


Alexander Belopolsky <alexander.belopolsky at gmail.com> added the comment:

I agree that having some of datetime.now([tz]) functionality replicated in datetime.today() makes little sense.  However, the presence of this method in datetime class is a consequence of datetime being a subclass of the date class. The latter was a design mistake IMO, but as other pointed out it is too late to do anything about it.

----------
assignee:  -> belopolsky

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:55:50 2020
From: report at bugs.python.org (hai shi)
Date: Wed, 14 Oct 2020 15:55:50 +0000
Subject: [issue39337] codecs.lookup() ignores non-ASCII characters,
 whereas encodings.normalize_encoding() copies them
In-Reply-To: <1579038882.16.0.589810918272.issue39337@roundup.psfhosted.org>
Message-ID: <1602690950.31.0.37573981318.issue39337@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

Thanks for everyone's continus review :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39337>
_______________________________________

From report at bugs.python.org  Wed Oct 14 11:57:20 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 14 Oct 2020 15:57:20 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1601567658.27.0.420109981563.issue41904@roundup.psfhosted.org>
Message-ID: <1602691040.43.0.543316723514.issue41904@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I concur with the other respondents.  This ship has sailed.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Wed Oct 14 12:00:22 2020
From: report at bugs.python.org (ThatXliner)
Date: Wed, 14 Oct 2020 16:00:22 +0000
Subject: [issue42023] Argparse: Add a "display" arg
In-Reply-To: <1602537496.16.0.894148688163.issue42023@roundup.psfhosted.org>
Message-ID: <1602691222.38.0.396749654553.issue42023@roundup.psfhosted.org>


ThatXliner <bryan.hu.2020 at gmail.com> added the comment:

>However, I can imagine adding a variable that gives the user full control over the action-invocation.  In:

    argparse.HelpFormatter._format_action_invocation method.

That's what I'm trying to change. If there was a public API/method for manipulating the left side of the help menu.

  (This part)     (Manipulatable via help=)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42023>
_______________________________________

From report at bugs.python.org  Wed Oct 14 12:05:18 2020
From: report at bugs.python.org (Alexander Belopolsky)
Date: Wed, 14 Oct 2020 16:05:18 +0000
Subject: [issue41904] datetime.datetime.today makes no sense and should be
 removed
In-Reply-To: <1601567658.27.0.420109981563.issue41904@roundup.psfhosted.org>
Message-ID: <1602691518.46.0.681245777461.issue41904@roundup.psfhosted.org>


Change by Alexander Belopolsky <alexander.belopolsky at gmail.com>:


----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41904>
_______________________________________

From report at bugs.python.org  Wed Oct 14 12:09:51 2020
From: report at bugs.python.org (jayesh)
Date: Wed, 14 Oct 2020 16:09:51 +0000
Subject: [issue42024] Exception ignored in: <function
 WeakValueDictionary.__init__.<locals>.remove at 0x7f6a325f2ea0>
In-Reply-To: <1602566139.42.0.455519135805.issue42024@roundup.psfhosted.org>
Message-ID: <1602691791.7.0.471155437582.issue42024@roundup.psfhosted.org>


jayesh <jaymahajan28 at gmail.com> added the comment:

Please check my attached log file.
In that, I am printing ansible version which shows python 3.5.4.
Let me know any other info required from my side.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42024>
_______________________________________

From report at bugs.python.org  Wed Oct 14 12:17:05 2020
From: report at bugs.python.org (Zachary Ware)
Date: Wed, 14 Oct 2020 16:17:05 +0000
Subject: [issue42024] Exception ignored in: <function
 WeakValueDictionary.__init__.<locals>.remove at 0x7f6a325f2ea0>
In-Reply-To: <1602566139.42.0.455519135805.issue42024@roundup.psfhosted.org>
Message-ID: <1602692225.63.0.313299263409.issue42024@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

As mentioned in my first message, Python 3.5.4 has been out of support for over 2.5 years now, and 3.5 as a whole has been out of support for a month now.  You'll need to show the problem using Python 3.8.6 or 3.9.0 for anything to be done about it here.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42024>
_______________________________________

From report at bugs.python.org  Wed Oct 14 12:20:16 2020
From: report at bugs.python.org (Tim Peters)
Date: Wed, 14 Oct 2020 16:20:16 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602692416.56.0.960091937233.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

For completeness, a link to the python-dev thread about this:

https://mail.python.org/archives/list/python-dev at python.org/thread/ECAZN35JCEE67ZVYHALRXDP4FILGR53Y/#4IEDAS5QAHF53IV5G3MRWPQAYBIOCWJ5

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Wed Oct 14 13:09:06 2020
From: report at bugs.python.org (Lisa Roach)
Date: Wed, 14 Oct 2020 17:09:06 +0000
Subject: [issue42038] Tracemalloc's format() doc contradictory
Message-ID: <1602695346.39.0.326290965149.issue42038@roundup.psfhosted.org>


New submission from Lisa Roach <lisaroach14 at gmail.com>:

Tracemalloc's format documentation (https://docs.python.org/3/library/tracemalloc.html#tracemalloc.Traceback.format) says first:

"Format the traceback as a list of lines with newlines."

then:

"Similar to the traceback.format_tb() function, except that format() does not include newlines."

The first statement is incorrect, tracemalloc does NOT add newlines to the list. I recommend just removing the "with newlines" in the first statement.

----------
assignee: docs at python
components: Documentation
messages: 378636
nosy: docs at python, lisroach
priority: low
severity: normal
status: open
title: Tracemalloc's format() doc contradictory
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42038>
_______________________________________

From report at bugs.python.org  Wed Oct 14 13:10:13 2020
From: report at bugs.python.org (Lisa Roach)
Date: Wed, 14 Oct 2020 17:10:13 +0000
Subject: [issue42038] Tracemalloc's format() doc contradictory
In-Reply-To: <1602695346.39.0.326290965149.issue42038@roundup.psfhosted.org>
Message-ID: <1602695413.66.0.0632168459019.issue42038@roundup.psfhosted.org>


Change by Lisa Roach <lisaroach14 at gmail.com>:


----------
keywords: +easy, newcomer friendly

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42038>
_______________________________________

From report at bugs.python.org  Wed Oct 14 13:17:36 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 14 Oct 2020 17:17:36 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602695856.81.0.819985783478.issue41984@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

Using the following patch:

https://github.com/python/cpython/compare/master...brandtbucher:track-all-heap-types

I got the following pyperformance results (with PGO/LTO and CPU isolation, insignificant rows omitted):

2020-10-13_20-04-master-7992579cd27f.json.gz
============================================

Performance version: 1.0.0
Report on Linux-4.4.0-190-generic-x86_64-with-glibc2.23
Number of logical CPUs: 8
Start date: 2020-10-14 07:49:46.738847
End date: 2020-10-14 08:12:58.050557

2020-10-13_20-37-track-all-heap-types-63d8d25867b5.json.gz
==========================================================

Performance version: 1.0.0
Report on Linux-4.4.0-190-generic-x86_64-with-glibc2.23
Number of logical CPUs: 8
Start date: 2020-10-14 08:29:52.009796
End date: 2020-10-14 08:52:49.230214

+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| Benchmark               | 2020-10-13_20-04-master-7992579cd27f.json.gz | 2020-10-13_20-37-track-all-heap-types-63d8d25867b5.json.gz | Change       | Significance          |
+=========================+==============================================+============================================================+==============+=======================+
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| chameleon               | 13.7 ms                                      | 13.1 ms                                                    | 1.04x faster | Significant (t=7.27)  |
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| chaos                   | 163 ms                                       | 159 ms                                                     | 1.03x faster | Significant (t=5.39)  |
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| crypto_pyaes            | 160 ms                                       | 156 ms                                                     | 1.02x faster | Significant (t=7.29)  |
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| deltablue               | 10.9 ms                                      | 10.7 ms                                                    | 1.03x faster | Significant (t=4.36)  |
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| django_template         | 73.1 ms                                      | 71.2 ms                                                    | 1.03x faster | Significant (t=4.42)  |
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| go                      | 373 ms                                       | 381 ms                                                     | 1.02x slower | Significant (t=-4.71) |
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| nbody                   | 206 ms                                       | 200 ms                                                     | 1.03x faster | Significant (t=7.52)  |
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| regex_dna               | 295 ms                                       | 288 ms                                                     | 1.02x faster | Significant (t=5.26)  |
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| richards                | 103 ms                                       | 101 ms                                                     | 1.03x faster | Significant (t=5.40)  |
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| scimark_sparse_mat_mult | 6.96 ms                                      | 7.17 ms                                                    | 1.03x slower | Significant (t=-4.93) |
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| spectral_norm           | 218 ms                                       | 207 ms                                                     | 1.05x faster | Significant (t=10.29) |
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+
| unpack_sequence         | 101 ns                                       | 84.1 ns                                                    | 1.20x faster | Significant (t=36.84) |
+-------------------------+----------------------------------------------+------------------------------------------------------------+--------------+-----------------------+

Note that I used pyperformance==1.0.0, since 1.0.1 won't run on 3.10.

In general, it looks like the patch has no real performance impact. The result for unpack_sequence is *extremely* surprising... I'm quite skeptical of it, although it looks like it is one of the more "micro" benchmarks in the suite.

All things considered, I believe we should fix this... I personally view memory leaks as second only to crashes and incorrect behavior in terms of severity.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 13:30:44 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 14 Oct 2020 17:30:44 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602696644.77.0.187495295489.issue41984@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thanks a lot, Brandt for doing the benchmarking!

I think that unpack_sequence is **very** affected by code locality. I was debugging it recently with Linux perf (https://perf.wiki.kernel.org/index.php/Main_Page) and it shows that is extremely affected by L1-L2 cache performance. I still need to understand why, but yeah, I am fine ignoring it.

>All things considered, I believe we should fix this... I personally view memory leaks as second only to crashes and incorrect behavior in terms of severity.

Yeah, I very much agree with you. Could you convert your patch into a PR?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 13:55:05 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 14 Oct 2020 17:55:05 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602698105.49.0.503772057811.issue41984@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

No problem. I just need to rework some hacks in test_finalization where we use empty __slots__ to create non-GC types. I think I can just create a simple utility in _testcapi to untrack instances for this purpose.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 13:57:20 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 14 Oct 2020 17:57:20 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602698240.45.0.206253064137.issue41984@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

>  I think I can just create a simple utility in _testcapi to untrack instances for this purpose.

I have the feeling that I am misunderstanding what you refer to, but if is **untrack** what you need, there is gc.untrack()

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 14:03:44 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 14 Oct 2020 18:03:44 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602698624.66.0.0975299244849.issue41984@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

> there is gc.untrack()

I'm not sure that's true... :)

Although perhaps track()/untrack() functions *could* be useful to add to the gc module... but that's a separate conversation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 14:05:32 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 14 Oct 2020 18:05:32 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602698732.98.0.865836769485.issue41984@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> I'm not sure that's true... :)

Oh boy, I need to....ehem....yeah I will be back in....one second...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 14:06:31 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 14 Oct 2020 18:06:31 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602698791.21.0.333821544154.issue41984@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

In any case, you can expose:

https://docs.python.org/3/c-api/gcsupport.html#c.PyObject_GC_UnTrack

in the testcapi module

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 14:23:34 2020
From: report at bugs.python.org (paul j3)
Date: Wed, 14 Oct 2020 18:23:34 +0000
Subject: [issue42023] Argparse: Add a "display" arg
In-Reply-To: <1602537496.16.0.894148688163.issue42023@roundup.psfhosted.org>
Message-ID: <1602699814.01.0.293181090874.issue42023@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

That method could be customized in a HelpFormatter subclass.  There already are several subclasses (documented), and writing your own is allowed, if not actually encouraged.

https://docs.python.org/3/library/argparse.html#formatter-class

Adding an extra parameter to 'add_argument', and passing that on through the Action class (and subclasses) is, potentially, a bigger task.  

So if you can get by with just customizing _format_action_invocation, there's no need for further action here.

I'll look for some examples, here or on SO, of customizing this method.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42023>
_______________________________________

From report at bugs.python.org  Wed Oct 14 14:31:23 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 14 Oct 2020 18:31:23 +0000
Subject: [issue42039] Add gc.track and gc.untrack
Message-ID: <1602700283.06.0.781805695704.issue42039@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

We have C-API calls to track and untrack objects. Having similar calls in Python can be usefull to selectively deactivate the garbage collector for some objects for performance, debugging or testing purposes. For instance, in https://bugs.python.org/issue41984 this could have been very usefull

----------
assignee: pablogsal
components: Interpreter Core
messages: 378645
nosy: pablogsal
priority: normal
severity: normal
status: open
title: Add gc.track and gc.untrack
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42039>
_______________________________________

From report at bugs.python.org  Wed Oct 14 14:33:38 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 14 Oct 2020 18:33:38 +0000
Subject: [issue42039] Add gc.track and gc.untrack
In-Reply-To: <1602700283.06.0.781805695704.issue42039@roundup.psfhosted.org>
Message-ID: <1602700418.33.0.66161870137.issue42039@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +21669
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22699

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42039>
_______________________________________

From report at bugs.python.org  Wed Oct 14 14:33:45 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 14 Oct 2020 18:33:45 +0000
Subject: [issue42039] Add gc.track and gc.untrack
In-Reply-To: <1602700283.06.0.781805695704.issue42039@roundup.psfhosted.org>
Message-ID: <1602700425.26.0.835633401312.issue42039@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +tim.peters
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42039>
_______________________________________

From report at bugs.python.org  Wed Oct 14 14:35:25 2020
From: report at bugs.python.org (ThatXliner)
Date: Wed, 14 Oct 2020 18:35:25 +0000
Subject: [issue42023] Argparse: Add a "display" arg
In-Reply-To: <1602537496.16.0.894148688163.issue42023@roundup.psfhosted.org>
Message-ID: <1602700525.87.0.677935497765.issue42023@roundup.psfhosted.org>


ThatXliner <bryan.hu.2020 at gmail.com> added the comment:

Should I rename this to "Argparse: finer control on help txt"

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42023>
_______________________________________

From report at bugs.python.org  Wed Oct 14 14:45:07 2020
From: report at bugs.python.org (ThatXliner)
Date: Wed, 14 Oct 2020 18:45:07 +0000
Subject: [issue42023] Argparse: Add a "display" arg
In-Reply-To: <1602537496.16.0.894148688163.issue42023@roundup.psfhosted.org>
Message-ID: <1602701107.01.0.173452079456.issue42023@roundup.psfhosted.org>


ThatXliner <bryan.hu.2020 at gmail.com> added the comment:

> So if you can get by with just customizing _format_action_invocation, there's no need for further action here.

Then maybe we could just make a new function that takes 2 arguments: Name of another action class (or the action class itself), and a tuple of the arg names to be displayed. It returns a new action class that contains the help text properties of the given action class with customized displayed arg names.


Maybe like

parser.add_argument("-f", "--foo", action=argparse.CustomArgName(action="store_true", name=("-F!!", "--FOO!"), help="TO foo a bar"))

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42023>
_______________________________________

From report at bugs.python.org  Wed Oct 14 14:46:10 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 14 Oct 2020 18:46:10 +0000
Subject: [issue42039] Add gc.track and gc.untrack
In-Reply-To: <1602700283.06.0.781805695704.issue42039@roundup.psfhosted.org>
Message-ID: <1602701170.32.0.00221788875279.issue42039@roundup.psfhosted.org>


Change by Brandt Bucher <brandtbucher at gmail.com>:


----------
nosy: +brandtbucher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42039>
_______________________________________

From report at bugs.python.org  Wed Oct 14 14:48:42 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 14 Oct 2020 18:48:42 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602701322.33.0.132723907903.issue41984@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

I'll hold off until https://bugs.python.org/issue42039 is resolved.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 15:02:29 2020
From: report at bugs.python.org (paul j3)
Date: Wed, 14 Oct 2020 19:02:29 +0000
Subject: [issue42023] Argparse: Add a "display" arg
In-Reply-To: <1602537496.16.0.894148688163.issue42023@roundup.psfhosted.org>
Message-ID: <1602702149.74.0.895223041896.issue42023@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

Some StackOverFlow answers cusomizing this help method:

https://stackoverflow.com/questions/23936145/python-argparse-help-message-disable-metavar-for-short-options

https://stackoverflow.com/questions/18275023/dont-show-long-options-twice-in-print-help-from-argparse

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42023>
_______________________________________

From report at bugs.python.org  Wed Oct 14 15:39:46 2020
From: report at bugs.python.org (ThatXliner)
Date: Wed, 14 Oct 2020 19:39:46 +0000
Subject: [issue42023] Argparse: Add a "display" arg
In-Reply-To: <1602537496.16.0.894148688163.issue42023@roundup.psfhosted.org>
Message-ID: <1602704386.41.0.0711115878439.issue42023@roundup.psfhosted.org>


ThatXliner <bryan.hu.2020 at gmail.com> added the comment:

Editing the description, etc. seems like a good way to do this. But it seems "hacky". The other answer on StackOverflow implements a custom class which does nice things, but not what I want.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42023>
_______________________________________

From report at bugs.python.org  Wed Oct 14 15:40:18 2020
From: report at bugs.python.org (ThatXliner)
Date: Wed, 14 Oct 2020 19:40:18 +0000
Subject: [issue42023] Argparse: Add a "display" arg
In-Reply-To: <1602537496.16.0.894148688163.issue42023@roundup.psfhosted.org>
Message-ID: <1602704418.14.0.929656231401.issue42023@roundup.psfhosted.org>


ThatXliner <bryan.hu.2020 at gmail.com> added the comment:

In the end, I think python's argparse needs more built-in help formatters...


Should I close this?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42023>
_______________________________________

From report at bugs.python.org  Wed Oct 14 17:14:17 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Wed, 14 Oct 2020 21:14:17 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602710057.96.0.912091059175.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

The most recent batch of commits added a jump table.
Between master and PR 22679 now, there are 151 cases slower than master and 463 that faster than master.
The slower cases are at most twice as slow, but the faster cases are often 10-20x faster.
I could add a cutoff to use a simpler algorithm instead, for needles of length less than ~10,
but I wanted to get the "purer" data out before making that change.

The benchmark data is here: https://pastebin.com/raw/bzQ4xQgM

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Wed Oct 14 17:42:21 2020
From: report at bugs.python.org (Sagar Pant)
Date: Wed, 14 Oct 2020 21:42:21 +0000
Subject: [issue42034] Unchecked return in Objects/typeobject.c and possible
 uninitialized variables in cls and new_mro
In-Reply-To: <1602683248.52.0.780024334642.issue42034@roundup.psfhosted.org>
Message-ID: <1602711741.12.0.770770358432.issue42034@roundup.psfhosted.org>


Change by Sagar Pant <sagpant at microsoft.com>:


----------
components: +Library (Lib) -C API

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42034>
_______________________________________

From report at bugs.python.org  Wed Oct 14 17:42:35 2020
From: report at bugs.python.org (Sagar Pant)
Date: Wed, 14 Oct 2020 21:42:35 +0000
Subject: [issue42036] Unchecked return in Modules/posixmodule.c from multiple
 function calls
In-Reply-To: <1602688870.73.0.257118876464.issue42036@roundup.psfhosted.org>
Message-ID: <1602711755.8.0.0882177430842.issue42036@roundup.psfhosted.org>


Change by Sagar Pant <sagpant at microsoft.com>:


----------
components: +Library (Lib) -C API

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42036>
_______________________________________

From report at bugs.python.org  Wed Oct 14 19:00:53 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 14 Oct 2020 23:00:53 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602716453.74.0.560308407051.issue41984@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

Actually, never mind. Because of the way finalization works, we need to create untracked *types* for these tests, not untracked *instances*.

PR up soon.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 19:08:03 2020
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 14 Oct 2020 23:08:03 +0000
Subject: [issue42019] Override MagicMock special methods
In-Reply-To: <1602527199.87.0.454087859253.issue42019@roundup.psfhosted.org>
Message-ID: <1602716883.42.0.715399785028.issue42019@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I don't know whether this is intended behaviour of not, but it seems that MagicMock's __init__ is setting the magic methods, every time a mock instance is created. I was able to achieve what you tried to write with this class definition - it sets __len__ after super.__init__ has done what it needs to do.

class MagicMockChild(MagicMock):
    def __init__(self):
        super().__init__()
        self.__len__ = lambda self : 9

This is not intended to be a satisfying answer, just to show what's going on.

----------
components: +Library (Lib)
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42019>
_______________________________________

From report at bugs.python.org  Wed Oct 14 19:36:51 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 14 Oct 2020 23:36:51 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602718611.48.0.342912679358.issue41984@roundup.psfhosted.org>


Change by Brandt Bucher <brandtbucher at gmail.com>:


----------
keywords: +patch
pull_requests: +21671
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22701

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 21:44:15 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Thu, 15 Oct 2020 01:44:15 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602726255.85.0.0431491218479.issue41984@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:


New changeset c13b847a6f913b72eeb71651ff626390b738d973 by Brandt Bucher in branch 'master':
bpo-41984: GC track all user classes (GH-22701)
https://github.com/python/cpython/commit/c13b847a6f913b72eeb71651ff626390b738d973


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 21:44:37 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 15 Oct 2020 01:44:37 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602726277.23.0.822292305979.issue41984@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21672
pull_request: https://github.com/python/cpython/pull/22702

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 21:44:44 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 15 Oct 2020 01:44:44 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602726284.89.0.420433425797.issue41984@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21673
pull_request: https://github.com/python/cpython/pull/22703

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 21:46:42 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Thu, 15 Oct 2020 01:46:42 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602726402.61.0.922109368992.issue41984@roundup.psfhosted.org>


Change by Brandt Bucher <brandtbucher at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 21:53:34 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 15 Oct 2020 01:53:34 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602726814.84.0.303606421992.issue41894@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 2d2af320d94afc6561e8f8adf174c9d3fd9065bc by Kevin Adler in branch 'master':
bpo-41894: Fix UnicodeDecodeError while loading native module (GH-22466)
https://github.com/python/cpython/commit/2d2af320d94afc6561e8f8adf174c9d3fd9065bc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Wed Oct 14 21:53:43 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 15 Oct 2020 01:53:43 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602726823.08.0.251774217505.issue41894@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21674
pull_request: https://github.com/python/cpython/pull/22704

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Wed Oct 14 21:53:50 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 15 Oct 2020 01:53:50 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602726830.96.0.976542338858.issue41894@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21675
pull_request: https://github.com/python/cpython/pull/22705

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Wed Oct 14 22:11:16 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 15 Oct 2020 02:11:16 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602727876.46.0.359205512966.issue41894@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 47ca6799725bb4c40953bb26ebcd726d1d766361 by Miss Skeleton (bot) in branch '3.8':
bpo-41894: Fix UnicodeDecodeError while loading native module (GH-22466)
https://github.com/python/cpython/commit/47ca6799725bb4c40953bb26ebcd726d1d766361


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Wed Oct 14 22:25:49 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 15 Oct 2020 02:25:49 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602728749.36.0.516747268775.issue41894@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f07448bef48d645c8cee862b1f25a99003a6140e by Miss Skeleton (bot) in branch '3.9':
bpo-41894: Fix UnicodeDecodeError while loading native module (GH-22466)
https://github.com/python/cpython/commit/f07448bef48d645c8cee862b1f25a99003a6140e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Wed Oct 14 23:16:09 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 15 Oct 2020 03:16:09 +0000
Subject: [issue41894] UnicodeDecodeError during load failure in non-UTF-8
 locale
In-Reply-To: <1601486783.26.0.906458411993.issue41894@roundup.psfhosted.org>
Message-ID: <1602731769.78.0.156904753185.issue41894@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Thank you for finding/fixing.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41894>
_______________________________________

From report at bugs.python.org  Wed Oct 14 23:29:18 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 15 Oct 2020 03:29:18 +0000
Subject: [issue42039] Add gc.track and gc.untrack
In-Reply-To: <1602700283.06.0.781805695704.issue42039@roundup.psfhosted.org>
Message-ID: <1602732558.79.0.181110812619.issue42039@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

There are many code that an object is tracked/untracked. This API can cause fatal error too easily.
I think this API should be exposed only in _testcapi.

----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42039>
_______________________________________

From report at bugs.python.org  Wed Oct 14 23:38:32 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Thu, 15 Oct 2020 03:38:32 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602733112.96.0.311112246849.issue41984@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:


New changeset d197b2bb3e401bed53987b65a7ceb6c712c4f5bd by Miss Skeleton (bot) in branch '3.9':
bpo-41984: GC track all user classes (GH-22701/GH-22702)
https://github.com/python/cpython/commit/d197b2bb3e401bed53987b65a7ceb6c712c4f5bd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 23:41:40 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 15 Oct 2020 03:41:40 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602733300.22.0.681470007739.issue41984@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21676
pull_request: https://github.com/python/cpython/pull/22707

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Wed Oct 14 23:58:44 2020
From: report at bugs.python.org (Bug Reporter)
Date: Thu, 15 Oct 2020 03:58:44 +0000
Subject: [issue41561] test_ssl fails in Ubuntu 20.04:
 test_min_max_version_mismatch
In-Reply-To: <1597551049.14.0.0578030464715.issue41561@roundup.psfhosted.org>
Message-ID: <1602734324.36.0.774306530565.issue41561@roundup.psfhosted.org>


Bug Reporter <bugsrep at gmail.com> added the comment:

I reported a bug at https://bugs.launchpad.net/ubuntu/+source/openssl/+bug/1899878

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41561>
_______________________________________

From report at bugs.python.org  Thu Oct 15 00:15:20 2020
From: report at bugs.python.org (Tal Einat)
Date: Thu, 15 Oct 2020 04:15:20 +0000
Subject: [issue24845] IDLE functional/integration testing
In-Reply-To: <1439325481.18.0.135721195599.issue24845@psf.upfronthosting.co.za>
Message-ID: <1602735320.12.0.998792599399.issue24845@roundup.psfhosted.org>


Change by Tal Einat <taleinat+python at gmail.com>:


----------
nosy: +taleinat
nosy_count: 4.0 -> 5.0
pull_requests: +21677
pull_request: https://github.com/python/cpython/pull/22682

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24845>
_______________________________________

From report at bugs.python.org  Thu Oct 15 00:23:15 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 15 Oct 2020 04:23:15 +0000
Subject: [issue42030] Drop support for dynload_aix
In-Reply-To: <1602634134.46.0.704375608696.issue42030@roundup.psfhosted.org>
Message-ID: <1602735795.65.0.959513340103.issue42030@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
nosy: +David.Edelsohn

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42030>
_______________________________________

From report at bugs.python.org  Thu Oct 15 00:26:51 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 15 Oct 2020 04:26:51 +0000
Subject: [issue42030] Drop support for dynload_aix
In-Reply-To: <1602634134.46.0.704375608696.issue42030@roundup.psfhosted.org>
Message-ID: <1602736011.69.0.987058818987.issue42030@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
nosy: +Michael.Felt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42030>
_______________________________________

From report at bugs.python.org  Thu Oct 15 01:08:28 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 15 Oct 2020 05:08:28 +0000
Subject: [issue42040] Change IDLE 'more information' splash line,
 change doc name
Message-ID: <1602738508.01.0.647349013117.issue42040@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

IDLE currently follows the version and system info line with 
 Type "help", "copyright", "credits" or "license()" for more information.  The last 3 are nearly useless, and duplicate the availability of the documents in a better format from About IDLE, where such things are usually found.  In any case, beginners are not likely to care, and most people will look at most once.

Entering 'help' prints the instruction to enter 'help()' for interaction or 'help(object)' for info on object.

Proposed replacement:
  Type "help" (no quotes) or click Help above for more information.

On macOS, one must click IDLE for About IDLE, but macOS users should know and expect it there (which is why it is moved there on macOS).

Also, the menu entry "IDLE Help" should be "IDLE Doc".  I believe the current entry dates to when "IDLE Help" was a separate text from the IDLE doc rather than a copy thereof.

PR later.

----------
assignee: terry.reedy
components: IDLE
messages: 378663
nosy: taleinat, terry.reedy
priority: normal
severity: normal
stage: needs patch
status: open
title: Change IDLE 'more information' splash line, change doc name
type: enhancement
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42040>
_______________________________________

From report at bugs.python.org  Thu Oct 15 01:15:34 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Thu, 15 Oct 2020 05:15:34 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1602738934.26.0.905152490672.issue35823@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

Well, much later than promised, but I'm picking it up. Since in the meantime support for setting uid/gid/groups was merged, and I'm aware about potential issues with calling corresponding C library functions in a vfork()-child, I asked a question on musl mailing list: https://www.openwall.com/lists/musl/2020/10/12/1

So, it seems we'll need to fallback to fork() if set*id() is needed, which is in line with our previous discussion about avoidance of vfork() in privileged processes anyway.

I'm also discussing -Wclobbered warnings with a GCC developer. I wouldn't like to restructure code just to avoid GCC false positives, so currently I'm leaning towards disabling this warning entirely for subprocess_fork_exec() and documenting that arbitrary stores to local variables between vfork() and child_exec() are not allowed due to stack sharing, but we'll see if a better solution emerges.

----------
assignee:  -> izbyshev

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Thu Oct 15 01:50:57 2020
From: report at bugs.python.org (Mark Keller)
Date: Thu, 15 Oct 2020 05:50:57 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
Message-ID: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>


New submission from Mark Keller <markooo.keller at gmail.com>:

Hey,

Wanted to report this weird behavior I saw recently. Let me first explain how to reproduce and then talk about where I think the issue comes from.

I attached a tar.gz file with 2 Python files in it.

Here's how to reproduce:
0. Make sure that pytest is unavailable in your command line, or please edit to another library that you don't have available from another Python install (make sure to update the import statement in `script1.py`).
1. Untar the 2 scripts into current working directory. Note: I reproduced on a Windows VM (Version 10.0.18363 Build 18363).
2. Make a Python 3.7, or 3.8 environment venv. Note: I used Python 3.8.2.
3. Activate venv and install pytest in it.
4. Run `python run_scripts.py` and observe the error.

Note: The same thing works on Python 3.6 as expected.

My team observed this issue when virtualenv released this Monday. It changed how it works with Windows and Python 3.7+, before it was not using the Windows redirect script generated by venv and just worked like how older versions on Windows do.
But what we are seeing is that if you start a subprocess call to `python` then that gets resolved to the system wide Python binary without the venv site-packages being in PYTHONPATH.
So the subprocess will fail when importing pytest in the subprocess.

If this is not clear please don't hesitate to ask me for clarification, or refer to https://github.com/pypa/virtualenv/issues/1981 for more debugging info.

Another interesting thing that I noticed is that if you make a subprocess call to `pytest` instead then that gets resolved correctly.

----------
components: Windows
files: repro.tar.gz
messages: 378665
nosy: keller00, paul.moore, steve.dower, tim.golden, vinay.sajip, zach.ware
priority: normal
severity: normal
status: open
title: venv subprocess call to python resolves to wrong interpreter
versions: Python 3.7, Python 3.8
Added file: https://bugs.python.org/file49520/repro.tar.gz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Thu Oct 15 03:20:20 2020
From: report at bugs.python.org (Bernat Gabor)
Date: Thu, 15 Oct 2020 07:20:20 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602746420.06.0.606554716124.issue42041@roundup.psfhosted.org>


Bernat Gabor <gaborjbernat at gmail.com> added the comment:

I wonder if this is an interaction issue with the builtin Windows provided python executable?

----------
nosy: +eryksun, gaborjbernat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Thu Oct 15 04:06:35 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 15 Oct 2020 08:06:35 +0000
Subject: [issue42033] Seemingly unnecessary complexification of foo(**kw)
In-Reply-To: <1602672511.92.0.360571035375.issue42033@roundup.psfhosted.org>
Message-ID: <1602749195.35.0.0587328621347.issue42033@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee:  -> Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42033>
_______________________________________

From report at bugs.python.org  Thu Oct 15 05:25:58 2020
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 15 Oct 2020 09:25:58 +0000
Subject: [issue42033] Seemingly unnecessary complexification of foo(**kw)
In-Reply-To: <1602672511.92.0.360571035375.issue42033@roundup.psfhosted.org>
Message-ID: <1602753958.25.0.276017577532.issue42033@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Have you observed any slowdown or incorrect behaviour?

The 3.8 bytecode looks incorrect to me.
The C-API documentation doesn't prohibit callables from mutating the dictionary they receive.
Unless a copy is made, then a callee could mutate `var`.

https://docs.python.org/3/c-api/call.html

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42033>
_______________________________________

From report at bugs.python.org  Thu Oct 15 05:40:32 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 15 Oct 2020 09:40:32 +0000
Subject: [issue42039] Add gc.track and gc.untrack
In-Reply-To: <1602700283.06.0.781805695704.issue42039@roundup.psfhosted.org>
Message-ID: <1602754832.89.0.0919552927293.issue42039@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

You mean because we need to modify _gc_prev and they may be in an inconsistent state? I may be missing something, but the only tricky moment is if someone calls this from a finalizer and in that case we have already constructed the reachable and unreachable sets. Or are you referring to other possible crashes?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42039>
_______________________________________

From report at bugs.python.org  Thu Oct 15 05:50:14 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 15 Oct 2020 09:50:14 +0000
Subject: [issue42039] Add gc.track and gc.untrack
In-Reply-To: <1602700283.06.0.781805695704.issue42039@roundup.psfhosted.org>
Message-ID: <1602755414.05.0.0127183555542.issue42039@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I meant this: https://github.com/python/cpython/blob/b67cbbda3a022cec5e2ad929f0531162166e7c8d/Include/internal/pycore_object.h#L75-L78

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42039>
_______________________________________

From report at bugs.python.org  Thu Oct 15 05:50:50 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 15 Oct 2020 09:50:50 +0000
Subject: [issue42039] Add gc.track and gc.untrack
In-Reply-To: <1602700283.06.0.781805695704.issue42039@roundup.psfhosted.org>
Message-ID: <1602755450.16.0.953192972963.issue42039@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

and this: https://github.com/python/cpython/blob/b67cbbda3a022cec5e2ad929f0531162166e7c8d/Include/internal/pycore_object.h#L111-L113

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42039>
_______________________________________

From report at bugs.python.org  Thu Oct 15 06:04:53 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 15 Oct 2020 10:04:53 +0000
Subject: [issue42039] Add gc.track and gc.untrack
In-Reply-To: <1602700283.06.0.781805695704.issue42039@roundup.psfhosted.org>
Message-ID: <1602756293.34.0.128535395011.issue42039@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

In my implementation, there is guards that do early return in those cases and there are tests that check that indeed we don't crash of that happens when calling the exposed functions

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42039>
_______________________________________

From report at bugs.python.org  Thu Oct 15 06:27:33 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 15 Oct 2020 10:27:33 +0000
Subject: [issue42039] Add gc.track and gc.untrack
In-Reply-To: <1602700283.06.0.781805695704.issue42039@roundup.psfhosted.org>
Message-ID: <1602757653.41.0.430350201428.issue42039@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> In my implementation, there is guards that do early return in those cases and there are tests that check that indeed we don't crash of that happens when calling the exposed functions

The guard doesn't help much. _PyObject_GC_UNTRACK() is called from many object tp_dealloc().
After user call `gc.untrack(obj)`, when the obj is deallocated, assertion error happens.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42039>
_______________________________________

From report at bugs.python.org  Thu Oct 15 06:38:56 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 15 Oct 2020 10:38:56 +0000
Subject: [issue42039] Add gc.track and gc.untrack
In-Reply-To: <1602700283.06.0.781805695704.issue42039@roundup.psfhosted.org>
Message-ID: <1602758336.68.0.582058890271.issue42039@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> The guard doesn't help much. _PyObject_GC_UNTRACK() is called from many object tp_dealloc().
After user call `gc.untrack(obj)`, when the obj is deallocated, assertion error happens.

Oh, actually that is a very good point. Although we could argue if the check is super useful or not, I agree that as things are currently is not a good idea to expose these functions. I will close the issue.

Thanks a lot for pointing that out, Inada-san.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42039>
_______________________________________

From report at bugs.python.org  Thu Oct 15 07:07:54 2020
From: report at bugs.python.org (Xavier Morel)
Date: Thu, 15 Oct 2020 11:07:54 +0000
Subject: [issue42033] Seemingly unnecessary complexification of foo(**kw)
In-Reply-To: <1602672511.92.0.360571035375.issue42033@roundup.psfhosted.org>
Message-ID: <1602760074.74.0.5167657431.issue42033@roundup.psfhosted.org>


Xavier Morel <xavier.morel at masklinn.net> added the comment:

I have not noticed anything, I was just looking at the bytecode changes and stumbled upon this oddity. Though I would expect a small slowdown as every fn(**kw) would now incur an extra dict copy, unless there?s something in call_function_ex which copies the input dict iff its ref count is not one?

For whatever that?s worth, the 3.8 bytecode has been there since call_function_ex was added in 3.6 and before that call_function_kw looks identical (load_global foo, load_local var, call_function_kw)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42033>
_______________________________________

From report at bugs.python.org  Thu Oct 15 07:18:26 2020
From: report at bugs.python.org (Carlo Dri)
Date: Thu, 15 Oct 2020 11:18:26 +0000
Subject: [issue32244] Multiprocessing:
 multiprocessing.connection.Listener.accept() should accept a timeout
In-Reply-To: <1512659399.52.0.213398074469.issue32244@psf.upfronthosting.co.za>
Message-ID: <1602760706.72.0.549227213203.issue32244@roundup.psfhosted.org>


Carlo Dri <carlo.dri at gmail.com> added the comment:

In agree with this proposal! I was looking for the exact same possibility of specifying a timeout to the accept() method, both in AF_INET and AF_PIPE sockets. If there is any  better way to implement this I would love to hear it.

----------
nosy: +carlodri

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32244>
_______________________________________

From report at bugs.python.org  Thu Oct 15 07:21:51 2020
From: report at bugs.python.org (Carlo Dri)
Date: Thu, 15 Oct 2020 11:21:51 +0000
Subject: [issue32244] Multiprocessing:
 multiprocessing.connection.Listener.accept() should accept a timeout
In-Reply-To: <1512659399.52.0.213398074469.issue32244@psf.upfronthosting.co.za>
Message-ID: <1602760911.36.0.104190462653.issue32244@roundup.psfhosted.org>


Change by Carlo Dri <carlo.dri at gmail.com>:


----------
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32244>
_______________________________________

From report at bugs.python.org  Thu Oct 15 07:51:37 2020
From: report at bugs.python.org (Steve Dower)
Date: Thu, 15 Oct 2020 11:51:37 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602762697.7.0.410708965914.issue42041@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

This is due to how Windows resolves relative paths when creating a new process. It *always* looks in the current application directory first, which with this setup will be the original Python executable rather than the venv redirector.

The best fix is to pass sys.executable instead of "python", which is more reliable on every OS and under every configuration. I've heard multiple people say that they prefer to launch venvs directly rather than modifying their environment in order to put it first on PATH.

If you are deliberately trying to use PATH to resolve the user's default "python" (which may not be in any way related to the one that's currently running), then use shutil.which() first and pass the full path to subprocess.

There's no bug to fix here, but if someone wants to add a section to the docs (and ideally, Mark or someone who has hit this problem can tell us which docs they read where they might have seen it) explaining that passing "python" to subprocess is a bad idea, feel free.

----------
assignee:  -> docs at python
components: +Documentation
nosy: +docs at python
versions: +Python 3.10, Python 3.9 -Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Thu Oct 15 07:57:21 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 15 Oct 2020 11:57:21 +0000
Subject: [issue42042] docs.python.org for 3.10 missing the new refererence
 record.
Message-ID: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>


New submission from Dong-hee Na <donghee.na92 at gmail.com>:

For example
https://docs.python.org/3.10/c-api/bool.html?highlight=pydict_new#c.PyDict_New

should display 

`Return value: New reference.`

but not, this looks like a regression bug.

other version display `Return value: New reference.` very well.

----------
assignee: docs at python
components: Documentation
messages: 378677
nosy: corona10, docs at python, vstinner
priority: normal
severity: normal
status: open
title: docs.python.org for 3.10 missing the new refererence record.
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Thu Oct 15 08:03:28 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89tienne_Pot?=)
Date: Thu, 15 Oct 2020 12:03:28 +0000
Subject: [issue42043] zipfile.Path should support inheritance
Message-ID: <1602763408.56.0.61735130641.issue42043@roundup.psfhosted.org>


New submission from ?tienne Pot <etiennefg.pot at gmail.com>:

Currently, zipfile.Path inheritance behavior is inconsistent with pathlib.Path:

```
class MyPath(zipfile.Path):
  pass


path = MyPath(zf)
path = path.joinpath('other')
assert isinstance(path, MyPath)  # Oups, type(path) is zipfile.Path
```

Calling parent, /,... should keep the class, as for pathlib.Path

Use case: I'm writing a wrapper around `zipfile.Path` which adds `os.fspath` compatibility (the file is extracted in a tmp dir when os.path.join, open,...).

----------
components: Library (Lib)
messages: 378678
nosy: ?tienne Pot
priority: normal
severity: normal
status: open
title: zipfile.Path should support inheritance
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42043>
_______________________________________

From report at bugs.python.org  Thu Oct 15 08:07:10 2020
From: report at bugs.python.org (Roundup Robot)
Date: Thu, 15 Oct 2020 12:07:10 +0000
Subject: [issue42043] zipfile.Path should support inheritance
In-Reply-To: <1602763408.56.0.61735130641.issue42043@roundup.psfhosted.org>
Message-ID: <1602763630.22.0.778138148629.issue42043@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 1.0 -> 2.0
pull_requests: +21678
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22711

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42043>
_______________________________________

From report at bugs.python.org  Thu Oct 15 08:18:04 2020
From: report at bugs.python.org (Aristotelis Mikropoulos)
Date: Thu, 15 Oct 2020 12:18:04 +0000
Subject: [issue42019] Override MagicMock special methods
In-Reply-To: <1602527199.87.0.454087859253.issue42019@roundup.psfhosted.org>
Message-ID: <1602764284.23.0.757656310197.issue42019@roundup.psfhosted.org>


Aristotelis Mikropoulos <amikrop at gmail.com> added the comment:

Yep, I had figured out myself that those stub methods are being set during MagicMock's __init__, thanks for answering anyway :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42019>
_______________________________________

From report at bugs.python.org  Thu Oct 15 08:20:44 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 15 Oct 2020 12:20:44 +0000
Subject: [issue42021] Fix possible ref. leaks in _sqlite3 module initialisation
In-Reply-To: <1602530320.77.0.149303517961.issue42021@roundup.psfhosted.org>
Message-ID: <1602764444.83.0.996403657181.issue42021@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:


New changeset 644e94272a89196801825cb69a56377bf62d256a by Erlend Egeberg Aasland in branch 'master':
bpo-42021: Fix possible ref leaks during _sqlite3 module init (GH-22673)
https://github.com/python/cpython/commit/644e94272a89196801825cb69a56377bf62d256a


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42021>
_______________________________________

From report at bugs.python.org  Thu Oct 15 08:22:02 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 15 Oct 2020 12:22:02 +0000
Subject: [issue42021] Fix possible ref. leaks in _sqlite3 module initialisation
In-Reply-To: <1602530320.77.0.149303517961.issue42021@roundup.psfhosted.org>
Message-ID: <1602764522.53.0.138777598477.issue42021@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42021>
_______________________________________

From report at bugs.python.org  Thu Oct 15 08:57:58 2020
From: report at bugs.python.org (Paul Moore)
Date: Thu, 15 Oct 2020 12:57:58 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602766678.5.0.958961230644.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

Agreed, this is just "normal Windows behaviour". It's definitely surprising and non-obvious (I saw this issue and it never even occurred to me that this was what was happening) so I'd support documenting it somewhere. My instinct is that the subprocess documentation is the right place, but I suspect that in practice, people hitting this issue with a virtual environment won't spot anything we write there, so it'll end up just being a "well, we told you so" measure rather than helping users in a practical sense.

So I'd agree with Steve's comment - Mark, if you can suggest anywhere we could document this which you *would* have spotted when you encountered this issue, that would be great.

Hmm, maybe we could document in venv that the Python executable in a venv redirects to the base Python, so that the "application directory" for a script run from a venv is the base executable's directory, not the venv - with a link to the MS documentation that explains how this affects path searches? (IIRC, we've been hesitant to document the redirection as it's an "implementation detail", but this is clearly a case where it affects user-visible behaviour, so we can't really use that argument any more...)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Thu Oct 15 09:20:37 2020
From: report at bugs.python.org (Bernat Gabor)
Date: Thu, 15 Oct 2020 13:20:37 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602768037.4.0.115601991497.issue42041@roundup.psfhosted.org>


Bernat Gabor <gaborjbernat at gmail.com> added the comment:

Taking a look at the existing documentation this should probably be mentioned under the args part of https://docs.python.org/3/library/subprocess.html#popen-constructor, not? (that's where other similar gotchas are explained too)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Thu Oct 15 09:21:41 2020
From: report at bugs.python.org (Xavier Morel)
Date: Thu, 15 Oct 2020 13:21:41 +0000
Subject: [issue40325] Random.seed does not affect string hash randomization
 leading to non-intuitive results
In-Reply-To: <1587245119.63.0.0763742728572.issue40325@roundup.psfhosted.org>
Message-ID: <1602768101.47.0.706791015259.issue40325@roundup.psfhosted.org>


Xavier Morel <xavier.morel at masklinn.net> added the comment:

@rhettinger checking software against 3.9 there's a little issue with the way the check is done: if passed something which is *both* a sequence and a set (e.g. an ordered set), `random.sample` will trigger a warning, which I don't think is correct.

Should I open a new issue for that? Fix seems simple: just move the check for _Set inside the check for _Sequence, and raise if that doesn't pass either.

----------
nosy: +xmorel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40325>
_______________________________________

From report at bugs.python.org  Thu Oct 15 09:22:04 2020
From: report at bugs.python.org (Fabio Zadrozny)
Date: Thu, 15 Oct 2020 13:22:04 +0000
Subject: [issue42044] Running Python in unbuffered mode may not write all
 contents to the console
Message-ID: <1602768124.79.0.2669254941.issue42044@roundup.psfhosted.org>


New submission from Fabio Zadrozny <fabioz at users.sourceforge.net>:

When running Python in unbuffered mode it may fail to write all the contents to the actual console (on Windows).

The code below can reproduce the issue: 

```
import sys
s = ''
for i in range(1,301):
    s += f"{str(i*100).zfill(10)}{'x' * 89}\n"

sys.stdout.write(s)
```

When calling it with `python -u code.py` it'll write only up to line 15000 and when calling it with `python code.py` it'll write up to line 30000.

This fails because in `_textiowrapper_writeflush` it doesn't verify if all the contents have been indeed written and thus fails in a partial write. In buffered mode it works because `_io_BufferedWriter_write_impl` does the job properly.

I'm a bit uncertain on why doesn't `_io__WindowsConsoleIO_write_impl` itself do the loop to write everything instead of leaving it up to callers to do that work (apparently due to issue11395 it says that it only writes partially, but maybe the fix could've been to loop inside of `_io__WindowsConsoleIO_write_impl` to write everything instead of expecting callers to handle partial writes...

----------
components: IO
messages: 378684
nosy: fabioz
priority: normal
severity: normal
status: open
title: Running Python in unbuffered mode may not write all contents to the console
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42044>
_______________________________________

From report at bugs.python.org  Thu Oct 15 09:39:59 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 15 Oct 2020 13:39:59 +0000
Subject: [issue42043] zipfile.Path should support inheritance
In-Reply-To: <1602763408.56.0.61735130641.issue42043@roundup.psfhosted.org>
Message-ID: <1602769199.42.0.968922961312.issue42043@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +jaraco

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42043>
_______________________________________

From report at bugs.python.org  Thu Oct 15 09:57:08 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 15 Oct 2020 13:57:08 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1602770228.44.0.959424342702.issue1635741@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21679
pull_request: https://github.com/python/cpython/pull/22712

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Thu Oct 15 10:22:28 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 15 Oct 2020 14:22:28 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1602771748.07.0.138278488843.issue1635741@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset e6b8c5263a7fcf5b95d0fd4c900e5949eeb6630d by Victor Stinner in branch 'master':
bpo-1635741: Add a global module state to unicodedata (GH-22712)
https://github.com/python/cpython/commit/e6b8c5263a7fcf5b95d0fd4c900e5949eeb6630d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Thu Oct 15 10:24:49 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 15 Oct 2020 14:24:49 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1602771889.31.0.999139402989.issue1635741@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21680
pull_request: https://github.com/python/cpython/pull/22713

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Thu Oct 15 11:13:14 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Thu, 15 Oct 2020 15:13:14 +0000
Subject: [issue42033] Seemingly unnecessary complexification of foo(**kw)
In-Reply-To: <1602672511.92.0.360571035375.issue42033@roundup.psfhosted.org>
Message-ID: <1602774794.18.0.00340179768934.issue42033@roundup.psfhosted.org>


Change by Brandt Bucher <brandtbucher at gmail.com>:


----------
nosy: +brandtbucher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42033>
_______________________________________

From report at bugs.python.org  Thu Oct 15 11:17:29 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 15 Oct 2020 15:17:29 +0000
Subject: [issue42033] Seemingly unnecessary complexification of foo(**kw)
In-Reply-To: <1602672511.92.0.360571035375.issue42033@roundup.psfhosted.org>
Message-ID: <1602775049.55.0.131867864009.issue42033@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

$ python3.8 -m timeit -s "a = {'a': 1}" "dict(**a)"
2000000 loops, best of 5: 113 nsec per loop
$ python3.9 -m timeit -s "a = {'a': 1}" "dict(**a)"
2000000 loops, best of 5: 181 nsec per loop

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42033>
_______________________________________

From report at bugs.python.org  Thu Oct 15 11:24:27 2020
From: report at bugs.python.org (Augusto Hack)
Date: Thu, 15 Oct 2020 15:24:27 +0000
Subject: [issue42045] Add support to async code to pdb
Message-ID: <1602775467.01.0.625412494748.issue42045@roundup.psfhosted.org>


New submission from Augusto Hack <me at hak.cx>:

Currently it seems that `pdb` does not support executing `async` functions. This makes debugging `async` code a bit harder if one needs to call an `async` function from the REPL.

Here is an example:

```python
import asyncio

async def f() -> int:
    return 1

async def main():
    breakpoint()

asyncio.run(main())
```

The goal would be to call `f()`. In a real world application this could be additional HTTP requests, database queries, etc.

----------
components: asyncio
messages: 378687
nosy: asvetlov, hack.augusto, yselivanov
priority: normal
severity: normal
status: open
title: Add support to async code to pdb
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42045>
_______________________________________

From report at bugs.python.org  Thu Oct 15 11:51:56 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Thu, 15 Oct 2020 15:51:56 +0000
Subject: [issue41984] Empty __slots__ can create untracked reference cycles
In-Reply-To: <1602271068.86.0.423346630238.issue41984@roundup.psfhosted.org>
Message-ID: <1602777116.01.0.465145351438.issue41984@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:


New changeset aeb66c1abbf4ec214e2e80eb972546996d1a1571 by Miss Skeleton (bot) in branch '3.8':
bpo-41984: GC track all user classes (GH-22701/GH-22707)
https://github.com/python/cpython/commit/aeb66c1abbf4ec214e2e80eb972546996d1a1571


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41984>
_______________________________________

From report at bugs.python.org  Thu Oct 15 12:13:57 2020
From: report at bugs.python.org (Sorin Sbarnea)
Date: Thu, 15 Oct 2020 16:13:57 +0000
Subject: [issue41973] Docs: TypedDict is now of type function instead of class
In-Reply-To: <1602138406.98.0.272652370144.issue41973@roundup.psfhosted.org>
Message-ID: <1602778437.49.0.394197047314.issue41973@roundup.psfhosted.org>


Change by Sorin Sbarnea <sorin.sbarnea at gmail.com>:


----------
nosy: +ssbarnea

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41973>
_______________________________________

From report at bugs.python.org  Thu Oct 15 13:14:02 2020
From: report at bugs.python.org (Mark Keller)
Date: Thu, 15 Oct 2020 17:14:02 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602782042.06.0.282400112295.issue42041@roundup.psfhosted.org>


Mark Keller <markooo.keller at gmail.com> added the comment:

Thank you so much for the prompt responses.

I would say that this should be documented on the venv page (https://docs.python.org/3/library/venv.html) as I find the subprocess page too dense of information already, but I do agree that venv page is most likely not where developers would look first.

I'm a little embarrassed to say this, but I didn't even know that sys.executable existed.

So maybe the better way to document this would be to mention sys.executable on the subprocess page, just as a sure way find where the current interpreter lives and then go into detail why this behavior difference is on the venv page. Maybe have them linked to each other?

What do you think about this?

----------
components:  -Documentation
versions: +Python 3.7, Python 3.8 -Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Thu Oct 15 13:36:32 2020
From: report at bugs.python.org (john_miller)
Date: Thu, 15 Oct 2020 17:36:32 +0000
Subject: [issue42046] Unable to write to file without elevated privileges
Message-ID: <1602783392.97.0.0712436068375.issue42046@roundup.psfhosted.org>


New submission from john_miller <johnson.b.ourne+pythonbugtracker at gmail.com>:

Trying to write into a file fails with a PermissionError (PermissionError: [Errno 13] Permission denied:).

Typing in a non-elevated shell (User is Administrator)
C:\Users\Username\Desktop>C:\Python38-32\python.exe
open("some_file.txt","w") fails on the Desktop, in the user directory and in directories where Administrators are permitted to write (while normal users can only read and execute).

(Permissions for the user in those directories: 
Desktop rwx, 
Username-directory rwx, 
third-location r-x for users/rwx for Administrator-user-group (with non-elevated applications))

I can write to all these places without elevation using the shell or standard applications like notepad.exe. 

Why do I have to elevate the Python-process to access such functionality? Is this related to the security-settings on python.exe or its installation-directory location?

Forcing a user to elevate the user-launched process for tasks that operate on normal user-writable files feels like a light security-risk. Because they get used to elevate Python-scripts even if the performed task by itself would not require it.

What changed compared to Python 2?

----------
components: Windows
messages: 378690
nosy: john_miller, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Unable to write to file without elevated privileges
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42046>
_______________________________________

From report at bugs.python.org  Thu Oct 15 14:27:59 2020
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 15 Oct 2020 18:27:59 +0000
Subject: [issue42046] Unable to write to file without elevated privileges
In-Reply-To: <1602783392.97.0.0712436068375.issue42046@roundup.psfhosted.org>
Message-ID: <1602786479.98.0.648700073636.issue42046@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> Desktop rwx, 
> Username-directory rwx, 

POSIX permissions are not meaningful in Windows. Please run the following two commands in a Python script in order to show the current user and the access-control list on the directory:

    import subprocess
    subprocess.call('whoami.exe')
    subprocess.call(r'icacls.exe "C:\Users\Username\Desktop"')

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42046>
_______________________________________

From report at bugs.python.org  Thu Oct 15 14:33:20 2020
From: report at bugs.python.org (David CARLIER)
Date: Thu, 15 Oct 2020 18:33:20 +0000
Subject: [issue42047] DragonFlyBSD thread native id support missing
Message-ID: <1602786800.77.0.034925025592.issue42047@roundup.psfhosted.org>


Change by David CARLIER <devnexen at gmail.com>:


----------
components: Extension Modules
nosy: devnexen
priority: normal
severity: normal
status: open
title: DragonFlyBSD thread native id support missing
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42047>
_______________________________________

From report at bugs.python.org  Thu Oct 15 14:34:17 2020
From: report at bugs.python.org (David CARLIER)
Date: Thu, 15 Oct 2020 18:34:17 +0000
Subject: [issue42047] DragonFlyBSD thread native id support missing
Message-ID: <1602786857.38.0.77210028079.issue42047@roundup.psfhosted.org>


Change by David CARLIER <devnexen at gmail.com>:


----------
keywords: +patch
pull_requests: +21681
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22714

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42047>
_______________________________________

From report at bugs.python.org  Thu Oct 15 14:42:18 2020
From: report at bugs.python.org (Josh Lee)
Date: Thu, 15 Oct 2020 18:42:18 +0000
Subject: [issue16525] wave file module does not support 32bit float format
In-Reply-To: <1353528827.37.0.543069044809.issue16525@psf.upfronthosting.co.za>
Message-ID: <1602787338.18.0.172611730563.issue16525@roundup.psfhosted.org>


Change by Josh Lee <jleedev at gmail.com>:


----------
nosy: +jleedev

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16525>
_______________________________________

From report at bugs.python.org  Thu Oct 15 14:54:00 2020
From: report at bugs.python.org (Paul Moore)
Date: Thu, 15 Oct 2020 18:54:00 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602788040.66.0.264552932728.issue42041@roundup.psfhosted.org>


Change by Paul Moore <p.f.moore at gmail.com>:


----------
keywords: +patch
pull_requests: +21683
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22715

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Thu Oct 15 14:55:46 2020
From: report at bugs.python.org (Paul Moore)
Date: Thu, 15 Oct 2020 18:55:46 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602788146.67.0.979897910126.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

I've created https://github.com/python/cpython/pull/22715 as a suggested documentation fix. Mark, does this cover what you would have needed to know? Steve, is what I've written technically accurate?

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Thu Oct 15 15:00:29 2020
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 15 Oct 2020 19:00:29 +0000
Subject: [issue42044] Running Python in unbuffered mode may not write all
 contents to the console
In-Reply-To: <1602768124.79.0.2669254941.issue42044@roundup.psfhosted.org>
Message-ID: <1602788429.59.0.306993392643.issue42044@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

Text mode without a buffer isn't reliable. That said, Python 3.9 no longer supports Windows 7, so it can remove the 32 KiB limit on console I/O files.

The size limit in Windows 7 and earlier is due to the LPC-based pseudo-files that it uses for I/O. Under the hood, console pseudo-files use a 64 KiB heap that's shared between the console host process and client processes. 

In Windows 8+, console files are real files that use the ConDrv device instead of LPC, in which case there is practically no limit on the size of buffers that can be read and written.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42044>
_______________________________________

From report at bugs.python.org  Thu Oct 15 15:19:12 2020
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 15 Oct 2020 19:19:12 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602789552.49.0.956051079408.issue42041@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

PR 22715 is accurate for the current implementation of subprocess. There has been discussion in past issues about implementing a PATH search that's similar to what the CMD shell does -- as in calling os.system() or Popen() with shell=True -- instead of relying on the search that WinAPI CreateProcessW implements. The resolved path would be passed as the `executable` argument, which becomes the lpApplicationName argument of CreateProcessW.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Thu Oct 15 15:44:02 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Thu, 15 Oct 2020 19:44:02 +0000
Subject: [issue42043] zipfile.Path should support inheritance
In-Reply-To: <1602763408.56.0.61735130641.issue42043@roundup.psfhosted.org>
Message-ID: <1602791042.33.0.853850800588.issue42043@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

This issue was addressed incidentally in [jaraco/zipp#56](https://github.com/jaraco/zipp/issues/56) released as zipp 3.2.0.

I'd like to incorporate the tests submitted in PR 22711 and then port those changes to Python.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42043>
_______________________________________

From report at bugs.python.org  Thu Oct 15 16:12:25 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 15 Oct 2020 20:12:25 +0000
Subject: [issue42048] Document Argument Clinic's defining_class converter
Message-ID: <1602792744.97.0.495560068875.issue42048@roundup.psfhosted.org>


New submission from Erlend Egeberg Aasland <erlend.aasland at innova.no>:

The 'defining_class' AC converter is not documented.

https://www.python.org/dev/peps/pep-0573/#argument-clinic
https://docs.python.org/3.10/howto/clinic.html

----------
components: Argument Clinic
messages: 378696
nosy: erlendaasland, larry, vstinner
priority: normal
severity: normal
status: open
title: Document Argument Clinic's defining_class converter
type: enhancement
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42048>
_______________________________________

From report at bugs.python.org  Thu Oct 15 16:15:09 2020
From: report at bugs.python.org (Mark Keller)
Date: Thu, 15 Oct 2020 20:15:09 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602792909.97.0.28679447814.issue42041@roundup.psfhosted.org>


Mark Keller <markooo.keller at gmail.com> added the comment:

This sounds good to me Paul, thank you again!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Thu Oct 15 16:41:17 2020
From: report at bugs.python.org (Paul Moore)
Date: Thu, 15 Oct 2020 20:41:17 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602794477.57.0.169984006872.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

Eryk - I suggest that we modify (or remove) the note in venv that my PR adds as part of such a change, rather than try to qualify the text now (which would probably only make it harder for people to understand the issue).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Thu Oct 15 17:05:20 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Thu, 15 Oct 2020 21:05:20 +0000
Subject: [issue41855] FastPath.zip_children can give duplicate results on
 Python 3.8
In-Reply-To: <1600979447.4.0.878308868671.issue41855@roundup.psfhosted.org>
Message-ID: <1602795920.51.0.281402179881.issue41855@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:


New changeset 967fddae2fe48f297563c358bdbdde1e2cfed4ee by Jason R. Coombs in branch '3.8':
[3.8] bpo-41855: Fix duplicate results in FastPath.zip_children() (#22404)
https://github.com/python/cpython/commit/967fddae2fe48f297563c358bdbdde1e2cfed4ee


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41855>
_______________________________________

From report at bugs.python.org  Thu Oct 15 17:25:53 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Thu, 15 Oct 2020 21:25:53 +0000
Subject: [issue42043] zipfile.Path should support inheritance
In-Reply-To: <1602763408.56.0.61735130641.issue42043@roundup.psfhosted.org>
Message-ID: <1602797153.93.0.67858927103.issue42043@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
pull_requests: +21684
pull_request: https://github.com/python/cpython/pull/22716

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42043>
_______________________________________

From report at bugs.python.org  Thu Oct 15 20:44:00 2020
From: report at bugs.python.org (David Edelsohn)
Date: Fri, 16 Oct 2020 00:44:00 +0000
Subject: [issue42030] Drop support for dynload_aix
In-Reply-To: <1602634134.46.0.704375608696.issue42030@roundup.psfhosted.org>
Message-ID: <1602809040.76.0.0630395776954.issue42030@roundup.psfhosted.org>


David Edelsohn <dje.gcc at gmail.com> added the comment:

If Python has been defaulting to dlopen() on AIX systems that support it, there is no reason to maintain the historical, AIX-specific load() support in dynload_aix.c

I believe that dlopen() was introduced on AIX in release 4.3.  The official end of support for AIX 4.3 was 2003, so I doubt there are any customers on extended support, or at least those customers are unlikely to install Python 3.11.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42030>
_______________________________________

From report at bugs.python.org  Thu Oct 15 22:58:54 2020
From: report at bugs.python.org (Kevin)
Date: Fri, 16 Oct 2020 02:58:54 +0000
Subject: [issue42030] Drop support for dynload_aix
In-Reply-To: <1602634134.46.0.704375608696.issue42030@roundup.psfhosted.org>
Message-ID: <1602817134.65.0.523841727943.issue42030@roundup.psfhosted.org>


Change by Kevin <kadler at us.ibm.com>:


----------
keywords: +patch
pull_requests: +21685
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22717

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42030>
_______________________________________

From report at bugs.python.org  Thu Oct 15 23:06:55 2020
From: report at bugs.python.org (Kevin)
Date: Fri, 16 Oct 2020 03:06:55 +0000
Subject: [issue42030] Drop support for dynload_aix
In-Reply-To: <1602634134.46.0.704375608696.issue42030@roundup.psfhosted.org>
Message-ID: <1602817615.63.0.304745932346.issue42030@roundup.psfhosted.org>


Kevin <kadler at us.ibm.com> added the comment:

I've opened a PR to disable support in 3.10 with removal in 3.11 according to the guidelines outline in PEP 11. Given the unlikeliness that anyone is actually still using this feature (and are possibly already broken by a bunch of other things), would it make more sense to do the removal in one go? I do see that systems without multithreading support were both unsupported and removed in 3.7, though I do not know the particulars of why that is the case since most other entries have a 1 version gap.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42030>
_______________________________________

From report at bugs.python.org  Fri Oct 16 00:39:07 2020
From: report at bugs.python.org (Josh Rosenberg)
Date: Fri, 16 Oct 2020 04:39:07 +0000
Subject: [issue42033] Seemingly unnecessary complexification of foo(**kw)
In-Reply-To: <1602672511.92.0.360571035375.issue42033@roundup.psfhosted.org>
Message-ID: <1602823147.21.0.19562314524.issue42033@roundup.psfhosted.org>


Change by Josh Rosenberg <shadowranger+python at gmail.com>:


----------
nosy: +josh.r

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42033>
_______________________________________

From report at bugs.python.org  Fri Oct 16 01:34:51 2020
From: report at bugs.python.org (waicalibre)
Date: Fri, 16 Oct 2020 05:34:51 +0000
Subject: [issue42049] Add image/webp to list of media types in mimetypes.py
Message-ID: <1602826491.72.0.784851705448.issue42049@roundup.psfhosted.org>


New submission from waicalibre <waicailbre_aayx at protonmail.com>:

WebP is an open image format that's existed for 10 years and is supported by most modern web browsers: https://developer.mozilla.org/en-US/docs/Web/Media/Formats/Image_types#WebP. It should be in the list of media types.

----------
messages: 378702
nosy: waicalibre
priority: normal
severity: normal
status: open
title: Add image/webp to list of media types in mimetypes.py
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42049>
_______________________________________

From report at bugs.python.org  Fri Oct 16 01:36:08 2020
From: report at bugs.python.org (waicalibre)
Date: Fri, 16 Oct 2020 05:36:08 +0000
Subject: [issue42049] Add image/webp to list of media types in mimetypes.py
In-Reply-To: <1602826491.72.0.784851705448.issue42049@roundup.psfhosted.org>
Message-ID: <1602826568.14.0.794956717413.issue42049@roundup.psfhosted.org>


Change by waicalibre <waicailbre_aayx at protonmail.com>:


----------
keywords: +patch
pull_requests: +21686
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22718

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42049>
_______________________________________

From report at bugs.python.org  Fri Oct 16 01:41:48 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Fri, 16 Oct 2020 05:41:48 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1602826908.83.0.360456843405.issue35823@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

I've updated my PR.

* After a discussion with Alexander Monakov (a GCC developer), moved vfork() into a small function to isolate it from both subprocess_fork_exec() and child_exec(). This appears to be the best strategy to avoid -Wclobbered false positives as well as potential compiler bugs.

* Got rid of VFORK_USABLE checks in function parameter lists. Now `child_sigmask` parameter is always present, but is NULL if vfork() is not available or usable. The type is `void *` to avoid hard dependence on sigset_t, which other CPython source files appear to avoid.

* Disabled vfork() in case setuid()/setgid()/setgroups() needed.

* Added more comments explaining vfork()-related stuff.

* Added commit message and NEWS entry.

Potential improvements:

* To avoid repeating long parameter lists in several functions, we can move them to a struct. The downside is that we'd need to convert child_exec() to use that struct all over the place. I don't have a strong preference here.

* Are any documentation changes needed? We don't change any interfaces, so I'm not sure.

Potential future directions:

* If desired, a vfork() opt-out may be implemented. But it'd need to disable posix_spawn() on Linux as well, since it might be implemented via vfork(), and we have no good way to check that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Fri Oct 16 02:04:32 2020
From: report at bugs.python.org (Xavier Morel)
Date: Fri, 16 Oct 2020 06:04:32 +0000
Subject: [issue24828] Segfault when using store-context AST node in a load
 context
In-Reply-To: <1439042614.34.0.045626812152.issue24828@psf.upfronthosting.co.za>
Message-ID: <1602828272.21.0.19510499063.issue24828@roundup.psfhosted.org>


Xavier Morel <xavier.morel at masklinn.net> added the comment:

Should I close this since I believe 2.7 is not supported anymore?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24828>
_______________________________________

From report at bugs.python.org  Fri Oct 16 02:44:21 2020
From: report at bugs.python.org (Carlo Dri)
Date: Fri, 16 Oct 2020 06:44:21 +0000
Subject: [issue33533] Provide an async iterator version of as_completed
In-Reply-To: <1526453333.0.0.682650639539.issue33533@psf.upfronthosting.co.za>
Message-ID: <1602830661.72.0.0741138563003.issue33533@roundup.psfhosted.org>


Change by Carlo Dri <carlo.dri at gmail.com>:


----------
nosy: +carlodri

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33533>
_______________________________________

From report at bugs.python.org  Fri Oct 16 02:58:44 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 16 Oct 2020 06:58:44 +0000
Subject: [issue42049] Add image/webp to list of media types in mimetypes.py
In-Reply-To: <1602826491.72.0.784851705448.issue42049@roundup.psfhosted.org>
Message-ID: <1602831524.15.0.807088598672.issue42049@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This seems to be a duplicate of https://bugs.python.org/issue38902

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42049>
_______________________________________

From report at bugs.python.org  Fri Oct 16 04:27:23 2020
From: report at bugs.python.org (Hartmut Goebel)
Date: Fri, 16 Oct 2020 08:27:23 +0000
Subject: [issue42050] ensurepip fails if cwd contains illformed setup.cf
Message-ID: <1602836843.13.0.778924482006.issue42050@roundup.psfhosted.org>


New submission from Hartmut Goebel <h.goebel at crazy-compilers.com>:

If the current directory contains a ill-formed setup.cfg, setting up a virtual env fails, caused by ensurepip failing:

Expected behaviour:
running ensurepip should completely ignore the content of the current working directory.

How to reproduce:

$ rm -rf /tmp/v2
$ mkdir /tmp/v2
$ cd /tmp/v2
$ cat > setup.cfg <<EOF
> [options]
> setuptools_requires
> EOF
$ python3 -m venv /tmp/v2/_venv
Error: Command '['/tmp/v2/_venv/bin/python3', '-Im', 'ensurepip', '--upgrade', '--default-pip']' returned non-zero exit status 2.
$ /tmp/v2/_venv/bin/python3 -Im ensurepip --upgrade --default-pip
Looking in links: /tmp/tmpimoh6tke
Collecting setuptools
Collecting pip
Installing collected packages: setuptools, pip
Exception:
?
configparser.ParsingError: Source contains parsing errors: 'setup.cfg'
        [line  2]: 'setuptools_requires\n'


Environment:
Tested with both Python 3.8.2 and 3.7.6

----------
components: Library (Lib)
messages: 378706
nosy: htgoebel
priority: normal
severity: normal
status: open
title: ensurepip fails if cwd contains illformed setup.cf
type: crash
versions: Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42050>
_______________________________________

From report at bugs.python.org  Fri Oct 16 04:32:10 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 16 Oct 2020 08:32:10 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
Message-ID: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

The XML documentation starts with a red warning:

"Warning: The XML modules are not secure against erroneous or maliciously constructed data. If you need to parse untrusted or unauthenticated data see the XML vulnerabilities and The defusedxml Package sections. "
https://docs.python.org/dev/library/xml.html

I suggest to add the same warning to the plistlib library which uses the XML parser internally to handle XML files.

----------
components: Library (Lib)
messages: 378707
nosy: vstinner
priority: normal
severity: normal
status: open
title: plistlib inherits XML vulnerabilities: we should document them
type: security
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Fri Oct 16 04:32:51 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 16 Oct 2020 08:32:51 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1602837171.78.0.219611979962.issue42051@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Fri Oct 16 04:34:47 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 16 Oct 2020 08:34:47 +0000
Subject: [issue41919] Modify test_codecs to use the new codecs.unregister()
 function
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1602837287.06.0.968336021625.issue41919@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset c9f696cb96d1c362d5cad871f61da520572d9b08 by Hai Shi in branch 'master':
bpo-41919, test_codecs: Move codecs.register calls to setUp() (GH-22513)
https://github.com/python/cpython/commit/c9f696cb96d1c362d5cad871f61da520572d9b08


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Fri Oct 16 04:34:56 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 16 Oct 2020 08:34:56 +0000
Subject: [issue41919] Modify test_codecs to use the new codecs.unregister()
 function
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1602837296.69.0.840906851064.issue41919@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Fri Oct 16 04:45:33 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Fri, 16 Oct 2020 08:45:33 +0000
Subject: [issue36034] Suprise halt caused by
 -Werror=implicit-function-declaration in ./Modules/posixmodule.c
In-Reply-To: <1550577361.99.0.890870320024.issue36034@roundup.psfhosted.org>
Message-ID: <1602837933.7.0.686395300214.issue36034@roundup.psfhosted.org>


Change by Alexey Izbyshev <izbyshev at ispras.ru>:


----------
resolution:  -> not a bug

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36034>
_______________________________________

From report at bugs.python.org  Fri Oct 16 05:21:22 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 16 Oct 2020 09:21:22 +0000
Subject: [issue36534] tarfile and zipfile: handling Windows (path) illegal
 characters in archive member names
In-Reply-To: <1554458671.74.0.11308540457.issue36534@roundup.psfhosted.org>
Message-ID: <1602840082.66.0.380994927286.issue36534@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

zipfile is also impacted by the issue of reserved Windows filenames like "NUL". ZipFile._sanitize_windows_name() does not handle them.

----------
title: tarfile: handling Windows (path) illegal characters in archive member names -> tarfile and zipfile: handling Windows (path) illegal characters in archive member names

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36534>
_______________________________________

From report at bugs.python.org  Fri Oct 16 06:48:40 2020
From: report at bugs.python.org (conchylicultor)
Date: Fri, 16 Oct 2020 10:48:40 +0000
Subject: [issue42052] pathlib.Path should not call str() internally to allow
 inheritance
Message-ID: <1602845320.78.0.454867915032.issue42052@roundup.psfhosted.org>


New submission from conchylicultor <etiennefg.pot at gmail.com>:

I'm writing a subclass of `pathlib.Path` with custom `__fspath__`.

To prevent bad usages (users should use `os.fspath(path)` instead of `str(path)` to access the underlying path), I would like to overwrite `str`:


```
class MyPath(pathlib.PosixPath):

  def __fspath__(self) -> str:
    # Custom fspath

  def __str__(self) -> str:
    raise TypeError(
        f'Please do not use `str()` directly:'
        ' * For display: Use, f-string, `.format` or `repr`'
        ' * To access the path string: Use `os.fspath`, as per PEP 519'
    )

  def __format__(self, format_spec) -> str:
    return format(super().__str__(), format_spec)
```

However, this is breaking pathlib internal, as `str(self)` is used at many places. It would be nice if all internal `str()` calls where replaced by some `self._str()`.

I also think it would be more semantically correct if some of the `__str__` call where replaced by `__fspath__`, like: https://github.com/python/cpython/blob/b30934e9afb0af3f8e2e5f0992445be775b3c630/Lib/pathlib.py#L748

----------
components: Library (Lib)
messages: 378710
nosy: conchylicultor
priority: normal
severity: normal
status: open
title: pathlib.Path should not call str() internally to allow inheritance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42052>
_______________________________________

From report at bugs.python.org  Fri Oct 16 07:47:36 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 16 Oct 2020 11:47:36 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1602848856.41.0.235629592021.issue42051@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Is there something we could do in plistlib to avoid those problems? 

Plist XML files are not arbitrary XML. In particular disabling entity definitions would avoid the problems mentioned as plist files should not contain those. That said, a quick glance at the xml.etree module doesn't seem to have a documented way to disable entities.

----------
nosy: +ronaldoussoren

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Fri Oct 16 08:24:14 2020
From: report at bugs.python.org (Nikolay)
Date: Fri, 16 Oct 2020 12:24:14 +0000
Subject: [issue15795] Zipfile.extractall does not preserve file permissions
In-Reply-To: <1346106964.12.0.723201722432.issue15795@psf.upfronthosting.co.za>
Message-ID: <1602851054.13.0.648451085129.issue15795@roundup.psfhosted.org>


Nikolay <kulakov.n at gmail.com> added the comment:

Is there any chance that the pull request will be accepted? I'm a bit tired of using workaround every time I need unzip something on linux.

----------
nosy: +kulakov-n

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15795>
_______________________________________

From report at bugs.python.org  Fri Oct 16 08:32:50 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 16 Oct 2020 12:32:50 +0000
Subject: [issue24828] Segfault when using store-context AST node in a load
 context
In-Reply-To: <1439042614.34.0.045626812152.issue24828@psf.upfronthosting.co.za>
Message-ID: <1602851570.9.0.945051165532.issue24828@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24828>
_______________________________________

From report at bugs.python.org  Fri Oct 16 09:47:15 2020
From: report at bugs.python.org (conchylicultor)
Date: Fri, 16 Oct 2020 13:47:15 +0000
Subject: [issue42052] pathlib.Path should not call str() internally to allow
 inheritance
In-Reply-To: <1602845320.78.0.454867915032.issue42052@roundup.psfhosted.org>
Message-ID: <1602856035.09.0.989850566265.issue42052@roundup.psfhosted.org>


conchylicultor <etiennefg.pot at gmail.com> added the comment:

Closing this as I realize that even if this was solved, it would still not fully resolve the issue. Basically I want to control how __fspath__ and __str__ behave externally (for users), but internal fspath and str should always call `super()`

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42052>
_______________________________________

From report at bugs.python.org  Fri Oct 16 10:00:55 2020
From: report at bugs.python.org (john_miller)
Date: Fri, 16 Oct 2020 14:00:55 +0000
Subject: [issue42046] Unable to write to file without elevated privileges
In-Reply-To: <1602783392.97.0.0712436068375.issue42046@roundup.psfhosted.org>
Message-ID: <1602856855.18.0.224379262796.issue42046@roundup.psfhosted.org>


john_miller <johnson.b.ourne+pythonbugtracker at gmail.com> added the comment:

Short summary:
>icacls.exe C:\Python38-32\python.exe lists Mandatory Label\Low Mandatory Level:(I)(NW) ** This might be the problem. Removing "L" with icacls might work.
>User integrity level is usually "Medium"
>**When a user attempts to launch an executable file, the new process is created with the minimum of the user integrity level and the file integrity level.**
>NOT TESTED "icacls.exe" with option "/setintegritylevel Medium" applied to all relevant files in the Python-directory could changee the low integrity-level inherited from "C:\".

---
The python-process runs under the username "Username" according to the 
>whoami.exe (in python.exe launched from a non-elevated console)
COMPUTERNAME\username
0
>whoami.exe (in python.exe launched from an elevated console)
COMPUTERNAME\username
0
>whoami.exe (launched directly from non-elevated console)
COMPUTERNAME\username

>icacls.exe "C:\Users\Username\Desktop" 
C:\Users\Username\Desktop NT AUTHORITY\SYSTEM:(I)(OI)(CI)(F)
                          BUILTIN\Administrators:(I)(OI)(CI)(F)
                          COMPUTERNAME\Username:(I)(OI)(CI)(F)
>icacls.exe "C:\Users\Username"
C:\Users\Username NT AUTHORITY\SYSTEM:(OI)(CI)(F)
                  BUILTIN\Administrators:(OI)(CI)(F)
                  COMPUTERNAME\Username:(OI)(CI)(F)
                  COMPUTERNAME\HomeUsers:(RX)

(I used to UNIX-syntax as a short-hand for specified permissions relating to a specified user. I can see how that could introduce misunderstandings for everyone glancing over the text.)

I used procexp.exe to dig around the Security-tab of the active processes:
A difference between the processes seems to relate to MIC-labels on the running processes[1], especially when compared to a notepad.exe launched from a non-elevated console.

cmd.exe (Non-elevated) Medium -> python.exe Low
cmd.exe (Elevated) High -> python.exe High
cmd.exe (Non-elevated) Medium -> notepad.exe Medium

Low -> Mandatory Label\Low Mandatory Level
Medium -> Mandatory Label\Medium Mandatory Level
High-> Mandatory Label\High Mandatory Level

It seems this labeling system is checked before Discretionary Access Control List's (DACL) come into play.[2]

>Windows defines four integrity levels: low, medium, high, and system. Standard users receive medium, elevated users receive high. Processes you start and objects you create receive your integrity level (medium or high) or low if the executable file's level is low; system services receive system integrity. Objects that lack an integrity label are treated as medium by the operating system; this prevents low-integrity code from modifying unlabeled objects. Additionally, Windows ensures that processes running with a low integrity level cannot obtain access a process which is associated with an app container.

>**When a user attempts to launch an executable file, the new process is created with the minimum of the user integrity level and the file integrity level.** 
>This means that the new process will never execute with higher integrity than the executable file. If the administrator user executes a low integrity program, the token for the new process functions with the low integrity level. This helps protect a user who launches untrustworthy code from malicious acts performed by that code. The user data, which is at the typical user integrity level, is write-protected against this new process.

The file integrity-level can be modified with icacls.exe and it's "/setintegritylevel [(CI)(OI)]Level"-option (Level= one element of {L,M,H,Low,Medium,High}).

(In theory "icacls.exe C:\Python38-32\python.exe /setintegritylevel Medium" might do the trick. I haven't tested this. I wonder if icacls would still list an integrity-level on the file for files that have Medium integrity.)

I'll also look into System Access Control List's (SACL)[4] too as mentioned in [2].

Using SetACL.exe [5], I found nothing of note:
>SetACL.exe -on "C:\Windows\system32\notepad.exe" -ot file -actn list -lst "f:tab;w:d,s,o,g;i:y"
for SACL-part: Everyone   write+WRITE_OWNER+WRITE_DAC+DELETE   audit   audit_success+audit_fail
>SetACL.exe -on "C:\Python38-32\python.exe" -ot file -actn list -lst "f:tab;w:d,s,o,g;i:y"
for SACL-part: [empty]


>icacls.exe C:\Python38-32\python.exe BUILTIN\Administrators:(I)(F)
                           NT AUTHORITY\SYSTEM:(I)(F)
                           BUILTIN\User:(I)(RX)
                           NT AUTHORITY\Authenticated Users:(I)(M)
                           Mandatory Label\Low Mandatory Level:(I)(NW) ** This might be the problem. Removing "L" with icacls might work.
>icacls.exe C:\Python38-32
C:\Python38-32 BUILTIN\Administrators:(I)(F)
               BUILTIN\Administrators:(I)(OI)(CI)(IO)(F)
               NT AUTHORITY\SYSTEM:(I)(F)
               NT AUTHORITY\SYSTEM:(I)(OI)(CI)(IO)(F)
               BUILTIN\User:(I)(OI)(CI)(RX)
               NT AUTHORITY\Authenticated Users:(I)(M)
               NT AUTHORITY\Authenticated Users:(I)(OI)(CI)(IO)(M)
               Mandatory Label\Low Mandatory Level:(I)(OI)(CI)(NW)
>icacls.exe C:\
C:\ BUILTIN\Administrators:(F)
    BUILTIN\Administrators:(OI)(CI)(IO)(F)
    NT AUTHORITY\SYSTEM:(F)
    NT AUTHORITY\SYSTEM:(OI)(CI)(IO)(F)
    BUILTIN\User:(OI)(CI)(RX)
    NT AUTHORITY\Authenticated Users:(OI)(CI)(IO)(M)
    NT AUTHORITY\Authenticated Users:(AD)
    Mandatory Label\Low Mandatory Level:(OI)(CI)(NW)

icacls.exe "C:\Program Files" doesn't have "Mandatory Label\Low Mandatory Level" in it's ACL.

It's probably not related, but downloading with Chrome, sets an NTFS-alternate-datastream "Zone.Identifier" with content "[ZoneTransfer]"+line-break+"ZoneId=3" on files it downloads as of late.
("dir /R file.txt" shows file.txt:Zone.Identifier:$DATA ; access with "notepad.exe file.txt:Zone.Identifier").
Neither C:\Python38-32 nor C:\Python38-32 have any alternate data-streams attached. But double-clicking on python.exe directly gives a security-warning (probably due to low-integrity-level) talking about how files from the Internet can be dangerous.

(Internet Explorer might change it's own integrity level downwards once launched, because the file-integrity-level of the exe is not low.)

[1] https://en.wikipedia.org/wiki/Mandatory_Integrity_Control )
[2] https://docs.microsoft.com/en-us/windows/win32/secauthz/mandatory-integrity-control
[3] https://docs.microsoft.com/en-us/windows/win32/api/winnt/ns-winnt-system_mandatory_label_ace
[4] https://docs.microsoft.com/en-us/windows/win32/ad/retrieving-an-objectampaposs-sacl
[5] https://helgeklein.com/setacl/documentation/command-line-version-setacl-exe/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42046>
_______________________________________

From report at bugs.python.org  Fri Oct 16 10:06:24 2020
From: report at bugs.python.org (Xavier Morel)
Date: Fri, 16 Oct 2020 14:06:24 +0000
Subject: [issue33387] Simplify bytecodes for try-finally,
 try-except and with blocks.
In-Reply-To: <1525026522.22.0.682650639539.issue33387@psf.upfronthosting.co.za>
Message-ID: <1602857184.71.0.644320925102.issue33387@roundup.psfhosted.org>


Xavier Morel <xavier.morel at masklinn.net> added the comment:

The 3.9 changelog mentions WITH_EXCEPT_FINISH but that seems to have ultimately been called WITH_EXCEPT_START, maybe it shoudl be updated also?

----------
nosy: +xmorel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33387>
_______________________________________

From report at bugs.python.org  Fri Oct 16 10:14:25 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Fri, 16 Oct 2020 14:14:25 +0000
Subject: [issue42011] Documentation for logging.Filter.filter reports the
 wrong return type
In-Reply-To: <1602493243.32.0.577845482202.issue42011@roundup.psfhosted.org>
Message-ID: <1602857665.53.0.272384002456.issue42011@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset e9959c71185d0850c84e3aba0301fbc238f194a9 by Necdet Can Atesman in branch 'master':
bpo-42011: Update documentation of logging.Filter.filter() (GH-22692)
https://github.com/python/cpython/commit/e9959c71185d0850c84e3aba0301fbc238f194a9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42011>
_______________________________________

From report at bugs.python.org  Fri Oct 16 10:54:08 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Fri, 16 Oct 2020 14:54:08 +0000
Subject: [issue42030] Drop support for dynload_aix
In-Reply-To: <1602634134.46.0.704375608696.issue42030@roundup.psfhosted.org>
Message-ID: <1602860048.22.0.987047140431.issue42030@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
nosy: +BTaskaya, pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42030>
_______________________________________

From report at bugs.python.org  Fri Oct 16 11:01:11 2020
From: report at bugs.python.org (Eryk Sun)
Date: Fri, 16 Oct 2020 15:01:11 +0000
Subject: [issue42046] Unable to write to file without elevated privileges
In-Reply-To: <1602783392.97.0.0712436068375.issue42046@roundup.psfhosted.org>
Message-ID: <1602860471.13.0.197494414762.issue42046@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> icacls.exe C:\Python38-32\python.exe lists Mandatory Label\
> Low Mandatory Level:(I)(NW) ** This might be the problem. Removing "L"
> with icacls might work.
>
> **When a user attempts to launch an executable file, the new process is
> created with the minimum of the user integrity level and the file 
> integrity level.**

The token mandatory policy [1] for a standard logon is TOKEN_MANDATORY_POLICY_NO_WRITE_UP (1) and TOKEN_MANDATORY_POLICY_NEW_PROCESS_MIN (2). The above quote applies to the latter. For an elevated logon, the mandatory policy is just TOKEN_MANDATORY_POLICY_NO_WRITE_UP, so setting a low-integrity label on python.exe has no effect on a new process created from an elevated security context. The following queries demonstrate the mandatory policy for both cases:

standard logon:

    >>> GetTokenInformation(-4, TokenMandatoryPolicy)
    3

elevated logon:

    >>> GetTokenInformation(-4, TokenMandatoryPolicy)
    1

> >icacls.exe C:\
> C:\ BUILTIN\Administrators:(F)
>     BUILTIN\Administrators:(OI)(CI)(IO)(F)
>     NT AUTHORITY\SYSTEM:(F)
>     NT AUTHORITY\SYSTEM:(OI)(CI)(IO)(F)
>     BUILTIN\User:(OI)(CI)(RX)
>     NT AUTHORITY\Authenticated Users:(OI)(CI)(IO)(M)
>     NT AUTHORITY\Authenticated Users:(AD)
>     Mandatory Label\Low Mandatory Level:(OI)(CI)(NW)

Something has modified the security on the root directory of your system drive. The low-integrity no-write-up (NW) label that's inheritable by directories (CI) and files (OI) is the source of the problem. It's supposed to be a high-integrity no-write-up (NW) label that applies to files in the root directory (OI)(NP) and not to the root directory itself (IO) or subdirectories (no CI):

    Mandatory Label\High Mandatory Level:(OI)(NP)(IO)(NW)

> I used to UNIX-syntax as a short-hand for specified permissions relating
> to a specified user. I can see how that could introduce misunderstandings
> for everyone glancing over the text.

I was concerned that you were using a third-party tools such as MSYS2 bash to check permissions. POSIX rwx access for a user can be computed in terms of effective permissions and generic read, write, and execute access rights. But there's no equivalent to POSIX owner and group permissions. Access for a user SID has to be computed against all entries in the DACL and the mandatory label.

[1] https://docs.microsoft.com/en-us/windows/win32/api/winnt/ns-winnt-token_mandatory_policy

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42046>
_______________________________________

From report at bugs.python.org  Fri Oct 16 12:01:24 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 16:01:24 +0000
Subject: [issue28660] TextWrapper break_long_words=True,
 break_on_hyphens=True on long words
In-Reply-To: <1478795701.76.0.659915154246.issue28660@psf.upfronthosting.co.za>
Message-ID: <1602864084.87.0.156416625793.issue28660@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +patch
nosy: +iritkatriel
nosy_count: 3.0 -> 4.0
pull_requests: +21688
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22721

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28660>
_______________________________________

From report at bugs.python.org  Fri Oct 16 12:05:14 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 16:05:14 +0000
Subject: [issue28660] TextWrapper break_long_words=True,
 break_on_hyphens=True on long words
In-Reply-To: <1478795701.76.0.659915154246.issue28660@psf.upfronthosting.co.za>
Message-ID: <1602864314.42.0.716839080108.issue28660@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

textwrap does not actually apply the break-on-hyphen algorithm at all to long words. It just chops them up into depth-sized pieces. 

The PR I just submitted looks for hyphens and uses them as cut points if they exist, without any attempt to understand their context.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28660>
_______________________________________

From report at bugs.python.org  Fri Oct 16 12:28:49 2020
From: report at bugs.python.org (Mark Shannon)
Date: Fri, 16 Oct 2020 16:28:49 +0000
Subject: [issue33387] Simplify bytecodes for try-finally,
 try-except and with blocks.
In-Reply-To: <1525026522.22.0.682650639539.issue33387@psf.upfronthosting.co.za>
Message-ID: <1602865729.95.0.247828962725.issue33387@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
pull_requests: +21689
pull_request: https://github.com/python/cpython/pull/22723

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33387>
_______________________________________

From report at bugs.python.org  Fri Oct 16 12:29:33 2020
From: report at bugs.python.org (Steve Dower)
Date: Fri, 16 Oct 2020 16:29:33 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602865773.68.0.227701939129.issue42041@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Thanks for doing the PR, Paul.

Honestly, I'd rather document in subprocess that Popen("python") is not a good idea, and should use either sys.executable or shutil.which depending on what you mean. This is a platform-independent gotcha, as it's very easy to reproduce the failure (e.g. run on Linux where "python"==Python 2.x).

Describing the current state of how venv works in the venv docs is fine, and what you've got there is accurate (might be easier to follow on first reading if it leads with Python picking up the venv based on the launched executable, rather than anything in the terminal's environment).

My concern is that we don't make this level of detail a documented guarantee, and can still change it between major versions without the deprecation period. I'm happy to guarantee intended uses, and it might be worth figuring out what those are (e.g. does double-clicking in Explorer matter? what about the Run window? Desktop shortcuts? With/without activation? etc.) and likely we'd have to clarify which ones don't work the same for the symlink vs. redirector options.

IOW, if someone writes an actual spec (and we all agree on it), we can guarantee that. Without it, I'd rather implementation internals remain internal.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Fri Oct 16 12:46:57 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 16 Oct 2020 16:46:57 +0000
Subject: [issue42011] Documentation for logging.Filter.filter reports the
 wrong return type
In-Reply-To: <1602493243.32.0.577845482202.issue42011@roundup.psfhosted.org>
Message-ID: <1602866817.34.0.146568662053.issue42011@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21691
pull_request: https://github.com/python/cpython/pull/22725

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42011>
_______________________________________

From report at bugs.python.org  Fri Oct 16 12:46:49 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 16 Oct 2020 16:46:49 +0000
Subject: [issue42011] Documentation for logging.Filter.filter reports the
 wrong return type
In-Reply-To: <1602493243.32.0.577845482202.issue42011@roundup.psfhosted.org>
Message-ID: <1602866809.14.0.194550624357.issue42011@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21690
pull_request: https://github.com/python/cpython/pull/22724

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42011>
_______________________________________

From report at bugs.python.org  Fri Oct 16 12:47:32 2020
From: report at bugs.python.org (Mark Shannon)
Date: Fri, 16 Oct 2020 16:47:32 +0000
Subject: [issue33387] Simplify bytecodes for try-finally,
 try-except and with blocks.
In-Reply-To: <1525026522.22.0.682650639539.issue33387@psf.upfronthosting.co.za>
Message-ID: <1602866852.55.0.951640066427.issue33387@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Yes, thanks for pointing that out.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33387>
_______________________________________

From report at bugs.python.org  Fri Oct 16 13:06:47 2020
From: report at bugs.python.org (Benjamin Peterson)
Date: Fri, 16 Oct 2020 17:06:47 +0000
Subject: [issue42030] Drop support for dynload_aix
In-Reply-To: <1602634134.46.0.704375608696.issue42030@roundup.psfhosted.org>
Message-ID: <1602868007.06.0.871304366542.issue42030@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:

I think we should just axe it.

----------
nosy: +benjamin.peterson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42030>
_______________________________________

From report at bugs.python.org  Fri Oct 16 13:20:37 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Fri, 16 Oct 2020 17:20:37 +0000
Subject: [issue42011] Documentation for logging.Filter.filter reports the
 wrong return type
In-Reply-To: <1602493243.32.0.577845482202.issue42011@roundup.psfhosted.org>
Message-ID: <1602868837.41.0.207652960197.issue42011@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset 8f7eab788aedcf1a23ef9be767e1b3502a6bbd5c by Miss Skeleton (bot) in branch '3.8':
bpo-42011: Update documentation of logging.Filter.filter() (GH-22692) (GH-22724)
https://github.com/python/cpython/commit/8f7eab788aedcf1a23ef9be767e1b3502a6bbd5c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42011>
_______________________________________

From report at bugs.python.org  Fri Oct 16 13:21:56 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Fri, 16 Oct 2020 17:21:56 +0000
Subject: [issue42011] Documentation for logging.Filter.filter reports the
 wrong return type
In-Reply-To: <1602493243.32.0.577845482202.issue42011@roundup.psfhosted.org>
Message-ID: <1602868916.94.0.434620310105.issue42011@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset dff9161821032acfd2588d42d88511ebdbabaaf3 by Miss Skeleton (bot) in branch '3.9':
bpo-42011: Update documentation of logging.Filter.filter() (GH-22692) (GH-22725)
https://github.com/python/cpython/commit/dff9161821032acfd2588d42d88511ebdbabaaf3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42011>
_______________________________________

From report at bugs.python.org  Fri Oct 16 13:22:48 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Fri, 16 Oct 2020 17:22:48 +0000
Subject: [issue42011] Documentation for logging.Filter.filter reports the
 wrong return type
In-Reply-To: <1602493243.32.0.577845482202.issue42011@roundup.psfhosted.org>
Message-ID: <1602868968.88.0.699487640476.issue42011@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42011>
_______________________________________

From report at bugs.python.org  Fri Oct 16 13:29:34 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 17:29:34 +0000
Subject: [issue28660] TextWrapper break_long_words=True,
 break_on_hyphens=True on long words
In-Reply-To: <1478795701.76.0.659915154246.issue28660@psf.upfronthosting.co.za>
Message-ID: <1602869374.87.0.324491959297.issue28660@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Actually I see what Serhiy meant about the hyphen algorithm - the regex breaking up words. Yes, this is applied to long words and the reason he stated for this issue is correct.

It is probably possible to make that regex understand width and long-words, but it would be more complicated and will need to be recalculated for each width. I think long words are not the typical input, so it's better to handle them separately and keep the rest simple.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28660>
_______________________________________

From report at bugs.python.org  Fri Oct 16 13:31:45 2020
From: report at bugs.python.org (dubiousjim)
Date: Fri, 16 Oct 2020 17:31:45 +0000
Subject: [issue42053] fwalk: incorrect boolean test for non-fd arguments
Message-ID: <1602869505.61.0.789643368245.issue42053@roundup.psfhosted.org>


New submission from dubiousjim <dubiousjim at gmail.com>:

`Lib/os.py` has at line 464, in definition of `fwalk`:

```
if not isinstance(top, int) or not hasattr(top, '__index__'):
```

If I understand this test correctly, it should be requiring that the name/fd is NEITHER an int NOR has an __index__ method. As written, anything which fails the left-hand side (and so is an int) will probably have an __index__ method, so the right-hand side is idle.

Proposed fix: change `or` to `and`.

----------
components: Library (Lib)
messages: 378725
nosy: dubiousjim
priority: normal
severity: normal
status: open
title: fwalk: incorrect boolean test for non-fd arguments
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42053>
_______________________________________

From report at bugs.python.org  Fri Oct 16 13:42:52 2020
From: report at bugs.python.org (Kevin)
Date: Fri, 16 Oct 2020 17:42:52 +0000
Subject: [issue42030] Drop support for dynload_aix
In-Reply-To: <1602634134.46.0.704375608696.issue42030@roundup.psfhosted.org>
Message-ID: <1602870172.35.0.164342795144.issue42030@roundup.psfhosted.org>


Kevin <kadler at us.ibm.com> added the comment:

Ok, I have updated the PR to remove it completely.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42030>
_______________________________________

From report at bugs.python.org  Fri Oct 16 13:54:13 2020
From: report at bugs.python.org (Paul Moore)
Date: Fri, 16 Oct 2020 17:54:13 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602870853.84.0.400417425101.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

Fair enough. I think we have to be careful here - people do rely on how the "internal" aspects of virtual environments work, like it or not, and we've definitely broken people's code in the past as a result of taking a hardline "it's not documented, so it's not guaranteed" approach. (Disclaimer - we broke some of my code, so I'm not unbiased when I say the above ;-))

I take your point that this is a cross-platform issue, and as such would be worth putting in the `subprocess` documentation. When I looked, though, I couldn't really find anywhere that felt appropriate. I'll take a second look, but if you have any suggestions I'd appreciate it.

The bit that I *do* think is a venv gotcha is that it's entirely reasonable for a user to expect that if they run path\to\venv\Scripts\python.exe, then their Python script will be run by that executable. The redirector breaks that assumption, and while I'm fine with the idea that we don't want to document all of the details of the redirector, I *do* think we should document that you must not make that assumption.

How about this:

   The mechanism by which virtual enviroments are implemented means that
   you should not assume that the executable in the virtual environment
   is the one that will ultimately run your script. As a result, you
   should always use `sys.executable` to identify "this script's Python
   interpreter", as that is guaranteed to be set as you would expect.

I'm not completely happy with the above, but that's mostly because I'd rather just document how the process works (even if it's with a disclaimer "this is implementation detail and may change without notice"). But that's not my call to make, so I'll defer to you on that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Fri Oct 16 14:03:36 2020
From: report at bugs.python.org (Benjamin Peterson)
Date: Fri, 16 Oct 2020 18:03:36 +0000
Subject: [issue42030] Drop support for dynload_aix
In-Reply-To: <1602634134.46.0.704375608696.issue42030@roundup.psfhosted.org>
Message-ID: <1602871416.21.0.616958256795.issue42030@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset 1dd6d956a3ddf2cf6d4a69241dba8cd1379421b9 by Kevin Adler in branch 'master':
closes bpo-42030: Remove legacy AIX dynload support (GH-22717)
https://github.com/python/cpython/commit/1dd6d956a3ddf2cf6d4a69241dba8cd1379421b9


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42030>
_______________________________________

From report at bugs.python.org  Fri Oct 16 14:08:14 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Fri, 16 Oct 2020 18:08:14 +0000
Subject: [issue40341] Programming FAQ includes actively discouraged solutions; 
 Should those be removed?
In-Reply-To: <1587416365.54.0.999974156982.issue40341@roundup.psfhosted.org>
Message-ID: <1602871694.5.0.187437240118.issue40341@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
nosy: +ZackerySpytz
nosy_count: 3.0 -> 4.0
pull_requests: +21692
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22726

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40341>
_______________________________________

From report at bugs.python.org  Fri Oct 16 14:17:42 2020
From: report at bugs.python.org (Steve Dower)
Date: Fri, 16 Oct 2020 18:17:42 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602872262.89.0.0334668504757.issue42041@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> The bit that I *do* think is a venv gotcha is that it's entirely reasonable for a user to expect that if they run path\to\venv\Scripts\python.exe, then their Python script will be run by that executable.

This is still true, though, as much as it's ever been. The gotcha is that launching "python" may not launch "path\to\venv\Scripts\python.exe" even if that's the first entry on PATH.

For the documentation, we could phrase it more positively as "If you need the path to the Python executable, use sys.executable. Relying on explicit or implicit PATH resolution may result in the wrong version of Python being used, especially when the user has launched from a virtual environment."

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Fri Oct 16 14:19:55 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 18:19:55 +0000
Subject: [issue32549] Travis: Test with OpenSSL 1.1.0
In-Reply-To: <1515926387.7.0.467229070634.issue32549@psf.upfronthosting.co.za>
Message-ID: <1602872395.65.0.941651446805.issue32549@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32549>
_______________________________________

From report at bugs.python.org  Fri Oct 16 14:23:20 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 18:23:20 +0000
Subject: [issue32659] Solaris "stat" should support "st_fstype"
In-Reply-To: <1516841214.25.0.467229070634.issue32659@psf.upfronthosting.co.za>
Message-ID: <1602872600.02.0.675834176496.issue32659@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32659>
_______________________________________

From report at bugs.python.org  Fri Oct 16 14:26:21 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 18:26:21 +0000
Subject: [issue31878] Cygwin: _socket module does not compile due to missing
 ioctl declaration
In-Reply-To: <1509032541.6.0.213398074469.issue31878@psf.upfronthosting.co.za>
Message-ID: <1602872781.3.0.479221909315.issue31878@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31878>
_______________________________________

From report at bugs.python.org  Fri Oct 16 14:42:02 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 18:42:02 +0000
Subject: [issue33483] build system requires explicit compiler,
 but should discover it
In-Reply-To: <1526236134.66.0.682650639539.issue33483@psf.upfronthosting.co.za>
Message-ID: <1602873722.49.0.452747436635.issue33483@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33483>
_______________________________________

From report at bugs.python.org  Fri Oct 16 14:44:25 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 16 Oct 2020 18:44:25 +0000
Subject: [issue40341] Programming FAQ includes actively discouraged solutions; 
 Should those be removed?
In-Reply-To: <1587416365.54.0.999974156982.issue40341@roundup.psfhosted.org>
Message-ID: <1602873865.79.0.0348474801346.issue40341@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset a22a19f3548f6064035e7c59a19cda1e9506db92 by Zackery Spytz in branch 'master':
bpo-40341: Remove some "discouraged solutions" in Doc/faq/programming.rst (GH-22726)
https://github.com/python/cpython/commit/a22a19f3548f6064035e7c59a19cda1e9506db92


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40341>
_______________________________________

From report at bugs.python.org  Fri Oct 16 14:44:38 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 16 Oct 2020 18:44:38 +0000
Subject: [issue40341] Programming FAQ includes actively discouraged solutions; 
 Should those be removed?
In-Reply-To: <1587416365.54.0.999974156982.issue40341@roundup.psfhosted.org>
Message-ID: <1602873878.75.0.733137597604.issue40341@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21693
pull_request: https://github.com/python/cpython/pull/22727

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40341>
_______________________________________

From report at bugs.python.org  Fri Oct 16 14:44:32 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 18:44:32 +0000
Subject: [issue33394] the build of the shared modules is quiet/non-visible
 when GNU make gets passed macros
In-Reply-To: <1525109371.22.0.682650639539.issue33394@psf.upfronthosting.co.za>
Message-ID: <1602873872.07.0.451739058935.issue33394@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33394>
_______________________________________

From report at bugs.python.org  Fri Oct 16 14:45:11 2020
From: report at bugs.python.org (Benjamin Peterson)
Date: Fri, 16 Oct 2020 18:45:11 +0000
Subject: [issue33483] build system requires explicit compiler,
 but should discover it
In-Reply-To: <1526236134.66.0.682650639539.issue33483@psf.upfronthosting.co.za>
Message-ID: <1602873911.2.0.846762054231.issue33483@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33483>
_______________________________________

From report at bugs.python.org  Fri Oct 16 14:54:04 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 16 Oct 2020 18:54:04 +0000
Subject: [issue40341] Programming FAQ includes actively discouraged solutions; 
 Should those be removed?
In-Reply-To: <1587416365.54.0.999974156982.issue40341@roundup.psfhosted.org>
Message-ID: <1602874444.4.0.24024122551.issue40341@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40341>
_______________________________________

From report at bugs.python.org  Fri Oct 16 15:14:38 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Fri, 16 Oct 2020 19:14:38 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602875678.45.0.57905406758.issue41972@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

FWIW I think your numbers look good, a small needle cut-off is likely a good idea.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Fri Oct 16 15:17:43 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Fri, 16 Oct 2020 19:17:43 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602875863.96.0.0983636398403.issue41972@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Another potential algorithm to consider in large needle situations is a Rabin-Karp rolling hash string search.

If used, it's the kind of algorithm that I'd probably bail out to an alternate method on if a run of Rabin-Karp started having a high percentage of false positive failed comparisons (suggesting data antagonistic to the chosen rolling hash algorithm(s) which would degenerate performance back to Needle*Haystack territory).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Fri Oct 16 15:24:02 2020
From: report at bugs.python.org (Mark Sapiro)
Date: Fri, 16 Oct 2020 19:24:02 +0000
Subject: [issue42054] email message get_content throws KeyError for content
 main types font and model
Message-ID: <1602876242.42.0.187869890423.issue42054@roundup.psfhosted.org>


New submission from Mark Sapiro <mark at msapiro.net>:

With Policy = email.policy.default, there are handlers for get_content() only for content types 'text', 'audio', 'image', 'video', 'application', 'message/rfc822', 'message/external-body' and 'message'. While these are the only main types listed in RFC 6838, RFC 8081 adds 'font' and RFC 2077 defines 'model' there are several registered 'font' and 'model' types at https://www.iana.org/assignments/media-types/media-types.xhtml

It would be good if get_content() returned content, even if only raw bytes, for those types.

----------
messages: 378738
nosy: msapiro
priority: normal
severity: normal
status: open
title: email message get_content throws KeyError for content main types font and model
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42054>
_______________________________________

From report at bugs.python.org  Fri Oct 16 15:40:08 2020
From: report at bugs.python.org (john_miller)
Date: Fri, 16 Oct 2020 19:40:08 +0000
Subject: [issue42046] Unable to write to file without elevated privileges
In-Reply-To: <1602783392.97.0.0712436068375.issue42046@roundup.psfhosted.org>
Message-ID: <1602877208.03.0.418619547067.issue42046@roundup.psfhosted.org>


john_miller <johnson.b.ourne+pythonbugtracker at gmail.com> added the comment:

I changed the integrity-level of "C:\" to "Mandatory Label\High Mandatory Level:(OI)(NP)(IO)(NW)" which seems to have fixed the problem.

Thanks for the help.

I guess I must have directly or through some other application indirectly changed the integrity level of "C:\".

Regarding:
>The token mandatory policy [1] for a standard logon is TOKEN_MANDATORY_POLICY_NO_WRITE_UP (1) and TOKEN_MANDATORY_POLICY_NEW_PROCESS_MIN (2). The above quote applies to the latter. For an elevated logon, the mandatory policy is just TOKEN_MANDATORY_POLICY_NO_WRITE_UP, so setting a low-integrity label on python.exe has no effect on a new process created from an elevated security context. The following queries demonstrate the mandatory policy for both cases:

Could this be affected by User-Account-Control (UAC) being set to the highest level?

Starting python.exe from a non-elevated shell (user is administrator):
>>> import win32security
>>> import win32api
>>> import win32con
>>> process = win32api.GetCurrentProcess()
>>> processtoken = win32security.OpenProcessToken(process, win32con.MAXIMUM_ALLOWED)
>>> win32security.GetTokenInformation(processtoken, win32security.TokenMandatoryPolicy)
3 (TOKEN_MANDATORY_POLICY_NO_WRITE_UP and TOKEN_MANDATORY_POLICY_NEW_PROCESS_MIN)

Starting python.exe from an elevated shell (user is administrator):
>>> import win32security
>>> import win32api
>>> import win32con
>>> process = win32api.GetCurrentProcess()
>>> processtoken = win32security.OpenProcessToken(process, win32con.MAXIMUM_ALLOWED)
>>> win32security.GetTokenInformation(processtoken, win32security.TokenMandatoryPolicy)
1 (TOKEN_MANDATORY_POLICY_NO_WRITE_UP)

I assume in this case the following sentence would apply with the "python.exe"-file's integrity level being set to Low:
>**When a user attempts to launch an executable file, the new process is created with the minimum of the user integrity level and the file integrity level.**
As the shell is started with medium integrity level and the file is set to low integrity level the process would get created with low integrity level.

Regarding the integrity settings:
This seems to be problem affecting other people too.
https://answers.microsoft.com/en-us/protect/forum/mse-protect_scanning-windows_7/cs-integrity-level-set-to-low-by-essentials-full/e61e537e-54fb-4923-93bc-784a0b583f1a
https://answers.microsoft.com/en-us/windows/forum/windows_7-winapps/root-of-systemdrive-keeps-getting-low-integrity/6cfd967d-17f5-44a1-beaa-1ad1ffe28faa
https://answers.microsoft.com/en-us/windows/forum/all/root-of-systemdrive-keeps-getting-low-integrity/6cfd967d-17f5-44a1-beaa-1ad1ffe28faa
"C:\Program Files", "C:\Users" and "C:\Windows" seem to have their own DACL's.

(win32security.GetFileSecurity("C:\\", win32security.SACL_SECURITY_INFORMATION) fails on me even on an elevated prompt.
chml https://www.minasi.com/apps/ seems to be more descriptive with SACL-integrity policies (No write up, No read up, No execute up))
(icacls.exe seems to have undocumented options with /setintegritylevel https://docs.microsoft.com/en-us/windows-server/administration/windows-commands/icacls
"(NW)" is not directly mentioned. I'm assuming "(NR)" and "(NX)" might be the missing integrity policy options for an integrity level entry.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42046>
_______________________________________

From report at bugs.python.org  Fri Oct 16 15:39:53 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Fri, 16 Oct 2020 19:39:53 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602877193.0.0.682607769203.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

I'm doing a couple more timing tests to try to understand exactly when the cutoff should be applied (based on some combination of needle and haystack lengths).

Can the rolling hash algorithm be made to go sublinear like O(n/m)? It looked like it was pretty essential that it hash/unhash each and every haystack character. You could probably do a bloom-like check where you jump ahead by the needle length sometimes, but you'd then have to re-hash the m characters in the new window anyway.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Fri Oct 16 15:45:54 2020
From: report at bugs.python.org (Paul Moore)
Date: Fri, 16 Oct 2020 19:45:54 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602877554.91.0.778449216859.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

> This is still true, though, as much as it's ever been.

But it's *not*, if I understand the problem here. Windows resolves a bare "python" command by searching the directory containing the running executable first. I would reasonably assume that if I type

    path/to/venv/scripts/python.exe foo.py

then the "running executable" is "path/to/venv/scripts/python.exe", and so the path containing the running executable is "path/to/venv/scripts", so a search for "python" will locate "path/to/venv/scripts/python.exe", because that's how Windows path search rules work. The problem is that that exe is a redirector, and the script is *actually* being run by the system Python.

Of course, the assumption I made is flawed, because there's never been anything saying that a program called "python.exe" can't do anything it likes in the process of running a script, including redirecting. But it's been the case for a long time, and IMO the introduction of the redirector counts as a user-visible behaviour change, and we should therefore explicitly point it out.

I really don't see why you are so reluctant to include this. I'm not asking that we guarantee any behaviour, or that we commit ourselves to anything. Just that we note that people ought not to be making a specific assumption (which it appears from this issue, people *have* been making).

> we could phrase it more positively

Cool, I'll update the PR to add this statement or something similar to the subprocess docs in the next couple of days.

I'm not going to fight to keep the comments in the venv documentation. I'm disappointed, and I feel like we'll end up with people relying on *more* of the implementation details because we're keeping things vague, but I have more important things to debate, so I'll drop this :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Fri Oct 16 15:49:20 2020
From: report at bugs.python.org (Bar Harel)
Date: Fri, 16 Oct 2020 19:49:20 +0000
Subject: [issue19270] Document that sched.cancel() doesn't distinguish equal
 events and can break order
In-Reply-To: <1381913252.24.0.629122693277.issue19270@psf.upfronthosting.co.za>
Message-ID: <1602877760.88.0.106429548723.issue19270@roundup.psfhosted.org>


Change by Bar Harel <bzvi7919 at gmail.com>:


----------
pull_requests: +21694
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22729

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19270>
_______________________________________

From report at bugs.python.org  Fri Oct 16 15:52:45 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Fri, 16 Oct 2020 19:52:45 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602877965.0.0.0981840238542.issue41972@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

I assume a rolling hash is linear at best, even if you do add some skip ahead checks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Fri Oct 16 16:15:31 2020
From: report at bugs.python.org (Matias Grioni)
Date: Fri, 16 Oct 2020 20:15:31 +0000
Subject: [issue42055] Python Nuget Packages for Windows Installation: Request
 for more versions
Message-ID: <1602879331.23.0.640725632242.issue42055@roundup.psfhosted.org>


New submission from Matias Grioni <matgrioni at gmail.com>:

Hello,

The python nuget feed here, https://www.nuget.org/packages/python, has a lot of the versions post 3.5. However, it is missing some bug fix and security fix versions. For example, it has no versions after 3.6.8, which had security fixes until 3.6.12.

Is there a specific reason for excluding these? I can't tell any pattern related to security or bug fix versions for each of the minor versions.

Thanks,

Matias

----------
components: Installation, Windows
messages: 378743
nosy: matgrioni, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Python Nuget Packages for Windows Installation: Request for more versions
type: enhancement
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42055>
_______________________________________

From report at bugs.python.org  Fri Oct 16 16:25:31 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 16 Oct 2020 20:25:31 +0000
Subject: [issue42028] Regression in mimetypes for image/bmp
In-Reply-To: <1602623702.59.0.922962266093.issue42028@roundup.psfhosted.org>
Message-ID: <1602879931.0.0.886095844117.issue42028@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42028>
_______________________________________

From report at bugs.python.org  Fri Oct 16 16:28:07 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 16 Oct 2020 20:28:07 +0000
Subject: [issue40341] Programming FAQ includes actively discouraged solutions; 
 Should those be removed?
In-Reply-To: <1587416365.54.0.999974156982.issue40341@roundup.psfhosted.org>
Message-ID: <1602880087.16.0.889826538294.issue40341@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 0fbddb14dc03f61738af01af88e7d8aa8df07336 by Miss Skeleton (bot) in branch '3.9':
bpo-40341: Remove some "discouraged solutions" in Doc/faq/programming.rst (GH-22726) (GH-22727)
https://github.com/python/cpython/commit/0fbddb14dc03f61738af01af88e7d8aa8df07336


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40341>
_______________________________________

From report at bugs.python.org  Fri Oct 16 16:29:09 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 16 Oct 2020 20:29:09 +0000
Subject: [issue40341] Programming FAQ includes actively discouraged solutions; 
 Should those be removed?
In-Reply-To: <1587416365.54.0.999974156982.issue40341@roundup.psfhosted.org>
Message-ID: <1602880149.73.0.819009684438.issue40341@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Dominik, thanks for the suggestion.

Zackery, thanks for the PR.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40341>
_______________________________________

From report at bugs.python.org  Fri Oct 16 16:34:25 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 16 Oct 2020 20:34:25 +0000
Subject: [issue41988] No hyphen in broken up word in documentation
In-Reply-To: <1602276270.7.0.489043595778.issue41988@roundup.psfhosted.org>
Message-ID: <1602880465.94.0.959606292193.issue41988@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I am closing because word breakage when wrapping and justifying is an OS-browswer issue.  I see the image as having two hyphenation bugs, but whoever wrote that viewer might disagree.

The displayed paragraph is the first bullet point in the doc.  With Firefox on Windows 10, the default wrapping (narrower than my full screen width) is after 'paramont' and 'learn at'.

  Decimal ?is based on a floating-point model which was designed with people in mind, and necessarily has a paramount
  guiding principle ? computers must provide an arithmetic that works in the same way as the arithmetic that people learn at
  school.? ? excerpt from the decimal arithmetic specification.

If I enlarge the text with Cntl-Mousewheel, even up to to the max 300%, Firefox rewraps but never breaks words; it only justifies with spaces.

With MS Edge and Google Chrome, the default breaks are after 'has a' and 'as the' and the max enlargements are 400/500%, but the behavior is otherwise the same -- rewrapping and justification with spaces, no word breaks.

  Decimal ?is based on a floating-point model which was designed with people in mind, and necessarily has a
  paramount guiding principle ? computers must provide an arithmetic that works in the same way as the
  arithmetic that people learn at school.? ? excerpt from the decimal arithmetic specification.

Safari on my Macbook Mohave, does break words, and has nec-essarily, arith-metic, and ap-plication (later in the text), which are correct.

In the image, rewrapping is done by breaking words according to some local algorithm.  Short pieces as in ne-cessarily and ap-plications are hyphenated but the 'big' pieces of arith metic are not.  This looks like a browser bug, but might be a local standard.  According to both Google and my paper dictionary, the first hyphenation should be nec-essarily, as in Safari, which is an exception to the general rule of 'before a single consonant', as in spe-ci-fi-ca-tion.  But maybe some group disagrees with this exception.

----------
nosy: +mdk, terry.reedy
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41988>
_______________________________________

From report at bugs.python.org  Fri Oct 16 16:35:28 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 16 Oct 2020 20:35:28 +0000
Subject: [issue41988] No hyphen in broken up word in documentation
In-Reply-To: <1602276270.7.0.489043595778.issue41988@roundup.psfhosted.org>
Message-ID: <1602880528.98.0.716339974934.issue41988@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Raymond, what viewer are you using when you see unhyphenated word breaks?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41988>
_______________________________________

From report at bugs.python.org  Fri Oct 16 16:42:20 2020
From: report at bugs.python.org (Dean)
Date: Fri, 16 Oct 2020 20:42:20 +0000
Subject: [issue41966] datetime.time issue with pickling in PyPy
In-Reply-To: <1602065311.95.0.279586156365.issue41966@roundup.psfhosted.org>
Message-ID: <1602880940.28.0.99292612889.issue41966@roundup.psfhosted.org>


Change by Dean <scaram at gmail.com>:


----------
keywords: +patch
pull_requests: +21695
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22731

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41966>
_______________________________________

From report at bugs.python.org  Fri Oct 16 16:42:44 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 16 Oct 2020 20:42:44 +0000
Subject: [issue41989] htmlparser unclosed script tag causes data loss
In-Reply-To: <1602292109.75.0.598084394689.issue41989@roundup.psfhosted.org>
Message-ID: <1602880964.64.0.558507172949.issue41989@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Waylan, 3.7 and before only get security fixes.

To me, this might be considered an enhancement rather than bug fix, but I will leave that to Ezio.

----------
nosy: +terry.reedy
versions:  -Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41989>
_______________________________________

From report at bugs.python.org  Fri Oct 16 16:48:04 2020
From: report at bugs.python.org (Paul Moore)
Date: Fri, 16 Oct 2020 20:48:04 +0000
Subject: [issue42055] Python Nuget Packages for Windows Installation: Request
 for more versions
In-Reply-To: <1602879331.23.0.640725632242.issue42055@roundup.psfhosted.org>
Message-ID: <1602881284.95.0.447495536813.issue42055@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

Python 3.6.9 and later were source-only security fix releases. We don't provide *any* binary releases for those versions, the nuget distribution is no different in that respect.

The release schedule for Python 3.6 is at https://www.python.org/dev/peps/pep-0494/. There are similar PEPs for the release schedules of other versions.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42055>
_______________________________________

From report at bugs.python.org  Fri Oct 16 17:08:45 2020
From: report at bugs.python.org (Tim Peters)
Date: Fri, 16 Oct 2020 21:08:45 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602882525.7.0.0118454158623.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

I don't think Rabin-Karp is worth trying here. The PR is provably worst-case linear time, and the constant factor is already reasonably small. Its only real weakness I can see is that it can be significantly (but seemingly not dramatically) slower than the status quo, in what are exceptionally good cases for the status quo, and perhaps most often due to the increased preprocessing cost of the new code (which is relatively most damaging if the needle is found early in the haystack - in which cases preprocessing can be close to a pure waste of time).

The status quo and the PR both enjoy sublinear (O(len(haystack) / len(needle)) cases too, but R-K doesn't.

Where R-K is a "go to" choice is when an app needs to search the same large text for several strings (Wikipedia has a decent description of R-K can be adapted to that) - but Python has no string API that does such a thing (closest is joining the search-for strings via "|" for a regexp search).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Fri Oct 16 17:11:19 2020
From: report at bugs.python.org (Tim Peters)
Date: Fri, 16 Oct 2020 21:11:19 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602882679.85.0.74128387185.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Removed 3.8 from the Versions list. The code was functioning as designed, and the O(n*m) worst case bounds were always known to be possible, so there's no actual bug here.

----------
versions:  -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Fri Oct 16 17:12:25 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 16 Oct 2020 21:12:25 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1602882745.51.0.0345182836933.issue42010@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Subscription of list and dict (only with '') and ??? is at least puzzling.  Removal of a new feature after release is a bad idea.  But this new feature, expansion of subscription, needs to documented in
https://docs.python.org/3/reference/expressions.html#subscriptions
as legal code.

The current first line

 "A subscription selects an item of a sequence (string, tuple or list) or mapping (dictionary) object:"

is no longer always true.  This suggested replacement is:

 "Subscription of a sequence (string, tuple or list) or mapping (dictionary) object selects an item from the collection."

Then at the end, add something like

 "Subscription of certain type objects creates a Generic Alias.

where 'Generic Alias links to where such are documented.

----------
assignee:  -> docs at python
components: +Documentation -Interpreter Core
nosy: +docs at python, terry.reedy
stage: patch review -> needs patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Fri Oct 16 17:13:06 2020
From: report at bugs.python.org (Tim Peters)
Date: Fri, 16 Oct 2020 21:13:06 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602882786.52.0.25393979165.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

And changed the "Type" field to "performance", because speed is the only issue here.

----------
type: behavior -> performance

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Fri Oct 16 17:40:47 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 16 Oct 2020 21:40:47 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1602884447.12.0.14352184157.issue42010@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

That sentence has been a lie for a long time (from the start?).

Any type can define __getitem__ and get this behavior, though in this case it is done through __class_getitem__ (PEP NNN).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Fri Oct 16 17:49:21 2020
From: report at bugs.python.org (Steve Dower)
Date: Fri, 16 Oct 2020 21:49:21 +0000
Subject: [issue42028] Regression in mimetypes for image/bmp
In-Reply-To: <1602623702.59.0.922962266093.issue42028@roundup.psfhosted.org>
Message-ID: <1602884961.75.0.32859175169.issue42028@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Yep, looks like the extra entry can just be removed. Guess we missed it in issue4963

Care to submit a PR?

----------
versions: +Python 3.10 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42028>
_______________________________________

From report at bugs.python.org  Fri Oct 16 17:50:09 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 21:50:09 +0000
Subject: [issue32215] sqlite3 400x-600x slower depending on formatting of an
 UPDATE statement in a string
In-Reply-To: <1512434453.0.0.213398074469.issue32215@psf.upfronthosting.co.za>
Message-ID: <1602885009.03.0.904023775391.issue32215@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32215>
_______________________________________

From report at bugs.python.org  Fri Oct 16 17:54:52 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 21:54:52 +0000
Subject: [issue31522] _mboxMMDF.get_string() fails to pass param to get_bytes()
In-Reply-To: <1505860469.5.0.965882587471.issue31522@psf.upfronthosting.co.za>
Message-ID: <1602885292.72.0.839109310972.issue31522@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, can it be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31522>
_______________________________________

From report at bugs.python.org  Fri Oct 16 17:55:31 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 21:55:31 +0000
Subject: [issue31522] _mboxMMDF.get_string() fails to pass param to get_bytes()
In-Reply-To: <1505860469.5.0.965882587471.issue31522@psf.upfronthosting.co.za>
Message-ID: <1602885331.39.0.855957724855.issue31522@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Well, the PR doesn't have a unit test so maybe not.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31522>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:00:03 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:00:03 +0000
Subject: [issue35414] A reference counting bug in PyState_RemoveModule()
In-Reply-To: <1543991124.3.0.788709270274.issue35414@psf.upfronthosting.co.za>
Message-ID: <1602885603.66.0.731609400769.issue35414@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35414>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:00:24 2020
From: report at bugs.python.org (Steve Dower)
Date: Fri, 16 Oct 2020 22:00:24 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602885624.41.0.778488666599.issue42041@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> I'm not asking that we guarantee any behaviour, or that we commit ourselves to anything. Just that we note that people ought not to be making a specific assumption

Which is a fine intent, it's just the running assumption is that if it's in the documentation, it's supported (e.g. the distutils discussion). So no matter how carefully we document something as unsupported, people will still argue that it's supported because it's in the docs ????

> which it appears from this issue, people *have* been making

We'd need Mark to weigh in (or possibly track down and ask a colleague), but I expect the assumption is that subprocess.Popen("python") searches PATH first. I've honestly never encountered anyone who deliberately depended on the application directory search (at least the first time, some who have discovered it have used it, though it tends to surprise colleagues when they do).

> I'll update the PR to add this statement or something similar to the subprocess docs in the next couple of days.

No rush. We've got the sprints next week, and I don't have any major time consuming projects, so will probably get a few easier PRs done. Looks like I can edit your PR, so I can finish it up if you want to just move on :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:01:41 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:01:41 +0000
Subject: [issue35436] Add missing PyErr_NoMemory() calls
In-Reply-To: <1544165858.95.0.788709270274.issue35436@psf.upfronthosting.co.za>
Message-ID: <1602885701.12.0.653346056048.issue35436@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?  2.7 is no longer relevant.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35436>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:03:16 2020
From: report at bugs.python.org (Matias Grioni)
Date: Fri, 16 Oct 2020 22:03:16 +0000
Subject: [issue42055] Python Nuget Packages for Windows Installation: Request
 for more versions
In-Reply-To: <1602879331.23.0.640725632242.issue42055@roundup.psfhosted.org>
Message-ID: <1602885796.12.0.612571692173.issue42055@roundup.psfhosted.org>


Matias Grioni <matgrioni at gmail.com> added the comment:

Thanks Paul. I was confused by the 3.7.9 version on the feeds since it is a security fix version, but didn't do a more through check.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42055>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:03:56 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:03:56 +0000
Subject: [issue35525] Incorrect keyword name in NNTP.starttls() documentation
In-Reply-To: <1545146886.62.0.788709270274.issue35525@psf.upfronthosting.co.za>
Message-ID: <1602885836.78.0.177305254185.issue35525@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35525>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:05:14 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:05:14 +0000
Subject: [issue35847] RISC-V needs CTYPES_PASS_BY_REF_HACK
In-Reply-To: <1548750939.45.0.386681668204.issue35847@roundup.psfhosted.org>
Message-ID: <1602885914.73.0.438151483183.issue35847@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35847>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:05:10 2020
From: report at bugs.python.org (Steve Dower)
Date: Fri, 16 Oct 2020 22:05:10 +0000
Subject: [issue42055] Python Nuget Packages for Windows Installation: Request
 for more versions
In-Reply-To: <1602879331.23.0.640725632242.issue42055@roundup.psfhosted.org>
Message-ID: <1602885910.45.0.446990229803.issue42055@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Python 3.7.9 was a special case, as mentioned on the download page: https://www.python.org/downloads/release/python-379/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42055>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:09:45 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:09:45 +0000
Subject: [issue36179] _hashopenssl has reference leaks in OOM case
In-Reply-To: <1551692470.57.0.884323239932.issue36179@roundup.psfhosted.org>
Message-ID: <1602886185.35.0.126724176823.issue36179@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36179>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:15:13 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:15:13 +0000
Subject: [issue36285] Integer overflow in array.array.remove()
In-Reply-To: <1552521762.27.0.553620503066.issue36285@roundup.psfhosted.org>
Message-ID: <1602886513.68.0.112602228035.issue36285@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed? It was not backported to 3.7, but that's over now right?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36285>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:17:40 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:17:40 +0000
Subject: [issue36398] A possible crash in structseq.c's structseq_repr()
In-Reply-To: <1553228306.11.0.338923675636.issue36398@roundup.psfhosted.org>
Message-ID: <1602886660.91.0.657779239061.issue36398@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36398>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:20:42 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:20:42 +0000
Subject: [issue36531] PyType_FromSpec wrong behavior with multiple
 Py_tp_members
In-Reply-To: <1554422020.37.0.786317222832.issue36531@roundup.psfhosted.org>
Message-ID: <1602886842.44.0.54633596067.issue36531@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed? Or did you keep it open in order to add a unit test?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36531>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:21:57 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:21:57 +0000
Subject: [issue36583] Do not swallow exceptions in the _ssl module
In-Reply-To: <1554880959.84.0.895759680892.issue36583@roundup.psfhosted.org>
Message-ID: <1602886917.78.0.0614887659821.issue36583@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36583>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:25:53 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:25:53 +0000
Subject: [issue31922] Can't receive replies from multicast UDP with asyncio
In-Reply-To: <1509619876.25.0.213398074469.issue31922@psf.upfronthosting.co.za>
Message-ID: <1602887153.4.0.398044273234.issue31922@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31922>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:30:13 2020
From: report at bugs.python.org (Paul Moore)
Date: Fri, 16 Oct 2020 22:30:13 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1602887413.02.0.0384778938221.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

> We'd need Mark to weigh in (or possibly track down and ask a colleague), but I expect the assumption is that subprocess.Popen("python") searches PATH first.

I'm sure it was, TBH. The executable directory side of things is really just on digging a bit deeper - "well, Windows actually uses the executable directory, but that's not relevant because I ran the venv Python". That's when the mistaken assumption happens.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:32:29 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:32:29 +0000
Subject: [issue26423] Integer overflow in wrap_lenfunc() on 64-bit build of
 Windows with len > 2**31-1
In-Reply-To: <1456268688.08.0.284414420897.issue26423@psf.upfronthosting.co.za>
Message-ID: <1602887549.39.0.28272942614.issue26423@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26423>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:34:47 2020
From: report at bugs.python.org (Tal Einat)
Date: Fri, 16 Oct 2020 22:34:47 +0000
Subject: [issue35525] Incorrect keyword name in NNTP.starttls() documentation
In-Reply-To: <1545146886.62.0.788709270274.issue35525@psf.upfronthosting.co.za>
Message-ID: <1602887687.19.0.663317096072.issue35525@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

Indeed, this can be closed :)

Thanks for the report Colin, thanks for the PR Harmandeep, and thanks for the reminder to close this Irit!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35525>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:41:04 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:41:04 +0000
Subject: [issue37553] SendfileUsingSendTest tests timeout too short for
 Windows ARM32
In-Reply-To: <1562802865.66.0.679596534727.issue37553@roundup.psfhosted.org>
Message-ID: <1602888064.58.0.547199624265.issue37553@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37553>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:47:17 2020
From: report at bugs.python.org (=?utf-8?q?Misty_De_M=C3=A9o?=)
Date: Fri, 16 Oct 2020 22:47:17 +0000
Subject: [issue42056] Configure on Apple ARM: "Unexpected output of 'arch' on
 OSX"
Message-ID: <1602888437.02.0.217887780449.issue42056@roundup.psfhosted.org>


New submission from Misty De M?o <mistydemeo at gmail.com>:

Configure's `arch` check on Macs running with Apple Silicon CPUs will fail because the list of acceptable architectures is hardcoded to Intel and PowerPC: https://github.com/python/cpython/blob/master/configure.ac#L2486-L2496

This needs a clause that adds "arm64" as an acceptable arch.

----------
components: Build
messages: 378776
nosy: mistydemeo
priority: normal
severity: normal
status: open
title: Configure on Apple ARM: "Unexpected output of 'arch' on OSX"
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42056>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:48:30 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:48:30 +0000
Subject: [issue37428] SSLContext.post_handshake_auth implicitly enables cert
 validation
In-Reply-To: <1561631609.42.0.922673247425.issue37428@roundup.psfhosted.org>
Message-ID: <1602888510.31.0.57635560893.issue37428@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed? 2.7 is no longer relevant.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37428>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:49:10 2020
From: report at bugs.python.org (=?utf-8?q?Misty_De_M=C3=A9o?=)
Date: Fri, 16 Oct 2020 22:49:10 +0000
Subject: [issue42056] Configure on Apple ARM: "Unexpected output of 'arch' on
 OSX"
In-Reply-To: <1602888437.02.0.217887780449.issue42056@roundup.psfhosted.org>
Message-ID: <1602888550.09.0.8558767715.issue42056@roundup.psfhosted.org>


Change by Misty De M?o <mistydemeo at gmail.com>:


----------
keywords: +patch
pull_requests: +21696
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22732

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42056>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:49:54 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:49:54 +0000
Subject: [issue37440] httplib should enable post-handshake authentication for
 TLS 1.3
In-Reply-To: <1561732145.9.0.0353203933987.issue37440@roundup.psfhosted.org>
Message-ID: <1602888594.64.0.515724450759.issue37440@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed? 2.7 is no longer relevant.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37440>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:51:59 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:51:59 +0000
Subject: [issue38041] IDLE Shell: Refine restart line
In-Reply-To: <1567709534.52.0.152965325603.issue38041@roundup.psfhosted.org>
Message-ID: <1602888719.23.0.869959455076.issue38041@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38041>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:53:37 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:53:37 +0000
Subject: [issue38094] unneeded assignment to wb.len in PyBytes_Concat using
 buffer protocol
In-Reply-To: <1568129056.61.0.163100885596.issue38094@roundup.psfhosted.org>
Message-ID: <1602888817.36.0.429498785198.issue38094@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38094>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:59:55 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 22:59:55 +0000
Subject: [issue37555] _CallList.__contains__ doesn't always respect ANY.
In-Reply-To: <1562821924.84.0.134272462767.issue37555@roundup.psfhosted.org>
Message-ID: <1602889195.92.0.282525868784.issue37555@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Does this need a backport? It's in 3.9 but not 3.8.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37555>
_______________________________________

From report at bugs.python.org  Fri Oct 16 18:59:33 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 16 Oct 2020 22:59:33 +0000
Subject: [issue38041] IDLE Shell: Refine restart line
In-Reply-To: <1567709534.52.0.152965325603.issue38041@roundup.psfhosted.org>
Message-ID: <1602889173.32.0.779829852174.issue38041@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Yes, the further changes I am thinking about should be a new issue.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38041>
_______________________________________

From report at bugs.python.org  Fri Oct 16 19:04:54 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 23:04:54 +0000
Subject: [issue32820] Add and document __format__ method for IPv[46]Address
In-Reply-To: <1518363954.67.0.467229070634.issue32820@psf.upfronthosting.co.za>
Message-ID: <1602889494.13.0.610223958141.issue32820@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Do these PRs need to be backported? They're in 3.9 but not 3.8.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32820>
_______________________________________

From report at bugs.python.org  Fri Oct 16 19:07:56 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 23:07:56 +0000
Subject: [issue32498] urllib.parse.unquote raises incorrect errormessage when
 string parameter is bytes
In-Reply-To: <1515179710.49.0.467229070634.issue32498@psf.upfronthosting.co.za>
Message-ID: <1602889676.19.0.930708897301.issue32498@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed? (It's intended as a 3.9-only change).

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32498>
_______________________________________

From report at bugs.python.org  Fri Oct 16 19:10:58 2020
From: report at bugs.python.org (Eryk Sun)
Date: Fri, 16 Oct 2020 23:10:58 +0000
Subject: [issue42046] Unable to write to file without elevated privileges
In-Reply-To: <1602783392.97.0.0712436068375.issue42046@roundup.psfhosted.org>
Message-ID: <1602889858.82.0.494474084924.issue42046@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> processtoken = win32security.OpenProcessToken(process, win32con.MAXIMUM_ALLOWED)
> win32security.GetTokenInformation(processtoken, win32security.TokenMandatoryPolicy)

FYI, starting with Windows 8, the system supports pseudo-handles for the access token of the current process -- (HANDLE)-4 -- and the current thread -- (HANDLE)-5, which don't have to be opened and closed. In the API, they're available as the inlined functions GetCurrentProcessToken() and GetCurrentThreadToken(). These pseudo-handles have TOKEN_QUERY and TOKEN_QUERY_SOURCE access, so they can be used with token queries, i.e. GetTokenInformation(-4, TokenInformationClass).

> As the shell is started with medium integrity level and the file is set to low 
> integrity level the process would get created with low integrity level.

Yes, because the access token of shell, which is a limited medium-integrity logon, has a mandatory policy that includes TOKEN_MANDATORY_POLICY_NEW_PROCESS_MIN.

> "C:\Program Files", "C:\Users" and "C:\Windows" seem to have their own DACL's.

Those directories have protected DACLs with custom security, so they don't inherit the inheritable entries from the root directory. For example:

    >>> sd = GetNamedSecurityInfo(r'C:\Program Files', SE_FILE_OBJECT,
    ...     DACL_SECURITY_INFORMATION)
    >>> sd.GetSecurityDescriptorControl()[0] & SE_DACL_PROTECTED
    4096

That said, Python's installer doesn't set custom security on the installation directory, and that's not likely to change. It just relies on inheritance. If you install in "C:\Python38-32", and the inheritable security from the root directory is problematic, then you need to resolve the problem manually, as you have done.

> win32security.GetFileSecurity("C:\\", win32security.SACL_SECURITY_INFORMATION) 
> fails on me even on an elevated prompt.

Querying audit entries in the SACL of an object (SACL_SECURITY_INFORMATION) requires ACCESS_SYSTEM_SECURITY access, which requires SeSecurityPrivilege to be enabled. Administrators have this privilege, but it's disabled by default. 

Some entries in the SACL can be read with just READ_CONTROL access: the mandatory label (LABEL_SECURITY_INFORMATION -- WRITE_OWNER access to set), security resource attributes (ATTRIBUTE_SECURITY_INFORMATION -- WRITE_DAC access to set), and the central access policy identifier (SCOPE_SECURITY_INFORMATION -- ACCESS_SYSTEM_SECURITY access to set).

> "(NW)" is not directly mentioned. I'm assuming "(NR)" and "(NX)" might be the 
> missing integrity policy options for an integrity level entry.

I don't think icacls.exe allows setting no-read-up and no-execute-up access control. "NR" and "NX" appear to be ignored. For example:

    >>> cmd = r'icacls C:\Temp\spam.txt /setintegritylevel H:(NW)(NR)(NX)'
    >>> subprocess.call(cmd)
    processed file: C:\Temp\spam.txt
    Successfully processed 1 files; Failed processing 0 files
    0
    
    >>> sd = GetNamedSecurityInfo(r'C:\Temp\spam.txt', SE_FILE_OBJECT,
    ...     LABEL_SECURITY_INFORMATION)
    >>> sacl = sd.GetSecurityDescriptorSacl()
    >>> (acetype, aceflags), mask, sid = sacl.GetAce(0)

    >>> acetype == SYSTEM_MANDATORY_LABEL_ACE_TYPE
    True
    >>> aceflags == 0
    True
    >>> LookupAccountSid(None, sid)
    ('High Mandatory Level', 'Mandatory Label', 10)

But only the no-write-up access control is set:

    >>> mask == SYSTEM_MANDATORY_LABEL_NO_WRITE_UP
    True

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42046>
_______________________________________

From report at bugs.python.org  Fri Oct 16 19:11:52 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 23:11:52 +0000
Subject: [issue31202] Windows pathlib.Path.glob(pattern) fixed part of the
 pattern changed to lowercase whereas it should be unchanged.
In-Reply-To: <1502719052.2.0.11123711046.issue31202@psf.upfronthosting.co.za>
Message-ID: <1602889912.39.0.194400714853.issue31202@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31202>
_______________________________________

From report at bugs.python.org  Fri Oct 16 19:13:43 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Fri, 16 Oct 2020 23:13:43 +0000
Subject: [issue32820] Add and document __format__ method for IPv[46]Address
In-Reply-To: <1518363954.67.0.467229070634.issue32820@psf.upfronthosting.co.za>
Message-ID: <1602890023.0.0.841590605014.issue32820@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Re: backporting

A quick test shows this feature is not in 3.8. We can't add new features to 3.8, so I'd say "no, it doesn't need to be backported".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32820>
_______________________________________

From report at bugs.python.org  Fri Oct 16 19:13:43 2020
From: report at bugs.python.org (Paul Monson)
Date: Fri, 16 Oct 2020 23:13:43 +0000
Subject: [issue37553] SendfileUsingSendTest tests timeout too short for
 Windows ARM32
In-Reply-To: <1602888064.58.0.547199624265.issue37553@roundup.psfhosted.org>
Message-ID: <CAFOF355GguwEsojp62B1TXFEY5+wKQQ-qM81Ks9xbVf4KhsaSg@mail.gmail.com>


Paul Monson <paulmons at gmail.com> added the comment:

Yes.

On Fri, Oct 16, 2020 at 3:41 PM Irit Katriel <report at bugs.python.org> wrote:

>
> Irit Katriel <iritkatriel at yahoo.com> added the comment:
>
> Can this be closed?
>
> ----------
> nosy: +iritkatriel
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue37553>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37553>
_______________________________________

From report at bugs.python.org  Fri Oct 16 19:23:12 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 23:23:12 +0000
Subject: [issue37931] crash reimporting posix after Py_Finalize on mac
In-Reply-To: <1566574787.75.0.458129578699.issue37931@roundup.psfhosted.org>
Message-ID: <1602890592.04.0.124634934457.issue37931@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37931>
_______________________________________

From report at bugs.python.org  Fri Oct 16 19:24:10 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 23:24:10 +0000
Subject: [issue38820] Make Python compatible with OpenSSL 3.0.0
In-Reply-To: <1573916819.64.0.690362352385.issue38820@roundup.psfhosted.org>
Message-ID: <1602890650.43.0.0432751386421.issue38820@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38820>
_______________________________________

From report at bugs.python.org  Fri Oct 16 19:25:44 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 16 Oct 2020 23:25:44 +0000
Subject: [issue33592] Document contextvars C API
In-Reply-To: <1526923723.99.0.682650639539.issue33592@psf.upfronthosting.co.za>
Message-ID: <1602890744.54.0.995657387993.issue33592@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Can this be closed?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33592>
_______________________________________

From report at bugs.python.org  Fri Oct 16 19:49:17 2020
From: report at bugs.python.org (Brice Gros)
Date: Fri, 16 Oct 2020 23:49:17 +0000
Subject: [issue31202] Windows pathlib.Path.glob(pattern) fixed part of the
 pattern changed to lowercase whereas it should be unchanged.
In-Reply-To: <1502719052.2.0.11123711046.issue31202@psf.upfronthosting.co.za>
Message-ID: <1602892157.4.0.314442892095.issue31202@roundup.psfhosted.org>


Brice Gros <aicirbs at yahoo.fr> added the comment:

I think so, the original PR has been ported to 3.9, 3.8, 3.7, and all the PRs were merged.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31202>
_______________________________________

From report at bugs.python.org  Fri Oct 16 19:50:15 2020
From: report at bugs.python.org (Tim Peters)
Date: Fri, 16 Oct 2020 23:50:15 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602892215.57.0.0461479339624.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

BTW, in the old post of Fredrick's I linked to, he referred to a "stringbench.py" program he used for timings, but the link is dead.

I was surprised to find that it still lives on, under the Tools directory. Or did - I'm on Windows now and its Python distro doesn't always have everything in a Linux distro, for "reasons" I can't remember ;-)

Anyway, here on GitHub:

https://github.com/python/cpython/tree/master/Tools/stringbench

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Fri Oct 16 20:11:35 2020
From: report at bugs.python.org (Steve Dower)
Date: Sat, 17 Oct 2020 00:11:35 +0000
Subject: [issue31202] Windows pathlib.Path.glob(pattern) fixed part of the
 pattern changed to lowercase whereas it should be unchanged.
In-Reply-To: <1502719052.2.0.11123711046.issue31202@psf.upfronthosting.co.za>
Message-ID: <1602893495.57.0.342740437989.issue31202@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Yeah, looks done.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31202>
_______________________________________

From report at bugs.python.org  Fri Oct 16 20:34:43 2020
From: report at bugs.python.org (paul j3)
Date: Sat, 17 Oct 2020 00:34:43 +0000
Subject: [issue41854] argparse.add_mutually_exclusive_group fails for optional
 positional arguments
In-Reply-To: <1600979030.91.0.326865229332.issue41854@roundup.psfhosted.org>
Message-ID: <1602894883.17.0.336615084247.issue41854@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

Give the positional a non-none default:

e.g.

    group.add_argument('args', metavar='ARGUMENT', nargs='*', default=[],
                     help='arguments to PROGRAM')

Since a '*' or '?' positional works with an empty list of arguments, it is "always seen".  It requires some special handling to allow it to work in the mutually exclusive context.  It's a tricky piece of code that might not be well documented (if at all).

----------
nosy: +paul.j3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41854>
_______________________________________

From report at bugs.python.org  Fri Oct 16 21:21:28 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 17 Oct 2020 01:21:28 +0000
Subject: [issue38094] unneeded assignment to wb.len in PyBytes_Concat using
 buffer protocol
In-Reply-To: <1568129056.61.0.163100885596.issue38094@roundup.psfhosted.org>
Message-ID: <1602897688.25.0.866456821677.issue38094@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38094>
_______________________________________

From report at bugs.python.org  Fri Oct 16 21:29:10 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 17 Oct 2020 01:29:10 +0000
Subject: [issue38820] Make Python compatible with OpenSSL 3.0.0
In-Reply-To: <1573916819.64.0.690362352385.issue38820@roundup.psfhosted.org>
Message-ID: <1602898150.6.0.248477125522.issue38820@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38820>
_______________________________________

From report at bugs.python.org  Fri Oct 16 21:52:04 2020
From: report at bugs.python.org (John Belmonte)
Date: Sat, 17 Oct 2020 01:52:04 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1602899524.49.0.97398726564.issue38250@roundup.psfhosted.org>


Change by John Belmonte <john at neggie.net>:


----------
nosy: +jbelmonte
nosy_count: 4.0 -> 5.0
pull_requests: +21698
pull_request: https://github.com/python/cpython/pull/22734

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Fri Oct 16 22:23:18 2020
From: report at bugs.python.org (Benjamin Peterson)
Date: Sat, 17 Oct 2020 02:23:18 +0000
Subject: [issue37440] httplib should enable post-handshake authentication for
 TLS 1.3
In-Reply-To: <1561732145.9.0.0353203933987.issue37440@roundup.psfhosted.org>
Message-ID: <1602901398.0.0.171900966167.issue37440@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37440>
_______________________________________

From report at bugs.python.org  Fri Oct 16 22:23:07 2020
From: report at bugs.python.org (Benjamin Peterson)
Date: Sat, 17 Oct 2020 02:23:07 +0000
Subject: [issue37428] SSLContext.post_handshake_auth implicitly enables cert
 validation
In-Reply-To: <1561631609.42.0.922673247425.issue37428@roundup.psfhosted.org>
Message-ID: <1602901387.69.0.703477871291.issue37428@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37428>
_______________________________________

From report at bugs.python.org  Fri Oct 16 22:33:29 2020
From: report at bugs.python.org (Hiroshi Miura)
Date: Sat, 17 Oct 2020 02:33:29 +0000
Subject: [issue42057] pytest case which catch  exceptions become segfault
Message-ID: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>


New submission from Hiroshi Miura <miurahr at linux.com>:

I've observed that pytest becomes segmentation fault on python 3.9.0 with attached case.

I've tested the case with several python versions;
  python 3.9.0a2 - good
  python 3.9.0a3, 3.9.0-final - bad
  python 3.10.0a1 - good

- OS: Mint Linux 20, Linux kernel 5.8.14
- Attachments:
    * test_main.py  - pytest test case to reproduce
    * py_stacktrace.txt - pytest result which become segmentation fault
    * gdb_backtrace.txt - gdb backtrace

So I've bisected and  a result is as follows;

9af0e47b1705457bb6b327c197f2ec5737a1d8f6 is the first bad commit
commit 9af0e47b1705457bb6b327c197f2ec5737a1d8f6
Author: Mark Shannon <mark at hotpy.org>
Date:   Tue Jan 14 10:12:45 2020 +0000

    bpo-39156: Break up COMPARE_OP into four logically distinct opcodes. (GH-17754)

    Break up COMPARE_OP into four logically distinct opcodes:
    * COMPARE_OP for rich comparisons
    * IS_OP for 'is' and 'is not' tests
    * CONTAINS_OP for 'in' and 'is not' tests
    * JUMP_IF_NOT_EXC_MATCH for checking exceptions in 'try-except' statements.

 Doc/library/dis.rst                                |   21 +
 Include/opcode.h                                   |    8 +-
 Lib/importlib/_bootstrap_external.py               |    3 +-
 Lib/opcode.py                                      |    7 +-
 Lib/test/test_dis.py                               |  141 +-
 Lib/test/test_peepholer.py                         |   12 +-
 Lib/test/test_positional_only_arg.py               |    6 +-
 .../2019-12-30-10-53-59.bpo-39156.veT-CB.rst       |    9 +
 PC/launcher.c                                      |    3 +-
 Python/ceval.c                                     |  137 +-
 Python/compile.c                                   |   71 +-
 Python/importlib.h                                 | 2922 +++++++------
 Python/importlib_external.h                        | 4560 ++++++++++----------
 Python/importlib_zipimport.h                       | 1831 ++++----
 Python/opcode_targets.h                            |    6 +-
 Python/peephole.c                                  |    6 +-
 Tools/scripts/generate_opcode_h.py                 |    5 -
 17 files changed, 4901 insertions(+), 4847 deletions(-)
 create mode 100644 Misc/NEWS.d/next/Core and Builtins/2019-12-30-10-53-59.bpo-39156.veT-CB.rst

----------
components: Interpreter Core
files: test_main.py
messages: 378796
nosy: miurahr
priority: normal
severity: normal
status: open
title: pytest case which catch  exceptions become segfault
type: crash
versions: Python 3.9
Added file: https://bugs.python.org/file49521/test_main.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Fri Oct 16 22:33:53 2020
From: report at bugs.python.org (Hiroshi Miura)
Date: Sat, 17 Oct 2020 02:33:53 +0000
Subject: [issue42057] pytest case which catch  exceptions become segfault
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1602902033.38.0.595983507457.issue42057@roundup.psfhosted.org>


Change by Hiroshi Miura <miurahr at linux.com>:


Added file: https://bugs.python.org/file49522/py_stacktrace.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Fri Oct 16 22:34:10 2020
From: report at bugs.python.org (Hiroshi Miura)
Date: Sat, 17 Oct 2020 02:34:10 +0000
Subject: [issue42057] pytest case which catch  exceptions become segfault
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1602902050.6.0.692074714949.issue42057@roundup.psfhosted.org>


Change by Hiroshi Miura <miurahr at linux.com>:


Added file: https://bugs.python.org/file49523/gdb_backtrace.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Fri Oct 16 22:45:23 2020
From: report at bugs.python.org (Vaibhav Banait)
Date: Sat, 17 Oct 2020 02:45:23 +0000
Subject: [issue42058] Process not running with args
Message-ID: <1602902723.88.0.655306807418.issue42058@roundup.psfhosted.org>


New submission from Vaibhav Banait <vbanait at gmail.com>:

I am getting this error on windows 10 python 3.8 Emacs 27 and prelude configuration

Company: backend company-ngram-backend error "Process company-ngram not running" with args (prefix)

I am using this code in .emacs

    (with-eval-after-load 'company-ngram
  ; ~/data/ngram/*.txt are used as data
  (setq company-ngram-data-dir "~/data/ngram")
  ; company-ngram supports python 3 or newer
  (setq company-ngram-python "python3")
  (company-ngram-init)
  (cons 'company-ngram-backend company-backends)
  ; or use `M-x turn-on-company-ngram' and
  ; `M-x turn-off-company-ngram' on individual buffers
  ;
  ; save the cache of candidates
  (run-with-idle-timer 7200 t
                       (lambda ()
                         (company-ngram-command "save_cache")
                         ))
  )

(require 'company-ngram nil t)

----------
components: Regular Expressions
messages: 378797
nosy: ezio.melotti, mrabarnett, vbanait
priority: normal
severity: normal
status: open
title: Process not running with args
type: compile error
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42058>
_______________________________________

From report at bugs.python.org  Fri Oct 16 23:18:10 2020
From: report at bugs.python.org (Hiroshi Miura)
Date: Sat, 17 Oct 2020 03:18:10 +0000
Subject: [issue42057] pytest case which catch  exceptions become segfault
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1602904690.9.0.41669445481.issue42057@roundup.psfhosted.org>


Hiroshi Miura <miurahr at linux.com> added the comment:

Here is a result of running pytest on python 3.9.0 with gdb.

==================================================== test session starts ====================================================
platform linux -- Python 3.9.0, pytest-4.6.9, py-1.8.1, pluggy-0.13.0
rootdir: /home/miurahr/Projects/cpython
collected 2 items

test_main.py .
Program received signal SIGSEGV, Segmentation fault.
PyException_GetContext (self=self at entry=<traceback at remote 0x7ffff62b47c0>) at ../Objects/exceptions.c:351
warning: Source file is more recent than executable.
351	    Py_XINCREF(context);

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Fri Oct 16 23:43:17 2020
From: report at bugs.python.org (Hiroshi Miura)
Date: Sat, 17 Oct 2020 03:43:17 +0000
Subject: [issue42057] pytest case which catch  exceptions become segfault
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1602906197.01.0.295968711163.issue42057@roundup.psfhosted.org>


Hiroshi Miura <miurahr at linux.com> added the comment:

FYI: A following commit fixes the issue in 3.10 development branch.

6e8128f02e ("bpo-41323: Perform 'peephole' optimizations directly on the CFG. (GH-21517)", 2020-07-30)

----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Fri Oct 16 23:56:31 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 17 Oct 2020 03:56:31 +0000
Subject: [issue37555] _CallList.__contains__ doesn't always respect ANY.
In-Reply-To: <1562821924.84.0.134272462767.issue37555@roundup.psfhosted.org>
Message-ID: <1602906991.49.0.595540516852.issue37555@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I would prefer not backporting this change given the discussion in https://github.com/python/cpython/pull/14700#issuecomment-531791029

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37555>
_______________________________________

From report at bugs.python.org  Sat Oct 17 00:45:30 2020
From: report at bugs.python.org (Vaibhav Banait)
Date: Sat, 17 Oct 2020 04:45:30 +0000
Subject: [issue42058] Process not running with args
In-Reply-To: <1602902723.88.0.655306807418.issue42058@roundup.psfhosted.org>
Message-ID: <1602909930.49.0.507998691606.issue42058@roundup.psfhosted.org>


Change by Vaibhav Banait <vbanait at gmail.com>:


----------
type: compile error -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42058>
_______________________________________

From report at bugs.python.org  Sat Oct 17 00:48:27 2020
From: report at bugs.python.org (Ma Lin)
Date: Sat, 17 Oct 2020 04:48:27 +0000
Subject: [issue38252] Use 8-byte step to detect ASCII sequence in 64bit
 Windows builds
In-Reply-To: <1569153002.15.0.915285235862.issue38252@roundup.psfhosted.org>
Message-ID: <1602910107.79.0.474823173044.issue38252@roundup.psfhosted.org>


Ma Lin <malincns at 163.com> added the comment:

Although the improvement is not great, it's a very hot code path.

Could you review the PR?

----------
components: +Windows
nosy: +paul.moore, tim.golden

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38252>
_______________________________________

From report at bugs.python.org  Sat Oct 17 00:55:21 2020
From: report at bugs.python.org (Hiroshi Miura)
Date: Sat, 17 Oct 2020 04:55:21 +0000
Subject: [issue42057] pytest case which catch  exceptions become segfault
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1602910521.73.0.0392227514225.issue42057@roundup.psfhosted.org>


Hiroshi Miura <miurahr at linux.com> added the comment:

A test code does not always reproduce the issue. Please try it in several times.

It seems to be happened when multiple threads try execute a same function which produces an exception, and both callers try to catch the exception at the same time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Sat Oct 17 02:26:39 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 17 Oct 2020 06:26:39 +0000
Subject: [issue36179] _hashopenssl has reference leaks in OOM case
In-Reply-To: <1551692470.57.0.884323239932.issue36179@roundup.psfhosted.org>
Message-ID: <1602915999.2.0.925587436556.issue36179@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36179>
_______________________________________

From report at bugs.python.org  Sat Oct 17 03:41:14 2020
From: report at bugs.python.org (Reuben Thomas)
Date: Sat, 17 Oct 2020 07:41:14 +0000
Subject: [issue41854] argparse.add_mutually_exclusive_group fails for optional
 positional arguments
In-Reply-To: <1600979030.91.0.326865229332.issue41854@roundup.psfhosted.org>
Message-ID: <1602920474.42.0.222957834206.issue41854@roundup.psfhosted.org>


Reuben Thomas <rrt at sc3d.org> added the comment:

Thanks for the hint; could this be documented, please?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41854>
_______________________________________

From report at bugs.python.org  Sat Oct 17 04:34:18 2020
From: report at bugs.python.org (Eric Osborne)
Date: Sat, 17 Oct 2020 08:34:18 +0000
Subject: [issue32820] Add and document __format__ method for IPv[46]Address
In-Reply-To: <1602890023.0.0.841590605014.issue32820@roundup.psfhosted.org>
Message-ID: <CA+97oKMRkXSzXFi1q1d7xG4nduS-BG_xWVt76Qjfo0buEpRDmg@mail.gmail.com>


Eric Osborne <eric at notcom.com> added the comment:

Yes, I agree. Regardless of backport policy, this is a handy little
convenience featurette, not sliced bread v2, so it's not worth backporting
even if it was permissible.

eric

On Fri, Oct 16, 2020 at 7:13 PM Eric V. Smith <report at bugs.python.org>
wrote:

>
> Eric V. Smith <eric at trueblade.com> added the comment:
>
> Re: backporting
>
> A quick test shows this feature is not in 3.8. We can't add new features
> to 3.8, so I'd say "no, it doesn't need to be backported".
>
> ----------
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue32820>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32820>
_______________________________________

From report at bugs.python.org  Sat Oct 17 05:23:29 2020
From: report at bugs.python.org (=?utf-8?q?Alex_Gr=C3=B6nholm?=)
Date: Sat, 17 Oct 2020 09:23:29 +0000
Subject: [issue42059] TypedDict(...) as function does not respect "total" when
 setting __required_keys__ and __optional_keys__
Message-ID: <1602926609.93.0.947551036861.issue42059@roundup.psfhosted.org>


New submission from Alex Gr?nholm <alex.gronholm at nextday.fi>:

>>> DummyDict = TypedDict('DummyDict', {'x': int, 'y': str}, total=False)
>>> DummyDict.__required_keys__
frozenset({'x', 'y'})

This happens because the TypedDict function does not pass the "total" metaclass argument to _TypedDictMeta() (instead passing "__total__" in the attribute namespace) and the new code that sets __required_keys__ and __optional_keys__ only checks the metaclass argument.

----------
components: Library (Lib)
messages: 378805
nosy: alex.gronholm
priority: normal
severity: normal
status: open
title: TypedDict(...) as function does not respect "total" when setting __required_keys__ and __optional_keys__
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42059>
_______________________________________

From report at bugs.python.org  Sat Oct 17 05:39:24 2020
From: report at bugs.python.org (=?utf-8?q?Alex_Gr=C3=B6nholm?=)
Date: Sat, 17 Oct 2020 09:39:24 +0000
Subject: [issue42059] TypedDict(...) as function does not respect "total" when
 setting __required_keys__ and __optional_keys__
In-Reply-To: <1602926609.93.0.947551036861.issue42059@roundup.psfhosted.org>
Message-ID: <1602927564.77.0.882038267461.issue42059@roundup.psfhosted.org>


Change by Alex Gr?nholm <alex.gronholm at nextday.fi>:


----------
keywords: +patch
pull_requests: +21699
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22736

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42059>
_______________________________________

From report at bugs.python.org  Sat Oct 17 05:40:42 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sat, 17 Oct 2020 09:40:42 +0000
Subject: [issue42056] Configure on Apple ARM: "Unexpected output of 'arch' on
 OSX"
In-Reply-To: <1602888437.02.0.217887780449.issue42056@roundup.psfhosted.org>
Message-ID: <1602927642.29.0.478179697925.issue42056@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I have a PR that implements support for Apple Silicon:

https://github.com/python/cpython/pull/21564


Sadly this is not yet complete. I hope to make progress again during the core sprint next week.

----------
nosy: +ronaldoussoren

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42056>
_______________________________________

From report at bugs.python.org  Sat Oct 17 06:01:16 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 17 Oct 2020 10:01:16 +0000
Subject: [issue42059] TypedDict(...) as function does not respect "total" when
 setting __required_keys__ and __optional_keys__
In-Reply-To: <1602926609.93.0.947551036861.issue42059@roundup.psfhosted.org>
Message-ID: <1602928876.81.0.730641666479.issue42059@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +gvanrossum, levkivskyi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42059>
_______________________________________

From report at bugs.python.org  Sat Oct 17 07:11:01 2020
From: report at bugs.python.org (Christian Heimes)
Date: Sat, 17 Oct 2020 11:11:01 +0000
Subject: [issue38820] Make Python compatible with OpenSSL 3.0.0
In-Reply-To: <1573916819.64.0.690362352385.issue38820@roundup.psfhosted.org>
Message-ID: <1602933061.87.0.0770131013463.issue38820@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

No, this is still work in progress.

----------
resolution: fixed -> 
stage: resolved -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38820>
_______________________________________

From report at bugs.python.org  Sat Oct 17 07:34:18 2020
From: report at bugs.python.org (waicalibre)
Date: Sat, 17 Oct 2020 11:34:18 +0000
Subject: [issue42049] Add image/webp to list of media types in mimetypes.py
In-Reply-To: <1602826491.72.0.784851705448.issue42049@roundup.psfhosted.org>
Message-ID: <1602934458.67.0.392075136451.issue42049@roundup.psfhosted.org>


waicalibre <waicailbre_aayx at protonmail.com> added the comment:

Yep, looks like this issue is an exact duplicate. Sorry about that.
It looks like WebP is still not registered with IANA so it can't be added to the list according to this comment: https://github.com/python/cpython/blob/master/Lib/mimetypes.py#L407. It could still be added though to the common-but-not-official list of media types here: https://github.com/python/cpython/blob/master/Lib/mimetypes.py#L550.

Could that happen here or would that have to happen with a new issue and pull request, or in the issue that this issue is a duplicate of? Not really sure of the protocol here.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42049>
_______________________________________

From report at bugs.python.org  Sat Oct 17 08:48:42 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 17 Oct 2020 12:48:42 +0000
Subject: [issue32820] Add and document __format__ method for IPv[46]Address
In-Reply-To: <1518363954.67.0.467229070634.issue32820@psf.upfronthosting.co.za>
Message-ID: <1602938922.83.0.719713693445.issue32820@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

In that case, should this issue be closed?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32820>
_______________________________________

From report at bugs.python.org  Sat Oct 17 08:53:09 2020
From: report at bugs.python.org (Felipe Rodrigues)
Date: Sat, 17 Oct 2020 12:53:09 +0000
Subject: [issue42060] Usage of assert in http/client.py
Message-ID: <1602939189.16.0.999843550668.issue42060@roundup.psfhosted.org>


New submission from Felipe Rodrigues <felipe at felipevr.com>:

Hi all!

I was testing some static analysis tool and decided to use the HTTP module as testing ground. While running `bandit` at the client module, it detected 3 instances of using `assert` inside the code. Twice in the HTTPResponse class and once in the HTTPConnection class.

Now, I know that this will only cause any trouble when running python with the optimize settings turned on and if someone is that concerned about optimization, they probably won't be using the stdlib's HTTP implementation, but I think it would be fitting to fix this corner case.

I've written a PR that fixes this but I'm not sure if the raised exceptions and messages are ok

----------
components: Library (Lib)
messages: 378810
nosy: fbidu
priority: normal
severity: normal
status: open
title: Usage of assert in http/client.py
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42060>
_______________________________________

From report at bugs.python.org  Sat Oct 17 08:55:55 2020
From: report at bugs.python.org (Felipe Rodrigues)
Date: Sat, 17 Oct 2020 12:55:55 +0000
Subject: [issue42060] Usage of assert in http/client.py
In-Reply-To: <1602939189.16.0.999843550668.issue42060@roundup.psfhosted.org>
Message-ID: <1602939355.86.0.966019227107.issue42060@roundup.psfhosted.org>


Change by Felipe Rodrigues <felipe at felipevr.com>:


----------
keywords: +patch
pull_requests: +21700
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22737

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42060>
_______________________________________

From report at bugs.python.org  Sat Oct 17 08:56:56 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Sat, 17 Oct 2020 12:56:56 +0000
Subject: [issue32820] Add and document __format__ method for IPv[46]Address
In-Reply-To: <1518363954.67.0.467229070634.issue32820@psf.upfronthosting.co.za>
Message-ID: <1602939416.88.0.0725854002549.issue32820@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

At this point, it's a documentation-only issue. This new feature isn't documented.

It might be less confusing to close this issue and open a new one. I'll do that shortly.

----------
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32820>
_______________________________________

From report at bugs.python.org  Sat Oct 17 09:03:51 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Sat, 17 Oct 2020 13:03:51 +0000
Subject: [issue42061] Document __format__ method for IPv[46]Address
Message-ID: <1602939831.57.0.752623418103.issue42061@roundup.psfhosted.org>


New submission from Eric V. Smith <eric at trueblade.com>:

This feature was added in issue 32820, but was never documented.

----------
assignee: docs at python
components: Documentation
keywords: easy, newcomer friendly
messages: 378812
nosy: docs at python, eric.smith
priority: normal
severity: normal
stage: needs patch
status: open
title: Document __format__ method for IPv[46]Address
type: enhancement
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42061>
_______________________________________

From report at bugs.python.org  Sat Oct 17 09:07:00 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Sat, 17 Oct 2020 13:07:00 +0000
Subject: [issue32820] Add and document __format__ method for IPv[46]Address
In-Reply-To: <1518363954.67.0.467229070634.issue32820@psf.upfronthosting.co.za>
Message-ID: <1602940020.23.0.954582567911.issue32820@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I've created issue 42061 for the documentation. Hopefully marking that issue as easy and newcomer friendly will attract some attention.

Thanks ewosborne and Serhiy for adding this feature, and everyone for their input.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32820>
_______________________________________

From report at bugs.python.org  Sat Oct 17 10:13:56 2020
From: report at bugs.python.org (Felipe Rodrigues)
Date: Sat, 17 Oct 2020 14:13:56 +0000
Subject: [issue42062] Usage of HTTPResponse.url
Message-ID: <1602944036.34.0.151561478116.issue42062@roundup.psfhosted.org>


New submission from Felipe Rodrigues <felipe at felipevr.com>:

Hello all,

While testing some static analysis tools on HTTP/client.py, Pylint pointed
me to HTTPResponse.geturl() method with a "no-member" error for the `url`
attribute. I tried invoking the `geturl` method and reading the
`HTTPResponse.url` attribute using a sample code from the official docs:

```
import http.client
conn = http.client.HTTPSConnection("www.python.org")
conn.request("GET", "/")
r1 = conn.getresponse()
print(r1.status, r1.reason)

r1.geturl()
r1.url
```
```
import http.client
conn = http.client.HTTPSConnection("www.python.org")
conn.request("GET", "/")
r1 = conn.getresponse()
data1 = r1.read()

conn.request("GET", "/")
r1 = conn.getresponse()
while chunk := r1.read(200):
    print(repr(chunk))
r1.geturl()
r1.url
```

Both of those examples will raise an `AttributeError: 'HTTPResponse' object has no attribute 'url'`.

I tried searching through this module's history from when this line originally appeared,
https://github.com/python/cpython/commit/6c5e28c383bf587f80d01e52f887801be200200d but
I wasn't able to find this attribute being set internally by the class, even
though there is an `url` attribute at __init__.

So, I wonder if this attribute was intended to be set externally as in `r1.url = 'something'`
or if it is just a bug

----------
components: Library (Lib)
messages: 378814
nosy: fbidu
priority: normal
severity: normal
status: open
title: Usage of HTTPResponse.url

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42062>
_______________________________________

From report at bugs.python.org  Sat Oct 17 10:24:05 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 17 Oct 2020 14:24:05 +0000
Subject: [issue42042] docs.python.org for 3.10 missing the new refererence
 record.
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1602944645.22.0.750493726148.issue42042@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

This is the regression bug caused by sphinx==3.2.1
If we roll back the sphinx version(2.4.4), it is okay.
I am investigating what causes this issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Sat Oct 17 10:24:18 2020
From: report at bugs.python.org (Felipe Rodrigues)
Date: Sat, 17 Oct 2020 14:24:18 +0000
Subject: [issue42062] Usage of HTTPResponse.url
In-Reply-To: <1602944036.34.0.151561478116.issue42062@roundup.psfhosted.org>
Message-ID: <1602944658.28.0.482787238717.issue42062@roundup.psfhosted.org>


Change by Felipe Rodrigues <felipe at felipevr.com>:


----------
keywords: +patch
pull_requests: +21701
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22738

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42062>
_______________________________________

From report at bugs.python.org  Sat Oct 17 10:31:35 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 17 Oct 2020 14:31:35 +0000
Subject: [issue42042] docs.python.org for 3.10 missing the new refererence
 record.
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1602945095.81.0.895826919102.issue42042@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

sphinx2
(Pdb) par[0].attributes
{'ids': ['c._PyObject_New'], 'classes': [], 'names': ['c._PyObject_New'], 'dupnames': [], 'backrefs': [], 'first': False}

sphinx3
(Pdb) par[0].attributes
{'ids': ['c._PyObject_New'], 'classes': [], 'names': [], 'dupnames': [], 'backrefs': [], 'is_multiline': True}

We are using the names attribute for annotation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Sat Oct 17 10:38:08 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 17 Oct 2020 14:38:08 +0000
Subject: [issue42042] docs.python.org for 3.10 missing the new refererence
 record.
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1602945488.07.0.0378578369036.issue42042@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
keywords: +patch
pull_requests: +21702
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22739

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Sat Oct 17 10:41:55 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 17 Oct 2020 14:41:55 +0000
Subject: [issue42042] docs.python.org for 3.10 missing the new refererence
 record.
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1602945715.49.0.0954653684807.issue42042@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

One more regression is that
code background highlight is not applied after sphinx version3

See
https://docs.python.org/3.10/c-api/dict.html#c.PyDict_Next
https://docs.python.org/3.9/c-api/dict.html#c.PyDict_Next

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Sat Oct 17 10:42:06 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 17 Oct 2020 14:42:06 +0000
Subject: [issue42042] docs.python.org for 3.10 missing the new refererence
 record.
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1602945726.6.0.781174021101.issue42042@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
nosy: +Mariatta

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Sat Oct 17 10:43:00 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 17 Oct 2020 14:43:00 +0000
Subject: [issue42042] sphinx3 renders diffrently docs.python.org for 3.10
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1602945780.74.0.0680094767804.issue42042@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
title: docs.python.org for 3.10 missing the new refererence record. -> sphinx3 renders diffrently docs.python.org for 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Sat Oct 17 10:52:57 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 17 Oct 2020 14:52:57 +0000
Subject: [issue38320] Clarify unittest expectedFailure behaviour in the
 documentation
In-Reply-To: <1569834841.91.0.690142859839.issue38320@roundup.psfhosted.org>
Message-ID: <1602946377.6.0.219711250995.issue38320@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +patch
nosy: +iritkatriel
nosy_count: 2.0 -> 3.0
pull_requests: +21703
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22740

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38320>
_______________________________________

From report at bugs.python.org  Sat Oct 17 11:07:11 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 17 Oct 2020 15:07:11 +0000
Subject: [issue42042] sphinx3 renders diffrently docs.python.org for 3.10
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1602947231.37.0.99932043419.issue42042@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +mdk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Sat Oct 17 11:08:29 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 17 Oct 2020 15:08:29 +0000
Subject: [issue42059] TypedDict(...) as function does not respect "total" when
 setting __required_keys__ and __optional_keys__
In-Reply-To: <1602926609.93.0.947551036861.issue42059@roundup.psfhosted.org>
Message-ID: <1602947309.73.0.960187057487.issue42059@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Can you submit a PR to fix this? It looks like you already have a good understanding of the root cause of the problem, so it should be easy to fix. (Be sure to add a unit test.)

It can be backported to earlier Python versions that have typing.TypedDict (3.8+).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42059>
_______________________________________

From report at bugs.python.org  Sat Oct 17 11:07:40 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 17 Oct 2020 15:07:40 +0000
Subject: [issue42042] sphinx3 renders diffrently docs.python.org for 3.10
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1602947260.48.0.892500628006.issue42042@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

Okay this is the theme bug.
https://github.com/python/python-docs-theme/pull/57

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Sat Oct 17 11:09:46 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 17 Oct 2020 15:09:46 +0000
Subject: [issue42059] TypedDict(...) as function does not respect "total" when
 setting __required_keys__ and __optional_keys__
In-Reply-To: <1602926609.93.0.947551036861.issue42059@roundup.psfhosted.org>
Message-ID: <1602947386.17.0.912747301276.issue42059@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Whoops, sorry, didn't see that you already have a PR. I'll review it next week during the core sprint.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42059>
_______________________________________

From report at bugs.python.org  Sat Oct 17 11:10:37 2020
From: report at bugs.python.org (Eric Osborne)
Date: Sat, 17 Oct 2020 15:10:37 +0000
Subject: [issue32820] Add and document __format__ method for IPv[46]Address
In-Reply-To: <1602940020.23.0.954582567911.issue32820@roundup.psfhosted.org>
Message-ID: <CA+97oKPWGf1mPMdqZ6Xt2ThTHcWzhHvhiC1ku9je1wQi-MD0HA@mail.gmail.com>


Eric Osborne <eric at notcom.com> added the comment:

Did I really ship an enhancement without documenting it?  I am a terrible
person.  I will pick up the issue and take care of it.

eric

On Sat, Oct 17, 2020 at 9:07 AM Eric V. Smith <report at bugs.python.org>
wrote:

>
> Eric V. Smith <eric at trueblade.com> added the comment:
>
> I've created issue 42061 for the documentation. Hopefully marking that
> issue as easy and newcomer friendly will attract some attention.
>
> Thanks ewosborne and Serhiy for adding this feature, and everyone for
> their input.
>
> ----------
> resolution:  -> fixed
> stage: patch review -> resolved
> status: open -> closed
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue32820>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32820>
_______________________________________

From report at bugs.python.org  Sat Oct 17 14:19:22 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Sat, 17 Oct 2020 18:19:22 +0000
Subject: [issue40775] Fix missing dot in sqlite3 Node type name
Message-ID: <1602958762.19.0.885833716349.issue40775@roundup.psfhosted.org>


New submission from Erlend Egeberg Aasland <erlend.aasland at innova.no>:

Fixed in GH-22417 / bpo-41861

----------
resolution:  -> out of date
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40775>
_______________________________________

From report at bugs.python.org  Sat Oct 17 15:07:16 2020
From: report at bugs.python.org (Jake)
Date: Sat, 17 Oct 2020 19:07:16 +0000
Subject: [issue42063] More options to http.server & SimpleHTTPRequestHandler
Message-ID: <1602961636.81.0.0728597906503.issue42063@roundup.psfhosted.org>


New submission from Jake <sorme at kth.se>:

I would find it useful to have more options to http.server SimpleHTTPRequestHandler:

1) The option to get the current directory in not only HTML, but represented in JSON for example. This could be an added --json flag in the main method of http.server, and an added corresponding method in SimpleHTTPRequestHandler much like list_directory but for JSON. 


2) Options to add more headers. For example I would find it useful to be able to add the header 'Access-Control-Allow-Origin'. This could be achieved by send_head in SimpleHTTPRequestHandler taking more arguments for specifying any additional headers to be added. 

This way a custom class can inherit SimpleHTTPRequestHandler, and in its own send_head method call e.g. super().send_head(extra_headers={'Access-Control-Allow-Origin','*'}).

----------
components: Library (Lib)
messages: 378823
nosy: jacobsorme
priority: normal
severity: normal
status: open
title: More options to http.server & SimpleHTTPRequestHandler
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42063>
_______________________________________

From report at bugs.python.org  Sat Oct 17 15:35:48 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 17 Oct 2020 19:35:48 +0000
Subject: [issue40529] Auto Completions with case insensitive
In-Reply-To: <1588768459.35.0.455156839892.issue40529@roundup.psfhosted.org>
Message-ID: <1602963348.83.0.448276351792.issue40529@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

Thanks for the suggestion and for the high quality PR, Madhusudhan!

I'm not sure about this feature. It seems harmless enough, with the default being the existing case-sensitive completion. But it seems like a rather esoteric thing to want, so I'm not sure it's worth adding to the stdlib and maintaining indefinitely.

Would you mind bringing this up for discussion on Python-Ideas, so that we can get a feel for how many others would find this useful?

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40529>
_______________________________________

From report at bugs.python.org  Sat Oct 17 15:37:05 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Sat, 17 Oct 2020 19:37:05 +0000
Subject: [issue42064] Convert sqlite3 to multi-phase initialisation (PEP 489)
Message-ID: <1602963425.44.0.576962569847.issue42064@roundup.psfhosted.org>


New submission from Erlend Egeberg Aasland <erlend.aasland at innova.no>:

Porting sqlite3 to multi-phase initialisation is non-trivial and must be broken into smaller bpo's, often with multiple PR's per bpo. As far as I can see, this is the task list:

1) Heap types (PEP 384): bpo-41861
2) Argument Clinic: bpo-40956
3) Establish global module state
4) Pass `self` iso. callback object to trace, auth, and progress handlers (required for item 7)
5) Use sqlite3_create_collation_v2 iso. sqlite3_create_collation (see next list item)
6) For sqlite3_create_* functions, establish a context struct that contains the target user callback and the state. Modify callers to allocate memory, and the destructor to deallocate
7) Module state (PEP 573)
8) Multi-phase initialisation (PEP 489)

The list may be incomplete.

Separate bpo's for 1) and 2) are opened. Pr. 2020-10-17, 1) is almost done, and 2), part 1 of 5 is awaiting review. It may be convenient to open up sub-bpo's for some of the other tasks as well. For instance, using sqlite3_create_collation_v2() iso. sqlite3_create_collation(). (FYI, this imposes no new SQLite version requirements.)

I'd wait until AC is implemented with moving forward with the rest of the PR's, in order to avoid merge mess. The exception might be item 4, preparing the trace/progress/auth callbacks, which is easy to isolate from the rest.

I've prepared branches for most of these things locally, some split in multiple PR's to ease reviewing.

I've tagged Victor Stinner and Dong-hee Na (hope that's ok), since they've been helpful with reviewing and providing helpful hints thus far. Any input from Berker Peksag would be highly appreciated; after all, he is the maintainer of this module :)

Ref. bpo-1635741 (the grand multi-phase issue)

----------
components: Library (Lib)
messages: 378825
nosy: berker.peksag, corona10, erlendaasland, vstinner
priority: normal
severity: normal
status: open
title: Convert sqlite3 to multi-phase initialisation (PEP 489)
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42064>
_______________________________________

From report at bugs.python.org  Sat Oct 17 15:51:08 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 17 Oct 2020 19:51:08 +0000
Subject: [issue18857] urlencode of a None value uses the string 'None'
In-Reply-To: <1377633255.35.0.29938622913.issue18857@psf.upfronthosting.co.za>
Message-ID: <1602964268.23.0.413094741626.issue18857@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

Thanks for the PRs, James!

I've closed the PRs for now, to avoid having people spend time reviewing them while this issue is closed as "wontfix". That said, if further discussion changes that decision, the PRs could be reopened.

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18857>
_______________________________________

From report at bugs.python.org  Sat Oct 17 16:05:09 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 17 Oct 2020 20:05:09 +0000
Subject: [issue42065] Fix incorrectly formatted _codecs.charmap_decode error
 message
Message-ID: <1602965108.98.0.722974921612.issue42065@roundup.psfhosted.org>


New submission from Tal Einat <taleinat+python at gmail.com>:

The error message for _codecs.charmap_decode uses a non-existent formatting placeholder "%lx", when a mapped value is a number outside the range of valid Unicode code points.

This was reported by Max Bernstein (@tekknolagi) on GitHub PR GH-19940.

----------
messages: 378827
nosy: taleinat
priority: normal
severity: normal
status: open
title: Fix incorrectly formatted _codecs.charmap_decode error message

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42065>
_______________________________________

From report at bugs.python.org  Sat Oct 17 16:05:34 2020
From: report at bugs.python.org (Maxwell Bernstein)
Date: Sat, 17 Oct 2020 20:05:34 +0000
Subject: [issue42065] Fix incorrectly formatted _codecs.charmap_decode error
 message
In-Reply-To: <1602965108.98.0.722974921612.issue42065@roundup.psfhosted.org>
Message-ID: <1602965134.85.0.0537553436995.issue42065@roundup.psfhosted.org>


Change by Maxwell Bernstein <tekk.nolagi at gmail.com>:


----------
keywords: +patch
nosy: +tekknolagi
nosy_count: 1.0 -> 2.0
pull_requests: +21704
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/19940

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42065>
_______________________________________

From report at bugs.python.org  Sat Oct 17 16:21:13 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 17 Oct 2020 20:21:13 +0000
Subject: [issue42065] Fix incorrectly formatted _codecs.charmap_decode error
 message
In-Reply-To: <1602965108.98.0.722974921612.issue42065@roundup.psfhosted.org>
Message-ID: <1602966073.74.0.894990929259.issue42065@roundup.psfhosted.org>


Change by Tal Einat <taleinat+python at gmail.com>:


----------
components: +Library (Lib), Unicode
nosy: +ezio.melotti, vstinner -tekknolagi
type:  -> behavior
versions: +Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42065>
_______________________________________

From report at bugs.python.org  Sat Oct 17 16:25:18 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Sat, 17 Oct 2020 20:25:18 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602966318.73.0.319824401834.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

I added the cutoff for strings >= 10 characters, and I converted the PR from a draft to "Ready to Review."

When running stringbench.py before and after the PR, I get these results:

    Summary:
    Unicode Before: 81.82   Bytes Before: 92.62 
    Unicode After:  64.70   Bytes after: 62.41

    Full results here:
    https://pastebin.com/raw/DChzMjhH

And on the random zipf benchmarks: 

    Summary:
    14 cases slower (median 1.16x slower, at most 1.52x slower)
    601 cases faster (median 2.15x faster, at most 21.94x faster)
    
    Full results here:
    https://pastebin.com/raw/ez6529Bp

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sat Oct 17 16:30:00 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Sat, 17 Oct 2020 20:30:00 +0000
Subject: [issue42064] Convert sqlite3 to multi-phase initialisation (PEP 489)
In-Reply-To: <1602963425.44.0.576962569847.issue42064@roundup.psfhosted.org>
Message-ID: <1602966600.3.0.190683243988.issue42064@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Instead of using a custom context struct for sqlite3_create_funcion_v2(), we may just use sqlite3_context_db_handle() to get `self`, and then fetch the state using PyType_GetModuleState(Py_TYPE(self)).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42064>
_______________________________________

From report at bugs.python.org  Sat Oct 17 16:38:29 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 17 Oct 2020 20:38:29 +0000
Subject: [issue42065] Fix incorrectly formatted _codecs.charmap_decode error
 message
In-Reply-To: <1602965108.98.0.722974921612.issue42065@roundup.psfhosted.org>
Message-ID: <1602967109.25.0.749123384274.issue42065@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:


New changeset 3635388f52b42e5280229104747962117104c453 by Max Bernstein in branch 'master':
bpo-42065: Fix incorrectly formatted _codecs.charmap_decode error message (GH-19940)
https://github.com/python/cpython/commit/3635388f52b42e5280229104747962117104c453


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42065>
_______________________________________

From report at bugs.python.org  Sat Oct 17 16:38:55 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 17 Oct 2020 20:38:55 +0000
Subject: [issue42065] Fix incorrectly formatted _codecs.charmap_decode error
 message
In-Reply-To: <1602965108.98.0.722974921612.issue42065@roundup.psfhosted.org>
Message-ID: <1602967135.79.0.105246319563.issue42065@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21706
pull_request: https://github.com/python/cpython/pull/22744

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42065>
_______________________________________

From report at bugs.python.org  Sat Oct 17 16:38:48 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 17 Oct 2020 20:38:48 +0000
Subject: [issue42065] Fix incorrectly formatted _codecs.charmap_decode error
 message
In-Reply-To: <1602965108.98.0.722974921612.issue42065@roundup.psfhosted.org>
Message-ID: <1602967128.78.0.675009853608.issue42065@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21705
pull_request: https://github.com/python/cpython/pull/22743

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42065>
_______________________________________

From report at bugs.python.org  Sat Oct 17 16:40:52 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 17 Oct 2020 20:40:52 +0000
Subject: [issue42065] Fix incorrectly formatted _codecs.charmap_decode error
 message
In-Reply-To: <1602965108.98.0.722974921612.issue42065@roundup.psfhosted.org>
Message-ID: <1602967252.95.0.747860083939.issue42065@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

Thanks for the PR, Max!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42065>
_______________________________________

From report at bugs.python.org  Sat Oct 17 16:46:09 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Sat, 17 Oct 2020 20:46:09 +0000
Subject: [issue42064] Convert sqlite3 to multi-phase initialisation (PEP 489)
In-Reply-To: <1602963425.44.0.576962569847.issue42064@roundup.psfhosted.org>
Message-ID: <1602967569.18.0.615835259667.issue42064@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

No, unless we can add `self` as a private context to a sqlite3 database handle, we can't use that shortcut. However, using a custom context struct works, and it's a minor code change.

Proof-of-concept implementation diffstat:
 2 files changed, 54 insertions(+), 10 deletions(-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42064>
_______________________________________

From report at bugs.python.org  Sat Oct 17 16:49:28 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 17 Oct 2020 20:49:28 +0000
Subject: [issue40509] In argparse,
 allow REMAINDER(...) arguments in a mutually exclusive group
In-Reply-To: <1588674644.49.0.299540849008.issue40509@roundup.psfhosted.org>
Message-ID: <1602967768.87.0.0943514428156.issue40509@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

I suggest bringing this up for discussion on Python-Ideas.

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40509>
_______________________________________

From report at bugs.python.org  Sat Oct 17 16:51:12 2020
From: report at bugs.python.org (Tim Peters)
Date: Sat, 17 Oct 2020 20:51:12 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602967872.95.0.892700676627.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

When I ran stringbench yesterday (or the day before - don't remember), almost all the benefit seemed to come from the "late match, 100 characters" tests.  Seems similar for your run.  Here are your results for just that batch, interleaving the two runs to make it easy to see:  first line from the "before" run, second line from the "after" (PR) run, then a blank line.  Lather, rinse, repeat.

These are dramatic speedups for the "search forward" cases.  But there _also_ seem to be real (but much smaller) benefits for the "search backward" cases, which I don't recall seeing when I tried it.  Do you have a guess as to why?

========== late match, 100 characters
bytes   unicode
(in ms) (in ms) ratio%=bytes/unicode*100
2.73    3.88    70.4    s="ABC"*33; ((s+"D")*500+s+"E").find(s+"E") (*100)
0.17    0.15    116.3   s="ABC"*33; ((s+"D")*500+s+"E").find(s+"E") (*100)

2.01    3.54    56.8    s="ABC"*33; ((s+"D")*500+"E"+s).find("E"+s) (*100)
0.89    0.87    101.8   s="ABC"*33; ((s+"D")*500+"E"+s).find("E"+s) (*100)

1.66    2.36    70.2    s="ABC"*33; (s+"E") in ((s+"D")*300+s+"E") (*100)
0.15    0.13    111.5   s="ABC"*33; (s+"E") in ((s+"D")*300+s+"E") (*100)

2.74    3.89    70.5    s="ABC"*33; ((s+"D")*500+s+"E").index(s+"E") (*100)
0.17    0.15    112.4   s="ABC"*33; ((s+"D")*500+s+"E").index(s+"E") (*100)

3.93    4.00    98.4    s="ABC"*33; ((s+"D")*500+s+"E").partition(s+"E") (*100)
0.30    0.27    108.0   s="ABC"*33; ((s+"D")*500+s+"E").partition(s+"E") (*100)

3.99    4.59    86.8    s="ABC"*33; ("E"+s+("D"+s)*500).rfind("E"+s) (*100)
3.13    2.51    124.5   s="ABC"*33; ("E"+s+("D"+s)*500).rfind("E"+s) (*100)

1.64    2.23    73.3    s="ABC"*33; (s+"E"+("D"+s)*500).rfind(s+"E") (*100)
1.54    1.82    84.5    s="ABC"*33; (s+"E"+("D"+s)*500).rfind(s+"E") (*100)

3.97    4.59    86.4    s="ABC"*33; ("E"+s+("D"+s)*500).rindex("E"+s) (*100)
3.18    2.53    125.8   s="ABC"*33; ("E"+s+("D"+s)*500).rindex("E"+s) (*100)

4.69    4.67    100.3   s="ABC"*33; ("E"+s+("D"+s)*500).rpartition("E"+s) (*100)
3.37    2.66    126.9   s="ABC"*33; ("E"+s+("D"+s)*500).rpartition("E"+s) (*100)

4.09    2.82    145.0   s="ABC"*33; ("E"+s+("D"+s)*500).rsplit("E"+s, 1) (*100)
3.39    2.62    129.5   s="ABC"*33; ("E"+s+("D"+s)*500).rsplit("E"+s, 1) (*100)

3.50    3.51    99.7    s="ABC"*33; ((s+"D")*500+s+"E").split(s+"E", 1) (*100)
0.30    0.28    106.0   s="ABC"*33; ((s+"D")*500+s+"E").split(s+"E", 1) (*100)

Just for contrast, doesn't make much difference for the "late match, two characters" tests:

========== late match, two characters
0.44    0.58    76.2    ("AB"*300+"C").find("BC") (*1000)
0.57    0.48    120.2   ("AB"*300+"C").find("BC") (*1000)

0.59    0.73    80.5    ("AB"*300+"CA").find("CA") (*1000)
0.56    0.72    77.5    ("AB"*300+"CA").find("CA") (*1000)

0.55    0.49    112.5   "BC" in ("AB"*300+"C") (*1000)
0.66    0.37    177.7   "BC" in ("AB"*300+"C") (*1000)

0.45    0.58    76.5    ("AB"*300+"C").index("BC") (*1000)
0.57    0.49    116.5   ("AB"*300+"C").index("BC") (*1000)

0.61    0.62    98.6    ("AB"*300+"C").partition("BC") (*1000)
0.72    0.52    137.2   ("AB"*300+"C").partition("BC") (*1000)

0.62    0.64    96.4    ("C"+"AB"*300).rfind("CA") (*1000)
0.49    0.49    101.6   ("C"+"AB"*300).rfind("CA") (*1000)

0.57    0.65    87.5    ("BC"+"AB"*300).rfind("BC") (*1000)
0.51    0.57    89.3    ("BC"+"AB"*300).rfind("BC") (*1000)

0.62    0.64    96.5    ("C"+"AB"*300).rindex("CA") (*1000)
0.50    0.49    101.2   ("C"+"AB"*300).rindex("CA") (*1000)

0.68    0.69    99.0    ("C"+"AB"*300).rpartition("CA") (*1000)
0.61    0.54    113.5   ("C"+"AB"*300).rpartition("CA") (*1000)

0.82    0.60    137.8   ("C"+"AB"*300).rsplit("CA", 1) (*1000)
0.63    0.57    112.0   ("C"+"AB"*300).rsplit("CA", 1) (*1000)

0.63    0.61    103.0   ("AB"*300+"C").split("BC", 1) (*1000)
0.74    0.54    138.2   ("AB"*300+"C").split("BC", 1) (*1000)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sat Oct 17 17:10:37 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 17 Oct 2020 21:10:37 +0000
Subject: [issue40507] FileNotFound error raised by os.exec* doesn't contain
 filename
In-Reply-To: <1588658218.29.0.0740534174098.issue40507@roundup.psfhosted.org>
Message-ID: <1602969037.81.0.459283710126.issue40507@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

I agree that having the error message include the executable name could be useful.

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40507>
_______________________________________

From report at bugs.python.org  Sat Oct 17 17:10:54 2020
From: report at bugs.python.org (Tal Einat)
Date: Sat, 17 Oct 2020 21:10:54 +0000
Subject: [issue40507] FileNotFound error raised by os.exec* doesn't contain
 filename
In-Reply-To: <1588658218.29.0.0740534174098.issue40507@roundup.psfhosted.org>
Message-ID: <1602969054.11.0.0139797852365.issue40507@roundup.psfhosted.org>


Change by Tal Einat <taleinat+python at gmail.com>:


----------
type:  -> enhancement
versions: +Python 3.10 -Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40507>
_______________________________________

From report at bugs.python.org  Sat Oct 17 17:35:10 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Sat, 17 Oct 2020 21:35:10 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602970510.19.0.353872533478.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

> But there _also_ seem to be real (but much smaller) benefits
> for the "search backward" cases, which I don't recall seeing
> when I tried it.  Do you have a guess as to why?

I did change `skip = mlast - 1;` to `skip = mlast;` as you had pointed out.
So it could be that, or just a compiler/benchmark ghost.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sat Oct 17 17:57:05 2020
From: report at bugs.python.org (Elizabeth Uselton)
Date: Sat, 17 Oct 2020 21:57:05 +0000
Subject: [issue37555] _CallList.__contains__ doesn't always respect ANY.
In-Reply-To: <1562821924.84.0.134272462767.issue37555@roundup.psfhosted.org>
Message-ID: <1602971825.46.0.0209392129476.issue37555@roundup.psfhosted.org>


Elizabeth Uselton <elizabeth.uselton at gmail.com> added the comment:

I believe it should work in both 3.8 and 3.9, the difference is that someone (Serhiy if I'm remembering correctly?) did the work in 3.9 of standardizing which side of the = the needle was on. So, this change works on 3.9 without the _AnyComparer class I added, but I believe unless _AnyComparer has been removed, this change would work in 3.8. Xtreak, it seems like most of your concerns about backporting it are about how complicated this part of the code is, and wanting it to get more testing via the mock backport? Is there any way I can help mitigate those concerns, or keep up with how much use it's gotten from the mock backport so we can determine when (if ever) it would be a good time to backport this?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37555>
_______________________________________

From report at bugs.python.org  Sat Oct 17 18:30:19 2020
From: report at bugs.python.org (James Addison)
Date: Sat, 17 Oct 2020 22:30:19 +0000
Subject: [issue18857] urlencode of a None value uses the string 'None'
In-Reply-To: <1377633255.35.0.29938622913.issue18857@psf.upfronthosting.co.za>
Message-ID: <1602973819.78.0.484272263879.issue18857@roundup.psfhosted.org>


James Addison <jay+bpo at jp-hosting.net> added the comment:

No problem, and thanks for the heads-up Tal!  I'll raise this as a topic on python-dev if it still seems worth pursuing, after collecting some more thoughts about it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18857>
_______________________________________

From report at bugs.python.org  Sat Oct 17 18:34:35 2020
From: report at bugs.python.org (Senthil Kumaran)
Date: Sat, 17 Oct 2020 22:34:35 +0000
Subject: [issue18857] urlencode of a None value uses the string 'None'
In-Reply-To: <1602973819.78.0.484272263879.issue18857@roundup.psfhosted.org>
Message-ID: <CAPOVWORf5Yokfm8s2_UXw+xzVzP5G2S6HFnLrOewEWfP3AFT6w@mail.gmail.com>


Senthil Kumaran <senthil at uthcode.com> added the comment:

Hi James, I will give another look at it tonight or latest by Sunday PST ,
since I was involved in this and PRs. If we can make a decision within this
context, great, otherwise we can open it up to python-dev

On Sat, Oct 17, 2020 at 3:30 PM James Addison <report at bugs.python.org>
wrote:

>
> James Addison <jay+bpo at jp-hosting.net> added the comment:
>
> No problem, and thanks for the heads-up Tal!  I'll raise this as a topic
> on python-dev if it still seems worth pursuing, after collecting some more
> thoughts about it.
>
> ----------
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue18857>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18857>
_______________________________________

From report at bugs.python.org  Sat Oct 17 18:51:58 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 17 Oct 2020 22:51:58 +0000
Subject: [issue36201] AssertCountEqual does not work for nested dictionaries.
In-Reply-To: <1551832953.74.0.756790771637.issue36201@roundup.psfhosted.org>
Message-ID: <1602975118.4.0.801619375621.issue36201@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Should this be closed as won't fix?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36201>
_______________________________________

From report at bugs.python.org  Sat Oct 17 20:02:43 2020
From: report at bugs.python.org (James Addison)
Date: Sun, 18 Oct 2020 00:02:43 +0000
Subject: [issue18857] urlencode of a None value uses the string 'None'
In-Reply-To: <1377633255.35.0.29938622913.issue18857@psf.upfronthosting.co.za>
Message-ID: <1602979363.56.0.672758784619.issue18857@roundup.psfhosted.org>


James Addison <jay+bpo at jp-hosting.net> added the comment:

Thanks Senthil; please take your time.  This isn't urgent, and would likely benefit from further standardization of the URL query string and/or form-encoded data formats (outside the Python project) to achieve consensus.

A fully-considered answer at a later date would probably sit more comfortably with me than one that has any sense of time pressure.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18857>
_______________________________________

From report at bugs.python.org  Sat Oct 17 20:12:43 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 18 Oct 2020 00:12:43 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602979963.33.0.943364507556.issue41972@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

This may be irrelevant at this point, but trying to understand the original reproducer, I wanted to add my 1c worth.

It seems Dennis' reproducer.py is roughly this:

(I'm renaming BIG//3 to K to simplify the math.)

aaaaaBBBBBaaaaaBBBBBBBBBBBBBBB (haystack, length K*6)
BBBBBBBBBBBBBBB                (needle, length K*3)

The needle matches exactly once, at the end.  (Dennis uses BIG==10**6, which leaves a remainder of 1 after dividing by 3, but that turns out to be irrelevant -- it works with BIG==999999 as well.)

The reproducer falls prey to the fact that it shifts the needle by 1 each time (for the reason Tim already explained).  At each position probed, the sequence of comparisons is (regardless of the bloom filter or skip size, and stopping at the first mismatch):

- last byte of needle
- first, second, third, etc. byte of needle

As long as the needle's first character corresponds to an 'a' (i.e., K times) this is just two comparisons until failure, but once it hits the first run of 'B's it does K+1 comparisons, then shifts by 1, does another K+1 comparisons, and so on, for a total of K times. That's K**2 + K, the source of the slowdown. Then come K more quick misses, followed by the final success.

(Do we know how the OP found this reproducer? The specific length of their needle seems irrelevant, and I don't dare look in their data file.)

Anyway, thinking about this, for the current (unpatched) code, here's a somewhat simpler reproducer along the same lines:

BBBBBaaaaaBBBBB (haystack, length K*3)
BBBBBBBBBB      (needle, length K*2)

This immediately starts doing K sets of K+1 comparisons, i.e. K**2 + K again, followed by failure.


I am confident this has no relevance to the Two-Way algorithm.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sat Oct 17 20:30:19 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Sun, 18 Oct 2020 00:30:19 +0000
Subject: [issue42057] pytest case which catch  exceptions become segfault
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1602981019.23.0.416249764742.issue42057@roundup.psfhosted.org>


Change by Filipe La?ns <lains at riseup.net>:


----------
nosy: +FFY00

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Sat Oct 17 20:31:06 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Sun, 18 Oct 2020 00:31:06 +0000
Subject: [issue42050] ensurepip fails if cwd contains illformed setup.cf
In-Reply-To: <1602836843.13.0.778924482006.issue42050@roundup.psfhosted.org>
Message-ID: <1602981066.56.0.134904048767.issue42050@roundup.psfhosted.org>


Change by Filipe La?ns <lains at riseup.net>:


----------
nosy: +FFY00, dstufft, ncoghlan, pradyunsg

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42050>
_______________________________________

From report at bugs.python.org  Sat Oct 17 21:04:29 2020
From: report at bugs.python.org (Tim Peters)
Date: Sun, 18 Oct 2020 01:04:29 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602983069.42.0.896218504553.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

I don't think we have any idea how the OP stumbled into this. Looks like it "just happened".

The case you construted is quadratic-time, but not quite as bad:

BBBBBaaaaaBBBBB
BBBBBBBBBB

Fails at once, because 'a' doesn't match the trailing needle 'B'. The Bloom filter is useless because the next haystack 'B' _is_ in the needle.  So shift right 1:

BBBBBaaaaaBBBBB
xBBBBBBBBBB

Last character matches, so goes on to compare 4 Bs and an aB mismatch. 6 in all. Bloom filter useless again, and another shift by 1:

BBBBBaaaaaBBBBB
xxBBBBBBBBBB

Now there's 1 less compare, because only 3 Bs match.

And so on.  After the next shift, only 2 Bs match, and after the shift following that, only 1 B.  Getting to:

BBBBBaaaaaBBBBB
xxxxxBBBBBBBBBB

Now after matching the trailing Bs, aB mismatches at once.  And we're done, because another shift by 1 moves the end of the needle beyond the end of the haystack (although I bet the Bloom filter reads up the trailing NUL byte from the haystack and actually makes a "giant" shift).

You're right that two-way yawns at this ;-)  'B' * (K*2) is split into

u = "" # empty string!
v = 'B' * (K*2)

so only the "match the right half" part of the searching algorithm comes into play.

BBBBBaaaaaBBBBB
BBBBBBBBBB

first mismatches at the 6th character (1-based counting - at index 5), so it shifts right by 6:

BBBBBaaaaaBBBBB
xxxxxxBBBBBBBBBB

And it's done, because the needle has moved beyond the end of the haystack.

The brainpower that went into making this "look trivial" is quite impressive :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sat Oct 17 21:45:41 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 18 Oct 2020 01:45:41 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602985541.82.0.404682732932.issue41972@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Right, so IIUC the *quadratic* portion of Dennis? original reproducer, aBaBBB with pattern BBB, except with more cowbell :-) acts the same.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sat Oct 17 21:48:44 2020
From: report at bugs.python.org (paul j3)
Date: Sun, 18 Oct 2020 01:48:44 +0000
Subject: [issue40509] In argparse,
 allow REMAINDER(...) arguments in a mutually exclusive group
In-Reply-To: <1588674644.49.0.299540849008.issue40509@roundup.psfhosted.org>
Message-ID: <1602985724.2.0.520523646249.issue40509@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

A more recent issue shows that the use of a '*' positional in a multually_exclusive_group is poorly understood and documented.  

https://bugs.python.org/issue41854

That's part of why I am not enthusiastic about extending this to include REMAINDER.  

And on rereading Shani's posts, I realize I don't understand what this has to do with subcommands.  Is this the 'add_subparsers' mechanism, or just the idea of using a trailing part of sys.argv as input to another parser or script?

I think discussion of this topic can only proceed with some concrete examples, and may be even a proposed code change (not necessarily a formal patch or pull request).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40509>
_______________________________________

From report at bugs.python.org  Sat Oct 17 21:59:43 2020
From: report at bugs.python.org (Martin Panter)
Date: Sun, 18 Oct 2020 01:59:43 +0000
Subject: [issue42062] Usage of HTTPResponse.url
In-Reply-To: <1602944036.34.0.151561478116.issue42062@roundup.psfhosted.org>
Message-ID: <1602986383.64.0.834944414953.issue42062@roundup.psfhosted.org>


Martin Panter <vadmium+py at gmail.com> added the comment:

There is a comment in the HTTPResponse class regarding these methods:

# For compatibility with old-style urllib responses.

They were there for the "urlopen" API in "urllib.request", not for the "http.client" module on its own. I expect the "url" attribute is set by the "urlopen" code.

However more recently (Issue 12707) the "url" attribute and "geturl" method were documented in the HTTPResponse documentation, which is awkward.

----------
nosy: +martin.panter

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42062>
_______________________________________

From report at bugs.python.org  Sat Oct 17 22:09:49 2020
From: report at bugs.python.org (Tim Peters)
Date: Sun, 18 Oct 2020 02:09:49 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1602986989.1.0.366063804071.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Yup, they act essentially the same, but yours jumps into the quicksand earlier ;-)

I'm fond of this one:

"""
HUGE = 10**7
BIG = 10**6

bigxs = 'x' * BIG

haystack = 'x' * HUGE
needle = bigxs + 'y' + bigxs
"""

"The problem" then is in middle of the needle, not at either end, so really simple tricks all fail. For example, set(haystack) is a subset of set(needle), so our "Bloom filter" is useless, and needle[-1] == needle[-2], so our "skip" count is the useless 0.  Pure brute force is quadratic-time, and we're even slower because we're paying over & over to try heuristic speedups that happen never to pay off.

Two-way splits the needle as

u = bigxs
v = 'y' + bigxs

and again never gets out of the "try to match the right part" phase. Each time around it fails to match 'y' on the first try, and shifts right by 1.  Boring, but linear time overall.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sat Oct 17 22:14:03 2020
From: report at bugs.python.org (Martin Panter)
Date: Sun, 18 Oct 2020 02:14:03 +0000
Subject: [issue41983] Missing Documentation AF_PACKET
In-Reply-To: <1602255549.69.0.358914707678.issue41983@roundup.psfhosted.org>
Message-ID: <1602987243.8.0.910724686259.issue41983@roundup.psfhosted.org>


Martin Panter <vadmium+py at gmail.com> added the comment:

According to the documentation at <https://docs.python.org/3.8/library/socket.html#socket.AF_PACKET> and Issue 25041 it is only available on Linux. What documentation are you looking at?

----------
nosy: +martin.panter

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41983>
_______________________________________

From report at bugs.python.org  Sat Oct 17 23:13:00 2020
From: report at bugs.python.org (Ryan Hiebert)
Date: Sun, 18 Oct 2020 03:13:00 +0000
Subject: [issue33129] Add kwarg-only option to dataclass
In-Reply-To: <1521847997.9.0.467229070634.issue33129@psf.upfronthosting.co.za>
Message-ID: <1602990780.2.0.586197088571.issue33129@roundup.psfhosted.org>


Change by Ryan Hiebert <ryan at ryanhiebert.com>:


----------
nosy: +ryanhiebert

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33129>
_______________________________________

From report at bugs.python.org  Sat Oct 17 23:55:12 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 18 Oct 2020 03:55:12 +0000
Subject: [issue36201] AssertCountEqual does not work for nested dictionaries.
In-Reply-To: <1551832953.74.0.756790771637.issue36201@roundup.psfhosted.org>
Message-ID: <1602993312.94.0.258234718507.issue36201@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36201>
_______________________________________

From report at bugs.python.org  Sun Oct 18 02:00:35 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 06:00:35 +0000
Subject: [issue42065] Fix incorrectly formatted _codecs.charmap_decode error
 message
In-Reply-To: <1602965108.98.0.722974921612.issue42065@roundup.psfhosted.org>
Message-ID: <1603000835.15.0.257054942132.issue42065@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:


New changeset 6a2aa4994e99ae8e43011a0290646fde4724a003 by Miss Skeleton (bot) in branch '3.9':
bpo-42065: Fix incorrectly formatted _codecs.charmap_decode error message (GH-19940)
https://github.com/python/cpython/commit/6a2aa4994e99ae8e43011a0290646fde4724a003


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42065>
_______________________________________

From report at bugs.python.org  Sun Oct 18 02:16:59 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 06:16:59 +0000
Subject: [issue42065] Fix incorrectly formatted _codecs.charmap_decode error
 message
In-Reply-To: <1602965108.98.0.722974921612.issue42065@roundup.psfhosted.org>
Message-ID: <1603001819.76.0.451425835181.issue42065@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:


New changeset 400175ad91c1aa8abc6dfce108446e4210d0c157 by Miss Skeleton (bot) in branch '3.8':
bpo-42065: Fix incorrectly formatted _codecs.charmap_decode error message (GH-19940)
https://github.com/python/cpython/commit/400175ad91c1aa8abc6dfce108446e4210d0c157


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42065>
_______________________________________

From report at bugs.python.org  Sun Oct 18 02:27:01 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 06:27:01 +0000
Subject: [issue40492] -m cProfile -o f.pstats with a script that does chdir()
 writes to the changed directory and not `.`
In-Reply-To: <1588563387.24.0.675526674384.issue40492@roundup.psfhosted.org>
Message-ID: <1603002421.55.0.280539565797.issue40492@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

> I am not sure what is better: to fix it at high level, in main() for cProfile and cProfile, or at low level, in methods runctx() and run() of profile._Utils.

Maybe both, to keep them decoupled and be sure of correct behavior in all cases?

----------
nosy: +taleinat
versions: +Python 3.10 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40492>
_______________________________________

From report at bugs.python.org  Sun Oct 18 04:20:26 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 18 Oct 2020 08:20:26 +0000
Subject: [issue41822] Document the meaning of values for sys.float_info.rounds
In-Reply-To: <1600648706.73.0.507862170012.issue41822@roundup.psfhosted.org>
Message-ID: <1603009226.05.0.433131347322.issue41822@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Also, we should document the meaning of the other fields.  Several of them are not self explanatory:

min_10_exp = -307

   does not mean that 2.3e-308 isn't normalized

   does mean that 10**-307 is normalized and 10**-308 isn't


min_exp = -1021

   does not mean that 2**-1021 is the lowest normalized value

   does mean ldexp(0.5, -1021) == float_info.min


decimal_dig = 15

   does not mean digits required to specify every unique float

   does mean, "number of decimal digits, q, such that any 
   floating-point number with q decimal digits can be rounded
   into a floating-point number with p radix b digits and back
   again without change to the q decimal digits"

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41822>
_______________________________________

From report at bugs.python.org  Sun Oct 18 04:48:55 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 08:48:55 +0000
Subject: [issue41822] Document the meaning of values for sys.float_info.rounds
In-Reply-To: <1600648706.73.0.507862170012.issue41822@roundup.psfhosted.org>
Message-ID: <1603010935.85.0.487046243764.issue41822@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Python does not set the meaning and the value of these fields itself. It exposes C constants. Should we just copy definitions from corresponding C or floating-point standards?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41822>
_______________________________________

From report at bugs.python.org  Sun Oct 18 04:50:54 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 08:50:54 +0000
Subject: [issue41822] Document the meaning of values for sys.float_info.rounds
In-Reply-To: <1600648706.73.0.507862170012.issue41822@roundup.psfhosted.org>
Message-ID: <1603011054.02.0.760623084236.issue41822@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Oh, seems it was what Raymond proposed initially.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41822>
_______________________________________

From report at bugs.python.org  Sun Oct 18 04:59:25 2020
From: report at bugs.python.org (Iman Kermani)
Date: Sun, 18 Oct 2020 08:59:25 +0000
Subject: [issue42066] CookieJar cookies should not be sorted
Message-ID: <1603011565.07.0.705714624719.issue42066@roundup.psfhosted.org>


New submission from Iman Kermani <imankermani at hotmail.com>:

Lib/http/cookiejar.py

By default python handle cookies based on regular Netscape cookie protocol and the protocol defined by RFC 2965.

There is a behavior in python which sort cookies in CookieJar by default:
https://github.com/python/cpython/blob/975d10a4f8f5d99b01d02fc5f99305a86827f28e/Lib/http/cookiejar.py#L1220

Moreover there is no definition in the 2965 about the cookie ordering in Cookie Header when cookies have equal-length path fields.

This is a undesirable behavior when working with certain libraries like requests. https://github.com/psf/requests/issues/5630
 
In this case browser implements the RFC 6265 which obsoletes the RFC 2965. Therefore The behavior is based on https://tools.ietf.org/html/rfc6265#section-5.4:
"The user agent SHOULD sort the cookie-list in the following order:
Cookies with longer paths are listed before cookies with shorter paths.
Among cookies that have equal-length path fields, cookies with earlier creation-times are listed before cookies with later creation-times."

This means that the order of the cookies with same path attribute in Cookie header follow the Set-Cookie order in the HTTP response.

RFC 6265 compliance is not what this issue is meant rather it imply on the sorting of cookies which is unnecessary here and not mentioned in RFC 2965 or the regular Netscape cookie protocol.

Thanks in advance for looking into this issue

Regards.

----------
components: Library (Lib)
messages: 378855
nosy: IKermani
priority: normal
severity: normal
status: open
title: CookieJar cookies should not be sorted
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42066>
_______________________________________

From report at bugs.python.org  Sun Oct 18 05:13:18 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 18 Oct 2020 09:13:18 +0000
Subject: [issue41822] Document the meaning of values for sys.float_info.rounds
In-Reply-To: <1600648706.73.0.507862170012.issue41822@roundup.psfhosted.org>
Message-ID: <1603012398.61.0.265015208743.issue41822@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Here's a link:  http://c0x.coding-guidelines.com/5.2.4.2.2.html

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41822>
_______________________________________

From report at bugs.python.org  Sun Oct 18 05:16:10 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 09:16:10 +0000
Subject: [issue40507] FileNotFound error raised by os.exec* doesn't contain
 filename
In-Reply-To: <1588658218.29.0.0740534174098.issue40507@roundup.psfhosted.org>
Message-ID: <1603012570.65.0.617691596131.issue40507@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

After further reading, especially the docs for OSError which describe the filename and filename2 attributes, I agree that setting .filename on the FileNotFoundError exception is the way to go.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40507>
_______________________________________

From report at bugs.python.org  Sun Oct 18 05:17:15 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 09:17:15 +0000
Subject: [issue26423] Integer overflow in wrap_lenfunc() on 64-bit build of
 Windows with len > 2**31-1
In-Reply-To: <1456268688.08.0.284414420897.issue26423@psf.upfronthosting.co.za>
Message-ID: <1603012635.48.0.222199986987.issue26423@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26423>
_______________________________________

From report at bugs.python.org  Sun Oct 18 05:31:18 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 09:31:18 +0000
Subject: [issue36583] Do not swallow exceptions in the _ssl module
In-Reply-To: <1554880959.84.0.895759680892.issue36583@roundup.psfhosted.org>
Message-ID: <1603013478.21.0.64649760094.issue36583@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36583>
_______________________________________

From report at bugs.python.org  Sun Oct 18 05:36:28 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 09:36:28 +0000
Subject: [issue36398] A possible crash in structseq.c's structseq_repr()
In-Reply-To: <1553228306.11.0.338923675636.issue36398@roundup.psfhosted.org>
Message-ID: <1603013788.83.0.922714089365.issue36398@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36398>
_______________________________________

From report at bugs.python.org  Sun Oct 18 05:37:52 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 09:37:52 +0000
Subject: [issue36285] Integer overflow in array.array.remove()
In-Reply-To: <1552521762.27.0.553620503066.issue36285@roundup.psfhosted.org>
Message-ID: <1603013872.78.0.207653740811.issue36285@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36285>
_______________________________________

From report at bugs.python.org  Sun Oct 18 05:38:26 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 09:38:26 +0000
Subject: [issue35436] Add missing PyErr_NoMemory() calls
In-Reply-To: <1544165858.95.0.788709270274.issue35436@psf.upfronthosting.co.za>
Message-ID: <1603013906.48.0.52812145631.issue35436@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35436>
_______________________________________

From report at bugs.python.org  Sun Oct 18 05:38:57 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 09:38:57 +0000
Subject: [issue35414] A reference counting bug in PyState_RemoveModule()
In-Reply-To: <1543991124.3.0.788709270274.issue35414@psf.upfronthosting.co.za>
Message-ID: <1603013937.7.0.780475474065.issue35414@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35414>
_______________________________________

From report at bugs.python.org  Sun Oct 18 05:46:30 2020
From: report at bugs.python.org (Jake)
Date: Sun, 18 Oct 2020 09:46:30 +0000
Subject: [issue42004] Allow uploading files with SimpleHTTPRequestHandler
In-Reply-To: <1602377597.5.0.712668345738.issue42004@roundup.psfhosted.org>
Message-ID: <1603014390.77.0.749432358833.issue42004@roundup.psfhosted.org>


Change by Jake <sorme at kth.se>:


----------
nosy: +jacobsorme

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42004>
_______________________________________

From report at bugs.python.org  Sun Oct 18 06:26:11 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 10:26:11 +0000
Subject: [issue32498] urllib.parse.unquote raises incorrect errormessage when
 string parameter is bytes
In-Reply-To: <1515179710.49.0.467229070634.issue32498@psf.upfronthosting.co.za>
Message-ID: <1603016771.26.0.00269533173666.issue32498@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

Thanks for the reminder Irit!

No, this should not be closed yet, as there is still the possibility of improving the exception in version 3.8.

----------
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32498>
_______________________________________

From report at bugs.python.org  Sun Oct 18 08:57:26 2020
From: report at bugs.python.org (barak dopama)
Date: Sun, 18 Oct 2020 12:57:26 +0000
Subject: [issue42067] Type annotation in for-loops
Message-ID: <1603025846.26.0.322544281802.issue42067@roundup.psfhosted.org>


New submission from barak dopama <gaaartner at gmail.com>:

Why do I have to do this:
        for element in my_list:
            element: ElementType = element
            process(element)
And can't do this:
        for element: ElementType  in my_list:
            process(element)

----------
components: Build
messages: 378859
nosy: gaaartner
priority: normal
severity: normal
status: open
title: Type annotation in for-loops
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42067>
_______________________________________

From report at bugs.python.org  Sun Oct 18 09:07:14 2020
From: report at bugs.python.org (Iman Kermani)
Date: Sun, 18 Oct 2020 13:07:14 +0000
Subject: [issue42066] CookieJar cookies should not be sorted
In-Reply-To: <1603011565.07.0.705714624719.issue42066@roundup.psfhosted.org>
Message-ID: <1603026434.92.0.462513468012.issue42066@roundup.psfhosted.org>


Change by Iman Kermani <imankermani at hotmail.com>:


----------
keywords: +patch
pull_requests: +21707
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22745

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42066>
_______________________________________

From report at bugs.python.org  Sun Oct 18 09:20:59 2020
From: report at bugs.python.org (Marc Culler)
Date: Sun, 18 Oct 2020 13:20:59 +0000
Subject: [issue42068] For macOS,
 package the included Tcl and Tk frameworks in a rational way.
Message-ID: <1603027259.23.0.956934315272.issue42068@roundup.psfhosted.org>


New submission from Marc Culler <marc.culler at gmail.com>:

Packaging Tcl and Tk within the python framework is a great idea
and a big improvement.  But the way it is being done is pretty crazy,
and makes it unnecessarily difficult to upgrade the version of Tcl/Tk
that python is using.  That is something which should be easy,
especially since python is still using version 8.6.8 even though 8.6.11
is about to be released and includes the results of a huge effort to
improve and stabilize the macOS port of Tk.

There is a standard and completely straightforward way of including
a framework within a framework.  The normal thing to do would be
to create a directory Python.framework/Versions/X.Y/Frameworks/ which
contains Tcl.framework and Tk.framework.  Upgrading to a newer version
of Tcl and Tk would then simply require updating those frameworks, which
would be very easy to accomplish, for example, with a .pkg file.

Instead of doing this, Python currently jams everything related to Tcl
and Tk into its lib directory, changing the library and directory names
randomly and breaking the standard directory structure that Tcl and Tk
use in their frameworks.

Why not make it standard and simple?  Why add all of this random noise?

----------
components: macOS
messages: 378860
nosy: culler, ned.deily, ronaldoussoren
priority: normal
severity: normal
status: open
title: For macOS, package the included Tcl and Tk frameworks in a rational way.
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42068>
_______________________________________

From report at bugs.python.org  Sun Oct 18 09:37:17 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 13:37:17 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603028237.25.0.679364597868.issue42051@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Seems that we can not control entity definitions and expansions. We only can limit the number of expanded entities per element (the size of self.data).

What is the reasonable default limit (taking into account that every &lt; and &#12345; is a separate entity)? How to name the limit parameter if we make it configurable? What type of exceptions should be raised?

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Sun Oct 18 09:54:34 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Sun, 18 Oct 2020 13:54:34 +0000
Subject: [issue42068] For macOS,
 package the included Tcl and Tk frameworks in a rational way.
In-Reply-To: <1603027259.23.0.956934315272.issue42068@roundup.psfhosted.org>
Message-ID: <1603029274.58.0.310265133121.issue42068@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

It sounds like your solution is macOS only, where as Python needs to be cross platform.

Further, I assume there are good reasons that it's implemented the way it is. Perhaps there was no alternative when it was initially developed? And we're constrained by backward compatibility to at least some extent.

I'm sure that we'd accept contributions that used a more modern approach, if they were cross platform and didn't break anything.

By the way, getting volunteers to pay attention to your issue isn't helped by using words like "pretty crazy" and "random noise".

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42068>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:24:00 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sun, 18 Oct 2020 14:24:00 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603031040.85.0.133074217254.issue42051@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

One option is to copy what defusedxml does to forbid a number of unsafe operations, see https://github.com/tiran/defusedxml/blob/eb38a2d710b67df48614cb5098ddb8472289ce6d/defusedxml/ElementTree.py#L68

Defusedxml uses an XMLParser subclass that optionally disables some features (such as entity definitions), for plistlib those features can be disabled unconditionally. 

I haven't thought much about the exceptions to use, probably a similar exception as is used for invalid plist files. 

Another thing I haven't really thought about: would such a change be 3.10 only or is this something we could backport?  

The following plist file currently works with plistlib, but does not work with plutil(1) on macOS 10.15 (parse error in the DTD definition).  That indicates that entity definitions aren't supposed to be used in plist files and it would be safe to disable this feature in plistlib.

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd" [
   <!ENTITY entity "replacement text">
  ]>
<plist version="1.0">
  <dict>
    <key>A</key>
    <string>&entity;</string>
  </dict>
</plist>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:29:03 2020
From: report at bugs.python.org (Marc Culler)
Date: Sun, 18 Oct 2020 14:29:03 +0000
Subject: [issue42068] For macOS,
 package the included Tcl and Tk frameworks in a rational way.
In-Reply-To: <1603027259.23.0.956934315272.issue42068@roundup.psfhosted.org>
Message-ID: <1603031343.29.0.834808457819.issue42068@roundup.psfhosted.org>


Marc Culler <marc.culler at gmail.com> added the comment:

Dear Eric,

I am aware that python is cross platform.

The change that I am proposing would be almost entirely limited to
the file:
 Mac/BuildScript/build-installer.py
which is entirely mac-specific.  It controls how the Mac installer is
constructed.  Specifically, the effect would be to change the
directory structure of the Python framework which is installed by the
Python installer package in /Library/Frameworks/Python.framework.

There presumably would also be a very small change in the _tkinter
module to account for the fact that the Tcl and Tk shared libraries
would acquire new pathnames.

My sincere apologies for offending you by my use of the words
"crazy" and "random noise". I hope you will be able to focus on the
content of the ticket in spite of my use of those offensive words.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42068>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:34:03 2020
From: report at bugs.python.org (Ken Jin)
Date: Sun, 18 Oct 2020 14:34:03 +0000
Subject: [issue42067] Type annotation in for-loops
In-Reply-To: <1603025846.26.0.322544281802.issue42067@roundup.psfhosted.org>
Message-ID: <1603031643.08.0.661627462563.issue42067@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

That's an interesting syntax suggestion, you might want to suggest that in the python-ideas mailing list for other people to read about it rather than post it on python bugs.

IMO, this isn't really an issue since you can specify the type of the elements in generic types via::

   my_list: list[int] = [1, 2, 3]
   for element in my_list:
       process(element)

Your type checker should be able to infer that ``element`` is of type ``int`` (or hopefully, it will in the near future).

----------
nosy: +kj

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42067>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:36:33 2020
From: report at bugs.python.org (Jake)
Date: Sun, 18 Oct 2020 14:36:33 +0000
Subject: [issue42004] Allow uploading files with SimpleHTTPRequestHandler
In-Reply-To: <1602377597.5.0.712668345738.issue42004@roundup.psfhosted.org>
Message-ID: <1603031793.93.0.980358347859.issue42004@roundup.psfhosted.org>


Jake <sorme at kth.se> added the comment:

I would find this very useful.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42004>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:39:08 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sun, 18 Oct 2020 14:39:08 +0000
Subject: [issue42068] For macOS,
 package the included Tcl and Tk frameworks in a rational way.
In-Reply-To: <1603027259.23.0.956934315272.issue42068@roundup.psfhosted.org>
Message-ID: <1603031948.91.0.555020022868.issue42068@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I'm not sure what you are trying to accomplish.  It is already possible to replace the Tcl/Tk libraries by replacing the relevant files in Python.framework. However: these aren't meant to be user serviceable parts, the copy of Tcl/Tk that we include is tested with Tkinter.

I assume a future release of python will include a new copy of Tk when tests indicate it is an improvement for Tkinter. I won't make any promises because I'm not doing the integration work.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42068>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:40:31 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 14:40:31 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603032031.1.0.249665581012.issue42051@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Oh, I missed that there is a handler for EntityDecl. Well, then we can fix this issue in few lines of code.

I think it should be backported. We can add private flag (global or class variable) to enable entity declarations, but do not support them in 3.10.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:48:14 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 18 Oct 2020 14:48:14 +0000
Subject: [issue32498] urllib.parse.unquote raises incorrect errormessage when
 string parameter is bytes
In-Reply-To: <1515179710.49.0.467229070634.issue32498@psf.upfronthosting.co.za>
Message-ID: <1603032494.17.0.357976849246.issue32498@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
pull_requests: +21709
pull_request: https://github.com/python/cpython/pull/22746

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32498>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:48:46 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 14:48:46 +0000
Subject: [issue38252] Use 8-byte step to detect ASCII sequence in 64bit
 Windows builds
In-Reply-To: <1569153002.15.0.915285235862.issue38252@roundup.psfhosted.org>
Message-ID: <1603032526.84.0.962687359286.issue38252@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset a0c603cb9d4dbb9909979313a88bcd1f5fde4f62 by Ma Lin in branch 'master':
bpo-38252: Use 8-byte step to detect ASCII sequence in 64bit Windows build (GH-16334)
https://github.com/python/cpython/commit/a0c603cb9d4dbb9909979313a88bcd1f5fde4f62


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38252>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:49:41 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 18 Oct 2020 14:49:41 +0000
Subject: [issue32498] urllib.parse.unquote raises incorrect errormessage when
 string parameter is bytes
In-Reply-To: <1515179710.49.0.467229070634.issue32498@psf.upfronthosting.co.za>
Message-ID: <1603032581.75.0.445553976711.issue32498@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Ah yes, I missed that. I've pushed a PR for 3.8 that does this:

>>> urllib.parse.unquote(b'abc%20def')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\Users\User\src\cpython\lib\urllib\parse.py", line 635, in unquote
    raise TypeError('Expected str, got bytes')
TypeError: Expected str, got bytes

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32498>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:49:57 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 14:49:57 +0000
Subject: [issue41966] datetime.time issue with pickling in PyPy
In-Reply-To: <1602065311.95.0.279586156365.issue41966@roundup.psfhosted.org>
Message-ID: <1603032597.14.0.774775408221.issue41966@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset c304c9a7efa8751b5bc7526fa95cd5f30aac2b92 by scaramallion in branch 'master':
bpo-41966: Fix pickling pure datetime.time subclasses (GH-22731)
https://github.com/python/cpython/commit/c304c9a7efa8751b5bc7526fa95cd5f30aac2b92


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41966>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:50:13 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 18 Oct 2020 14:50:13 +0000
Subject: [issue41966] datetime.time issue with pickling in PyPy
In-Reply-To: <1602065311.95.0.279586156365.issue41966@roundup.psfhosted.org>
Message-ID: <1603032613.28.0.572930350666.issue41966@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21710
pull_request: https://github.com/python/cpython/pull/22747

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41966>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:50:21 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 18 Oct 2020 14:50:21 +0000
Subject: [issue41966] datetime.time issue with pickling in PyPy
In-Reply-To: <1602065311.95.0.279586156365.issue41966@roundup.psfhosted.org>
Message-ID: <1603032621.16.0.668777731272.issue41966@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21711
pull_request: https://github.com/python/cpython/pull/22748

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41966>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:54:14 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 14:54:14 +0000
Subject: [issue20184] Derby #16: Convert 50 sites to Argument Clinic across 9
 files
In-Reply-To: <1389140504.71.0.617730511292.issue20184@psf.upfronthosting.co.za>
Message-ID: <1603032854.98.0.010117602184.issue20184@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 1bcaa81e520e30f920bd69e46fbf1d67a9107ce1 by Serhiy Storchaka in branch 'master':
bpo-20184: Convert termios to Argument Clinic. (GH-22693)
https://github.com/python/cpython/commit/1bcaa81e520e30f920bd69e46fbf1d67a9107ce1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20184>
_______________________________________

From report at bugs.python.org  Sun Oct 18 10:57:07 2020
From: report at bugs.python.org (Marc Culler)
Date: Sun, 18 Oct 2020 14:57:07 +0000
Subject: [issue42068] For macOS,
 package the included Tcl and Tk frameworks in a rational way.
In-Reply-To: <1603027259.23.0.956934315272.issue42068@roundup.psfhosted.org>
Message-ID: <1603033027.82.0.282264096525.issue42068@roundup.psfhosted.org>


Marc Culler <marc.culler at gmail.com> added the comment:

Dear Ronald,

You are correct that "It is already possible to replace the Tcl/Tk libraries by replacing the relevant files in Python.framework."
I know that because I have done it.  Moreover, having done it, I
know that it is much more difficult than it should be.  A large
part of the difficulty is that the directory structure of the
Tcl/Tk installation within the Python framework is undocumented and
completely different from that used within Tcl.framework and
Tk.framework.  There is no need for that.  The versions of those
frameworks with Python wants to use could simply be embedded within
the Python.framework as subframeworks.  That simplifies the build and
it simplifies upgrades and it costs nothing as far as Python is
concerned.

The backwards compatibility promise offered by Tk and Tcl means that
replacing Tcl/Tk 8.6.X with Tcl/Tk 8.6.Y will work with no change to
the binary _tkinter.ZZZZ module.  When improvements or bug fixes are
made to Tcl and Tk it should be straightforward for users to update
Python so that it will take advantage of those improvements.  Before
Tcl and Tk were included in the Python framework that was simple.
You could just install the newer release of Tcl/Tk (at least for patch
releases).  Since _tkinter would look in the standard places, i.e.
/Library/Frameworks/Tk.framework (or Tcl.framework) for its shared
libraries, that would automatically work.

The point is that it could, and should, be just as simple to make such
an upgrade with the new where Tcl and Tk are included within the Python.framework.

That is what I am trying to accomplish.  The scope of this change will
probably be clearer if I make a pull request.  So I will do that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42068>
_______________________________________

From report at bugs.python.org  Sun Oct 18 11:33:04 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 15:33:04 +0000
Subject: [issue41966] datetime.time issue with pickling in PyPy
In-Reply-To: <1602065311.95.0.279586156365.issue41966@roundup.psfhosted.org>
Message-ID: <1603035184.56.0.142361482955.issue41966@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset a055ced9d43630cadc3c1d5edab0884f2c5131ea by Miss Skeleton (bot) in branch '3.9':
bpo-41966: Fix pickling pure datetime.time subclasses (GH-22731) (GH-22747)
https://github.com/python/cpython/commit/a055ced9d43630cadc3c1d5edab0884f2c5131ea


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41966>
_______________________________________

From report at bugs.python.org  Sun Oct 18 11:33:31 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 15:33:31 +0000
Subject: [issue41966] datetime.time issue with pickling in PyPy
In-Reply-To: <1602065311.95.0.279586156365.issue41966@roundup.psfhosted.org>
Message-ID: <1603035211.86.0.872367634015.issue41966@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 1040299e9283609f3de0f6e32a0d43458fe7f4f6 by Miss Skeleton (bot) in branch '3.8':
bpo-41966: Fix pickling pure datetime.time subclasses (GH-22731) (GH-22748)
https://github.com/python/cpython/commit/1040299e9283609f3de0f6e32a0d43458fe7f4f6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41966>
_______________________________________

From report at bugs.python.org  Sun Oct 18 12:00:16 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 16:00:16 +0000
Subject: [issue41966] datetime.time issue with pickling in PyPy
In-Reply-To: <1602065311.95.0.279586156365.issue41966@roundup.psfhosted.org>
Message-ID: <1603036816.23.0.558342851833.issue41966@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41966>
_______________________________________

From report at bugs.python.org  Sun Oct 18 12:05:33 2020
From: report at bugs.python.org (Paul Moore)
Date: Sun, 18 Oct 2020 16:05:33 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603037133.8.0.572324532417.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

OK, PR updated as per discussion.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Sun Oct 18 12:52:39 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 16:52:39 +0000
Subject: [issue38252] Use 8-byte step to detect ASCII sequence in 64bit
 Windows builds
In-Reply-To: <1569153002.15.0.915285235862.issue38252@roundup.psfhosted.org>
Message-ID: <1603039959.01.0.251219848334.issue38252@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38252>
_______________________________________

From report at bugs.python.org  Sun Oct 18 12:54:54 2020
From: report at bugs.python.org (Alex)
Date: Sun, 18 Oct 2020 16:54:54 +0000
Subject: [issue42069] Make filecmp more pythonic
Message-ID: <1603040094.49.0.136787075744.issue42069@roundup.psfhosted.org>


New submission from Alex <br.shurik at gmail.com>:

Cleanup the filecmp file add typing and make it more pythonic

----------
components: Library (Lib)
messages: 378877
nosy: alex.briskin
priority: normal
severity: normal
status: open
title: Make filecmp more pythonic
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42069>
_______________________________________

From report at bugs.python.org  Sun Oct 18 12:56:50 2020
From: report at bugs.python.org (Alex)
Date: Sun, 18 Oct 2020 16:56:50 +0000
Subject: [issue42069] Make filecmp more pythonic
In-Reply-To: <1603040094.49.0.136787075744.issue42069@roundup.psfhosted.org>
Message-ID: <1603040210.78.0.398913488845.issue42069@roundup.psfhosted.org>


Change by Alex <br.shurik at gmail.com>:


----------
keywords: +patch
pull_requests: +21712
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22750

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42069>
_______________________________________

From report at bugs.python.org  Sun Oct 18 13:01:26 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 17:01:26 +0000
Subject: [issue28660] TextWrapper break_long_words=True,
 break_on_hyphens=True on long words
In-Reply-To: <1478795701.76.0.659915154246.issue28660@psf.upfronthosting.co.za>
Message-ID: <1603040486.86.0.492575435086.issue28660@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset b81c833ab51fb7d7f0f8eaace37f60ef7455aa85 by Irit Katriel in branch 'master':
bpo-28660: Make TextWrapper break long words on hyphens (GH-22721)
https://github.com/python/cpython/commit/b81c833ab51fb7d7f0f8eaace37f60ef7455aa85


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28660>
_______________________________________

From report at bugs.python.org  Sun Oct 18 13:14:00 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 18 Oct 2020 17:14:00 +0000
Subject: [issue28660] TextWrapper break_long_words=True,
 break_on_hyphens=True on long words
In-Reply-To: <1478795701.76.0.659915154246.issue28660@psf.upfronthosting.co.za>
Message-ID: <1603041240.56.0.198526763315.issue28660@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28660>
_______________________________________

From report at bugs.python.org  Sun Oct 18 13:38:23 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 18 Oct 2020 17:38:23 +0000
Subject: [issue42069] Make filecmp more pythonic
In-Reply-To: <1603040094.49.0.136787075744.issue42069@roundup.psfhosted.org>
Message-ID: <1603042703.97.0.704779272489.issue42069@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

In general, we don't accept patches like this:

* It risks breaks (in fact the tests are failing.
* We're not apply Black's quoting preferences to existing files.
* We're not yet adding type annotations through out.
* The PR introduces multiple new dependencies on other modules.
  This tends to slow down load time and complicate maintenance.
* There are subtle changes to the logic and API because
  of the dataclasses, cached_property, and lru_cache.
* We want to avoid code churn because it reduces stability
  and because it complicates maintenance (making it harder to
  apply fixes across versions).

Thank you for the suggestion, but we'll decline.

----------
nosy: +rhettinger
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42069>
_______________________________________

From report at bugs.python.org  Sun Oct 18 14:02:08 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 18 Oct 2020 18:02:08 +0000
Subject: [issue37931] crash reimporting posix after Py_Finalize on mac
In-Reply-To: <1566574787.75.0.458129578699.issue37931@roundup.psfhosted.org>
Message-ID: <1603044128.51.0.385672898826.issue37931@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Right, I close the issue.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37931>
_______________________________________

From report at bugs.python.org  Sun Oct 18 14:07:11 2020
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 18 Oct 2020 18:07:11 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603044431.2.0.574489373882.issue42041@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

I don't know how much should be documented for subprocess.Popen, but here are the details for how searching works with shell=False (default) and shell=True.

For shell=False, the search path used by WinAPI CreateProcessW checks %__APPDIR__%; %__CD__% (unless %NoDefaultCurrentDirectoryInExePath% is defined and the name to search contains no backslashes); %SystemRoot%\System32; %SystemRoot%\System; %SystemRoot%; and then the %PATH% directories. The search path is passed to WinAPI SearchPathW, with a default ".exe" extension. SearchPathW tries to resolve a relative path (but not a drive-relative or rooted-relative path) against every directory in the search path, unless it explicitly begins with a "." or ".." component. For the relative case, it appends the default ".exe" extension to a name if and only if it has no extension (a trailing "." counts as an extension). For the non-relative case, it first tries to find the name as given and then with the default extension appended, even if the filename already has an extension (no exception is made for a trailing dot, i.e. searching for "C:\Temp\spam." will check for "spam." and then "spam..exe").

>From the POSIX perspective, the implicit inclusion of the application directory, working directory, and system directories is strange and, regarding the inclusion of the working directory, troubling. The fact that searching for a relative name with one or more slashes, such as "spam\\python", is not resolved against *only* the working directory is strange and not documented. The rules governing when ".exe" will be appended are complicated and incorrectly documented (e.g. the claim "if the file name contains a path, .exe is not appended").

With shell=True, the CMD shell simply checks %__CD__% (unless %NoDefaultCurrentDirectoryInExePath% is defined and the name to search contains no slashes) and %PATH%. Support for forward slash in the name to search is wonky; it works only for quoted paths. But at least a relative path that contains slashes is only resolved against the current working directory instead of every directory in the search path. CMD's rules for appending default extensions are simpler than SearchPathW in some ways, but also more complicated because it's generalized as the PATHEXT list of extensions. In each directory, CMD always looks first for the searched name as given and then the name plus each extension in PATHEXT, regardless of the filepath type or whether the searched name already has an extension. It will not find a name that has no extension unless PATHEXT includes a "." entry for the empty extension. (This is consistent with the desktop shell API, which supports defining an association for the "." filetype.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Sun Oct 18 14:11:03 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 18 Oct 2020 18:11:03 +0000
Subject: [issue42066] CookieJar cookies should not be sorted
In-Reply-To: <1603011565.07.0.705714624719.issue42066@roundup.psfhosted.org>
Message-ID: <1603044663.23.0.767053882449.issue42066@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

The seems reasonable to me.  Likely, the sorting was originally added to make the execution order deterministic.  Now that dicts remember insertion order, that is no longer necessary.  Helpfully, the docs do not specify sorting, so there is no guaranteed behavior.  That said, there is some risk that applications or their tests depend on the existing behavior.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42066>
_______________________________________

From report at bugs.python.org  Sun Oct 18 14:34:27 2020
From: report at bugs.python.org (Ned Deily)
Date: Sun, 18 Oct 2020 18:34:27 +0000
Subject: [issue42068] For macOS,
 package the included Tcl and Tk frameworks in a rational way.
In-Reply-To: <1603027259.23.0.956934315272.issue42068@roundup.psfhosted.org>
Message-ID: <1603046067.42.0.497206077828.issue42068@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
assignee:  -> ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42068>
_______________________________________

From report at bugs.python.org  Sun Oct 18 14:34:15 2020
From: report at bugs.python.org (Ned Deily)
Date: Sun, 18 Oct 2020 18:34:15 +0000
Subject: [issue42068] For macOS,
 package the included Tcl and Tk frameworks in a rational way.
In-Reply-To: <1603027259.23.0.956934315272.issue42068@roundup.psfhosted.org>
Message-ID: <1603046055.12.0.999124149248.issue42068@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Marc, thanks for your suggestion. I'm the one responsible for how Tcl and Tk are currently packaged in the python.org framework build and I know exactly what you are suggesting so there is no need for you to make a PR. There were reasons why I chose to set things up the way they are now but it doesn't mean we need to continue to do it that way.  I will be looking at macOS packaging issues this week during our development sprint and I will respond further to this issue then.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42068>
_______________________________________

From report at bugs.python.org  Sun Oct 18 14:44:55 2020
From: report at bugs.python.org (Msimpasona)
Date: Sun, 18 Oct 2020 18:44:55 +0000
Subject: [issue42070] I think the rationale to keep IsoCalendarDate private
 from the pickle perspective should get revisited
Message-ID: <1603046695.09.0.570659045382.issue42070@roundup.psfhosted.org>


New submission from Msimpasona <msimpasona at gmail.com>:

IsoCalendarDate is pickled as a regular tuple and so requires a slightly different code flow in case the pickle file is used as cache. More details here: https://stackoverflow.com/questions/64408303/python-3-9-unpickling-of-isocalendardate-data-returns-a-tuple

My question is what's the benefit of hiding the new class IsoCalendarDate?

----------
components: Library (Lib)
messages: 378884
nosy: msimpasona
priority: normal
severity: normal
status: open
title: I think the rationale to keep IsoCalendarDate private from the pickle perspective should get revisited
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42070>
_______________________________________

From report at bugs.python.org  Sun Oct 18 14:47:53 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 18 Oct 2020 18:47:53 +0000
Subject: [issue42070] I think the rationale to keep IsoCalendarDate private
 from the pickle perspective should get revisited
In-Reply-To: <1603046695.09.0.570659045382.issue42070@roundup.psfhosted.org>
Message-ID: <1603046873.78.0.334422449647.issue42070@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +belopolsky, p-ganssle

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42070>
_______________________________________

From report at bugs.python.org  Sun Oct 18 14:58:45 2020
From: report at bugs.python.org (Marco Castelluccio)
Date: Sun, 18 Oct 2020 18:58:45 +0000
Subject: [issue42071] Shelve should default to the default Pickle protocol
 instead of hardcoding version 3
Message-ID: <1603047525.23.0.754911707422.issue42071@roundup.psfhosted.org>


New submission from Marco Castelluccio <mcastelluccio at mozilla.com>:

Shelve is currently defaulting to Pickle protocol 3, instead of using Pickle's default protocol for the Python version in use.

This way, Shelve's users don't benefit from improvements introduced in newer Pickle protocols, unless they notice it and manually pass a newer protocol version to shelve.open or the Shelf constructor.

----------
components: Library (Lib)
messages: 378885
nosy: marco-c
priority: normal
severity: normal
status: open
title: Shelve should default to the default Pickle protocol instead of hardcoding version 3
type: enhancement
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42071>
_______________________________________

From report at bugs.python.org  Sun Oct 18 15:01:44 2020
From: report at bugs.python.org (Marco Castelluccio)
Date: Sun, 18 Oct 2020 19:01:44 +0000
Subject: [issue42071] Shelve should default to the default Pickle protocol
 instead of hardcoding version 3
In-Reply-To: <1603047525.23.0.754911707422.issue42071@roundup.psfhosted.org>
Message-ID: <1603047704.54.0.470995081871.issue42071@roundup.psfhosted.org>


Change by Marco Castelluccio <mcastelluccio at mozilla.com>:


----------
keywords: +patch
pull_requests: +21713
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22751

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42071>
_______________________________________

From report at bugs.python.org  Sun Oct 18 15:02:24 2020
From: report at bugs.python.org (Paul Moore)
Date: Sun, 18 Oct 2020 19:02:24 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603047744.29.0.120404200728.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

I don't think we should document this level of detail, both because it's basically Windows standard behaviour and therefore not up to us to document, and because it's *way* too overwhelming for the average user.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Sun Oct 18 15:08:59 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 18 Oct 2020 19:08:59 +0000
Subject: [issue42071] Shelve should default to the default Pickle protocol
 instead of hardcoding version 3
In-Reply-To: <1603047525.23.0.754911707422.issue42071@roundup.psfhosted.org>
Message-ID: <1603048139.84.0.0960785602961.issue42071@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

Unfortunately, this is a duplicate of bpo-34204 (which already has a pull request).

----------
nosy: +ZackerySpytz
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> Bump the default pickle protocol in shelve
versions:  -Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42071>
_______________________________________

From report at bugs.python.org  Sun Oct 18 15:10:43 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 18 Oct 2020 19:10:43 +0000
Subject: [issue42071] Shelve should default to the default Pickle protocol
 instead of hardcoding version 3
In-Reply-To: <1603047525.23.0.754911707422.issue42071@roundup.psfhosted.org>
Message-ID: <1603048243.62.0.849386428129.issue42071@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

This seems reasonable to me.

There might be some issue is existing code where different versions of Python are sharing the same shelf, but I don't think this is common.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42071>
_______________________________________

From report at bugs.python.org  Sun Oct 18 15:19:44 2020
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 18 Oct 2020 19:19:44 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603048784.25.0.626457275193.issue42041@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> I don't think we should document this level of detail

But a lot of it -- most of it -- is also strange behavior that no one would expect without reading about it somewhere. Most users of subprocess.Popen() will never wade through the documentation of CreateProcessW, SearchPathW, ShellExecuteExW, and cmd.exe -- to the extent that the behavior is usefully and correctly documented by Microsoft.

One of the reasons I bother writing it out in detail here is to make the case for always using shutil.which(), regardless of the value of `shell` (unless shell=True is being used beyond the filesystem scope). We have complete control of the implementation and documentation of shutil.which(). I don't want that advice to be narrowed down to just talking about running "python".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Sun Oct 18 15:50:24 2020
From: report at bugs.python.org (Paul Moore)
Date: Sun, 18 Oct 2020 19:50:24 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603050624.51.0.00682163712096.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

Well, I'm not convinced that using `shutil.which` is the right answer for anything other than "python". And even there, I'd recommend using `sys.executable` over `shutil.which` in pretty much every case.

My view is that if we ignore the "weirdness" introduced by the redirector[1], for everything else `subprocess` is fine - it searches for the executable using the normal platform semantics. That's nearly always the same across platforms, and when it isn't, users may well prefer consistency with the platform over identical cross-platform behaviour. And if they *do* want cross-platform consistency, at the cost of occasional differences between their program's behaviour and (for example) the shell, then they have `shutil.which` available.

Saying that `subprocess` follows platform semantics is easy, and clear. People who need to know platform details can find them out. People who want Python-defined cross-platform semantics have `shutil.which`.

That's the basis on which I feel that documenting the Windows rules is unnecessary. Also, why would we document the Windows rules, but not the POSIX rules? They are arguably just as strange to someone who doesn't know them.

[1] I would characterise that weirdness as being that the redirector impacts the behaviour of how the platform locates the "python" command under the platform search rules of the platform the redirector is used on - even though we don't document the behaviour of the redirector so the user cannot infer the actual rules without knowing implementation details.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Sun Oct 18 16:06:19 2020
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 18 Oct 2020 20:06:19 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603051579.44.0.404130484022.issue42041@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> Also, why would we document the Windows rules, but not the POSIX 
> rules? They are arguably just as strange to someone who doesn't 
> know them.

POSIX rules are simply to search PATH for the filename as passed, and if it has a slash in it, the path is resolved against the working directory. There is no implicit search of the application directory, current directory, and system directories. There is no search for "dir/file" in *every* search path directory instead of just resolving against the working directory. There is no figuring out when ".exe" or PATHEXT extensions will be appended or how to search for a filename that has no extension by appending a trailing "." to the name. And there is no massive inconsistency between the search semantics of shell=True and shell=False. What happens with "platform semantics" in Windows is complicated compared to POSIX. I'm more comfortable telling people to search via shutil.which() than relying on the platform search. I'd be much more comfortable if that's what subprocess.Popen() just did on its own. But we're locked into platform semantics, and I don't see that changing.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Sun Oct 18 16:19:04 2020
From: report at bugs.python.org (Grisha Lukovnikov)
Date: Sun, 18 Oct 2020 20:19:04 +0000
Subject: [issue42072] requests
Message-ID: <1603052344.71.0.153808857129.issue42072@roundup.psfhosted.org>


New submission from Grisha Lukovnikov <grishalukovnikov97 at gmail.com>:

Traceback (most recent call last):
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connectionpool.py", line 670, in urlopen
    httplib_response = self._make_request(
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connectionpool.py", line 381, in _make_request
    self._validate_conn(conn)
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connectionpool.py", line 978, in _validate_conn
    conn.connect()
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connection.py", line 343, in connect
    self.ssl_context = create_urllib3_context(
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\util\ssl_.py", line 301, in create_urllib3_context
    context.keylog_filename = os.environ.get("SSLKEYLOGFILE")
PermissionError: [Errno 13] Permission denied: 'C:\\Users\\dns\\Desktop'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\requests\adapters.py", line 439, in send
    resp = conn.urlopen(
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connectionpool.py", line 726, in urlopen
    retries = retries.increment(
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\util\retry.py", line 403, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\packages\six.py", line 734, in reraise
    raise value.with_traceback(tb)
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connectionpool.py", line 670, in urlopen
    httplib_response = self._make_request(
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connectionpool.py", line 381, in _make_request
    self._validate_conn(conn)
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connectionpool.py", line 978, in _validate_conn
    conn.connect()
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connection.py", line 343, in connect
    self.ssl_context = create_urllib3_context(
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\util\ssl_.py", line 301, in create_urllib3_context
    context.keylog_filename = os.environ.get("SSLKEYLOGFILE")
urllib3.exceptions.ProtocolError: ('Connection aborted.', PermissionError(13, 'Permission denied'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\dns\Desktop\kurs.py", line 3, in <module>
    print(requests.get("https://yandex.ru", verify=False).content)
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\requests\api.py", line 76, in get
    return request('get', url, params=params, **kwargs)
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\requests\api.py", line 61, in request
    return session.request(method=method, url=url, **kwargs)
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\requests\sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\requests\sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "C:\Users\dns\AppData\Local\Programs\Python\Python39\lib\site-packages\requests\adapters.py", line 498, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', PermissionError(13, 'Permission denied'))

----------
components: Windows
files: kurs.py
messages: 378892
nosy: grishalukovnikov97, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: requests
versions: Python 3.9
Added file: https://bugs.python.org/file49524/kurs.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42072>
_______________________________________

From report at bugs.python.org  Sun Oct 18 16:22:44 2020
From: report at bugs.python.org (Erik Welch)
Date: Sun, 18 Oct 2020 20:22:44 +0000
Subject: [issue42073] classmethod does not pass "type/owner" when invoking
 wrapped __get__
Message-ID: <1603052564.81.0.969263752847.issue42073@roundup.psfhosted.org>


New submission from Erik Welch <erik.n.welch at gmail.com>:

The following is new to Python 3.9, and I consider the implementation incomplete.  I have code that works for Python 3.8 and before, but not for Python 3.9:

"Class methods can now wrap other :term:`descriptors <descriptor>` such as :func:`property`."

https://github.com/python/cpython/pull/8405
https://bugs.python.org/issue19072

As implemented, `classmethod` does not correctly wrap descriptors that mimic classmethod.  Previously, __get__of wrapped objects wasn't invoked by classmethod, so it was safe to have an object with both __call__ and __get__ behave like a classmethod.  Now, classmethod calling __get__ first gives incorrect results.

Here is a minimal example:
```
from types import MethodType


class myclassmethod:
    def __init__(self, func):
        self.func = func

    def __call__(self, cls):
        return self.func(cls)

    def __get__(self, instance, owner=None):
        if owner is None:
            owner = type(instance)
        return MethodType(self, owner)


class A:
    @myclassmethod
    def f1(cls):
        return cls

    @classmethod
    @myclassmethod
    def f2(cls):
        return cls


assert A.f1() is A
assert A.f2() is A  # <-- fails in 3.9, works in 3.8 and before
```
This pattern would typically be used to do something extra in __call__.

For the sake of discussion, let's call the two arguments to __get__ "instance" and "owner".  Typically, "instance" is an instance of "owner", or, equivalently, "owner" is the type of "instance".  If "owner" is None, it is generally assumed to be the type of "instance".

In bpo19072 (and gh8405), classmethod was changed to call `obj.__get__(owner)` if the wrapped object "obj" has __get__.  Notice that only the "instance" argument is provided.  Moreover, the type `owner` is passed as the "instance" argument.  This means that the "owner" argument (which is None) will be assumed to be the type of the "instance" argument, which is the type of the `owner` type.  This is wrong.  The "owner" argument should be `owner`.

I believe it would be better for classmethod to call `obj.__get__(owner, owner)` if "obj" has __get__.

This is kind of difficult to explain.  I will make a PR with more informative tests shortly.  Here is the simple diff to make the above example pass:
```
diff --git a/Objects/funcobject.c b/Objects/funcobject.c
index bd24f67b97..74f9167566 100644
--- a/Objects/funcobject.c
+++ b/Objects/funcobject.c
@@ -739,7 +739,7 @@ cm_descr_get(PyObject *self, PyObject *obj, PyObject *type)
         type = (PyObject *)(Py_TYPE(obj));
     if (Py_TYPE(cm->cm_callable)->tp_descr_get != NULL) {
         return Py_TYPE(cm->cm_callable)->tp_descr_get(cm->cm_callable, type,
-                                                      NULL);
+                                                      type);
     }
     return PyMethod_New(cm->cm_callable, type);
 }

```
Since I consider the new behavior to have introduced a regression, I think this change should be applied to both 3.9 and 3.10.

Cheers!

----------
components: Interpreter Core
messages: 378893
nosy: berker.peksag, eriknw, rhettinger, serhiy.storchaka
priority: normal
severity: normal
status: open
title: classmethod does not pass "type/owner" when invoking wrapped __get__
type: behavior
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42073>
_______________________________________

From report at bugs.python.org  Sun Oct 18 16:30:17 2020
From: report at bugs.python.org (Paul Moore)
Date: Sun, 18 Oct 2020 20:30:17 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603053017.52.0.640715489145.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

Exactly. Why isn't the current directory searched? Why isn't foo/bar searched for on PATH? Why is it possible for the user to accidentally remove system commands from PATH and lose access to them? Any system is confusing and surprising to users only familiar with another system.

And I've had very bad experiences in the past with languages/applications that presume to define a "cross-platform" abstraction that ends up just "not behaving how I expect a native app to". You can build a cross-platform wrapper on top of native behaviour (witness `shutil.which`) but you can't do the opposite.

Maybe there's scope for a section in the documentation that discusses how to use `subprocess` in a platform-agnostic manner. I'd be OK with that, although I'd want it to read along the lines of "these are places where Windows and POSIX behave differently" and not "here's some weird stuff Windows does that POSIX users need to be aware of" which was how your comment read to me.

Never mind, I think we can just agree to differ on this. It's not likely to impact this issue or the PR for it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Sun Oct 18 16:48:38 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 20:48:38 +0000
Subject: [issue40492] -m cProfile -o f.pstats with a script that does chdir()
 writes to the changed directory and not `.`
In-Reply-To: <1588563387.24.0.675526674384.issue40492@roundup.psfhosted.org>
Message-ID: <1603054118.39.0.217419200542.issue40492@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:


New changeset 3c0ac18504cfeed822439024339d5717f42bdd66 by Anthony Sottile in branch 'master':
bpo-40492: Fix --outfile with relative path when the program changes it working dir (GH-19910)
https://github.com/python/cpython/commit/3c0ac18504cfeed822439024339d5717f42bdd66


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40492>
_______________________________________

From report at bugs.python.org  Sun Oct 18 16:53:38 2020
From: report at bugs.python.org (Paul Ganssle)
Date: Sun, 18 Oct 2020 20:53:38 +0000
Subject: [issue42070] I think the rationale to keep IsoCalendarDate private
 from the pickle perspective should get revisited
In-Reply-To: <1603046695.09.0.570659045382.issue42070@roundup.psfhosted.org>
Message-ID: <1603054418.27.0.242561079588.issue42070@roundup.psfhosted.org>


Paul Ganssle <p.ganssle at gmail.com> added the comment:

That's a reasonable enough objection, though what use case do you have for storing the IsocalendarDate object? The main reason we switched to using a named tuple like this was because the vast majority of uses of `isocalendar()` that I saw were people doing stuff like `dt.isocalendar()[0]`, rather than destructuring the tuple or accessing more than one element from the result.

It seems to me that if you are using a pickle for a cache, you'd either pickle the `datetime` itself (and call `.isocalendar()` in the process that has read from the cache already), or you'd store one or more of the fields directly on the object that you are caching.

A real life use case for this would help.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42070>
_______________________________________

From report at bugs.python.org  Sun Oct 18 16:54:17 2020
From: report at bugs.python.org (Anthony Sottile)
Date: Sun, 18 Oct 2020 20:54:17 +0000
Subject: [issue40492] -m cProfile -o f.pstats with a script that does chdir()
 writes to the changed directory and not `.`
In-Reply-To: <1588563387.24.0.675526674384.issue40492@roundup.psfhosted.org>
Message-ID: <1603054457.23.0.947068445064.issue40492@roundup.psfhosted.org>


Change by Anthony Sottile <asottile at umich.edu>:


----------
pull_requests: +21715
pull_request: https://github.com/python/cpython/pull/22752

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40492>
_______________________________________

From report at bugs.python.org  Sun Oct 18 16:54:58 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 20:54:58 +0000
Subject: [issue40492] -m cProfile -o f.pstats with a script that does chdir()
 writes to the changed directory and not `.`
In-Reply-To: <1588563387.24.0.675526674384.issue40492@roundup.psfhosted.org>
Message-ID: <1603054498.83.0.950696173953.issue40492@roundup.psfhosted.org>


Change by Tal Einat <taleinat+python at gmail.com>:


----------
pull_requests: +21716
pull_request: https://github.com/python/cpython/pull/22753

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40492>
_______________________________________

From report at bugs.python.org  Sun Oct 18 16:56:31 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 20:56:31 +0000
Subject: [issue40492] -m cProfile -o f.pstats with a script that does chdir()
 writes to the changed directory and not `.`
In-Reply-To: <1588563387.24.0.675526674384.issue40492@roundup.psfhosted.org>
Message-ID: <1603054591.38.0.562120534237.issue40492@roundup.psfhosted.org>


Change by Tal Einat <taleinat+python at gmail.com>:


----------
pull_requests: +21717
pull_request: https://github.com/python/cpython/pull/22754

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40492>
_______________________________________

From report at bugs.python.org  Sun Oct 18 16:57:33 2020
From: report at bugs.python.org (Anthony Sottile)
Date: Sun, 18 Oct 2020 20:57:33 +0000
Subject: [issue40492] -m cProfile -o f.pstats with a script that does chdir()
 writes to the changed directory and not `.`
In-Reply-To: <1588563387.24.0.675526674384.issue40492@roundup.psfhosted.org>
Message-ID: <1603054653.41.0.298162976711.issue40492@roundup.psfhosted.org>


Change by Anthony Sottile <asottile at umich.edu>:


----------
pull_requests: +21718
pull_request: https://github.com/python/cpython/pull/22755

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40492>
_______________________________________

From report at bugs.python.org  Sun Oct 18 16:59:43 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 20:59:43 +0000
Subject: [issue40492] -m cProfile -o f.pstats with a script that does chdir()
 writes to the changed directory and not `.`
In-Reply-To: <1588563387.24.0.675526674384.issue40492@roundup.psfhosted.org>
Message-ID: <1603054783.05.0.143151618269.issue40492@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

Many thanks for the report and the PR, Anthony!

Serhiy, do you think it is worth also calling abspath in the profile._Utils as you mentioned, for cases where those may be called directly?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40492>
_______________________________________

From report at bugs.python.org  Sun Oct 18 17:00:06 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 21:00:06 +0000
Subject: [issue40492] -m cProfile -o f.pstats with a script that does chdir()
 writes to the changed directory and not `.`
In-Reply-To: <1588563387.24.0.675526674384.issue40492@roundup.psfhosted.org>
Message-ID: <1603054806.21.0.502818996359.issue40492@roundup.psfhosted.org>


Change by Tal Einat <taleinat+python at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40492>
_______________________________________

From report at bugs.python.org  Sun Oct 18 17:06:41 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 21:06:41 +0000
Subject: [issue32498] urllib.parse.unquote raises incorrect errormessage when
 string parameter is bytes
In-Reply-To: <1515179710.49.0.467229070634.issue32498@psf.upfronthosting.co.za>
Message-ID: <1603055201.38.0.362418442218.issue32498@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:


New changeset 1a3f7c042a32fb813835243bd7f96e47c665bfdc by Irit Katriel in branch '3.8':
[3.8] bpo-32498: Improve exception message on passing bytes to urllib.parse.unquote (GH-22746)
https://github.com/python/cpython/commit/1a3f7c042a32fb813835243bd7f96e47c665bfdc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32498>
_______________________________________

From report at bugs.python.org  Sun Oct 18 17:07:57 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 21:07:57 +0000
Subject: [issue32498] urllib.parse.unquote raises incorrect errormessage when
 string parameter is bytes
In-Reply-To: <1515179710.49.0.467229070634.issue32498@psf.upfronthosting.co.za>
Message-ID: <1603055277.86.0.107937875993.issue32498@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

Thanks for the report and the PR, Stein!

And thanks for the PR for 3.8, Irit!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32498>
_______________________________________

From report at bugs.python.org  Sun Oct 18 17:14:22 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 21:14:22 +0000
Subject: [issue40492] -m cProfile -o f.pstats with a script that does chdir()
 writes to the changed directory and not `.`
In-Reply-To: <1588563387.24.0.675526674384.issue40492@roundup.psfhosted.org>
Message-ID: <1603055662.58.0.942116600305.issue40492@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:


New changeset 1c5a65723e623be32e246f58b8797a263f616295 by Anthony Sottile in branch '3.8':
bpo-40492: Fix --outfile with relative path when the program changes it working dir (GH-19910)
https://github.com/python/cpython/commit/1c5a65723e623be32e246f58b8797a263f616295


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40492>
_______________________________________

From report at bugs.python.org  Sun Oct 18 17:16:27 2020
From: report at bugs.python.org (Tal Einat)
Date: Sun, 18 Oct 2020 21:16:27 +0000
Subject: [issue40492] -m cProfile -o f.pstats with a script that does chdir()
 writes to the changed directory and not `.`
In-Reply-To: <1588563387.24.0.675526674384.issue40492@roundup.psfhosted.org>
Message-ID: <1603055787.05.0.155860827141.issue40492@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:


New changeset 7c949020ef2520d7a7cbc978f0b34423e6c2a94c by Anthony Sottile in branch '3.9':
bpo-40492: Fix --outfile with relative path when the program changes it working dir (GH-19910)
https://github.com/python/cpython/commit/7c949020ef2520d7a7cbc978f0b34423e6c2a94c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40492>
_______________________________________

From report at bugs.python.org  Sun Oct 18 17:17:30 2020
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 18 Oct 2020 21:17:30 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603055850.02.0.750047820395.issue42041@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> You can build a cross-platform wrapper on top of native behaviour 
> (witness `shutil.which`) but you can't do the opposite.

Nothing would prevent adding a parameter to use the platform semantics, if that had been in the design from the outset. But it's not something we should change at this stage. It's too fundamental.

> I'm not convinced that using `shutil.which` is the right 
> answer for anything other than "python".

Actually, I think shutil.which() is the right answer generally (within the filesystem scope) except for "python", for which sys.executable is usually what people want, i.e. the current interpreter. A PATH search via shutil.which('python') doesn't necessarily find the current interpreter, if anything at all. So I'm not arguing against advice to use sys.executable, but rather that recommmending shutil.which() should be done in a more generic way that's separate from the "python" problem. 

For platform semantics, I'd prefer a link to the CreateProcessW docs, with advice to read about the lpApplicationName parameter with respect to `executable` and lpCommandLine with respect to `args` and the platform search semantics. The CreateProcessW docs are rather long and off-putting, so I think it helps to narrow it down for people, and explicitly map between Popen() and CreateProcessW parameters.

Over the years, I've come across many forum questions in which novice users waste days on problems with respect to Windows quirks that can be resolved in a minute or so by someone with knowledge and experience. They get lots of advice with good intentions from programmers who only have POSIX experience (the Python ecosystem online is still heavily dominated by POSIX, despite the number of Windows users), and it's mostly wrong advice and a waste of their time (not even a learning experience). Documenting platform inconsistencies helps experienced programmers to use the docs in order to help novice programmers. It's not necessarily about helping novices directly. Often just a nudge in the right direction is enough.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Sun Oct 18 17:44:41 2020
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Sun, 18 Oct 2020 21:44:41 +0000
Subject: [issue42060] Usage of assert in http/client.py
In-Reply-To: <1602939189.16.0.999843550668.issue42060@roundup.psfhosted.org>
Message-ID: <1603057481.09.0.00130681546033.issue42060@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

If I understand correctly, those are _private methods_ (names start with underscore). In such cases, asserts can be completely fine, since the library writer controls the situations where the method is called. If it is never called with _UNKNOWN argument, assert is just that, assertion that it is so. (It would be different if it were a public method, since the library writer doesn't know it will never be called with _UNKNOWN.)

----------
nosy: +veky

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42060>
_______________________________________

From report at bugs.python.org  Sun Oct 18 17:49:09 2020
From: report at bugs.python.org (CaptainMitsumoto)
Date: Sun, 18 Oct 2020 21:49:09 +0000
Subject: [issue42074] f***ing setup failed is driving me insane
Message-ID: <1603057749.44.0.277772505127.issue42074@roundup.psfhosted.org>


New submission from CaptainMitsumoto <rikkuguzai at gmail.com>:

I am frustrated now. I was about to install Python 3.9.0 in my gaming laptop then I get this thing.

I tried to google the hex error and the error name. I tried getting help in Python Discord but no good luck, they're weren't any good solutions. I got this bug yesterday and I waited 1 day later (which is today) and it still existed. I tried installing the old versions before Python 3.9.0, still nope. Wow, this crap is driving me crazy, all I wanted to do is to code in Python.

Error: 0x80070002 - The system cannot find the file specified.

----------
components: Unicode
files: dsafdsfdsfdsfdsfsafsafsadfsagggg.PNG
messages: 378904
nosy: ezio.melotti, rikkuguzai, vstinner
priority: normal
severity: normal
status: open
title: f***ing setup failed is driving me insane
type: crash
versions: Python 3.9
Added file: https://bugs.python.org/file49525/dsafdsfdsfdsfdsfsafsafsadfsagggg.PNG

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42074>
_______________________________________

From report at bugs.python.org  Sun Oct 18 17:51:01 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Sun, 18 Oct 2020 21:51:01 +0000
Subject: [issue42064] Convert sqlite3 to multi-phase initialisation (PEP 489)
In-Reply-To: <1602963425.44.0.576962569847.issue42064@roundup.psfhosted.org>
Message-ID: <1603057861.01.0.429747229337.issue42064@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

FYI, WIP branch for this bpo is here: https://github.com/erlend-aasland/cpython/commits/bpo-42064/all
This currently includes items 1 though 6. I'll update the WIP branch with a draft of items 7 and 8, hopefully tomorrow.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42064>
_______________________________________

From report at bugs.python.org  Sun Oct 18 17:58:04 2020
From: report at bugs.python.org (Chris Jerdonek)
Date: Sun, 18 Oct 2020 21:58:04 +0000
Subject: [issue38323] asyncio: MultiLoopWatcher has a race condition
 (test_asyncio: test_close_kill_running() hangs on AMD64 RHEL7 Refleaks 3.x)
In-Reply-To: <1569848255.08.0.155489980043.issue38323@roundup.psfhosted.org>
Message-ID: <1603058284.73.0.136757266158.issue38323@roundup.psfhosted.org>


Change by Chris Jerdonek <chris.jerdonek at gmail.com>:


----------
pull_requests: +21719
pull_request: https://github.com/python/cpython/pull/22756

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38323>
_______________________________________

From report at bugs.python.org  Sun Oct 18 18:05:48 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 18 Oct 2020 22:05:48 +0000
Subject: [issue42074] setup error on windows
In-Reply-To: <1603057749.44.0.277772505127.issue42074@roundup.psfhosted.org>
Message-ID: <1603058748.32.0.804273597449.issue42074@roundup.psfhosted.org>


Change by Steven D'Aprano <steve+python at pearwood.info>:


----------
title: f***ing setup failed is driving me insane -> setup error on windows

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42074>
_______________________________________

From report at bugs.python.org  Sun Oct 18 18:15:40 2020
From: report at bugs.python.org (Mithil)
Date: Sun, 18 Oct 2020 22:15:40 +0000
Subject: [issue42075] Verbose/confusing default format on warnings
Message-ID: <1603059340.5.0.993614197366.issue42075@roundup.psfhosted.org>


New submission from Mithil <mithil467 at gmail.com>:

The default format prints a lot of details like filename, line number, and the source code on that line. A particular case where the warn message is written on the next line like -
warn(
   "Message here")
Will only print warn( as the source code and not the entire block.
My concern is, can this formatting be less detailed by default. Or, can this format be freely changed in a project A without worrying about affecting the global usage in any other project B that imports it.
Or at the very least, can this be made to print the entire block of code and not just the one line, because that makes it very confusing for the user.

More takes on the issue here - https://github.com/PyCQA/isort/issues/1568

----------
components: Library (Lib)
messages: 378906
nosy: Mithil
priority: normal
severity: normal
status: open
title: Verbose/confusing default format on warnings
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42075>
_______________________________________

From report at bugs.python.org  Sun Oct 18 18:16:48 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 18 Oct 2020 22:16:48 +0000
Subject: [issue42074] setup error on windows
In-Reply-To: <1603057749.44.0.277772505127.issue42074@roundup.psfhosted.org>
Message-ID: <1603059408.91.0.747598510563.issue42074@roundup.psfhosted.org>


Change by Steven D'Aprano <steve+python at pearwood.info>:


----------
components: +Installation -Unicode
type: crash -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42074>
_______________________________________

From report at bugs.python.org  Sun Oct 18 18:16:19 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 18 Oct 2020 22:16:19 +0000
Subject: [issue42074] setup error on windows
In-Reply-To: <1603057749.44.0.277772505127.issue42074@roundup.psfhosted.org>
Message-ID: <1603059379.48.0.235326479045.issue42074@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Hi CaptainMitsumoto,

Did you follow the instructions given by the installer to read the log file? We don't have access to your log file, only you do. Can you see what file cannot be found?

Did you try some basic googling? I'm not a Windows guru, but this:

https://answers.microsoft.com/en-us/windows/forum/windows_10-windows_install/0x80070002-the-system-cannot-find-the-file/cad10f8d-79f2-4a10-953f-b85478b3e1b7


suggests that the problem is related to permissions, or your OS installation, not to the installer itself. Do you have administrator privileges? Did you check your .Net framework? What version of Windows are you using?

If you have already received some suggestions which did not work, would you mind telling us what you already tried so we don't waste our time, and yours, telling you what you have already tried.

Did you successfully install the older version of Python? If so, there is nothing stopping you from coding in 3.8 and upgrading later.

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42074>
_______________________________________

From report at bugs.python.org  Sun Oct 18 18:25:59 2020
From: report at bugs.python.org (Erik Welch)
Date: Sun, 18 Oct 2020 22:25:59 +0000
Subject: [issue19072] classmethod doesn't honour descriptor protocol of
 wrapped callable
In-Reply-To: <1379856164.11.0.6368818134.issue19072@psf.upfronthosting.co.za>
Message-ID: <1603059959.64.0.485543029105.issue19072@roundup.psfhosted.org>


Change by Erik Welch <erik.n.welch at gmail.com>:


----------
nosy: +eriknw
nosy_count: 8.0 -> 9.0
pull_requests: +21721
pull_request: https://github.com/python/cpython/pull/22757

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19072>
_______________________________________

From report at bugs.python.org  Sun Oct 18 18:25:59 2020
From: report at bugs.python.org (Erik Welch)
Date: Sun, 18 Oct 2020 22:25:59 +0000
Subject: [issue42073] classmethod does not pass "type/owner" when invoking
 wrapped __get__
In-Reply-To: <1603052564.81.0.969263752847.issue42073@roundup.psfhosted.org>
Message-ID: <1603059959.56.0.51545614143.issue42073@roundup.psfhosted.org>


Change by Erik Welch <erik.n.welch at gmail.com>:


----------
keywords: +patch
pull_requests: +21720
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22757

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42073>
_______________________________________

From report at bugs.python.org  Sun Oct 18 18:32:05 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 18 Oct 2020 22:32:05 +0000
Subject: [issue42075] Verbose/confusing default format on warnings
In-Reply-To: <1603059340.5.0.993614197366.issue42075@roundup.psfhosted.org>
Message-ID: <1603060325.96.0.48576223708.issue42075@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

3.9 and older are all in feature freeze, so no changes in behaviour will be considered for them.

I'm afraid I cannot replicate the behaviour you describe. When I try, the full warning message is correctly displayed. See the attached file.

Importing it from the interactive interpreter gives:

    >>> import warntest
    /home/steve/warntest.py:5: UserWarning: Danger danger danger Will Robinson!!!
      "Danger danger danger Will Robinson!!!"


and running it from the commandline:


$ python3 ~/warntest.py 
/home/steve/warntest.py:5: UserWarning: Danger danger danger Will Robinson!!!
  "Danger danger danger Will Robinson!!!"


Can you provide a minimal working example of the issue?

----------
nosy: +steven.daprano
versions:  -Python 3.6, Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49526/warntest.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42075>
_______________________________________

From report at bugs.python.org  Sun Oct 18 18:46:05 2020
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 18 Oct 2020 22:46:05 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603061165.22.0.657466299753.issue42041@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> For platform semantics, I'd prefer a link to the CreateProcessW docs, 
> with advice to read about the lpApplicationName parameter with 
> respect to `executable` and lpCommandLine with respect to `args` 
> and the platform search semantics. 

For example, let's help someone figure out that because "python3.8" has a ".8" filename 'extension', ".exe" may or may not be appended in a search.

    >>> print(shutil.which('python3.8'))
    C:\Users\someone\AppData\Local\Microsoft\WindowsApps\python3.8.EXE

    >>> subprocess.call(['python3.8.exe', '-V'])
    Python 3.8.6
    0

SearchPathW (called internally by CreateProcessW) won't append the ".exe" default extension to a name that already has a ".8" extension:

    >>> try: subprocess.call(['python3.8', '-V'])
    ... except OSError as e: print(e)
    ...
    [WinError 2] The system cannot find the file specified

But with shell=True it works because CMD always appends the PATHEXT extensions (thankfully there isn't a "python3.8.com" file to get in the way, since .COM is usually listed before .EXE in PATHEXT):

    >>> subprocess.call('python3.8 -V', shell=True)
    Python 3.8.6
    0

SearchPathW does append the default ".exe" extension for a qualified path:

    >>> subprocess.call([r'C:\Users\someone\AppData\Local\Microsoft\WindowsApps\python3.8', '-V'])
    Python 3.8.6
    0

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Sun Oct 18 18:52:21 2020
From: report at bugs.python.org (Mithil)
Date: Sun, 18 Oct 2020 22:52:21 +0000
Subject: [issue42075] Verbose/confusing default format on warnings
In-Reply-To: <1603059340.5.0.993614197366.issue42075@roundup.psfhosted.org>
Message-ID: <1603061541.73.0.979964105265.issue42075@roundup.psfhosted.org>


Mithil <mithil467 at gmail.com> added the comment:

I ran the file that you linked and this is what it printed.

C:\Users\mithi\p\test\file.py:3: UserWarning: Danger danger danger Will Robinson!!!
  warnings.warn(

As you see, the warnings.warn( line is not desirable.
More details about my machine -
Windows 10
python 3.9.0

I have also tried running this with Python 3.10.0a1. Same result.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42075>
_______________________________________

From report at bugs.python.org  Sun Oct 18 19:00:52 2020
From: report at bugs.python.org (Serhiy Ivanov)
Date: Sun, 18 Oct 2020 23:00:52 +0000
Subject: [issue42076] urllib ResourceWarning in case of usage of FTP
Message-ID: <1603062052.42.0.758014022395.issue42076@roundup.psfhosted.org>


New submission from Serhiy Ivanov <icegood1980 at gmail.com>:

In case when FTP url is successfully connected via default FTPHandler in FTPHandler.connect_ftp then release of this stuff becomes total responsibility of user i.e. socket remains open, which leads to ResourceWarning in the garbage collector, in case if the user does nothing.

Something like this solves issue in user area:

class SafeFTPHandler(urllib.request.FTPHandler):
          ftp_object = None

          def __init__(self):
            super().__init__()

          def connect_ftp(self, user, passwd, host, port, dirs, timeout):
              self.ftp_object = super().connect_ftp(user, passwd, host, port, dirs, timeout)
              return self.ftp_object

          def ftp_response(self, req, response):
              self._close_ftp()
              return response

          def ftp_open(self, req):
            try:
              return super().ftp_open(req)
            except:
              self._close_ftp()
              raise

          def _close_ftp(self):
            if self.ftp_object:
                self.ftp_object.close()

and further usage in OpenerDirector...

In general case FTPHandler should be able to close immediately (in case if it raises as well) while re-using of the socket should be implemented only within CacheFTPHandler

----------
components: Library (Lib)
messages: 378911
nosy: icegood
priority: normal
severity: normal
status: open
title: urllib ResourceWarning in case of usage of FTP
type: resource usage
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42076>
_______________________________________

From report at bugs.python.org  Sun Oct 18 19:02:43 2020
From: report at bugs.python.org (Mithil)
Date: Sun, 18 Oct 2020 23:02:43 +0000
Subject: [issue42075] Verbose/confusing default format on warnings
In-Reply-To: <1603059340.5.0.993614197366.issue42075@roundup.psfhosted.org>
Message-ID: <1603062163.36.0.529783786861.issue42075@roundup.psfhosted.org>


Mithil <mithil467 at gmail.com> added the comment:

I also ran this on Fedora 32, python 3.8.6 and still got the same result.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42075>
_______________________________________

From report at bugs.python.org  Sun Oct 18 19:11:28 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 18 Oct 2020 23:11:28 +0000
Subject: [issue38947] dataclass defaults behave inconsistently for
 init=True/init=False when default is a descriptor
In-Reply-To: <1575158007.0.0.672423182846.issue38947@roundup.psfhosted.org>
Message-ID: <1603062688.23.0.945968200427.issue38947@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

If I change Foo in your code to:

    @dataclass(init=False)
    class Foo:
    	callback: Callable[[int], int] = lambda x: x**2

Then the same TypeError exception is raised for Foo. 

If I then change it back (remove the init=False so that it picks up the default value of True), and then change init=True in field:

@dataclass
class Bar:
    callback: Callable[[int], int] = field(init=True, default=lambda x: x**2)

Then I get the expected output of 
4
4

What do you consider to be an inconsistency here?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38947>
_______________________________________

From report at bugs.python.org  Sun Oct 18 19:48:06 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 18 Oct 2020 23:48:06 +0000
Subject: [issue38947] dataclass defaults behave inconsistently for
 init=True/init=False when default is a descriptor
In-Reply-To: <1575158007.0.0.672423182846.issue38947@roundup.psfhosted.org>
Message-ID: <1603064886.16.0.126088900536.issue38947@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I think you may have meant this issue (which is not related to field()):

from dataclasses import dataclass
from typing import Callable

@dataclass(init=True)
class Foo:
    callback: Callable[[int], int] = lambda x: x**2
     
@dataclass(init=False)
class Bar:
    callback: Callable[[int], int] = lambda x: x**2

print('Foo().callback:', Foo().callback)
print('Foo().callback(2):', Foo().callback(2))

print('Bar().callback:', Bar().callback)
print('Bar().callback(3):', Bar().callback(3))

Output:
Foo().callback: <function Foo.<lambda> at 0x019592F8>
Foo().callback(2): 4
Bar().callback: <bound method Bar.<lambda> of Bar(callback=<bound method Bar.<lambda> of ...>)>
Traceback (most recent call last):
  File "C:\Users\User\src\cpython\x.py", line 17, in <module>
    print('Bar().callback(3):', Bar().callback(3))
TypeError: Bar.<lambda>() takes 1 positional argument but 2 were given

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38947>
_______________________________________

From report at bugs.python.org  Sun Oct 18 21:14:32 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 19 Oct 2020 01:14:32 +0000
Subject: [issue40484] Document existing compiler flags under ast
In-Reply-To: <1588514973.24.0.132527747949.issue40484@roundup.psfhosted.org>
Message-ID: <1603070072.3.0.951760648261.issue40484@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 155938907c2b3df71608ddeaa0a43d2ec1f2c699 by Batuhan Taskaya in branch 'master':
bpo-40484: Document compiler flags under AST module (GH-19885)
https://github.com/python/cpython/commit/155938907c2b3df71608ddeaa0a43d2ec1f2c699


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40484>
_______________________________________

From report at bugs.python.org  Sun Oct 18 21:14:42 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 01:14:42 +0000
Subject: [issue40484] Document existing compiler flags under ast
In-Reply-To: <1588514973.24.0.132527747949.issue40484@roundup.psfhosted.org>
Message-ID: <1603070082.83.0.153127997015.issue40484@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21723
pull_request: https://github.com/python/cpython/pull/22758

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40484>
_______________________________________

From report at bugs.python.org  Sun Oct 18 21:24:36 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Mon, 19 Oct 2020 01:24:36 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603070676.89.0.930095679528.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

Below is one of the tests that got run when I happened to import something, and I thought it was a good illustration of the Boyer-Moore bad character shift table.

It's worth noting in particular that the table is the dominant force for speed in some common cases, with the two-way stuff only ever being checked once in this example. The shift table can be defeated with pathological strings, and that's where the two-way stuff begins to shine.

Checking " 32 bit (ARM)" in "3.10.0a1+ (heads/two-way-dirty:cf4e398e94, Oct 18 2020, 20:09:21) [MSC v.1927 32 bit (Intel)]".
========================
Two-way with needle=" 32 bit (ARM)" and haystack="(heads/two-way-dirty:cf4e398e94, Oct 18 2020, 20:09:21) [MSC v.1927 32 bit (Intel)]"
Split " 32 bit (ARM)" into " 32 bit" and " (ARM)".
needle is NOT completely periodic.
Using period 8.
> "(heads/two-way-dirty:cf4e398e94, Oct 18 2020, 20:09:21) [MSC v.1927 32 bit (Intel)]"
> " 32 bit (ARM)"
Last character not found in string.
> "(heads/two-way-dirty:cf4e398e94, Oct 18 2020, 20:09:21) [MSC v.1927 32 bit (Intel)]"
>              " 32 bit (ARM)"
Table says shift by 11.
> "(heads/two-way-dirty:cf4e398e94, Oct 18 2020, 20:09:21) [MSC v.1927 32 bit (Intel)]"
>                         " 32 bit (ARM)" # Made the '3's line up
Table says shift by 5.
> "(heads/two-way-dirty:cf4e398e94, Oct 18 2020, 20:09:21) [MSC v.1927 32 bit (Intel)]"
>                              " 32 bit (ARM)" # Here made the spaces line up
Last character not found in string.
> "(heads/two-way-dirty:cf4e398e94, Oct 18 2020, 20:09:21) [MSC v.1927 32 bit (Intel)]"
>                                           " 32 bit (ARM)" # Made the spaces line up
Checking the right half.
No match.
Jump forward without checking left half.
> "(heads/two-way-dirty:cf4e398e94, Oct 18 2020, 20:09:21) [MSC v.1927 32 bit (Intel)]"
>                                            " 32 bit (ARM)" # Made the spaces line up
Table says shift by 5.
> "(heads/two-way-dirty:cf4e398e94, Oct 18 2020, 20:09:21) [MSC v.1927 32 bit (Intel)]"
>                                                 " 32 bit (ARM)" # Made the spaces line up
Table says shift by 5.
> "(heads/two-way-dirty:cf4e398e94, Oct 18 2020, 20:09:21) [MSC v.1927 32 bit (Intel)]"
>                                                      " 32 bit (ARM)" # Made the spaces line up
Table says shift by 10.
> "(heads/two-way-dirty:cf4e398e94, Oct 18 2020, 20:09:21) [MSC v.1927 32 bit (Intel)]"
>                                                                " 32 bit (ARM)" # Made the spaces line up
Table says shift by 4.
> "(heads/two-way-dirty:cf4e398e94, Oct 18 2020, 20:09:21) [MSC v.1927 32 bit (Intel)]"
>                                                                    " 32 bit (ARM)" # Made the lparens line up
Last character not found in string.
Reached end. Returning -1.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sun Oct 18 21:30:37 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Mon, 19 Oct 2020 01:30:37 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603071037.75.0.474735991537.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

FWIW, one of the "# Made the spaces line up" is actually a "skip ahead by the needle length".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sun Oct 18 22:10:08 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 19 Oct 2020 02:10:08 +0000
Subject: [issue41982] [Python 3.8] Wrong location flagged as syntax error
In-Reply-To: <1602251034.78.0.495592912184.issue41982@roundup.psfhosted.org>
Message-ID: <1603073408.78.0.128997710762.issue41982@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Closing this as the new parser in Python3.9+ handles this correctly

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41982>
_______________________________________

From report at bugs.python.org  Sun Oct 18 22:18:56 2020
From: report at bugs.python.org (Zheng SHAO)
Date: Mon, 19 Oct 2020 02:18:56 +0000
Subject: [issue42077] Some Absolute domain name not work in urllib
Message-ID: <1603073936.71.0.541010072663.issue42077@roundup.psfhosted.org>


New submission from Zheng SHAO <axot at msn.com>:

```
import ssl
import urllib.request

url_string = "https://kubernetes.default.svc.cluster.local./api/"

ctx = ssl._create_unverified_context()

with urllib.request.urlopen(url_string, context=ctx) as f:
    f.read()
```

In running this sample code will got a following handshake error,

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python3.8/urllib/request.py", line 525, in open
    response = self._open(req, data)
  File "/usr/lib/python3.8/urllib/request.py", line 542, in _open
    result = self._call_chain(self.handle_open, protocol, protocol +
  File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.8/urllib/request.py", line 1393, in https_open
    return self.do_open(http.client.HTTPSConnection, req,
  File "/usr/lib/python3.8/urllib/request.py", line 1353, in do_open
    raise URLError(err)
urllib.error.URLError: <urlopen error [SSL: SSLV3_ALERT_UNEXPECTED_MESSAGE] sslv3 alert unexpected message (_ssl.c:1123)>

Instead using absolute domain name, using `https://kubernetes.default.svc.cluster.local/api/` then the issue solved. I also tried other domains like `google.com.`, but in this case the handshake process had no errors.

----------
components: Library (Lib)
messages: 378919
nosy: axot
priority: normal
severity: normal
status: open
title: Some Absolute domain name not work in urllib
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42077>
_______________________________________

From report at bugs.python.org  Sun Oct 18 22:20:07 2020
From: report at bugs.python.org (Zheng SHAO)
Date: Mon, 19 Oct 2020 02:20:07 +0000
Subject: [issue42077] Some absolute domain name not work in urllib
In-Reply-To: <1603073936.71.0.541010072663.issue42077@roundup.psfhosted.org>
Message-ID: <1603074007.32.0.12999899758.issue42077@roundup.psfhosted.org>


Change by Zheng SHAO <axot at msn.com>:


----------
title: Some Absolute domain name not work in urllib -> Some absolute domain name not work in urllib

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42077>
_______________________________________

From report at bugs.python.org  Sun Oct 18 23:43:38 2020
From: report at bugs.python.org (Tim Peters)
Date: Mon, 19 Oct 2020 03:43:38 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603079018.76.0.0483347254274.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Dennis, I think that's expected, right? Two-way on its own can exploit nothing about individual characters - it only preprocesses the needle to break the possibility for quadratic-time behavior due to periods in the needle.

It sounds like you switched the current code's Sunday-ish approach to a more Boyer-Moore-ish approach. That probably hurt, and especially for shorter needles (where Sunday can yield a maximum shift of len(needle)+1, not len(needle) - the "+1" is more significant the smaller len(needle)).

Sunday gave 3 variants of his basic algorithm, and in his tests they were all faster than Boyer-Moore, and more so the shorter the needle.  Just FYI, here's a scanned PDF of his paper:

https://csclub.uwaterloo.ca/~pbarfuss/p132-sunday.pdf

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Mon Oct 19 00:10:31 2020
From: report at bugs.python.org (Ken Jin)
Date: Mon, 19 Oct 2020 04:10:31 +0000
Subject: [issue40814] Update typing module documentation based on PEP 585
In-Reply-To: <1590755313.42.0.558710518983.issue40814@roundup.psfhosted.org>
Message-ID: <1603080631.56.0.149464294889.issue40814@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

The PR should be ready for review now. Thanks for your patience.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40814>
_______________________________________

From report at bugs.python.org  Mon Oct 19 00:55:36 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Mon, 19 Oct 2020 04:55:36 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603083336.89.0.256887911904.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

> Dennis, I think that's expected, right? Two-way on its own can exploit nothing about individual characters - it only preprocesses the needle to break the possibility for quadratic-time behavior due to periods in the needle.

Yes, that's correct.

> It sounds like you switched the current code's Sunday-ish approach to a more Boyer-Moore-ish approach. That probably hurt, and especially for shorter needles (where Sunday can yield a maximum shift of len(needle)+1, not len(needle) - the "+1" is more significant the smaller len(needle)).

I'm definitely open to switching things up, but I'm not totally sure there would be a difference. In Sunday, the pattern is somehow scanned at each step, and then upon finding a mismatch, we look up in the table the first character outside the window. With the PR as written, when looking up in the table the last character of the window, we haven't actually produced a mismatch yet; the 'continue' statements jump ahead *until* the last characters match (mod 128), and then the two-way scanning begins, which determines how the window gets shifted after that. But after this two-way-determined shift, the last character in the new window immediately gets looked up again in the table at the top of the loop, effectively letting the two-way shift immediately be extended to a longer shift. I suppose that the line `j += i - suffix + 1;` (which is very often an increment by 1) could be changed to a table lookup of the character just beyond the window, but I don't quite understand why that would be better than incrementing j and then doing the table lookups at the top of the loop.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Mon Oct 19 01:16:16 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Mon, 19 Oct 2020 05:16:16 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603084576.44.0.223274623521.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

I posted the example thinking that having a concrete walkthrough might be good for discussion, and it looks like it was. ;-)

This makes me curious how a simplified-but-not-as-simplified-as-the-status-quo Sunday algorithm would fare: using the Sunday algorithm, but with a shift lookup modulo 128 rather than a boolean lookup. It might not be provably O(n), but it might be faster for some cases. Although if the common case is already fast enough, maybe we do want a provably-linear algorithm for the big stuff.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Mon Oct 19 01:33:18 2020
From: report at bugs.python.org (Tim Peters)
Date: Mon, 19 Oct 2020 05:33:18 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603085598.85.0.395958635203.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

I confess I _assumed_ all along that you were generalizing the current code's Sunday trick to 7-bit equivalence classes (up from 32 bits total) and 64K possible shift counts (up from just 2 total possibilities: 1 or len(needle)+1). The Sunday trick couldn't care less where or when the mismatch occurs, just that a mismatch occurred somewhere.

In my head I was picturing the paper's code, not the PR.  Whenever it makes a shift, it could compare it to the "Sunday-ish shift", and pick the larger.  That should have no effect on worst case O() behavior - it would always shift at least as much as Crochempre-Perrin when a mismatch was hit.

I can't say how it would relate to details of the PR's spelling, because I'm still trying to fully understand the paper ;-) I don't believe I can usefully review the code before then.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Mon Oct 19 02:02:02 2020
From: report at bugs.python.org (Chetan Palliwal)
Date: Mon, 19 Oct 2020 06:02:02 +0000
Subject: [issue42026] index function return first index for same element if
 repetitive in a list
In-Reply-To: <1602581298.61.0.984431029548.issue42026@roundup.psfhosted.org>
Message-ID: <1603087322.03.0.3525758641.issue42026@roundup.psfhosted.org>


Chetan Palliwal <Chetanjain1313 at gmail.com> added the comment:

can you let it work using the index method then it index() is working fine. I can resolve it by using enumerate and another way.

The issue I raised here for the index() method not for enumerate.

----------
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42026>
_______________________________________

From report at bugs.python.org  Mon Oct 19 02:04:06 2020
From: report at bugs.python.org (Chetan Palliwal)
Date: Mon, 19 Oct 2020 06:04:06 +0000
Subject: [issue42026] index function return first index for same element if
 repetitive in a list
In-Reply-To: <1602581298.61.0.984431029548.issue42026@roundup.psfhosted.org>
Message-ID: <1603087446.25.0.704145152284.issue42026@roundup.psfhosted.org>


Chetan Palliwal <Chetanjain1313 at gmail.com> added the comment:

If the index() is working fine. why my previous attached code sample is returning 0 for each time I try to get the index for element 11 in the list.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42026>
_______________________________________

From report at bugs.python.org  Mon Oct 19 02:06:03 2020
From: report at bugs.python.org (Mark Keller)
Date: Mon, 19 Oct 2020 06:06:03 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603087563.96.0.296458085619.issue42041@roundup.psfhosted.org>


Mark Keller <markooo.keller at gmail.com> added the comment:

Paul explained precisely of what I was going through when I reached out to you with this:

> then the "running executable" is "path/to/venv/scripts/python.exe", and so the path containing the running executable is "path/to/venv/scripts", so a search for "python" will locate "path/to/venv/scripts/python.exe", because that's how Windows path search rules work. The problem is that that exe is a redirector, and the script is *actually* being run by the system Python.

However, after reading through your messages and thinking about this for a few days I think it'd be sufficient to point out sys.executable's existence early on in the subprocess docs and then say something like how python is not reliable. Similarly to what Paul said here: https://bugs.python.org/issue42041#msg378727

I used python in my subprocess call because I thought it would always resolve to the the current interpreter. Clearly I don't work a whole lot with Windows...

Eryk - I really appreciate your explanation and I think that level of detail should be documented. I'd read it because I'm interested, but that is probably too much detail for someone who is trying to get something done quickly.

I think both the quick explanation (and pointing out sys.executable's existence) and the detailed why would have it's place in the docs.
Maybe the details could be documented for educational purposes and not as a guarantee of implementation?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Mon Oct 19 03:03:42 2020
From: report at bugs.python.org (Gisle Vanem)
Date: Mon, 19 Oct 2020 07:03:42 +0000
Subject: [issue42078] _tracemalloc.c and Clang-cl
Message-ID: <1603091022.29.0.567599284376.issue42078@roundup.psfhosted.org>


New submission from Gisle Vanem <gvanem at yahoo.no>:

Related to:
  https://bugs.python.org/issue33351

where I commented above the following. 
When using `clang-cl` to build, I get the following error:
```
Modules/_tracemalloc.c(55,9): error: declaration of anonymous struct must be a definition
typedef struct
        ^
Modules/_tracemalloc.c(55,1): warning: typedef requires a name [-Wmissing-declarations]
typedef struct
^~~~~~~
Modules/_tracemalloc.c(68,9): warning: #pragma pack(pop, ...) failed: stack empty [-Wignored-pragmas]
#pragma pack(pop)
        ^
Modules/_tracemalloc.c(78,5): error: unknown type name 'frame_t'
    frame_t frames[1];
    ^
Modules/_tracemalloc.c(87,103): error: use of undeclared identifier 'frame_t'
static const unsigned long MAX_NFRAME = Py_MIN(UINT16_MAX, ((SIZE_MAX - sizeof(traceback_t)) / sizeof(frame_t) + 1));
                                                                                                      ^
Modules/_tracemalloc.c(87,103): error: use of undeclared identifier 'frame_t'
Modules/_tracemalloc.c(286,15): error: unknown type name 'frame_t'; did you mean 'trace_t'?
        const frame_t *frame1 = &traceback1->frames[i];
              ^~~~~~~
              trace_t
Modules/_tracemalloc.c(100,3): note: 'trace_t' declared here
} trace_t;
  ^
```

An easy fix is to patch it:
```
--- a/_tracemalloc.c 2020-10-18 12:06:55
+++ b/_tracemalloc.c 2020-10-19 09:02:17
@@ -52,11 +52,11 @@

 /* Pack the frame_t structure to reduce the memory footprint on 64-bit
    architectures: 12 bytes instead of 16. */
-typedef struct
 #ifdef __GNUC__
-__attribute__((packed))
+typedef struct __attribute__((packed))
 #elif defined(_MSC_VER)
 #pragma pack(push, 4)
+typedef struct
 #endif
 {
     /* filename cannot be NULL: "<unknown>" is used if the Python frame
```

(I'm amazed it's not done before).

----------
components: Build
messages: 378928
nosy: gvanem
priority: normal
severity: normal
status: open
title: _tracemalloc.c and Clang-cl
type: compile error
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42078>
_______________________________________

From report at bugs.python.org  Mon Oct 19 03:29:45 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 19 Oct 2020 07:29:45 +0000
Subject: [issue42026] index function return first index for same element if
 repetitive in a list
In-Reply-To: <1602581298.61.0.984431029548.issue42026@roundup.psfhosted.org>
Message-ID: <1603092585.59.0.501369556967.issue42026@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> If the index() is working fine. why my previous attached
> code sample is returning 0 for each time I try to get 
> the index for element 11 in the list.

Your code is buggy.  It assumes that list.index() changes its starting point as your for-loop iterates.   However, the documented and correct behavior of list.index() is that unless a *start* argument is provided, the search always starts at position zero and returns the index of the first matching target value:  

    >>> help(list.index)
    Help on method_descriptor:

    index(self, value, start=0, stop=9223372036854775807, /)
        Return first index of value.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42026>
_______________________________________

From report at bugs.python.org  Mon Oct 19 03:33:59 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 19 Oct 2020 07:33:59 +0000
Subject: [issue19270] Document that sched.cancel() doesn't distinguish equal
 events and can break order
In-Reply-To: <1381913252.24.0.629122693277.issue19270@psf.upfronthosting.co.za>
Message-ID: <1603092839.56.0.251984293831.issue19270@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 5368c2b6e23660cbce7e38dc68f859c66ac349ee by Bar Harel in branch 'master':
bpo-19270: Fixed sched.scheduler.cancel to cancel correct event (GH-22729)
https://github.com/python/cpython/commit/5368c2b6e23660cbce7e38dc68f859c66ac349ee


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19270>
_______________________________________

From report at bugs.python.org  Mon Oct 19 04:07:48 2020
From: report at bugs.python.org (twisteroid ambassador)
Date: Mon, 19 Oct 2020 08:07:48 +0000
Subject: [issue39116] StreamReader.readexactly() raises GeneratorExit on
 ProactorEventLoop
In-Reply-To: <1576944276.46.0.229840779815.issue39116@roundup.psfhosted.org>
Message-ID: <1603094868.39.0.345794207802.issue39116@roundup.psfhosted.org>


twisteroid ambassador <twisteroid.ambassador at gmail.com> added the comment:

This problem still exists on Python 3.9 and latest Windows 10.

I tried to catch the GeneratorExit and turn it into a normal Exception, and things only got weirder from here. Often several lines later another await statement would raise another GeneratorExit, such as writer.write() or even asyncio.sleep(). Doesn't matter whether I catch the additional GeneratorExit or not, once code exits this coroutine a RuntimeError('coroutine ignored GeneratorExit') is raised. And it doesn't matter what I do with this RuntimeError, the outermost coroutine's Task always generates an 'asyncio Task was destroyed but it is pending!' error message.

Taking a step back from this specific problem. Does a "casual" user of asyncio need to worry about handling GeneratorExits? Can I assume that I should not see GeneratorExits in user code?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39116>
_______________________________________

From report at bugs.python.org  Mon Oct 19 04:08:18 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 19 Oct 2020 08:08:18 +0000
Subject: [issue13451] sched.py: speedup cancel() method
In-Reply-To: <1321923822.73.0.49972384361.issue13451@psf.upfronthosting.co.za>
Message-ID: <1603094898.89.0.484670456603.issue13451@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +21724
pull_request: https://github.com/python/cpython/pull/22759

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13451>
_______________________________________

From report at bugs.python.org  Mon Oct 19 04:15:17 2020
From: report at bugs.python.org (twisteroid ambassador)
Date: Mon, 19 Oct 2020 08:15:17 +0000
Subject: [issue39116] StreamReader.readexactly() raises GeneratorExit on
 ProactorEventLoop
In-Reply-To: <1576944276.46.0.229840779815.issue39116@roundup.psfhosted.org>
Message-ID: <1603095317.55.0.410751415289.issue39116@roundup.psfhosted.org>


Change by twisteroid ambassador <twisteroid.ambassador at gmail.com>:


----------
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39116>
_______________________________________

From report at bugs.python.org  Mon Oct 19 04:34:01 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 08:34:01 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603096441.89.0.696681882352.issue42051@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I'm working on a PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Mon Oct 19 04:47:32 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 19 Oct 2020 08:47:32 +0000
Subject: [issue11698] Improve repr for structseq objects to show named,
 but unindexed fields
In-Reply-To: <1301264097.04.0.982421975108.issue11698@psf.upfronthosting.co.za>
Message-ID: <1603097252.93.0.637610286666.issue11698@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Other problem is that the repr looks like an evaluable expression, but evaluating it will always produce error.

>>> st = os.stat('/dev/null')
>>> st
os.stat_result(st_mode=8630, st_ino=6, st_dev=6, st_nlink=1, st_uid=0, st_gid=0, st_size=0, st_atime=1602523313, st_mtime=1602523313, st_ctime=1602523313)
>>> os.stat_result(st_mode=8630, st_ino=6, st_dev=6, st_nlink=1, st_uid=0, st_gid=0, st_size=0, st_atime=1602523313, st_mtime=1602523313, st_ctime=1602523313)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: structseq() takes at most 2 keyword arguments (10 given)

os.stat_result() accepts only two arguments: a tuple for indexable elements and a dict for non-indexable elements.

>>> os.stat_result((8630, 6, 6, 1, 0, 0, 0, 1602523313, 1602523313, 1602523313), {'st_atime': 1602523313.282834, 'st_mtime': 1602523313.282834, 'st_ctime': 1602523313.282834, 'st_atime_ns': 1602523313282834115, 'st_mtime_ns': 1602523313282834115, 'st_ctime_ns': 1602523313282834115, 'st_blksize': 4096, 'st_blocks': 0, 'st_rdev': 259})
os.stat_result(st_mode=8630, st_ino=6, st_dev=6, st_nlink=1, st_uid=0, st_gid=0, st_size=0, st_atime=1602523313, st_mtime=1602523313, st_ctime=1602523313)

But such form looks not very readable, because it lacks names for indexable elements.

To solve this we can use an angular form in the repr:

<os.stat_result ...>

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11698>
_______________________________________

From report at bugs.python.org  Mon Oct 19 04:55:37 2020
From: report at bugs.python.org (Jan Schatz)
Date: Mon, 19 Oct 2020 08:55:37 +0000
Subject: [issue42079] Why does tarfile.next swallow InvalidHeaderError
Message-ID: <1603097737.92.0.915813500773.issue42079@roundup.psfhosted.org>


New submission from Jan Schatz <jan.schatz at hms-networks.com>:

I have a tar gz archive that fails to be extracted via tarfile.extractall(). By adding some debug code I found that at some point InvalidHeaderError is raised inside tarfile.next(). But the function just swallows the exception, because the offset isn't 0 (see https://github.com/python/cpython/blob/5368c2b6e23660cbce7e38dc68f859c66ac349ee/Lib/tarfile.py#L2334). Why does the function behave like this? I would expect an except rather than silently stopping extraction if the archive is damaged.

----------
components: Library (Lib)
messages: 378934
nosy: jan.schatz
priority: normal
severity: normal
status: open
title: Why does tarfile.next swallow InvalidHeaderError
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42079>
_______________________________________

From report at bugs.python.org  Mon Oct 19 05:22:42 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 09:22:42 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603099362.45.0.749667406568.issue42051@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
keywords: +patch
pull_requests: +21725
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22760

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Mon Oct 19 05:26:00 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 09:26:00 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603099560.9.0.192593902575.issue42051@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

The PR is fairly simple: Just reject files with entity declarations as invalid files. Adding an option to accept entity declarations should not be necessary as Apple tools won't accept these declarations.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Mon Oct 19 06:09:29 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 10:09:29 +0000
Subject: [issue42056] Configure on Apple ARM: "Unexpected output of 'arch' on
 OSX"
In-Reply-To: <1602888437.02.0.217887780449.issue42056@roundup.psfhosted.org>
Message-ID: <1603102169.14.0.315093663112.issue42056@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I'm closing this issue because it is a duplicate of #41100, the patches needed to build on Apple Silicon are more involved than just a configure check.

----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> Build failure on macOS 11 (beta)
type:  -> compile error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42056>
_______________________________________

From report at bugs.python.org  Mon Oct 19 06:17:30 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 10:17:30 +0000
Subject: [issue41471] After installing python 3.x on Mac pip doesn't work at
 all
In-Reply-To: <1596537267.29.0.654374340764.issue41471@roundup.psfhosted.org>
Message-ID: <1603102650.49.0.270593061684.issue41471@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

The error is due to invalid proxy settings on the system.

I can reproduce the error by enabling a HTTP proxy in system settings, while adding "172.19.0.0/40" to the proxy exclude list in the HTTP proxy settings.

----------
stage:  -> needs patch
versions: +Python 3.10, Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41471>
_______________________________________

From report at bugs.python.org  Mon Oct 19 06:31:26 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 10:31:26 +0000
Subject: [issue41471] After installing python 3.x on Mac pip doesn't work at
 all
In-Reply-To: <1596537267.29.0.654374340764.issue41471@roundup.psfhosted.org>
Message-ID: <1603103486.57.0.0659431870801.issue41471@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
keywords: +patch
pull_requests: +21726
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22762

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41471>
_______________________________________

From report at bugs.python.org  Mon Oct 19 06:33:27 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 10:33:27 +0000
Subject: [issue41471] After installing python 3.x on Mac pip doesn't work at
 all
In-Reply-To: <1596537267.29.0.654374340764.issue41471@roundup.psfhosted.org>
Message-ID: <1603103607.15.0.129816337718.issue41471@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I've tested the same settings with Safari, and that browser ignores excludes with an invalid prefix length.

I've created a PR that does the same for urllib.request.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41471>
_______________________________________

From report at bugs.python.org  Mon Oct 19 06:52:05 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 10:52:05 +0000
Subject: [issue41680] Turtles in Python 3.8.5 crashes OSX 10.14.6
In-Reply-To: <1598898277.27.0.605010219391.issue41680@roundup.psfhosted.org>
Message-ID: <1603104725.99.0.653954174261.issue41680@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Also: What's meant by "crash OSX 10.14.6"?

Could this be a duplicate of #37833?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41680>
_______________________________________

From report at bugs.python.org  Mon Oct 19 07:10:38 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 19 Oct 2020 11:10:38 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603105838.15.0.43387200205.issue42041@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> I'd read it because I'm interested, but that is probably too much detail
> for someone who is trying to get something done quickly.

I did say that I don't know how much should be documented. I tend to dump a lot of information in issues so that people can make informed decisions. Personally I would keep it limited. I do want more help, and generic help, in the warning, but I don't want to spam the already exhausting and MEGO-prone (i.e. my eyes glaze over) subprocess docs.

With regard to the use of a platform search, note that subprocess actually implements its own search in POSIX. (subprocess supports posix_spawn -- but not posix_spawnp -- on macOS and on Linux with glibc 2.24+, but it's limited to a narrow subset of Popen arguments, excluding `cwd`, and it requires a qualified `executable` path.) A name containing a slash is resolved against `cwd` or the process current working directory. An unqualified name is searched for in the os.get_exec_path(env) search path, based on PATH from `env` or os.environ, else os.defpath. This allows `env` to override the POSIX search path, just as `cwd` in POSIX overrides the current working directory when resolving a qualified args[0] path and `executable`. This is sort of documented by saying that POSIX Popen() works "os.execvp()-like", but to be more correct it should say "os.execvpe()-like". The final "e" in "execvpe" is fundamentally important since PATH can be sourced from `env`.

In Windows, the search path and the working directory used for resolving paths can't be overridden without passing shell=True. subprocess incorrectly documents this by claiming in general that "the function looks for `executable` (or for the first item in `args`) relative to `cwd` if the executable path is a relative path". That wording isn't even correct for POSIX, for which the working directory only applies to args[0] if it contains a slash.

In light of this, how about inserting the following warning:

      Resolving the path of *executable* or the first item of *args* is
      platform dependent even with ``shell=False``. For POSIX, see
      :meth:`os.execvpe`, and note that when resolving or searching for the
      executable path, *cwd* overrides the current working directory and *env*
      can override the ``PATH`` environment variable. For Windows, see the
      documentation of the ``lpApplicationName`` and ``lpCommandLine``
      parameters of WinAPI ``CreateProcess``, and note that when resolving or
      searching for the executable path with ``shell=False``, *cwd* does not
      override the current working directory and *env* cannot override the
      ``PATH`` environment variable. Cross-platform usage can improve
      reliability by using a fully-qualified path for the executable, such as
      from :meth:`shutil.which`.

      On all platforms, using :data:`sys.executable` as the path of the
      executable is the recommended and reliable way to run the current Python
      interpreter.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Mon Oct 19 07:33:18 2020
From: report at bugs.python.org (Paul Moore)
Date: Mon, 19 Oct 2020 11:33:18 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603107198.56.0.453945903622.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

My biggest concern with the suggested wording (which in broad terms looks OK to me) is that it reintroduces the issue with the redirector.

By specifically saying that the behaviour in `CreateProcess` applies, we lead the user to the statement that the search path includes "the directory containing the running application", which the user will interpret as the directory of `sys.executable`. So we need to qualify this somewhere by clarifying that "the running application" may not actually be `sys.executable` (without saying what it actually *is*, as that would mean documentin what the redirector does, which Steve wants to avoid).

I don't have a good answer here - we have two conflicting preferences (document the search behaviour but don't document the way the redirector works) and something needs to give. (To be fair, there's a third conflicting priority here, which is me wanting everything to be explicit and clear. I'm willing to give that up if you and Steve can agree on something, though).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Mon Oct 19 07:35:54 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 11:35:54 +0000
Subject: [issue27126] Apple-supplied libsqlite3 on OS X is not fork safe;
 can cause crashes
In-Reply-To: <1464217505.87.0.0701340905112.issue27126@psf.upfronthosting.co.za>
Message-ID: <1603107354.69.0.472534659769.issue27126@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

The installers on Python.org no longer use the system version of libsqlite, sidestepping that issue. 

That doesn't fix the issue with _scproxy, but that's something we cannot easily fix in Python itself.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27126>
_______________________________________

From report at bugs.python.org  Mon Oct 19 07:49:19 2020
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 19 Oct 2020 11:49:19 +0000
Subject: [issue42077] Some absolute domain name not work in urllib
In-Reply-To: <1603073936.71.0.541010072663.issue42077@roundup.psfhosted.org>
Message-ID: <1603108159.43.0.327993819959.issue42077@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

SSLV3_ALERT_UNEXPECTED_MESSAGE means that the server is responding with incorrect TLS data. That's usually the case when the port on the server is HTTP instead of HTTPS. It's also possible that the server does not like the SNI header (Server Name Indication) and closes the connection incorrectly.

By the way unverified context is insecure and should not be used in production. I assume that you are using an unverified context because hostnames with a trailing dot are not supported by OpenSSL, see #31997 and #40306.

----------
nosy: +christian.heimes
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42077>
_______________________________________

From report at bugs.python.org  Mon Oct 19 07:49:25 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 11:49:25 +0000
Subject: [issue41754] Webbrowser Module Cannot Find xdg-settings on OSX
In-Reply-To: <1599718531.77.0.777287973454.issue41754@roundup.psfhosted.org>
Message-ID: <1603108165.58.0.316913458841.issue41754@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

It is far from clear what's going on here. In particular, it not clear to my why check_output(['xdg-settings', ...]) would ever raise NotADirectoryError.

- What packages do you have installed through homebrew? 
- Is there an xdg-settings command installed on your system?
- Are DISPLAY or WAYLAND_DISPLAY in your shell environment?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41754>
_______________________________________

From report at bugs.python.org  Mon Oct 19 07:51:42 2020
From: report at bugs.python.org (Erik Bray)
Date: Mon, 19 Oct 2020 11:51:42 +0000
Subject: [issue31878] Cygwin: _socket module does not compile due to missing
 ioctl declaration
In-Reply-To: <1509032541.6.0.213398074469.issue31878@psf.upfronthosting.co.za>
Message-ID: <1603108302.15.0.0590797598778.issue31878@roundup.psfhosted.org>


Change by Erik Bray <erik.m.bray at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31878>
_______________________________________

From report at bugs.python.org  Mon Oct 19 07:54:00 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 11:54:00 +0000
Subject: [issue41491] plistlib can't load macOS BigSur system LaunchAgent
In-Reply-To: <1596665779.04.0.552451730401.issue41491@roundup.psfhosted.org>
Message-ID: <1603108440.29.0.138553531411.issue41491@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

This file is still present on the latest version of macOS 11 beta on ARM64, with this integer value.  Furthermore plutil will happily read this file.

I'm in favour of changing plistlib to parse files like this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41491>
_______________________________________

From report at bugs.python.org  Mon Oct 19 08:04:34 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 12:04:34 +0000
Subject: [issue41491] plistlib can't load macOS BigSur system LaunchAgent
In-Reply-To: <1596665779.04.0.552451730401.issue41491@roundup.psfhosted.org>
Message-ID: <1603109074.73.0.446586397782.issue41491@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Given this plist:

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>
        <key>hex</key>
        <array>
                <integer>0x0100000c</integer>
        </array>
        <key>oct</key>
        <array>
                <integer>0123</integer>
        </array>
</dict>
</plist>


``plutil -convert json`` prints:

{"hex":[16777228],"oct":[123]}

That is, hexadecimal values are detected and parsed, but "0" as a prefix for octal values (as in C) is not.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41491>
_______________________________________

From report at bugs.python.org  Mon Oct 19 08:06:17 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 12:06:17 +0000
Subject: [issue41491] plistlib can't load macOS BigSur system LaunchAgent
In-Reply-To: <1596665779.04.0.552451730401.issue41491@roundup.psfhosted.org>
Message-ID: <1603109177.99.0.0621281542847.issue41491@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
keywords: +patch
pull_requests: +21727
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22764

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41491>
_______________________________________

From report at bugs.python.org  Mon Oct 19 08:28:46 2020
From: report at bugs.python.org (Seth Sims)
Date: Mon, 19 Oct 2020 12:28:46 +0000
Subject: [issue41270] NamedTemporaryFile is not its own iterator.
In-Reply-To: <1594389522.96.0.51886326593.issue41270@roundup.psfhosted.org>
Message-ID: <1603110526.01.0.181332226246.issue41270@roundup.psfhosted.org>


Change by Seth Sims <seth.sims at gmail.com>:


----------
pull_requests: +21728
pull_request: https://github.com/python/cpython/pull/22766

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41270>
_______________________________________

From report at bugs.python.org  Mon Oct 19 08:29:59 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 12:29:59 +0000
Subject: [issue31818] [macOS] _scproxy.get_proxies() crash -- get_proxies() is
 not fork-safe?
In-Reply-To: <1508409035.64.0.213398074469.issue31818@psf.upfronthosting.co.za>
Message-ID: <1603110599.7.0.924406200849.issue31818@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I'm in favour of closing this issue.

If anything needs to be done its adding a warning to the documentation of os.fork() to the effect that doing substantial work in the child can be problematic on macOS. Maybe something like:

.. warning:: On macOS the child proces might crash if the parent
   proces uses higher level system APIs before calling this function. This
   includes, but is not limited to, using :mod:`urllib.request` in the parent
   process.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31818>
_______________________________________

From report at bugs.python.org  Mon Oct 19 08:40:07 2020
From: report at bugs.python.org (4-launchpad-kalvdans-no-ip-org)
Date: Mon, 19 Oct 2020 12:40:07 +0000
Subject: [issue29688] Add support for Path.absolute()
In-Reply-To: <1488389848.79.0.700814097868.issue29688@psf.upfronthosting.co.za>
Message-ID: <1603111207.09.0.115347216841.issue29688@roundup.psfhosted.org>


Change by 4-launchpad-kalvdans-no-ip-org <launchpad at kalvdans.no-ip.org>:


----------
nosy: +4-launchpad-kalvdans-no-ip-org

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29688>
_______________________________________

From report at bugs.python.org  Mon Oct 19 09:02:40 2020
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 19 Oct 2020 13:02:40 +0000
Subject: [issue42057] pytest case which catch  exceptions become segfault
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1603112560.03.0.426881971051.issue42057@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

The test example has no reference to pytest in it.

How are you running it?
Can you produce a segmentation fault when run without pytest?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Mon Oct 19 09:08:51 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 13:08:51 +0000
Subject: [issue33387] Simplify bytecodes for try-finally,
 try-except and with blocks.
In-Reply-To: <1525026522.22.0.682650639539.issue33387@psf.upfronthosting.co.za>
Message-ID: <1603112931.23.0.922769793101.issue33387@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 7.0 -> 8.0
pull_requests: +21729
pull_request: https://github.com/python/cpython/pull/22765

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33387>
_______________________________________

From report at bugs.python.org  Mon Oct 19 09:17:34 2020
From: report at bugs.python.org (Julien Palard)
Date: Mon, 19 Oct 2020 13:17:34 +0000
Subject: [issue41812] Broken link on documentation header
In-Reply-To: <1600511961.8.0.4482824701.issue41812@roundup.psfhosted.org>
Message-ID: <1603113454.47.0.465993075716.issue41812@roundup.psfhosted.org>


Julien Palard <julien+python at palard.fr> added the comment:

Thanks for the heads up cocoatomo!!

Fixed: https://github.com/python/docsbuild-scripts/commit/c23b401425a47b9c8eaa9626701ba6b9b50531f7

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41812>
_______________________________________

From report at bugs.python.org  Mon Oct 19 10:03:41 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 19 Oct 2020 14:03:41 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603116221.45.0.672061075784.issue42041@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> My biggest concern with the suggested wording ... is that it 
> reintroduces the issue with the redirector.

I thought I addressed that in second paragraph by recommending sys.executable. It could be emphasized that running "python[x][.y]" is unreliable, without going into detailed examples of where it's unreliable on various platforms (i.e. avoid going into detail about issues with naming of binaries, embedding, the search path, redirectors, etc). A separate cross-platform note in venv could advise scripts to use sys.executable, with a link to the subprocess.Popen docs and a reference to the note about the platform-dependent search behavior and unreliability of running "python[x][.y]".

If the redirector issue is mentioned anywhere, I think it should be in the venv docs. It can include a note about the Windows implementation detail to use a redirector for non-symlink virtual environments. Of concern to me here is that the process handle and PID returned by CreateProcess is for the redirector. One can't use the returned process handle or PID with DuplicateHandle or WSADuplicateSocket (i.e. socket.socket.share) to share handles and sockets with a script that's running as a child process. It might seem to still be working, purely by accident, because the parent script is executing the base "python" instead of the redirector, but in that case the child script isn't using the virtual environment. There isn't an official way to support running sys._base_executable with the __PYVENV_LAUNCHER__ environment variable, as multiprocessing implements internally. Maybe the workaround should be incorporated implicitly in subprocess.Popen if `executable`, `args`, or args[0] is equal to sys.executable and sys._base_executable is different. If the latter is implemented, and using sys.executable is strongly advised, it strengthens the case to avoid discussing the redirector entirely.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Mon Oct 19 10:53:01 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Mon, 19 Oct 2020 14:53:01 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603119181.89.0.282100805704.issue41192@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:


New changeset ebc8c3828779374b9be4fae5c8ffc0059d36ac8c by Saiyang Gou in branch 'master':
bpo-41192: Fix some broken anchors for audit event entries (#21310)
https://github.com/python/cpython/commit/ebc8c3828779374b9be4fae5c8ffc0059d36ac8c


----------
nosy: +akuchling

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Mon Oct 19 10:53:04 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 14:53:04 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603119184.6.0.059166052974.issue41192@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 5.0 -> 6.0
pull_requests: +21730
pull_request: https://github.com/python/cpython/pull/22767

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Mon Oct 19 11:05:32 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 19 Oct 2020 15:05:32 +0000
Subject: [issue42057] pytest case which catch  exceptions become segfault
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1603119932.42.0.367208267189.issue42057@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I confirmed the issue. The simple version of the reproducer is:

```
def callee():
    raise Exception

def caller():
    try:
        callee()
    except Exception or Exception:
        pass

caller()
```

I can see assertion failure consisntently, when I use python --with-pydebug.

It seems peephole bug. Without peephole:

```
  7     >>   12 DUP_TOP
             14 LOAD_GLOBAL              1 (Exception)
             16 JUMP_IF_TRUE_OR_POP     20
             18 LOAD_GLOBAL              1 (Exception)
        >>   20 JUMP_IF_NOT_EXC_MATCH    32
             22 POP_TOP
             24 POP_TOP
             26 POP_TOP

  8          28 POP_EXCEPT
             30 JUMP_FORWARD             2 (to 34)
        >>   32 RERAISE
        >>   34 LOAD_CONST               0 (None)
             36 RETURN_VALUE
```

And with peephole:

```
  7     >>   12 DUP_TOP
             14 LOAD_GLOBAL              1 (Exception)
             16 POP_JUMP_IF_TRUE        22
             18 LOAD_GLOBAL              1 (Exception)
             20 JUMP_IF_NOT_EXC_MATCH    32
        >>   22 POP_TOP
             24 POP_TOP
             26 POP_TOP

  8          28 POP_EXCEPT
             30 JUMP_FORWARD             2 (to 34)
        >>   32 RERAISE
        >>   34 LOAD_CONST               0 (None)
             36 RETURN_VALUE
```

JUMP_IF_TRUE_OR_POP is converted into POP_JUMP_IF_TRUE. Exception is popped although JUMP_IF_NOT_EXC_MATCH needs it.

----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Mon Oct 19 11:17:22 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 19 Oct 2020 15:17:22 +0000
Subject: [issue42057] pytest case which catch  exceptions become segfault
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1603120642.02.0.0779052530546.issue42057@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I confirmed fix42057.patch fix the assertion failure. But I don't know where and how to write test yet.

----------
keywords: +patch
Added file: https://bugs.python.org/file49527/fix42057.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Mon Oct 19 11:29:26 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 15:29:26 +0000
Subject: [issue20585] urllib2 unrelease KQUEUE on Mac OSX 10.9+
In-Reply-To: <1392057963.63.0.832878598113.issue20585@psf.upfronthosting.co.za>
Message-ID: <1603121366.76.0.00831223466904.issue20585@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I cannot reproduce this issue on macOS 10.15 (with python 3.9).

I intent to close this issue because (a) this is a platform problem and (b) seems no longer to be a problem with the latest macOS and Python versions.

----------
resolution:  -> out of date
stage: needs patch -> resolved
status: open -> pending

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20585>
_______________________________________

From report at bugs.python.org  Mon Oct 19 11:37:55 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 15:37:55 +0000
Subject: [issue26376] Tkinter root window won't close if packed.
In-Reply-To: <1455721245.86.0.235285513904.issue26376@psf.upfronthosting.co.za>
Message-ID: <1603121875.99.0.00240950283937.issue26376@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I cannot reproduce this issue with Python 3.9 (Python.org installer). 

Both with "Run Module" and in the interactive shell (both in IDLE) the window will close properly.  In both cases the window it too small to show the minimise and maximise buttons (as in the original screenshots), but that's not something we can fix on the Python side. 

I propose closing this issue as "out of date".

----------
resolution:  -> out of date
status: open -> pending

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26376>
_______________________________________

From report at bugs.python.org  Mon Oct 19 11:39:29 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Mon, 19 Oct 2020 15:39:29 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603121969.11.0.0854488454569.issue41192@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:


New changeset 2ee6ef98b4cf94f4c21cc4301d4e226b70809c7e by Miss Skeleton (bot) in branch '3.9':
bpo-41192: Fix some broken anchors for audit event entries (GH-21310) (GH-22767)
https://github.com/python/cpython/commit/2ee6ef98b4cf94f4c21cc4301d4e226b70809c7e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Mon Oct 19 11:43:47 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Mon, 19 Oct 2020 15:43:47 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603122227.37.0.655627167036.issue41192@roundup.psfhosted.org>


Change by A.M. Kuchling <amk at amk.ca>:


----------
pull_requests: +21731
pull_request: https://github.com/python/cpython/pull/22768

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Mon Oct 19 11:55:30 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 15:55:30 +0000
Subject: [issue39107] Upgrade tcl/tk to 8.6.10 (Windows and maxOS)
In-Reply-To: <1576838540.23.0.689551930127.issue39107@roundup.psfhosted.org>
Message-ID: <1603122930.1.0.533287161074.issue39107@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 985f0ab3ad5e8e9a8d7fc53026c38390b1f2b466 by Steve Dower in branch 'master':
bpo-39107: Updated Tcl and Tk to 8.6.10 in Windows installer (GH-22405)
https://github.com/python/cpython/commit/985f0ab3ad5e8e9a8d7fc53026c38390b1f2b466


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39107>
_______________________________________

From report at bugs.python.org  Mon Oct 19 12:01:41 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 16:01:41 +0000
Subject: [issue41017] warning: 'Tk_Init' is deprecated: first deprecated
Message-ID: <1603123301.2.0.669100672194.issue41017@roundup.psfhosted.org>


New submission from Ronald Oussoren <ronaldoussoren at mac.com>:

The log shows a number of deprecation warnings in the Tcl/Tk headers included in the macOS SDK. That's just because Apple doesn't want you to use the system version of Tcl/Tk anymore.

The APIs themselves are fine if you use a non-system version of Tcl/Tk.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type:  -> compile error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41017>
_______________________________________

From report at bugs.python.org  Mon Oct 19 12:04:08 2020
From: report at bugs.python.org (John Ehresman)
Date: Mon, 19 Oct 2020 16:04:08 +0000
Subject: [issue42080] Disutils on windows debug build fails without -j1
Message-ID: <1603123448.09.0.581591280585.issue42080@roundup.psfhosted.org>


New submission from John Ehresman <jpe at wingware.com>:

Compiling pillow for a debug build fails without -j1 because distutils parallelizes the build, but there are problems with locking the .pdb file during when compiling the C files.  An example of the error message from a cl.exe command is:

fatal error C1041: cannot open program database 'C:\src\tmp\pillow-test\Pillow-7.2.0\vc140.pdb'; if multiple CL.EXE write to the same .PDB file, please use /FS

Building works with setup.py build_ext --disable-jpeg --disable-tiff --disable-zlib --debug build -j1

My guess is the fix is not to parallelize by default in a debug build; a /FS arg to cl.exe could be used, but that doesn't seem to be recommended.

I realize this might be considered a pillow bug, but my guess is that it affects other packages as well

----------
components: Distutils, Windows
messages: 378959
nosy: dstufft, eric.araujo, jpe, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Disutils on windows debug build fails without -j1
type: compile error
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42080>
_______________________________________

From report at bugs.python.org  Mon Oct 19 12:56:46 2020
From: report at bugs.python.org (Antoine Pitrou)
Date: Mon, 19 Oct 2020 16:56:46 +0000
Subject: [issue42081] Consider fast_double_parser for faster str->double
Message-ID: <1603126606.04.0.157687249306.issue42081@roundup.psfhosted.org>


New submission from Antoine Pitrou <pitrou at free.fr>:

This is more of a "could be nice" entry if there are any interested core developers.

A new algorithm and library was recently published for faster parsing of double numbers.  It claims rigorous accuracy and the performance is impressive.  The implementation is in C++ but it's really decorated C.  It also seems simple enough that it can be reimplemented independently.

https://github.com/lemire/fast_double_parser/

----------
components: Interpreter Core
messages: 378960
nosy: mark.dickinson, pitrou, tim.peters
priority: low
severity: normal
status: open
title: Consider fast_double_parser for faster str->double
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42081>
_______________________________________

From report at bugs.python.org  Mon Oct 19 12:57:13 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 16:57:13 +0000
Subject: [issue42080] Disutils on windows debug build fails without -j1
In-Reply-To: <1603123448.09.0.581591280585.issue42080@roundup.psfhosted.org>
Message-ID: <1603126633.6.0.0750045549925.issue42080@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

If you're building through setuptools, then it's a setuptools bug (they own distutils going forward). https://github.com/pypa/setuptools

If you're not, please try with setuptools in the picture. It shouldn't require any more than just importing its "setup()" function instead of distutils's.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42080>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:04:31 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Mon, 19 Oct 2020 17:04:31 +0000
Subject: [issue40671] Convert _hashlib to PEP 489 multiphase initialization
In-Reply-To: <1589807240.02.0.725265164424.issue40671@roundup.psfhosted.org>
Message-ID: <1603127071.43.0.0521097408923.issue40671@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40671>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:06:43 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 19 Oct 2020 17:06:43 +0000
Subject: [issue41746] Add optional type information to asdl_seq objects
In-Reply-To: <1599597077.35.0.913235954629.issue41746@roundup.psfhosted.org>
Message-ID: <1603127203.77.0.564172779461.issue41746@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

Pablo, can this be closed now that PR22223 is merged?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41746>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:08:46 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 19 Oct 2020 17:08:46 +0000
Subject: [issue41667] The python PEG generator incorrectly handles empty
 sequences in gather rules
In-Reply-To: <1598818116.29.0.0798714458289.issue41667@roundup.psfhosted.org>
Message-ID: <1603127326.82.0.614070463921.issue41667@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

This c

----------
nosy: +lys.nikolaou
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41667>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:09:38 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 19 Oct 2020 17:09:38 +0000
Subject: [issue41667] The python PEG generator incorrectly handles empty
 sequences in gather rules
In-Reply-To: <1598818116.29.0.0798714458289.issue41667@roundup.psfhosted.org>
Message-ID: <1603127378.44.0.6655955774.issue41667@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
Removed message: https://bugs.python.org/msg378963

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41667>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:19:39 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 19 Oct 2020 17:19:39 +0000
Subject: [issue42081] Consider fast_double_parser for faster str->double
In-Reply-To: <1603126606.04.0.157687249306.issue42081@roundup.psfhosted.org>
Message-ID: <1603127979.17.0.49365008675.issue42081@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

This was proposed in issue 41310.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42081>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:20:08 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 17:20:08 +0000
Subject: [issue31818] [macOS] _scproxy.get_proxies() crash -- get_proxies() is
 not fork-safe?
In-Reply-To: <1508409035.64.0.213398074469.issue31818@psf.upfronthosting.co.za>
Message-ID: <1603128008.52.0.674059881676.issue31818@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

I agree that we should close this issue, possibly with a documentation fix.  I wrote a blog posting about my investigations:

https://wefearchange.org/2018/11/forkmacos.rst.html

I don't think there's really much Python itself can do, and developers will just have to know that fork-without-exec is pretty much unsafe on macOS.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31818>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:20:21 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 19 Oct 2020 17:20:21 +0000
Subject: [issue40335] [PEP 617 new parser] Regression in multiline SyntaxError
 offsets
In-Reply-To: <1587332455.2.0.964330224308.issue40335@roundup.psfhosted.org>
Message-ID: <1603128021.62.0.251907724927.issue40335@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
resolution:  -> fixed
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40335>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:20:04 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 19 Oct 2020 17:20:04 +0000
Subject: [issue40335] [PEP 617 new parser] Regression in multiline SyntaxError
 offsets
In-Reply-To: <1587332455.2.0.964330224308.issue40335@roundup.psfhosted.org>
Message-ID: <1603128004.53.0.91918733451.issue40335@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

I'm closing this since this specific issue seems to be fixed both in master and in 3.9. Anthony, feel free to re-open it, in case I've missed something.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40335>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:20:32 2020
From: report at bugs.python.org (Antoine Pitrou)
Date: Mon, 19 Oct 2020 17:20:32 +0000
Subject: [issue42081] Consider fast_double_parser for faster str->double
In-Reply-To: <1603126606.04.0.157687249306.issue42081@roundup.psfhosted.org>
Message-ID: <1603128032.93.0.678649503884.issue42081@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

Oh, thank you.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42081>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:20:42 2020
From: report at bugs.python.org (Antoine Pitrou)
Date: Mon, 19 Oct 2020 17:20:42 +0000
Subject: [issue42081] Consider fast_double_parser for faster str->double
In-Reply-To: <1603126606.04.0.157687249306.issue42081@roundup.psfhosted.org>
Message-ID: <1603128042.97.0.281254920208.issue42081@roundup.psfhosted.org>


Change by Antoine Pitrou <pitrou at free.fr>:


----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> micro-optimization: increase our float parsing speed by Nx

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42081>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:23:30 2020
From: report at bugs.python.org (Ned Deily)
Date: Mon, 19 Oct 2020 17:23:30 +0000
Subject: [issue31818] [macOS] _scproxy.get_proxies() crash -- get_proxies() is
 not fork-safe?
In-Reply-To: <1508409035.64.0.213398074469.issue31818@psf.upfronthosting.co.za>
Message-ID: <1603128210.22.0.149735300996.issue31818@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

I wish there was a better solution but, as long as we want to continue to integrate with the system-provided proxy configuration, I guess we're kind of stuck.  I'll try to expand Ronald's wording into a doc PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31818>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:27:11 2020
From: report at bugs.python.org (Antoine Pitrou)
Date: Mon, 19 Oct 2020 17:27:11 +0000
Subject: [issue41310] micro-optimization: increase our float parsing speed by
 Nx
In-Reply-To: <1594851715.46.0.792624118962.issue41310@roundup.psfhosted.org>
Message-ID: <1603128431.06.0.356324932544.issue41310@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

FTR, no formal description of the algorithm seems to have been published, but the source code is amply commented:
https://github.com/lemire/fast_double_parser/blob/master/include/fast_double_parser.h

----------
nosy: +pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41310>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:27:20 2020
From: report at bugs.python.org (Antoine Pitrou)
Date: Mon, 19 Oct 2020 17:27:20 +0000
Subject: [issue41310] micro-optimization: increase our float parsing speed by
 Nx
In-Reply-To: <1594851715.46.0.792624118962.issue41310@roundup.psfhosted.org>
Message-ID: <1603128440.35.0.173916705396.issue41310@roundup.psfhosted.org>


Change by Antoine Pitrou <pitrou at free.fr>:


----------
priority: normal -> low

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41310>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:27:28 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 19 Oct 2020 17:27:28 +0000
Subject: [issue42082] Eliminate test_peg_generator redundant output
Message-ID: <1603128448.05.0.786885656714.issue42082@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

When running tests locally (Win10), test_peg_generator outputs the following 20 times.

parse.c
pegen.c
string_parser.c
tokenizer.c
Python-ast.c
asdl.c
peg_extension.c
   Creating library C:\Users\Terry\AppData\Local\Temp\tmpcr6_pvyl\Debug\Users\Terry\AppData\Local\Temp\tmpcr6_pvyl\parse_d.cp310-win32.lib and object C:\Users\Terry\AppData\Local\Temp\tmpcr6_pvyl\Debug\Users\Terry\AppData\Local\Temp\tmpcr6_pvyl\parse_d.cp310-win32.exp
LINK : /LTCG specified but no code generation required; remove /LTCG from the link command line to improve linker performance

Can this be fixed?

----------
components: Interpreter Core, Tests
messages: 378970
nosy: pablogsal, terry.reedy
priority: normal
severity: normal
stage: needs patch
status: open
title: Eliminate test_peg_generator redundant output
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42082>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:31:43 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 19 Oct 2020 17:31:43 +0000
Subject: [issue42082] Eliminate test_peg_generator redundant output
In-Reply-To: <1603128448.05.0.786885656714.issue42082@roundup.psfhosted.org>
Message-ID: <1603128703.91.0.145100328029.issue42082@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

Let me look into that.

----------
assignee:  -> lys.nikolaou
nosy: +lys.nikolaou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42082>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:43:59 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 19 Oct 2020 17:43:59 +0000
Subject: [issue39107] Upgrade tcl/tk to 8.6.10 (Windows and maxOS)
In-Reply-To: <1576838540.23.0.689551930127.issue39107@roundup.psfhosted.org>
Message-ID: <1603129439.04.0.666737772339.issue39107@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The Windows part of this is done.  Existing tests also pass on my machine.

Ned, do you want this left open for macOS? or close?

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39107>
_______________________________________

From report at bugs.python.org  Mon Oct 19 13:45:35 2020
From: report at bugs.python.org (John Ehresman)
Date: Mon, 19 Oct 2020 17:45:35 +0000
Subject: [issue42080] Disutils on windows debug build fails without -j1
In-Reply-To: <1603123448.09.0.581591280585.issue42080@roundup.psfhosted.org>
Message-ID: <1603129535.12.0.468405234055.issue42080@roundup.psfhosted.org>


John Ehresman <jpe at wingware.com> added the comment:

It is a setuptools bug and I've opened a setuptools issue at https://github.com/pypa/setuptools/issues/2442

Thanks!

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42080>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:05:26 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 18:05:26 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603130726.86.0.727445644878.issue41192@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21732
pull_request: https://github.com/python/cpython/pull/22770

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:09:10 2020
From: report at bugs.python.org (Ned Deily)
Date: Mon, 19 Oct 2020 18:09:10 +0000
Subject: [issue20585] urllib2 unrelease KQUEUE on Mac OSX 10.9+
In-Reply-To: <1392057963.63.0.832878598113.issue20585@psf.upfronthosting.co.za>
Message-ID: <1603130950.01.0.804484523424.issue20585@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

I can't reproduce with 3.9 on 10.9, either. If someone can reproduce with current Pythons and/or macOS without involving forking, feel free to reopen with details.

----------
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20585>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:13:56 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 18:13:56 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603131236.53.0.120069411368.issue42051@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:


New changeset 05ee790f4d1cd8725a90b54268fc1dfe5b4d1fa2 by Ronald Oussoren in branch 'master':
bpo-42051: Reject XML entity declarations in plist files (#22760)
https://github.com/python/cpython/commit/05ee790f4d1cd8725a90b54268fc1dfe5b4d1fa2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:14:03 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 18:14:03 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603131243.22.0.0435796475166.issue42051@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21733
pull_request: https://github.com/python/cpython/pull/22771

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:14:11 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 18:14:11 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603131251.61.0.83226858684.issue42051@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21734
pull_request: https://github.com/python/cpython/pull/22772

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:16:37 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 18:16:37 +0000
Subject: [issue41471] After installing python 3.x on Mac pip doesn't work at
 all
In-Reply-To: <1596537267.29.0.654374340764.issue41471@roundup.psfhosted.org>
Message-ID: <1603131397.11.0.956842027271.issue41471@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21735
pull_request: https://github.com/python/cpython/pull/22773

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41471>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:16:26 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 18:16:26 +0000
Subject: [issue41471] After installing python 3.x on Mac pip doesn't work at
 all
In-Reply-To: <1596537267.29.0.654374340764.issue41471@roundup.psfhosted.org>
Message-ID: <1603131386.24.0.605488013344.issue41471@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:


New changeset 93a1ccabdede416425473329b8c718d507c55e29 by Ronald Oussoren in branch 'master':
bpo-41471: Ignore invalid prefix lengths in system proxy settings on macOS (GH-22762)
https://github.com/python/cpython/commit/93a1ccabdede416425473329b8c718d507c55e29


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41471>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:16:52 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 18:16:52 +0000
Subject: [issue41471] After installing python 3.x on Mac pip doesn't work at
 all
In-Reply-To: <1596537267.29.0.654374340764.issue41471@roundup.psfhosted.org>
Message-ID: <1603131412.69.0.414688073912.issue41471@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21736
pull_request: https://github.com/python/cpython/pull/22774

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41471>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:23:22 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 18:23:22 +0000
Subject: [issue31818] [macOS] _scproxy.get_proxies() crash -- get_proxies() is
 not fork-safe?
In-Reply-To: <1508409035.64.0.213398074469.issue31818@psf.upfronthosting.co.za>
Message-ID: <1603131802.03.0.0835084605385.issue31818@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I'm in favour of keeping integration with system proxy settings, that's more user friendly. 

Note that _scproxy is an example of triggering this using the standard library, the same may happen when using 3th-party libraries on PyPI if those happen to use a higher-level API from Apple.  Even the system provided copy of sqlite is not safe (or at least wasn't, I haven't checked that lately).

I expect that similar problems might crop up on other platforms, especially when using threading.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31818>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:27:05 2020
From: report at bugs.python.org (Xemistry GmbH)
Date: Mon, 19 Oct 2020 18:27:05 +0000
Subject: [issue42083] PyStructSequence_NewType broken in 3.8
Message-ID: <1603132025.42.0.432168177789.issue42083@roundup.psfhosted.org>


New submission from Xemistry GmbH <wdi at xemistry.com>:

Calling PyStructSequence_NewType() with a NULL field in the desc.doc parameter (explicitly allowed as per docs) leads to a crash in 

Objects/typeobject.c:2956
2956                size_t len = strlen(old_doc)+1;

where old_doc is NULL.
If the doc string is set, the call succeeds, but with a warning

(stdin):1: DeprecationWarning: builtin type G_SGROUP has no __module__ attribute

(where G_SGROUP is my new type), which did not happen in 3.6, and which I do not think can be suppressed by function call arguments.

----------
components: C API
messages: 378978
nosy: wdi2
priority: normal
severity: normal
status: open
title: PyStructSequence_NewType broken in 3.8
type: crash
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42083>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:28:25 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Mon, 19 Oct 2020 18:28:25 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603132105.81.0.0048732745982.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

Unfortunately due to licensing issues, it looks like I'll have to ditch the PR and start from scratch: it was too heavily based on the glibc implementation, which has a stricter license. It may be take a good deal of time before I have a potential replacement, but I'll try to work on a "clean-room" implementation. Lesson learned!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:28:46 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 19 Oct 2020 18:28:46 +0000
Subject: [issue42084] Language aware diff headers
Message-ID: <1603132126.97.0.165979992409.issue42084@roundup.psfhosted.org>


New submission from Raymond Hettinger <raymond.hettinger at gmail.com>:

Improve our development environment by making the diff headers language aware.

See:  https://tekin.co.uk/2020/10/better-git-diff-output-for-ruby-python-elixir-and-more

----------
components: Build
messages: 378980
nosy: rhettinger
priority: normal
severity: normal
status: open
title: Language aware diff headers
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42084>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:28:49 2020
From: report at bugs.python.org (Ned Deily)
Date: Mon, 19 Oct 2020 18:28:49 +0000
Subject: [issue39107] Upgrade tcl/tk to 8.6.10 (Windows and maxOS)
In-Reply-To: <1576838540.23.0.689551930127.issue39107@roundup.psfhosted.org>
Message-ID: <1603132129.82.0.0620899174246.issue39107@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

We might as well close this for now. I'm hoping for an 8.6.11 real soon now with almost a year's worth of changes, many for macOS, and we will need to incorporate it all into a revised installer variant. It won't be forgotten :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39107>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:30:54 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 19 Oct 2020 18:30:54 +0000
Subject: [issue42084] Language aware diff headers
In-Reply-To: <1603132126.97.0.165979992409.issue42084@roundup.psfhosted.org>
Message-ID: <1603132254.65.0.941243339849.issue42084@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
keywords: +patch
pull_requests: +21737
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22776

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42084>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:32:05 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 19 Oct 2020 18:32:05 +0000
Subject: [issue39107] Upgrade Windows tcl/tk to 8.6.10
In-Reply-To: <1576838540.23.0.689551930127.issue39107@roundup.psfhosted.org>
Message-ID: <1603132325.05.0.160879134583.issue39107@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
components:  -macOS
resolution:  -> fixed
stage:  -> resolved
status: open -> closed
title: Upgrade tcl/tk to 8.6.10 (Windows and maxOS) -> Upgrade Windows tcl/tk to 8.6.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39107>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:36:05 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 19 Oct 2020 18:36:05 +0000
Subject: [issue39107] Upgrade Windows tcl/tk to 8.6.10
In-Reply-To: <1576838540.23.0.689551930127.issue39107@roundup.psfhosted.org>
Message-ID: <1603132565.29.0.587970832871.issue39107@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

We should then upgrade on Windows again.  PR would have nearly the same changes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39107>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:38:48 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 18:38:48 +0000
Subject: [issue37741] importlib.metadata docs not showing up in the module
 index
In-Reply-To: <1564685225.86.0.948746560612.issue37741@roundup.psfhosted.org>
Message-ID: <1603132728.79.0.753749992657.issue37741@roundup.psfhosted.org>


Change by Barry A. Warsaw <barry at python.org>:


----------
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37741>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:41:20 2020
From: report at bugs.python.org (Kevin)
Date: Mon, 19 Oct 2020 18:41:20 +0000
Subject: [issue40680] thread_cputime isn't supported by AIX5
In-Reply-To: <1589888991.61.0.317317587375.issue40680@roundup.psfhosted.org>
Message-ID: <1603132880.01.0.13897758559.issue40680@roundup.psfhosted.org>


Kevin <kadler at us.ibm.com> added the comment:

Does this need an update to PEP 11 documenting the drop of support?

Also, I can submit changes to remove pre-AIX 6 dead code paths. Should I open a separate issue for that or reference this one?

----------
nosy: +kadler

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40680>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:47:54 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 18:47:54 +0000
Subject: [issue41019] The necessary bits to build these optional modules were
 not found:
In-Reply-To: <1592473477.66.0.014691616705.issue41019@roundup.psfhosted.org>
Message-ID: <1603133274.84.0.543717835117.issue41019@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type:  -> compile error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41019>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:49:43 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 18:49:43 +0000
Subject: [issue41016] warning: 'Tk_GetNumMainWindows' is deprecated
Message-ID: <1603133383.98.0.463819063221.issue41016@roundup.psfhosted.org>


New submission from Ronald Oussoren <ronaldoussoren at mac.com>:

This is not a bug in Python, but a warning from Apple that they don't want you to use the system provided Tcl/Tk libraries.

The Python.org installers are already build using a custom build of Tcl/Tk, mostly because the system provided build is ancient and buggy.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type: enhancement -> compile error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41016>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:52:34 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Mon, 19 Oct 2020 18:52:34 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603133554.5.0.296041485399.issue41192@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:


New changeset ec18c468b8aed4b4a3d1942ae18b96d8efebe04b by Miss Skeleton (bot) in branch '3.8':
bpo-41192: Fix some broken anchors for audit event entries (GH-21310) (GH-22770)
https://github.com/python/cpython/commit/ec18c468b8aed4b4a3d1942ae18b96d8efebe04b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:52:34 2020
From: report at bugs.python.org (Ned Deily)
Date: Mon, 19 Oct 2020 18:52:34 +0000
Subject: [issue26376] Tkinter root window won't close if packed.
In-Reply-To: <1455721245.86.0.235285513904.issue26376@psf.upfronthosting.co.za>
Message-ID: <1603133554.25.0.949606501018.issue26376@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Unfortunately, I can reproduce it, or at least odd behavior when run from an IDLE.app edit window on with 3.9.0 on macOS 10.15. By observing the macOS Dock while running this, it looks like a second Python app instance is created while running this. We have seen similar behavior as documented in Issue38946. I have an idea what's going on there which I'll try to look at this week.  Let's close this as a duplicate so it's not forgotten.

----------
resolution: out of date -> duplicate
stage:  -> resolved
status: pending -> closed
superseder:  -> IDLE on macOS 10.15 Catalina does not open double-clicked files if app already launched

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26376>
_______________________________________

From report at bugs.python.org  Mon Oct 19 14:54:44 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 18:54:44 +0000
Subject: =?utf-8?q?=5Bissue41349=5D_Tk_window_not_going_full_screen_on_90=C2=B0_ro?=
 =?utf-8?q?tated__screen_on_mac?=
In-Reply-To: <1595259495.1.0.547279913373.issue41349@roundup.psfhosted.org>
Message-ID: <1603133684.82.0.861908305118.issue41349@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

The python.org installers don't include wish, which means I cannot attempt to reproduce the issue without using tkinter.

I agree that this likely is an issue with Tk itself.  Maybe keep the issue open for a bit longer to check if the upcoming Tk 8.6.11 release fixes this issue.

----------
versions: +Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41349>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:04:06 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Mon, 19 Oct 2020 19:04:06 +0000
Subject: [issue40680] thread_cputime isn't supported by AIX5
In-Reply-To: <1589888991.61.0.317317587375.issue40680@roundup.psfhosted.org>
Message-ID: <1603134246.18.0.822158616733.issue40680@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

> Also, I can submit changes to remove pre-AIX 6 dead code paths. Should I open a separate issue for that or reference this one?

Yes, please do so.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40680>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:13:16 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 19 Oct 2020 19:13:16 +0000
Subject: [issue42084] Language aware diff headers
In-Reply-To: <1603132126.97.0.165979992409.issue42084@roundup.psfhosted.org>
Message-ID: <1603134796.58.0.566071802597.issue42084@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42084>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:13:33 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 19 Oct 2020 19:13:33 +0000
Subject: [issue42084] Language aware diff headers
In-Reply-To: <1603132126.97.0.165979992409.issue42084@roundup.psfhosted.org>
Message-ID: <1603134813.21.0.8981101446.issue42084@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 95ad890a7b0341d8d2fde13f824bc24c65a8ece0 by Raymond Hettinger in branch 'master':
bpo-42084: Language aware diff headers (GH-22776)
https://github.com/python/cpython/commit/95ad890a7b0341d8d2fde13f824bc24c65a8ece0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42084>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:14:31 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 19 Oct 2020 19:14:31 +0000
Subject: [issue42083] PyStructSequence_NewType broken in 3.8
In-Reply-To: <1603132025.42.0.432168177789.issue42083@roundup.psfhosted.org>
Message-ID: <1603134871.59.0.925583090059.issue42083@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
priority: normal -> high

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42083>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:15:51 2020
From: report at bugs.python.org (Aivar Annamaa)
Date: Mon, 19 Oct 2020 19:15:51 +0000
Subject: [issue42068] For macOS,
 package the included Tcl and Tk frameworks in a rational way.
In-Reply-To: <1603027259.23.0.956934315272.issue42068@roundup.psfhosted.org>
Message-ID: <1603134951.95.0.681296996853.issue42068@roundup.psfhosted.org>


Change by Aivar Annamaa <aivar.annamaa at gmail.com>:


----------
nosy: +Aivar.Annamaa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42068>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:15:55 2020
From: report at bugs.python.org (Lisa Roach)
Date: Mon, 19 Oct 2020 19:15:55 +0000
Subject: [issue41954] [mock] Recursion on mocking inspect.isfunction
In-Reply-To: <1601968342.61.0.658071347558.issue41954@roundup.psfhosted.org>
Message-ID: <1603134955.27.0.424360938351.issue41954@roundup.psfhosted.org>


Lisa Roach <lisaroach14 at gmail.com> added the comment:

Oof yeah, sorry my commit broke this but it is pretty hard to avoid. Mario is right in that it would be messy and challenging to ensure anything mocked from the stdlib doesn't also break mock itself.  

I want to mark this as `wont fix`, unless there is a compelling reason for the stdlib's `inspect.isfunction` to be mockable. But I agree with Mario again here, it would be better to mock the module that is using the function rather than the built-in function itself.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41954>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:15:55 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 19:15:55 +0000
Subject: [issue24130] Remove -fno-common compile option from OS X framework
 builds?
In-Reply-To: <1430875287.46.0.873192743789.issue24130@psf.upfronthosting.co.za>
Message-ID: <1603134955.57.0.323560176756.issue24130@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I've checked and '-fcommon' is default (at least with Xcode 12 beta on x86_64), and likely not what you'd want:  With "-fcommon" the definition a non-static variable in two different files will get merged:

first.m:   int x;
second.m:   int x;

Without '-fno-common' this will be allowed (and that's generally not what you want, correct usage is to have one of the files use "extern int x;".  In clang 11 "-fno-common" is enabled by default, but I don't know when Apple do this in their copy of clang.

----


I'm closing this issue because using -fno-common is necessary avoid having a common section in the framework (see msg243259)

----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed
type:  -> compile error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24130>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:16:59 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 19:16:59 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603135019.19.0.997571590865.issue42041@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Proposed alternative based on Eryk's:

      For maximum reliability, use a fully-qualified path for the executable.
      To search for an unqualified name on :envvar:`PATH`, use
      :meth:`shutil.which`. On all platforms, passing :data:`sys.executable`
      is the recommended way to launch the current Python interpreter again,
      and use the ``-m`` command-line format to launch an installed module.

      Resolving the path of *executable* (or the first item of *args*) is
      platform dependent. For POSIX, see :meth:`os.execvpe`, and note that
      when resolving or searching for the executable path, *cwd* overrides the
      current working directory and *env* can override the ``PATH``
      environment variable. For Windows, see the documentation of the
      ``lpApplicationName`` and ``lpCommandLine`` parameters of WinAPI
      ``CreateProcess``, and note that when resolving or searching for the
      executable path with ``shell=False``, *cwd* does not override the
      current working directory and *env* cannot override the ``PATH``
      environment variable. Using a full path avoids all of these variations.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:17:14 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Mon, 19 Oct 2020 19:17:14 +0000
Subject: [issue38144] Add the root_dir and dir_fd parameters in glob.glob()
In-Reply-To: <1568313061.34.0.998675763501.issue38144@roundup.psfhosted.org>
Message-ID: <1603135034.42.0.854516906671.issue38144@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:

I'm digging around in the sys.audit() feature.  Did the sys.audit("glob.glob", ...) call disappear in commit 8a64ceaf9856e7570cad6f5d628cce789834e019, or is something clever going on that I missed?

----------
nosy: +akuchling

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38144>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:22:51 2020
From: report at bugs.python.org (Lisa Roach)
Date: Mon, 19 Oct 2020 19:22:51 +0000
Subject: [issue42072] requests
In-Reply-To: <1603052344.71.0.153808857129.issue42072@roundup.psfhosted.org>
Message-ID: <1603135371.45.0.785750046783.issue42072@roundup.psfhosted.org>


Lisa Roach <lisaroach14 at gmail.com> added the comment:

Requests is a third-party library (https://pypi.org/project/requests/2.7.0/), it is not a part of CPython so this is not the correct forum to report bugs. They have their own issue tracker here: https://github.com/psf/requests/issues

I'd also suggest a permission error is not a bug in Requests, but perhaps a permission issue that is local to your machine. Perhaps searching around StackOverflow can offer you some guidance.

----------
nosy: +lisroach
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42072>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:26:35 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 19:26:35 +0000
Subject: [issue37677] Seg Fault on OSX when multiprocessing
In-Reply-To: <1564042021.53.0.0155934240157.issue37677@roundup.psfhosted.org>
Message-ID: <1603135595.81.0.677753809484.issue37677@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I'm closing this issue because this crash is caused by a platform issue, and Python 3.8 has a workaround by using a different spawn method in multiprocessing.

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37677>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:27:05 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 19 Oct 2020 19:27:05 +0000
Subject: [issue15877] xml.dom.minidom cannot parse ISO-2022-JP
In-Reply-To: <1346999883.79.0.0390921600311.issue15877@psf.upfronthosting.co.za>
Message-ID: <1603135625.2.0.00890573409286.issue15877@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Closing - this now works for me on Python 3.8 and 3.10. It was fixed sometime in the last 8 years.

----------
resolution:  -> works for me
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15877>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:29:23 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 19 Oct 2020 19:29:23 +0000
Subject: [issue38693] Use f-strings instead of str.format within importlib
In-Reply-To: <1572934817.34.0.695862725726.issue38693@roundup.psfhosted.org>
Message-ID: <1603135763.54.0.674729386744.issue38693@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
versions: +Python 3.10 -Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38693>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:29:42 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 19 Oct 2020 19:29:42 +0000
Subject: [issue40484] Document existing compiler flags under ast
In-Reply-To: <1588514973.24.0.132527747949.issue40484@roundup.psfhosted.org>
Message-ID: <1603135782.03.0.433679512349.issue40484@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset a358a0ad7140ee636ab2631cfee0f365a5dbd4ea by Miss Skeleton (bot) in branch '3.9':
bpo-40484: Document compiler flags under AST module (GH-19885) (GH-22758)
https://github.com/python/cpython/commit/a358a0ad7140ee636ab2631cfee0f365a5dbd4ea


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40484>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:33:13 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 19 Oct 2020 19:33:13 +0000
Subject: [issue38693] Use f-strings instead of str.format within importlib
In-Reply-To: <1572934817.34.0.695862725726.issue38693@roundup.psfhosted.org>
Message-ID: <1603135993.69.0.6062446474.issue38693@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Status: Waiting until after the importlib.metadata and importlib.resources backports drop support for both Python 2.7 and 3.5 as keeping them in sync would be a pain for maintainers (per jaraco on our sprint importlib-any chat today)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38693>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:38:23 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 19 Oct 2020 19:38:23 +0000
Subject: [issue42066] CookieJar cookies should not be sorted
In-Reply-To: <1603011565.07.0.705714624719.issue42066@roundup.psfhosted.org>
Message-ID: <1603136303.29.0.400364644932.issue42066@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
versions:  -Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42066>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:38:17 2020
From: report at bugs.python.org (Vladimir Matveev)
Date: Mon, 19 Oct 2020 19:38:17 +0000
Subject: [issue42085] Add dedicated slot for sending values
Message-ID: <1603136296.98.0.312180912341.issue42085@roundup.psfhosted.org>


New submission from Vladimir Matveev <desco.by at gmail.com>:

https://bugs.python.org/issue41756 has introduced PyIter_Send as a common entrypoint for sending values however currently fast path that does not use StopIteration exception is only available for generators/coroutines. It would be quite nice if this machinery was extensible and other types (both internal and 3rd party) could opt-in into using exception-free way of returning values without needing to update the implementation of PyIter_Send. One way of solving this is adding a new slot with a signature that matches PyIter_Send. With it:
- it should be possible to implement this slot for coroutines/generators and remove  special casing for them  in PyIter_Send
- provide implementation for this slot for internal types (i.e. FutureIter in _asynciomodule.c) - results of this experiment can be found below
- enable external native extensions to provide efficient implementation of coroutines (i.e.  Cython could benefit from it)

Microbenchmark to demonstrate the difference of accessing the value of fulfiled Future without and with dedicated slot:
```
import asyncio
import time

N = 100000000

async def run():
    fut = asyncio.Future()
    fut.set_result(42)

    t0 = time.time()
    for _ in range(N):
        await fut
    t1 = time.time()
    print(f"Time: {t1 - t0} s")

asyncio.run(run())
```
Time: 8.365560054779053 s - without the slot
Time: 5.799655914306641 s - with the  slot

----------
components: Interpreter Core
messages: 378999
nosy: v2m
priority: normal
severity: normal
status: open
title: Add dedicated slot for sending values
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42085>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:38:43 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 19:38:43 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1603136323.4.0.493817023885.issue41490@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +21738
pull_request: https://github.com/python/cpython/pull/22779

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:39:12 2020
From: report at bugs.python.org (Vladimir Matveev)
Date: Mon, 19 Oct 2020 19:39:12 +0000
Subject: [issue42085] Add dedicated slot for sending values
In-Reply-To: <1603136296.98.0.312180912341.issue42085@roundup.psfhosted.org>
Message-ID: <1603136352.69.0.686581965486.issue42085@roundup.psfhosted.org>


Change by Vladimir Matveev <desco.by at gmail.com>:


----------
keywords: +patch
pull_requests: +21739
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22780

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42085>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:39:53 2020
From: report at bugs.python.org (Paul Moore)
Date: Mon, 19 Oct 2020 19:39:53 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603136393.49.0.0776749512327.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

I like that, I've updated the PR accordingly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:45:38 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 19 Oct 2020 19:45:38 +0000
Subject: [issue41746] Add optional type information to asdl_seq objects
In-Reply-To: <1599597077.35.0.913235954629.issue41746@roundup.psfhosted.org>
Message-ID: <1603136738.5.0.48584917414.issue41746@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Pablo, can this be closed now that PR22223 is merged?

Nop, we still need to fix the CHECK macros that do type erasure (they cast the result to void).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41746>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:47:31 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 19 Oct 2020 19:47:31 +0000
Subject: [issue26376] Tkinter root window won't close if packed.
In-Reply-To: <1455721245.86.0.235285513904.issue26376@psf.upfronthosting.co.za>
Message-ID: <1603136851.21.0.64411582475.issue26376@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I just reproduced this too with Airbook Mohave.  When IDLE's Shell is running, it is linked to an execution subprocess that is initially invisible, unless and until the user creates a visible window.  Tk() does this.  On Windows, a tk Window icon appears when I mouse over the IDLE taskbar icon.  On Mac, a new python rocket icon, also used for Python Launcher, appears.  And it becomes the active app for the Apple menu bar, making it more tied to the OS than on Windows.  In either case, I can switch between IDLE and tk windows by clicking icons or sub-icons.

When I click the red close button on the tk window, it disappears, but the rocket app icon is still there.  Clicking it maybe restores the window, which was hidden, not closed.  Or I may have to right click the rocket and then 'tk'.  Right-clicking the rocket and then 'quit' fails to close.  But trying to modify the tk window may fail with 'app destroyed' even though it can be made visible.  Closing the parent IDLE closes the Window.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26376>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:54:57 2020
From: report at bugs.python.org (Daniel Lenski)
Date: Mon, 19 Oct 2020 19:54:57 +0000
Subject: [issue2190] MozillaCookieJar ignore HttpOnly cookies
In-Reply-To: <1203957546.34.0.123660895963.issue2190@psf.upfronthosting.co.za>
Message-ID: <1603137297.27.0.646515417796.issue2190@roundup.psfhosted.org>


Daniel Lenski <dlenski at gmail.com> added the comment:

I've got a patch that will address both loading and saving of "HTTP-only" cookies: https://github.com/python/cpython/compare/master...dlenski:patch-1

Testing/feedback before I submit as a PR would be very welcome.

----------
versions: +Python 3.10, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2190>
_______________________________________

From report at bugs.python.org  Mon Oct 19 15:58:22 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Mon, 19 Oct 2020 19:58:22 +0000
Subject: [issue42086] AST: Document / re-design? the simple constructor nodes
 from sums
Message-ID: <1603137502.35.0.449039325711.issue42086@roundup.psfhosted.org>


New submission from Batuhan Taskaya <isidentical at gmail.com>:

Simple constructors (basically constructors with no fields) are currently 'cached' / pre-created and dispatched. What I mean by that is, when a user parses some code with `ast.parse()` and gets a tree object, all simple constructors with the same value would point to the same object.

>>> mod1 = ast.parse("a + b", mode="eval")
>>> mod1.body.left.ctx
<ast.Load object at 0x7f8695321d20>
>>> mod1.body.right.ctx
<ast.Load object at 0x7f8695321d20>
>>> mod1.body.left.ctx is mod1.body.right.ctx
True
>>> mod1.body.left.ctx.some_annotation_that_my_extra_process_tool_puts = 1
>>> mod1.body.right.ctx.some_annotation_that_my_extra_process_tool_puts
1

Even though I have no real evidence that, this was done on purpose, I believe this is some sort of 'enum' replication (caching singletons but not really, since this is only valid for the results of ast.parse)
>>> mod1.body.right.ctx is ast.Load()
False
>>> ast.parse("a + b", mode="eval").body.left.ctx is ast.parse("c + d", mode="eval").body.right.ctx
True



Obviously, we can not change these into enums like (ast.expr_ctx.Load / LOAD) since it would break theoretically most of the code that works with ast. So here is a tl;dr:

- Even though all ast objects are mutable (by default), we use the same objects when converting C AST into Python AST. So that mutations on one object is affecting the rest of the tree. 

- We can either;
  - Document this behavior and keep it
  - Return freshly constructed objects when converting C AST into Python AST
    This has a very slight (that I suspect no body uses) risk of breaking code, but as I implied, very slight. Which would occur in such a case

import ast
from collections import defaultdict

def collect_contexts(tree):
    contexts = defaultdict(list)
    for node in ast.walk(tree):
        if isinstance(node, ast.Name):
            contexts[node.ctx].append(node.id)
    return contexts
    
print(collect_contexts(ast.parse("a, b = c, d")))

This code can easily (and it makes it more reliable/robust) refactored into 
-             contexts[node.ctx].append(node.id)
-             contexts[type(node.ctx)].append(node.id)
but just mentioning in case of any question appears about backwards incompatability.

----------
components: Library (Lib)
messages: 379004
nosy: BTaskaya, lys.nikolaou, pablogsal, serhiy.storchaka
priority: normal
severity: normal
status: open
title: AST: Document / re-design? the simple constructor nodes from sums
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42086>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:13:01 2020
From: report at bugs.python.org (Saiyang Gou)
Date: Mon, 19 Oct 2020 20:13:01 +0000
Subject: [issue39567] Add audit for os.walk(), os.fwalk(),
 Path.glob() and Path.rglob()
In-Reply-To: <1580977248.64.0.174366488821.issue39567@roundup.psfhosted.org>
Message-ID: <1603138381.37.0.178725977117.issue39567@roundup.psfhosted.org>


Saiyang Gou <gousaiyang223 at gmail.com> added the comment:

Should we backport this to 3.8? I believe that we should either backport this to 3.8 or document that these audit events are new in 3.9.

----------
nosy: +gousaiyang

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39567>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:22:36 2020
From: report at bugs.python.org (Ned Deily)
Date: Mon, 19 Oct 2020 20:22:36 +0000
Subject: [issue41680] Turtles in Python 3.8.5 crashes OSX 10.14.6
In-Reply-To: <1598898277.27.0.605010219391.issue41680@roundup.psfhosted.org>
Message-ID: <1603138956.2.0.431669149995.issue41680@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

> Could this be a duplicate of #37833?

I suppose it's possible if not using a python.org Python.

I'm not able to reproduce this with a current Python 3.9.0 on macOS 10.15.7. 

I'm going to close this for now.  If someone is able to provide more information on how to reproduce this, please re-open.

----------
resolution:  -> works for me
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41680>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:24:45 2020
From: report at bugs.python.org (Kevin)
Date: Mon, 19 Oct 2020 20:24:45 +0000
Subject: [issue42087] Remove pre-AIX 6.1 dead code paths
Message-ID: <1603139085.09.0.736153857755.issue42087@roundup.psfhosted.org>


New submission from Kevin <kadler at us.ibm.com>:

Follow on to https://bugs.python.org/issue40680. In there, it was decided that since AIX 5 and below doesn't support thread_cputime, support for it would be dropped and the issue was closed without removing any of the dead code paths and references.

----------
components: Interpreter Core
messages: 379007
nosy: kadler
priority: normal
severity: normal
status: open
title: Remove pre-AIX 6.1 dead code paths

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42087>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:25:10 2020
From: report at bugs.python.org (Kevin)
Date: Mon, 19 Oct 2020 20:25:10 +0000
Subject: [issue40680] thread_cputime isn't supported by AIX5
In-Reply-To: <1589888991.61.0.317317587375.issue40680@roundup.psfhosted.org>
Message-ID: <1603139110.99.0.617528815982.issue40680@roundup.psfhosted.org>


Kevin <kadler at us.ibm.com> added the comment:

Ok, I've opened https://bugs.python.org/issue42087

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40680>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:25:08 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Mon, 19 Oct 2020 20:25:08 +0000
Subject: [issue42087] Remove pre-AIX 6.1 dead code paths
In-Reply-To: <1603139085.09.0.736153857755.issue42087@roundup.psfhosted.org>
Message-ID: <1603139108.4.0.802065156363.issue42087@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42087>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:27:56 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 19 Oct 2020 20:27:56 +0000
Subject: [issue24725] test_socket testFDPassEmpty fails on OS X 10.11+ with
 "Cannot allocate memory"
In-Reply-To: <1437896131.77.0.341264720465.issue24725@psf.upfronthosting.co.za>
Message-ID: <1603139276.31.0.83731856509.issue24725@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

The issue is still present with python 3.9 and macOS 10.15 as well as current macOS 11 betas.

The following python scriptlet reproduces the issue:

# ---
import socket
  
sd1, sd2 = socket.socketpair()

sd1.sendmsg([b"hello"], [(socket.SOL_SOCKET, socket.SCM_RIGHTS, b"")])
sd2.recvmsg(1)
# ---

I think the attached file "repro.c" does the same in C, it also fails with "recvmsg: Cannot allocate memory".


I've filed an issue for this with Apple: FB8813140.  I filed it from an Arm Mac system, with some luck this will help to get attention :-)

----------
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.5
Added file: https://bugs.python.org/file49528/repro.c

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24725>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:34:54 2020
From: report at bugs.python.org (Ben Avrahami)
Date: Mon, 19 Oct 2020 20:34:54 +0000
Subject: [issue42088] types.SimpleNamespace.__repr__ documentation
 inconsistency
Message-ID: <1603139694.62.0.339590504513.issue42088@roundup.psfhosted.org>


New submission from Ben Avrahami <avrahami.ben at gmail.com>:

According to the documentation for types.SimpleNamespace, `repr(SimpleNamespace())` should return `"SimpleNamespace()"`, but in actuality returns `"namespace()"`. This is because SimpleNamespace is an alias for the C implemented type `_PyNamespaceObject`. Interestingly, `_PyNamespaceObject` names itself `"types.SimpleNamespace"`. This has the obvious issue of the documentation being wrong, but also the (perhaps less interesting issue) of `eval(repr(SimpleNamespace))` resulting in a NameError.

I propose that `_PyNamespaceObject`'s __repr__ method be changed to return `"SimpleNamespace(<args>)"`. This would require only the change of a constant in one line (currently this is line 75 on namespaceobject.c).

A smaller fix would be to change the documentation to correctly reflect this behavior.

----------
components: Library (Lib)
messages: 379010
nosy: avrahami.ben
priority: normal
severity: normal
status: open
title: types.SimpleNamespace.__repr__ documentation inconsistency
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42088>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:38:17 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 19 Oct 2020 20:38:17 +0000
Subject: [issue40423] Optimization: use close_range(2) if available
In-Reply-To: <1588083008.52.0.574583659738.issue40423@roundup.psfhosted.org>
Message-ID: <1603139897.51.0.294482750419.issue40423@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

thanks Kyle!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40423>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:41:24 2020
From: report at bugs.python.org (Ned Deily)
Date: Mon, 19 Oct 2020 20:41:24 +0000
Subject: [issue41754] Webbrowser Module Cannot Find xdg-settings on OSX
In-Reply-To: <1599718531.77.0.777287973454.issue41754@roundup.psfhosted.org>
Message-ID: <1603140084.26.0.88362939114.issue41754@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

That does seem very odd but the issue clearly has been seen by multiple users. Since it shouldn't cause any negative effects, I'm in favor of just adding NotADirectoryError to the try/except list as suggested in the workaround and make the problem go away.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41754>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:41:41 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Mon, 19 Oct 2020 20:41:41 +0000
Subject: [issue42037] Documentation confusion in CookieJar functions
In-Reply-To: <1602689022.88.0.876415237077.issue42037@roundup.psfhosted.org>
Message-ID: <1603140101.79.0.1370050905.issue42037@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Hello!  I don?t see the problem that you are mentioning: the request methods removed from Request objects are not in the list of methods required by the CookieJar methods.

----------
nosy: +eric.araujo

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42037>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:42:14 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 19 Oct 2020 20:42:14 +0000
Subject: [issue40360] Deprecate lib2to3 (and 2to3) for future removal
In-Reply-To: <1587530454.25.0.44181585934.issue40360@roundup.psfhosted.org>
Message-ID: <1603140134.14.0.966468537876.issue40360@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
assignee: gregory.p.smith -> 
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40360>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:41:53 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 19 Oct 2020 20:41:53 +0000
Subject: [issue40360] Deprecate lib2to3 (and 2to3) for future removal
In-Reply-To: <1587530454.25.0.44181585934.issue40360@roundup.psfhosted.org>
Message-ID: <1603140113.18.0.514009291924.issue40360@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

status: lib2to3 PendingDeprecationWarning shipped in 3.9.  Since we don't have a specific release planned for the final deprecation, I'll leave this issue open while we figure that out.  Once we do, we should promote this to a regular DeprecationWarning in whichever release is next at that time.

----------
versions:  -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40360>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:45:30 2020
From: report at bugs.python.org (Ned Deily)
Date: Mon, 19 Oct 2020 20:45:30 +0000
Subject: [issue41754] Webbrowser Module Cannot Find xdg-settings on OSX
In-Reply-To: <1599718531.77.0.777287973454.issue41754@roundup.psfhosted.org>
Message-ID: <1603140330.39.0.838101466745.issue41754@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
keywords: +newcomer friendly
stage:  -> needs patch
type: crash -> behavior
versions:  -Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41754>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:49:44 2020
From: report at bugs.python.org (Zachary Ware)
Date: Mon, 19 Oct 2020 20:49:44 +0000
Subject: [issue34716] MagicMock.__divmod__ should return a pair
In-Reply-To: <1537213558.4.0.956365154283.issue34716@psf.upfronthosting.co.za>
Message-ID: <1603140584.93.0.280692599678.issue34716@roundup.psfhosted.org>


Change by Zachary Ware <zachary.ware at gmail.com>:


----------
versions: +Python 3.10 -Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34716>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:50:51 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Mon, 19 Oct 2020 20:50:51 +0000
Subject: [issue42089] Better message in PackageNotFoundError
Message-ID: <1603140651.15.0.510180378799.issue42089@roundup.psfhosted.org>


New submission from Jason R. Coombs <jaraco at jaraco.com>:

As reported in https://gitlab.com/python-devs/importlib_metadata/-/issues/124, it would be nice if the PackageNotFoundError gave some guidance to the user about the context of the error and how to investigate.

----------
assignee: jaraco
components: Library (Lib)
messages: 379015
nosy: jaraco
priority: normal
severity: normal
status: open
title: Better message in PackageNotFoundError
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42089>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:53:55 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 20:53:55 +0000
Subject: [issue42089] Better message in PackageNotFoundError
In-Reply-To: <1603140651.15.0.510180378799.issue42089@roundup.psfhosted.org>
Message-ID: <1603140835.58.0.970440579311.issue42089@roundup.psfhosted.org>


Change by Barry A. Warsaw <barry at python.org>:


----------
keywords: +patch
nosy: +barry
nosy_count: 1.0 -> 2.0
pull_requests: +21740
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22775

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42089>
_______________________________________

From report at bugs.python.org  Mon Oct 19 16:58:28 2020
From: report at bugs.python.org (conchylicultor)
Date: Mon, 19 Oct 2020 20:58:28 +0000
Subject: [issue42090] zipfile.Path.joinpath API inconsistent with
 pathlib.Path.joinpath
Message-ID: <1603141108.13.0.969027124293.issue42090@roundup.psfhosted.org>


New submission from conchylicultor <etiennefg.pot at gmail.com>:

The following code fail with zipfile.Path, but works with pathlib.Path:

```
path = path.joinpath().joinpath('other', 'other')
```

Zipfile: https://github.com/python/cpython/blob/95ad890a7b0341d8d2fde13f824bc24c65a8ece0/Lib/zipfile.py#L2363

```
def joinpath(self, add):
```

Pathlib: https://github.com/python/cpython/blob/95ad890a7b0341d8d2fde13f824bc24c65a8ece0/Lib/pathlib.py#L955

```
def joinpath(self, *args):
```

----------
components: Library (Lib)
messages: 379016
nosy: conchylicultor
priority: normal
severity: normal
status: open
title: zipfile.Path.joinpath API inconsistent with pathlib.Path.joinpath
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42090>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:06:03 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 21:06:03 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1603141563.02.0.578112166102.issue41490@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I did some bad things in git and so I had to recreate the PR against master, but the importlib.resources tests still fail.

Seems like the ensurepip/venv tests are fine though? Did something change in pip/certifi between 20.2.1 and 20.2.3?

I still consider the changes a release blocking regression, but if it's not blocking ensurepip then I guess the updated packages can go in now. I'll split up my PR tomorrow, but I'm not feeling like fighting git more tonight.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:07:11 2020
From: report at bugs.python.org (Pridhvi Myneni)
Date: Mon, 19 Oct 2020 21:07:11 +0000
Subject: [issue42091] strftime returns empty string for -d, -I 3.8.3
Message-ID: <1603141631.63.0.815612128268.issue42091@roundup.psfhosted.org>


New submission from Pridhvi Myneni <bluerat33 at gmail.com>:

My system has python from MSYS2 integrated with my windows environment, so I can't test if Windows exhibits the same issue; however, this works perfectly in Ubuntu. The issue is %-d, %-I don't work as expected and instead cause the function call to return an empty string. 

Steps to reproduce:
import datetime
now = datetime.datetime.now()
now.strftime("%-I")
...

----------
messages: 379018
nosy: PMARINA
priority: normal
severity: normal
status: open
title: strftime returns empty string for -d, -I 3.8.3
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42091>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:14:31 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 21:14:31 +0000
Subject: [issue42089] Better message in PackageNotFoundError
In-Reply-To: <1603140651.15.0.510180378799.issue42089@roundup.psfhosted.org>
Message-ID: <1603142071.68.0.545951727348.issue42089@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 96ddc58281d2b6b2258b1a628bccf252090d5611 by Barry Warsaw in branch 'master':
bpo-42089: Sync with current cpython branch of importlib_metadata (GH-22775)
https://github.com/python/cpython/commit/96ddc58281d2b6b2258b1a628bccf252090d5611


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42089>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:22:22 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 21:22:22 +0000
Subject: [issue42092] test_host_resolution_bad_address does not always fail as
 expected
Message-ID: <1603142542.04.0.682089318313.issue42092@roundup.psfhosted.org>


New submission from Barry A. Warsaw <barry at python.org>:

This is very likely caused by something janky my ISP (AT&T) is doing with IPv6, but the above named test fails for me because IPv6 addresses like `::1q` do not fail to resolve as the test expects.

I'm not sure what can or should be done about it, but as this is an annoying local failure, and I couldn't find another mention of it by searching bpo, I wanted to at least get it on record.

The test function's comment says:

"
        # These are all malformed IP addresses and expected not to resolve to
        # any result.  But some ISPs, e.g. AWS, may successfully resolve these
        # IPs.
"

So apparently, put AT&T in that bucket of ISPs that resolve those IPv6 addresses.

----------
messages: 379020
nosy: barry
priority: normal
severity: normal
status: open
title: test_host_resolution_bad_address does not always fail as expected
versions: Python 3.10, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42092>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:24:27 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 21:24:27 +0000
Subject: [issue31818] [macOS] _scproxy.get_proxies() crash -- get_proxies() is
 not fork-safe?
In-Reply-To: <1508409035.64.0.213398074469.issue31818@psf.upfronthosting.co.za>
Message-ID: <1603142667.3.0.582656503778.issue31818@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

My understanding is that this is specifically a problem with the Objective-C runtime that _scproxy.c accesses.  The runtime is not thread safe and whereas in earlier versions of macOS, it silently failed, now macOS is explicitly aborting the process.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31818>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:25:33 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 19 Oct 2020 21:25:33 +0000
Subject: [issue42091] strftime returns empty string for -d, -I 3.8.3
In-Reply-To: <1603141631.63.0.815612128268.issue42091@roundup.psfhosted.org>
Message-ID: <1603142733.52.0.142438218631.issue42091@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Can you tell us what the expected behavior is?

>From the strftime docs: "The full set of format codes supported varies across platforms, because Python calls the platform C library?s strftime() function, and platform variations are common. To see the full set of format codes supported on your platform, consult the strftime(3) documentation."

You're probably just seeing platform-specific behavior.

On cygwin, I get an empty string.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42091>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:27:25 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 21:27:25 +0000
Subject: [issue38320] Clarify unittest expectedFailure behaviour in the
 documentation
In-Reply-To: <1569834841.91.0.690142859839.issue38320@roundup.psfhosted.org>
Message-ID: <1603142845.02.0.541640161406.issue38320@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset fa8748271a61177e9bf609921fa464cc6990478b by Irit Katriel in branch 'master':
bpo-38320: Clarify that expectedFailure is satisfied by either failure or error of the test. (GH-22740)
https://github.com/python/cpython/commit/fa8748271a61177e9bf609921fa464cc6990478b


----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38320>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:27:35 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 21:27:35 +0000
Subject: [issue38320] Clarify unittest expectedFailure behaviour in the
 documentation
In-Reply-To: <1569834841.91.0.690142859839.issue38320@roundup.psfhosted.org>
Message-ID: <1603142855.02.0.261249336723.issue38320@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21741
pull_request: https://github.com/python/cpython/pull/22782

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38320>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:28:13 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 21:28:13 +0000
Subject: [issue38320] Clarify unittest expectedFailure behaviour in the
 documentation
In-Reply-To: <1569834841.91.0.690142859839.issue38320@roundup.psfhosted.org>
Message-ID: <1603142893.09.0.530589924788.issue38320@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21742
pull_request: https://github.com/python/cpython/pull/22783

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38320>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:36:06 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 21:36:06 +0000
Subject: [issue41845] Promote PyObject_GenericGetDict to the stable API
In-Reply-To: <1600871509.15.0.3993940648.issue41845@roundup.psfhosted.org>
Message-ID: <1603143366.02.0.575792864955.issue41845@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Unfortunately, fixing this won't make the builds work in previous versions, so it can't be backported.

We also need to update the version check in the PR - I left a comment for it.

----------
nosy: +steve.dower
versions:  -Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41845>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:43:25 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 21:43:25 +0000
Subject: [issue41784] Promote PyUnicode_AsUTF8AndSize to be available with the
 limited API (PEP 384)
In-Reply-To: <1600112223.54.0.368726029107.issue41784@roundup.psfhosted.org>
Message-ID: <1603143805.5.0.218196852536.issue41784@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Agreed that there's no way we can make Py_buffer part of the limited ABI.

I just looked over the PR and it's missing a What's New entry (e.g. https://docs.python.org/3/whatsnew/3.9.html#c-api-changes). Other than that, looks fine to me.

----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41784>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:45:01 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 21:45:01 +0000
Subject: [issue37461] email.parser.Parser hang
In-Reply-To: <1561951273.26.0.821144691276.issue37461@roundup.psfhosted.org>
Message-ID: <1603143901.62.0.212262107159.issue37461@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

Thanks everyone for the fixes; I think this bug is now resolved.  Closing.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37461>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:50:00 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 21:50:00 +0000
Subject: [issue33972] AttributeError in email.message.iter_attachments()
In-Reply-To: <1530024211.47.0.56676864532.issue33972@psf.upfronthosting.co.za>
Message-ID: <1603144200.74.0.703146663815.issue33972@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

Thank you all for the fix.  Closing.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33972>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:50:53 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 19 Oct 2020 21:50:53 +0000
Subject: [issue42064] Convert sqlite3 to multi-phase initialisation (PEP 489)
In-Reply-To: <1602963425.44.0.576962569847.issue42064@roundup.psfhosted.org>
Message-ID: <1603144253.27.0.247296992209.issue42064@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Work with item 7 is progressing; see WIP branch for details. Current showstopper is how to fetch module state from Connection.__init__ when it has been overloaded (for example in /Lib/sqlite3/test/factory.py). Guessing that Py_TYPE(self) does not return the sqlite3.Connection type.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42064>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:51:20 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 19 Oct 2020 21:51:20 +0000
Subject: [issue41746] Add optional type information to asdl_seq objects
In-Reply-To: <1599597077.35.0.913235954629.issue41746@roundup.psfhosted.org>
Message-ID: <1603144280.68.0.0841746948229.issue41746@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
pull_requests: +21743
pull_request: https://github.com/python/cpython/pull/22786

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41746>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:54:02 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 21:54:02 +0000
Subject: [issue39825] EXT_SUFFIX inconsistent between sysconfig and
 distutils.sysconfig (Windows)
In-Reply-To: <1583156407.62.0.364374237882.issue39825@roundup.psfhosted.org>
Message-ID: <1603144442.13.0.920382801932.issue39825@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Agreed, this should be updated.

3.7 is out of scope, I'm afraid, but 3.8 onwards should be fine.

----------
versions: +Python 3.10 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39825>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:03:07 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:03:07 +0000
Subject: [issue41292] Dead link in Windows FAQ
In-Reply-To: <1594651776.92.0.628399384515.issue41292@roundup.psfhosted.org>
Message-ID: <1603144987.85.0.196454318867.issue41292@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21744
pull_request: https://github.com/python/cpython/pull/22788

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41292>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:03:14 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:03:14 +0000
Subject: [issue41292] Dead link in Windows FAQ
In-Reply-To: <1594651776.92.0.628399384515.issue41292@roundup.psfhosted.org>
Message-ID: <1603144994.98.0.696602022086.issue41292@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21745
pull_request: https://github.com/python/cpython/pull/22789

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41292>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:02:50 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 22:02:50 +0000
Subject: [issue41292] Dead link in Windows FAQ
In-Reply-To: <1594651776.92.0.628399384515.issue41292@roundup.psfhosted.org>
Message-ID: <1603144970.9.0.0842731099171.issue41292@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 33242a9328cb3912f02819d2d092bf89681000b2 by Michel Samia in branch 'master':
bpo-41292: Fixes dead link to cx_freeze from Windows FAQ (GH-21463)
https://github.com/python/cpython/commit/33242a9328cb3912f02819d2d092bf89681000b2


----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41292>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:04:43 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 22:04:43 +0000
Subject: [issue41292] Dead link in Windows FAQ
In-Reply-To: <1594651776.92.0.628399384515.issue41292@roundup.psfhosted.org>
Message-ID: <1603145083.2.0.236514624465.issue41292@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41292>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:05:36 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Mon, 19 Oct 2020 22:05:36 +0000
Subject: [issue38145] Fix short option 'd' in 'distutils' command 'bdist_dumb'
In-Reply-To: <1568313123.54.0.58284352566.issue38145@roundup.psfhosted.org>
Message-ID: <1603145136.8.0.137079804198.issue38145@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Thanks for the report and patch, but considering that distutils is mostly frozen and on its way out of the stdlib, also that bdist_dump is not a format that?s really suitable for anything (people use sdists and wheels), I am inclined to close this.

Setuptools maintainers have adopted (copied) distutils to simplify setuptools, and the bug is present there too, so you could report the bug there: https://github.com/pypa/distutils/blob/master/distutils/command/bdist_dumb.py

----------
assignee:  -> eric.araujo
resolution:  -> wont fix
stage: patch review -> 
status: open -> pending
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38145>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:06:12 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 22:06:12 +0000
Subject: [issue16396] Importing ctypes.wintypes on Linux gives a ValueError
 instead of an ImportError
In-Reply-To: <1351956172.0.0.64927799046.issue16396@psf.upfronthosting.co.za>
Message-ID: <1603145172.61.0.601263043482.issue16396@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 5456e78f4593edc277ab72fb9a9db1ebae7d4c2d by Jason R. Coombs in branch 'master':
bpo-16396: Allow wintypes to be imported on non-Windows systems. (GH-21394)
https://github.com/python/cpython/commit/5456e78f4593edc277ab72fb9a9db1ebae7d4c2d


----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16396>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:06:28 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:06:28 +0000
Subject: [issue16396] Importing ctypes.wintypes on Linux gives a ValueError
 instead of an ImportError
In-Reply-To: <1351956172.0.0.64927799046.issue16396@psf.upfronthosting.co.za>
Message-ID: <1603145188.76.0.773961492679.issue16396@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 11.0 -> 12.0
pull_requests: +21746
pull_request: https://github.com/python/cpython/pull/22790

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16396>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:07:07 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 22:07:07 +0000
Subject: [issue16396] Importing ctypes.wintypes on Linux gives a ValueError
 instead of an ImportError
In-Reply-To: <1351956172.0.0.64927799046.issue16396@psf.upfronthosting.co.za>
Message-ID: <1603145227.34.0.63936470308.issue16396@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16396>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:06:37 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:06:37 +0000
Subject: [issue16396] Importing ctypes.wintypes on Linux gives a ValueError
 instead of an ImportError
In-Reply-To: <1351956172.0.0.64927799046.issue16396@psf.upfronthosting.co.za>
Message-ID: <1603145197.06.0.81654030036.issue16396@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21747
pull_request: https://github.com/python/cpython/pull/22791

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16396>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:07:16 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Mon, 19 Oct 2020 22:07:16 +0000
Subject: [issue6164] [AIX] Patch to correct the AIX C/C++ linker argument used
 for 'runtime_library_dirs'
In-Reply-To: <1243876957.94.0.533443517724.issue6164@psf.upfronthosting.co.za>
Message-ID: <1603145236.59.0.657350998148.issue6164@roundup.psfhosted.org>


Change by ?ric Araujo <merwok at netwok.org>:


----------
resolution:  -> out of date
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6164>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:08:54 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:08:54 +0000
Subject: [issue41217] Obsolete note for default asyncio event loop on Windows
In-Reply-To: <1594023051.16.0.859268804549.issue41217@roundup.psfhosted.org>
Message-ID: <1603145334.79.0.0484367509774.issue41217@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21749
pull_request: https://github.com/python/cpython/pull/22793

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41217>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:08:47 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:08:47 +0000
Subject: [issue41217] Obsolete note for default asyncio event loop on Windows
In-Reply-To: <1594023051.16.0.859268804549.issue41217@roundup.psfhosted.org>
Message-ID: <1603145327.05.0.00166351944999.issue41217@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 8.0 -> 9.0
pull_requests: +21748
pull_request: https://github.com/python/cpython/pull/22792

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41217>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:08:40 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 22:08:40 +0000
Subject: [issue41217] Obsolete note for default asyncio event loop on Windows
In-Reply-To: <1594023051.16.0.859268804549.issue41217@roundup.psfhosted.org>
Message-ID: <1603145320.79.0.265422907809.issue41217@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 4dfb190a33a1deac60306f15d52d2fe11fb93464 by Zackery Spytz in branch 'master':
bpo-41217: Fix incorrect note in the asyncio.create_subprocess_shell() docs (GH-21360)
https://github.com/python/cpython/commit/4dfb190a33a1deac60306f15d52d2fe11fb93464


----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41217>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:12:23 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 22:12:23 +0000
Subject: [issue41217] Obsolete note for default asyncio event loop on Windows
In-Reply-To: <1594023051.16.0.859268804549.issue41217@roundup.psfhosted.org>
Message-ID: <1603145543.87.0.409412807225.issue41217@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41217>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:13:05 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:13:05 +0000
Subject: [issue41292] Dead link in Windows FAQ
In-Reply-To: <1594651776.92.0.628399384515.issue41292@roundup.psfhosted.org>
Message-ID: <1603145585.45.0.44383767057.issue41292@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 4c8da3230a494dac3d7fd3b4396a60038b2be6de by Miss Skeleton (bot) in branch '3.8':
bpo-41292: Fixes dead link to cx_freeze from Windows FAQ (GH-21463)
https://github.com/python/cpython/commit/4c8da3230a494dac3d7fd3b4396a60038b2be6de


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41292>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:17:56 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 22:17:56 +0000
Subject: [issue41784] Promote PyUnicode_AsUTF8AndSize to be available with the
 limited API (PEP 384)
In-Reply-To: <1600112223.54.0.368726029107.issue41784@roundup.psfhosted.org>
Message-ID: <1603145876.95.0.331587558837.issue41784@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 3a8fdb28794b2f19f6c8464378fb8b46bce1f5f4 by Alex Gaynor in branch 'master':
bpo-41784: make PyUnicode_AsUTF8AndSize part of the limited API (GH-22252)
https://github.com/python/cpython/commit/3a8fdb28794b2f19f6c8464378fb8b46bce1f5f4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41784>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:18:07 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 22:18:07 +0000
Subject: [issue41784] Promote PyUnicode_AsUTF8AndSize to be available with the
 limited API (PEP 384)
In-Reply-To: <1600112223.54.0.368726029107.issue41784@roundup.psfhosted.org>
Message-ID: <1603145887.43.0.830956150975.issue41784@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Thanks, Alex!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41784>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:19:03 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:19:03 +0000
Subject: [issue41217] Obsolete note for default asyncio event loop on Windows
In-Reply-To: <1594023051.16.0.859268804549.issue41217@roundup.psfhosted.org>
Message-ID: <1603145943.49.0.341970567666.issue41217@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset dc785db64d55c3d7a69b10c303e6386e87cfd01b by Miss Skeleton (bot) in branch '3.8':
bpo-41217: Fix incorrect note in the asyncio.create_subprocess_shell() docs (GH-21360)
https://github.com/python/cpython/commit/dc785db64d55c3d7a69b10c303e6386e87cfd01b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41217>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:23:14 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 19 Oct 2020 22:23:14 +0000
Subject: [issue41433] Logging libraries BufferingHandler flushed twice at
 shutdown
In-Reply-To: <1596002244.65.0.208232248615.issue41433@roundup.psfhosted.org>
Message-ID: <1603146194.01.0.121665415166.issue41433@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

adamist521, is your issue resolved by now? Does calling flush() on super help?

If not, can you please provide a script demonstrating the problem?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41433>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:24:08 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:24:08 +0000
Subject: [issue41292] Dead link in Windows FAQ
In-Reply-To: <1594651776.92.0.628399384515.issue41292@roundup.psfhosted.org>
Message-ID: <1603146248.32.0.809941484862.issue41292@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset e67f186898b6731b8e8f3f6b07cb0959e9aa0ab6 by Miss Skeleton (bot) in branch '3.9':
bpo-41292: Fixes dead link to cx_freeze from Windows FAQ (GH-21463)
https://github.com/python/cpython/commit/e67f186898b6731b8e8f3f6b07cb0959e9aa0ab6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41292>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:24:41 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Mon, 19 Oct 2020 22:24:41 +0000
Subject: [issue34858] MappingProxy objects should JSON serialize just like a
 dictionary
In-Reply-To: <1538358992.7.0.545547206417.issue34858@psf.upfronthosting.co.za>
Message-ID: <1603146281.62.0.900230520398.issue34858@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

See also #30343

----------
nosy: +eric.araujo

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34858>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:28:44 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 19 Oct 2020 22:28:44 +0000
Subject: [issue22577] local variable changes lost after pdb jump command
In-Reply-To: <1412763709.52.0.382735862315.issue22577@psf.upfronthosting.co.za>
Message-ID: <1603146524.59.0.32752547935.issue22577@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22577>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:29:40 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:29:40 +0000
Subject: [issue16396] Importing ctypes.wintypes on Linux gives a ValueError
 instead of an ImportError
In-Reply-To: <1351956172.0.0.64927799046.issue16396@psf.upfronthosting.co.za>
Message-ID: <1603146580.22.0.678533305547.issue16396@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6e998fad1c92aee9c8c23c5887a7023d76bdf6c2 by Miss Skeleton (bot) in branch '3.8':
bpo-16396: Allow wintypes to be imported on non-Windows systems. (GH-21394)
https://github.com/python/cpython/commit/6e998fad1c92aee9c8c23c5887a7023d76bdf6c2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16396>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:29:44 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 19 Oct 2020 22:29:44 +0000
Subject: [issue26794] curframe can be None in pdb.py
In-Reply-To: <1460965664.24.0.92280915097.issue26794@psf.upfronthosting.co.za>
Message-ID: <1603146584.31.0.663842328775.issue26794@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26794>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:30:43 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:30:43 +0000
Subject: [issue41217] Obsolete note for default asyncio event loop on Windows
In-Reply-To: <1594023051.16.0.859268804549.issue41217@roundup.psfhosted.org>
Message-ID: <1603146643.01.0.248022304464.issue41217@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b62ecc21b451d2b8e041f5367c7b563ac01bbdd8 by Miss Skeleton (bot) in branch '3.9':
bpo-41217: Fix incorrect note in the asyncio.create_subprocess_shell() docs (GH-21360)
https://github.com/python/cpython/commit/b62ecc21b451d2b8e041f5367c7b563ac01bbdd8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41217>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:31:15 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:31:15 +0000
Subject: [issue40901] It's not clear what "interface name" means in socket
 if_nameindex/if_nametoindex/if_indextoname on Windows
In-Reply-To: <1591535857.64.0.826872278568.issue40901@roundup.psfhosted.org>
Message-ID: <1603146675.51.0.511926759059.issue40901@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 7.0 -> 8.0
pull_requests: +21750
pull_request: https://github.com/python/cpython/pull/22794

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40901>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:31:01 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 22:31:01 +0000
Subject: [issue40901] It's not clear what "interface name" means in socket
 if_nameindex/if_nametoindex/if_indextoname on Windows
In-Reply-To: <1591535857.64.0.826872278568.issue40901@roundup.psfhosted.org>
Message-ID: <1603146661.06.0.313983294195.issue40901@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset f85658a09878c658ae0e0590bfa30e4ce51c9a04 by Jakub Stasiak in branch 'master':
bpo-40901: Describe what "interface name" means on Windows (GH-20694)
https://github.com/python/cpython/commit/f85658a09878c658ae0e0590bfa30e4ce51c9a04


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40901>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:31:22 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:31:22 +0000
Subject: [issue40901] It's not clear what "interface name" means in socket
 if_nameindex/if_nametoindex/if_indextoname on Windows
In-Reply-To: <1591535857.64.0.826872278568.issue40901@roundup.psfhosted.org>
Message-ID: <1603146682.81.0.271232809887.issue40901@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21751
pull_request: https://github.com/python/cpython/pull/22795

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40901>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:32:43 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:32:43 +0000
Subject: [issue16396] Importing ctypes.wintypes on Linux gives a ValueError
 instead of an ImportError
In-Reply-To: <1351956172.0.0.64927799046.issue16396@psf.upfronthosting.co.za>
Message-ID: <1603146763.3.0.106712554819.issue16396@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 05d52a0ad69cbadd4b048f2a97991e4e58d4a922 by Miss Skeleton (bot) in branch '3.9':
bpo-16396: Allow wintypes to be imported on non-Windows systems. (GH-21394)
https://github.com/python/cpython/commit/05d52a0ad69cbadd4b048f2a97991e4e58d4a922


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16396>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:32:36 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Mon, 19 Oct 2020 22:32:36 +0000
Subject: [issue30343] Subclassed json.JSONEncoder does not respect default
 method for supported types
In-Reply-To: <1494511106.37.0.544159404801.issue30343@psf.upfronthosting.co.za>
Message-ID: <1603146756.66.0.78342064255.issue30343@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

See also https://bugs.python.org/issue34858

This needs a discussion on python-ideas or -dev.

----------
nosy: +eric.araujo

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30343>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:32:25 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 22:32:25 +0000
Subject: [issue40901] It's not clear what "interface name" means in socket
 if_nameindex/if_nametoindex/if_indextoname on Windows
In-Reply-To: <1591535857.64.0.826872278568.issue40901@roundup.psfhosted.org>
Message-ID: <1603146745.56.0.58048530159.issue40901@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Very helpful contribution! Thank your

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40901>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:39:53 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:39:53 +0000
Subject: [issue40901] It's not clear what "interface name" means in socket
 if_nameindex/if_nametoindex/if_indextoname on Windows
In-Reply-To: <1591535857.64.0.826872278568.issue40901@roundup.psfhosted.org>
Message-ID: <1603147193.13.0.403463628287.issue40901@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 609a38a36f3006ee00eccc18b25e3b2d577a3e56 by Miss Skeleton (bot) in branch '3.8':
bpo-40901: Describe what "interface name" means on Windows (GH-20694)
https://github.com/python/cpython/commit/609a38a36f3006ee00eccc18b25e3b2d577a3e56


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40901>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:41:12 2020
From: report at bugs.python.org (Jakub Stasiak)
Date: Mon, 19 Oct 2020 22:41:12 +0000
Subject: [issue40901] It's not clear what "interface name" means in socket
 if_nameindex/if_nametoindex/if_indextoname on Windows
In-Reply-To: <1591535857.64.0.826872278568.issue40901@roundup.psfhosted.org>
Message-ID: <1603147272.04.0.55115147888.issue40901@roundup.psfhosted.org>


Jakub Stasiak <jakub+python.org at stasiak.at> added the comment:

Cheers!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40901>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:45:55 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Mon, 19 Oct 2020 22:45:55 +0000
Subject: [issue27226] distutils: unable to compile both .opt-1.pyc and
 .opt2.pyc simultaneously
In-Reply-To: <1465106608.99.0.622112847685.issue27226@psf.upfronthosting.co.za>
Message-ID: <1603147555.29.0.941224095535.issue27226@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

FWIW the behaviour in distutils was intended to be controlled by the setup.p options, but in fact also depended on the options of the python command itself (-O and dont-write-bytecode option/envvar).  This was changed in distutils2 but judged too big to fix in distutils: https://hg.python.org/distutils2/rev/7c0a88497b5c

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27226>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:47:44 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 22:47:44 +0000
Subject: [issue41845] Promote PyObject_GenericGetDict to the stable API
In-Reply-To: <1600871509.15.0.3993940648.issue41845@roundup.psfhosted.org>
Message-ID: <1603147664.24.0.459871337847.issue41845@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 1438c2ac773e87d1f9c97fc22f2346e16bf48773 by Zackery Spytz in branch 'master':
bpo-41845: Move PyObject_GenericGetDict() back into the limited API (GH22646)
https://github.com/python/cpython/commit/1438c2ac773e87d1f9c97fc22f2346e16bf48773


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41845>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:49:22 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:49:22 +0000
Subject: [issue27321] Email parser creates a message object that can't be
 flattened
In-Reply-To: <1465930372.53.0.0254623453508.issue27321@psf.upfronthosting.co.za>
Message-ID: <1603147762.35.0.586180948326.issue27321@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset bf838227c35212709dc43b3c3c57f8e1655c1d24 by Mark Sapiro in branch 'master':
bpo-27321 Fix email.generator.py to not replace a non-existent header. (GH-18074)
https://github.com/python/cpython/commit/bf838227c35212709dc43b3c3c57f8e1655c1d24


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27321>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:49:30 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 22:49:30 +0000
Subject: [issue41845] Promote PyObject_GenericGetDict to the stable API
In-Reply-To: <1600871509.15.0.3993940648.issue41845@roundup.psfhosted.org>
Message-ID: <1603147770.69.0.5247255387.issue41845@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Thanks!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41845>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:49:35 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:49:35 +0000
Subject: [issue27321] Email parser creates a message object that can't be
 flattened
In-Reply-To: <1465930372.53.0.0254623453508.issue27321@psf.upfronthosting.co.za>
Message-ID: <1603147775.79.0.0259798989846.issue27321@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21752
pull_request: https://github.com/python/cpython/pull/22796

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27321>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:49:44 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:49:44 +0000
Subject: [issue27321] Email parser creates a message object that can't be
 flattened
In-Reply-To: <1465930372.53.0.0254623453508.issue27321@psf.upfronthosting.co.za>
Message-ID: <1603147784.25.0.924799660166.issue27321@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21753
pull_request: https://github.com/python/cpython/pull/22797

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27321>
_______________________________________

From report at bugs.python.org  Mon Oct 19 18:49:58 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 22:49:58 +0000
Subject: [issue40901] It's not clear what "interface name" means in socket
 if_nameindex/if_nametoindex/if_indextoname on Windows
In-Reply-To: <1591535857.64.0.826872278568.issue40901@roundup.psfhosted.org>
Message-ID: <1603147798.72.0.476042228924.issue40901@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 9308173f880f3c0a6447da8335f3ae68edad3b0f by Miss Skeleton (bot) in branch '3.9':
bpo-40901: Describe what "interface name" means on Windows (GH-20694)
https://github.com/python/cpython/commit/9308173f880f3c0a6447da8335f3ae68edad3b0f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40901>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:02:01 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 23:02:01 +0000
Subject: [issue27321] Email parser creates a message object that can't be
 flattened
In-Reply-To: <1465930372.53.0.0254623453508.issue27321@psf.upfronthosting.co.za>
Message-ID: <1603148521.16.0.574028175824.issue27321@roundup.psfhosted.org>


Change by Barry A. Warsaw <barry at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10, Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27321>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:01:23 2020
From: report at bugs.python.org (Steve Dower)
Date: Mon, 19 Oct 2020 23:01:23 +0000
Subject: [issue38324] [Windows] test_locale and test__locale failures on
 Windows
In-Reply-To: <1569849277.36.0.00648751871696.issue38324@roundup.psfhosted.org>
Message-ID: <1603148483.79.0.290162852966.issue38324@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I just took a look at the PR and I think it's good, but if anyone else wants to have a look before I merge it (probably not today), please do.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38324>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:07:26 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 23:07:26 +0000
Subject: [issue27321] Email parser creates a message object that can't be
 flattened
In-Reply-To: <1465930372.53.0.0254623453508.issue27321@psf.upfronthosting.co.za>
Message-ID: <1603148846.95.0.441515326206.issue27321@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 371146a3f8a989964e2a9c0efc7d776815410fac by Miss Skeleton (bot) in branch '3.8':
bpo-27321 Fix email.generator.py to not replace a non-existent header. (GH-18074)
https://github.com/python/cpython/commit/371146a3f8a989964e2a9c0efc7d776815410fac


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27321>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:11:42 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 19 Oct 2020 23:11:42 +0000
Subject: [issue27321] Email parser creates a message object that can't be
 flattened
In-Reply-To: <1465930372.53.0.0254623453508.issue27321@psf.upfronthosting.co.za>
Message-ID: <1603149102.44.0.3459457619.issue27321@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 72ce82abcf9051b18a05350936de7ecab7306662 by Miss Skeleton (bot) in branch '3.9':
bpo-27321 Fix email.generator.py to not replace a non-existent header. (GH-18074)
https://github.com/python/cpython/commit/72ce82abcf9051b18a05350936de7ecab7306662


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27321>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:16:18 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 23:16:18 +0000
Subject: [issue11414] Add import fix for email.Message
In-Reply-To: <1299428963.38.0.740283733384.issue11414@psf.upfronthosting.co.za>
Message-ID: <1603149378.9.0.700591699842.issue11414@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

Thanks for the PR @iritkatriel but I'm inclined to close this as won't fix.  There are plenty of other changes someone would need to migrate to Python 3 for the email package, so I think this is of limited benefit.

----------
resolution:  -> wont fix
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11414>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:16:15 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 19 Oct 2020 23:16:15 +0000
Subject: [issue40484] Document existing compiler flags under ast
In-Reply-To: <1588514973.24.0.132527747949.issue40484@roundup.psfhosted.org>
Message-ID: <1603149375.39.0.161115092566.issue40484@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40484>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:30:12 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 19 Oct 2020 23:30:12 +0000
Subject: [issue41586] Allow to set pipe size on subprocess.Popen.
In-Reply-To: <1597815960.69.0.196461399013.issue41586@roundup.psfhosted.org>
Message-ID: <1603150212.22.0.882828050554.issue41586@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset 23c0fb8edd16fe6d796df2853a5369fd783e05b7 by Ruben Vorderman in branch 'master':
bpo-41586: Add pipesize parameter to subprocess & F_GETPIPE_SZ and F_SETPIPE_SZ to fcntl. (GH-21921)
https://github.com/python/cpython/commit/23c0fb8edd16fe6d796df2853a5369fd783e05b7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41586>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:30:40 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 19 Oct 2020 23:30:40 +0000
Subject: [issue41586] Allow to set pipe size on subprocess.Popen.
In-Reply-To: <1597815960.69.0.196461399013.issue41586@roundup.psfhosted.org>
Message-ID: <1603150240.58.0.275724741256.issue41586@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Thanks Ruben!

----------
resolution:  -> fixed
stage: patch review -> commit review
status: open -> closed
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41586>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:31:04 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 23:31:04 +0000
Subject: [issue1823] Possible to set invalid Content-Transfer-Encoding on
 email.mime.multipart.MIMEMultipart
In-Reply-To: <1200309434.22.0.561367082724.issue1823@psf.upfronthosting.co.za>
Message-ID: <1603150264.65.0.524303879053.issue1823@roundup.psfhosted.org>


Change by Barry A. Warsaw <barry at python.org>:


----------
assignee:  -> barry

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1823>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:30:58 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 23:30:58 +0000
Subject: [issue1823] Possible to set invalid Content-Transfer-Encoding on
 email.mime.multipart.MIMEMultipart
In-Reply-To: <1200309434.22.0.561367082724.issue1823@psf.upfronthosting.co.za>
Message-ID: <1603150258.49.0.453313095157.issue1823@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

Updating the Python versions to the only active ones on which this bug could conceivably be fixed.  I haven't validated that it's still a problem, and I haven't decided whether it's appropriate to backport to 3.9 and 3.8.

I'll work on a patch and see how it goes.

----------
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1823>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:41:24 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 19 Oct 2020 23:41:24 +0000
Subject: [issue36541] Make lib2to3 grammar better match Python,
 support the := walrus
In-Reply-To: <1554514880.92.0.277848417721.issue36541@roundup.psfhosted.org>
Message-ID: <1603150884.08.0.708993547966.issue36541@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Parsing support for `f(**mapping)` support is indeed still missing.

as lib2to3 is pending deprecation at this point, i'm not going to work on this.  anyone is welcome to pick it up.  modifying the lib2to3 grammar, and any related code, and adding a test is what's needed to parse that syntax.

----------
assignee: gregory.p.smith -> 
stage: patch review -> needs patch
versions: +Python 3.10 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36541>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:43:35 2020
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 19 Oct 2020 23:43:35 +0000
Subject: [issue38324] [Windows] test_locale and test__locale failures on
 Windows
In-Reply-To: <1569849277.36.0.00648751871696.issue38324@roundup.psfhosted.org>
Message-ID: <1603151015.89.0.230551024469.issue38324@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

PR 20529 looks good to me. Thank you, Tiago.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38324>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:48:02 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 23:48:02 +0000
Subject: [issue41988] No hyphen in broken up word in documentation
In-Reply-To: <1602276270.7.0.489043595778.issue41988@roundup.psfhosted.org>
Message-ID: <1603151282.37.0.570729719181.issue41988@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

I am seeing this in Brave (a Chrome derivative).  Many examples in https://docs.python.org/3/library/email.html

See the words "in\nterface" and "ob\nject' in the attached screenshot.

----------
nosy: +barry
Added file: https://bugs.python.org/file49530/Screen Shot 2020-10-19 at 16.46.44.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41988>
_______________________________________

From report at bugs.python.org  Mon Oct 19 19:58:59 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 19 Oct 2020 23:58:59 +0000
Subject: [issue1823] Possible to set invalid Content-Transfer-Encoding on
 email.mime.multipart.MIMEMultipart
In-Reply-To: <1200309434.22.0.561367082724.issue1823@psf.upfronthosting.co.za>
Message-ID: <1603151939.01.0.923169614416.issue1823@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

The other question is what to do about `EmailMessage` objects, which don't have a `set_charset()` method.  For now, I'll ignore that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1823>
_______________________________________

From report at bugs.python.org  Mon Oct 19 20:06:35 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Tue, 20 Oct 2020 00:06:35 +0000
Subject: [issue1823] Possible to set invalid Content-Transfer-Encoding on
 email.mime.multipart.MIMEMultipart
In-Reply-To: <1200309434.22.0.561367082724.issue1823@psf.upfronthosting.co.za>
Message-ID: <1603152395.39.0.948601203562.issue1823@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

Actually, I think I am going to close this as won't fix, for two reasons.

First, this only potentially affects the legacy API, and second, in Python 3, the error you get when you do it like the original repro example seems obvious to me.

```
>>> mp = MIMEMultipart()
>>> t = MIMEText('sample text')
>>> mp.attach(t)
>>> mp.set_charset('utf-8')
Traceback (most recent call last):
  File "/Users/barry/projects/python/cpython/Lib/email/message.py", line 356, in set_charset
    cte(self)
TypeError: 'str' object is not callable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/barry/projects/python/cpython/Lib/email/message.py", line 364, in set_charset
    payload = payload.encode('ascii', 'surrogateescape')
AttributeError: 'list' object has no attribute 'encode'
```

----------
resolution:  -> wont fix
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1823>
_______________________________________

From report at bugs.python.org  Mon Oct 19 20:08:59 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 20 Oct 2020 00:08:59 +0000
Subject: [issue38324] [Windows] test__locale fails on Windows local machines
In-Reply-To: <1569849277.36.0.00648751871696.issue38324@roundup.psfhosted.org>
Message-ID: <1603152539.81.0.191620401438.issue38324@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

This issue *is* a duplicate of #37945 with respect to test_locale.  So I remove that from the title.  It is not a duplicate with respect to test__locale, which fails for a very different reason.  The other failures I mentioned are noise here (and now fixed).  So when PR-20529 is merged (it fixes test__locale for me also), we can close this.

----------
title: [Windows] test_locale and test__locale failures on Windows -> [Windows] test__locale fails on Windows local machines

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38324>
_______________________________________

From report at bugs.python.org  Mon Oct 19 20:15:16 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 20 Oct 2020 00:15:16 +0000
Subject: [issue37945] [Windows] locale.getdefaultlocale() issues on Windows:
 test_locale.test_getsetlocale_issue1813()
In-Reply-To: <1566754401.97.0.888593384986.issue37945@roundup.psfhosted.org>
Message-ID: <1603152916.8.0.767777648228.issue37945@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

test__locale (#38324) also passed CI and buildbots while failing locally.

----------
nosy: +terry.reedy
stage:  -> needs patch
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37945>
_______________________________________

From report at bugs.python.org  Mon Oct 19 20:17:25 2020
From: report at bugs.python.org (Daniel Lenski)
Date: Tue, 20 Oct 2020 00:17:25 +0000
Subject: [issue2190] MozillaCookieJar ignores HttpOnly cookies
In-Reply-To: <1203957546.34.0.123660895963.issue2190@psf.upfronthosting.co.za>
Message-ID: <1603153045.38.0.449511075742.issue2190@roundup.psfhosted.org>


Change by Daniel Lenski <dlenski at gmail.com>:


----------
title: MozillaCookieJar ignore HttpOnly cookies -> MozillaCookieJar ignores HttpOnly cookies

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2190>
_______________________________________

From report at bugs.python.org  Mon Oct 19 20:25:28 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 20 Oct 2020 00:25:28 +0000
Subject: [issue41988] No hyphen in broken up word in documentation
In-Reply-To: <1602276270.7.0.489043595778.issue41988@roundup.psfhosted.org>
Message-ID: <1603153528.69.0.243819362834.issue41988@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Perhaps send the screenshot to the Brave devs, along with the doc url.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41988>
_______________________________________

From report at bugs.python.org  Mon Oct 19 20:25:54 2020
From: report at bugs.python.org (Roundup Robot)
Date: Tue, 20 Oct 2020 00:25:54 +0000
Subject: [issue2190] MozillaCookieJar ignores HttpOnly cookies
In-Reply-To: <1203957546.34.0.123660895963.issue2190@psf.upfronthosting.co.za>
Message-ID: <1603153554.43.0.0883059341247.issue2190@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
nosy: +python-dev
nosy_count: 7.0 -> 8.0
pull_requests: +21754
pull_request: https://github.com/python/cpython/pull/22798

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2190>
_______________________________________

From report at bugs.python.org  Mon Oct 19 20:32:02 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 20 Oct 2020 00:32:02 +0000
Subject: [issue40133] Provide additional matchers for unittest.mock
In-Reply-To: <1585735205.76.0.306632606173.issue40133@roundup.psfhosted.org>
Message-ID: <1603153922.42.0.707151774254.issue40133@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

based on the reaction from those who own mock at this point, i'm going to close this.  shipping more handy mock matchers with mock makes sense to me as they belong together.  but i'm not willing to argue it if anyone thinks it'll be a maintenance burden within the stdlib.

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40133>
_______________________________________

From report at bugs.python.org  Mon Oct 19 20:33:39 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 20 Oct 2020 00:33:39 +0000
Subject: [issue13501] Make libedit support more generic;
 port readline / libedit to FreeBSD
In-Reply-To: <1322579942.3.0.601983912656.issue13501@psf.upfronthosting.co.za>
Message-ID: <1603154019.08.0.68009133944.issue13501@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13501>
_______________________________________

From report at bugs.python.org  Mon Oct 19 21:19:00 2020
From: report at bugs.python.org (Kyle Stanley)
Date: Tue, 20 Oct 2020 01:19:00 +0000
Subject: [issue38912] test_asyncio altered the execution environment
In-Reply-To: <1574729421.23.0.927917235759.issue38912@roundup.psfhosted.org>
Message-ID: <1603156740.46.0.414242386159.issue38912@roundup.psfhosted.org>


Kyle Stanley <aeros167 at gmail.com> added the comment:


New changeset de73d432bb29f6439f2db16cb991e15e09c70c26 by Justin Turner Arthur in branch 'master':
bpo-38912: fix close before connect callback in test_asyncio SSL tests (GH-22691)
https://github.com/python/cpython/commit/de73d432bb29f6439f2db16cb991e15e09c70c26


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38912>
_______________________________________

From report at bugs.python.org  Mon Oct 19 21:19:22 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 01:19:22 +0000
Subject: [issue38912] test_asyncio altered the execution environment
In-Reply-To: <1574729421.23.0.927917235759.issue38912@roundup.psfhosted.org>
Message-ID: <1603156762.79.0.156530295096.issue38912@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21757
pull_request: https://github.com/python/cpython/pull/22800

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38912>
_______________________________________

From report at bugs.python.org  Mon Oct 19 21:19:15 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 01:19:15 +0000
Subject: [issue38912] test_asyncio altered the execution environment
In-Reply-To: <1574729421.23.0.927917235759.issue38912@roundup.psfhosted.org>
Message-ID: <1603156755.97.0.207644775302.issue38912@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 6.0 -> 7.0
pull_requests: +21756
pull_request: https://github.com/python/cpython/pull/22799

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38912>
_______________________________________

From report at bugs.python.org  Mon Oct 19 21:24:59 2020
From: report at bugs.python.org (Kyle Stanley)
Date: Tue, 20 Oct 2020 01:24:59 +0000
Subject: [issue38912] test_asyncio altered the execution environment
In-Reply-To: <1574729421.23.0.927917235759.issue38912@roundup.psfhosted.org>
Message-ID: <1603157099.23.0.275997073029.issue38912@roundup.psfhosted.org>


Kyle Stanley <aeros167 at gmail.com> added the comment:

I've applied Justin's patch, and opened PRs for backporting to 3.9 and 3.8 (currently waiting on CI). 

Based on my local testing and buildbot fleet results, it definitely reduces the rate at which the failure occurs, but does not 100% resolve the ENV CHANGED failure (from the transport being closed). As a result, I'll leave the issue open for further investigation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38912>
_______________________________________

From report at bugs.python.org  Mon Oct 19 21:29:48 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 20 Oct 2020 01:29:48 +0000
Subject: [issue27898] regexp performance degradation between 2.7.6 and 2.7.12
In-Reply-To: <1472574470.7.0.512575721216.issue27898@psf.upfronthosting.co.za>
Message-ID: <1603157388.61.0.507489215229.issue27898@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

2.7 is end of life.

if you have regular expression performance issues with something in 3, please open a new issue.

----------
nosy: +gregory.p.smith
resolution:  -> wont fix
stage:  -> resolved
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27898>
_______________________________________

From report at bugs.python.org  Mon Oct 19 21:40:09 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 01:40:09 +0000
Subject: [issue38912] test_asyncio altered the execution environment
In-Reply-To: <1574729421.23.0.927917235759.issue38912@roundup.psfhosted.org>
Message-ID: <1603158009.79.0.348603292993.issue38912@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset e43bee7e114ec361efde34f4b546f984574e6653 by Miss Skeleton (bot) in branch '3.9':
bpo-38912: fix close before connect callback in test_asyncio SSL tests (GH-22691)
https://github.com/python/cpython/commit/e43bee7e114ec361efde34f4b546f984574e6653


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38912>
_______________________________________

From report at bugs.python.org  Mon Oct 19 21:44:09 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 01:44:09 +0000
Subject: [issue38912] test_asyncio altered the execution environment
In-Reply-To: <1574729421.23.0.927917235759.issue38912@roundup.psfhosted.org>
Message-ID: <1603158249.04.0.345695717724.issue38912@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 3faef630a44be2d1ea5516e85e95fef4fd027a95 by Miss Skeleton (bot) in branch '3.8':
bpo-38912: fix close before connect callback in test_asyncio SSL tests (GH-22691)
https://github.com/python/cpython/commit/3faef630a44be2d1ea5516e85e95fef4fd027a95


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38912>
_______________________________________

From report at bugs.python.org  Mon Oct 19 21:57:37 2020
From: report at bugs.python.org (Ned Deily)
Date: Tue, 20 Oct 2020 01:57:37 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603159057.01.0.213077272283.issue42051@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
nosy: +ned.deily
nosy_count: 5.0 -> 6.0
pull_requests: +21758
pull_request: https://github.com/python/cpython/pull/22801

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Mon Oct 19 21:58:46 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 20 Oct 2020 01:58:46 +0000
Subject: [issue1260171] subprocess: more general (non-buffering) communication
Message-ID: <1603159126.59.0.71278277783.issue1260171@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

since the time this was filed, subprocess has evolved a lot and third party options for child process have appeared as well as modern things like:

https://docs.python.org/3/library/asyncio-subprocess.html (stdlib)

https://trio.readthedocs.io/en/stable/reference-io.html?highlight=subprocess#options-for-starting-subprocesses (trio, easier async framework to use than asyncio)

plumbing stdin/stdout/stderr data to python file-like objects from the stdlib subprocess APIs themselves is better left to third party solutions building on top of the subprocess module today.

----------
assignee:  -> gregory.p.smith
nosy: +gregory.p.smith
resolution:  -> wont fix
stage: test needed -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1260171>
_______________________________________

From report at bugs.python.org  Mon Oct 19 22:23:44 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 20 Oct 2020 02:23:44 +0000
Subject: [issue40380] OS-related test failures on Linux in Python 3.8.2
In-Reply-To: <1587757709.05.0.540074868271.issue40380@roundup.psfhosted.org>
Message-ID: <1603160624.0.0.465810789132.issue40380@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40380>
_______________________________________

From report at bugs.python.org  Mon Oct 19 22:24:36 2020
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 20 Oct 2020 02:24:36 +0000
Subject: [issue42057] peephole optimizer bug relating to JUMP_IF_NOT_EXC_MATCH
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1603160676.29.0.0964801222983.issue42057@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
title: pytest case which catch  exceptions become segfault -> peephole optimizer bug relating to JUMP_IF_NOT_EXC_MATCH

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Mon Oct 19 22:26:15 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 20 Oct 2020 02:26:15 +0000
Subject: [issue38456] Reduce the time test_subprocess takes to complete.
In-Reply-To: <1570915664.41.0.600749429007.issue38456@roundup.psfhosted.org>
Message-ID: <1603160775.27.0.506605261284.issue38456@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

the slowest tests on Linux today (with number of seconds prepended on my system that runs the suite serially in 34 seconds on a debug build):


3.01 test_check_output_stdout_arg (test.test_subprocess.ProcessTestCaseNoPoll) ... ok
3.01 test_check_output_stdout_arg (test.test_subprocess.ProcessTestCase) ... ok
3.0 test_check_output_stdin_with_input_arg (test.test_subprocess.RunFuncTestCase) ... ok
2.28 test_issue8780 (test.test_subprocess.ProcessTestCase) ... ok
2.27 test_issue8780 (test.test_subprocess.ProcessTestCaseNoPoll) ... ok
2.04 test_communicate_BrokenPipeError_stdin_write (test.test_subprocess.POSIXProcessTestCase) ... ok
1.45 test_leak_fast_process_del_killed (test.test_subprocess.POSIXProcessTestCase) ... ok
1.04 test_communicate_stdout (test.test_subprocess.ProcessTestCase) ... ok
1.03 test_communicate_stdout (test.test_subprocess.ProcessTestCaseNoPoll) ... ok
1.03 test_kill (test.test_subprocess.POSIXProcessTestCase) ... ok
1.03 test_send_signal (test.test_subprocess.POSIXProcessTestCase) ... ok
1.03 test_terminate (test.test_subprocess.POSIXProcessTestCase) ... ok
0.636 test_communicate_timeout (test.test_subprocess.ProcessTestCase) ... ok
0.636 test_communicate_timeout (test.test_subprocess.ProcessTestCaseNoPoll) ... ok
0.58 test_swap_fds (test.test_subprocess.POSIXProcessTestCase) ... ok

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38456>
_______________________________________

From report at bugs.python.org  Mon Oct 19 22:34:38 2020
From: report at bugs.python.org (Benjamin Peterson)
Date: Tue, 20 Oct 2020 02:34:38 +0000
Subject: [issue42060] Usage of assert in http/client.py
In-Reply-To: <1602939189.16.0.999843550668.issue42060@roundup.psfhosted.org>
Message-ID: <1603161278.09.0.621624616093.issue42060@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:

Are these assertion failures actually reachable due to malformed input? If so, there should be some tests to that effect. Otherwise, if they're actually "impossible" situations, I don't think this change is necessary.

----------
nosy: +benjamin.peterson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42060>
_______________________________________

From report at bugs.python.org  Mon Oct 19 22:34:46 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 02:34:46 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603161286.66.0.135095793754.issue42051@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 479553c7c11306a09ce34edb6ef208133b7b95fe by Miss Skeleton (bot) in branch '3.9':
bpo-42051: Reject XML entity declarations in plist files (GH-22760)
https://github.com/python/cpython/commit/479553c7c11306a09ce34edb6ef208133b7b95fe


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Mon Oct 19 22:35:27 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 02:35:27 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603161327.67.0.710795501404.issue42051@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 65894cac0835cb8f469f649e20aa1be8bf89f5ae by Miss Skeleton (bot) in branch '3.8':
bpo-42051: Reject XML entity declarations in plist files (GH-22760)
https://github.com/python/cpython/commit/65894cac0835cb8f469f649e20aa1be8bf89f5ae


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Mon Oct 19 22:36:34 2020
From: report at bugs.python.org (Ned Deily)
Date: Tue, 20 Oct 2020 02:36:34 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603161394.84.0.129537784975.issue42051@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset e512bc799e3864fe3b1351757261762d63471efc by Ned Deily in branch '3.7':
bpo-42051: Reject XML entity declarations in plist files (#22760) (GH-22801)
https://github.com/python/cpython/commit/e512bc799e3864fe3b1351757261762d63471efc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Mon Oct 19 22:38:43 2020
From: report at bugs.python.org (Ned Deily)
Date: Tue, 20 Oct 2020 02:38:43 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1603161523.5.0.197332197784.issue41944@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 43e523103886af66d6c27cd72431b5d9d14cd2a9 by Miss Skeleton (bot) in branch '3.7':
bpo-41944: No longer call eval() on content received via HTTP in the CJK codec tests (GH-22566) (GH-22578)
https://github.com/python/cpython/commit/43e523103886af66d6c27cd72431b5d9d14cd2a9


----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Mon Oct 19 22:45:40 2020
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 20 Oct 2020 02:45:40 +0000
Subject: [issue42057] peephole optimizer bug relating to JUMP_IF_NOT_EXC_MATCH
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1603161940.31.0.182316706894.issue42057@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +21759
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22802

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Mon Oct 19 23:11:45 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 20 Oct 2020 03:11:45 +0000
Subject: [issue42090] zipfile.Path.joinpath API inconsistent with
 pathlib.Path.joinpath
In-Reply-To: <1603141108.13.0.969027124293.issue42090@roundup.psfhosted.org>
Message-ID: <1603163505.89.0.5666128946.issue42090@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +jaraco

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42090>
_______________________________________

From report at bugs.python.org  Mon Oct 19 23:18:36 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 20 Oct 2020 03:18:36 +0000
Subject: [issue42093] Add opcode cache for LOAD_ATTR
Message-ID: <1603163916.18.0.528007796853.issue42093@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

>From the creators of "opcode cache for LOAD_GLOBAL" (https://bugs.python.org/issue26219) now it's time for "opcode cache for LOAD_ATTR: the revenge". This issue/PR builds on top of Yury's original patch in the same way https://bugs.python.org/issue26219 did for LOAD_GLOBAL. 

These are the benchmark results for the pyperformance test suite with PGO/LTO/CPU ISOLATION in a tuned system with pyperf:

+-------------------------+--------------------------------------+-------------------------------------+
| Benchmark               | 2020-10-20_01-18-master-de73d432bb29 | 2020-10-20_02-28-cache-68f931f6938a |
+=========================+======================================+=====================================+
| go                      | 407 ms                               | 349 ms: 1.17x faster (-14%)         |
+-------------------------+--------------------------------------+-------------------------------------+
| raytrace                | 822 ms                               | 730 ms: 1.13x faster (-11%)         |
+-------------------------+--------------------------------------+-------------------------------------+
| unpickle_pure_python    | 497 us                               | 447 us: 1.11x faster (-10%)         |
+-------------------------+--------------------------------------+-------------------------------------+
| scimark_sor             | 311 ms                               | 280 ms: 1.11x faster (-10%)         |
+-------------------------+--------------------------------------+-------------------------------------+
| hexiom                  | 15.4 ms                              | 14.0 ms: 1.10x faster (-9%)         |
+-------------------------+--------------------------------------+-------------------------------------+
| logging_silent          | 302 ns                               | 276 ns: 1.10x faster (-9%)          |
+-------------------------+--------------------------------------+-------------------------------------+
| chaos                   | 176 ms                               | 163 ms: 1.08x faster (-7%)          |
+-------------------------+--------------------------------------+-------------------------------------+
| pyflate                 | 1.01 sec                             | 948 ms: 1.06x faster (-6%)          |
+-------------------------+--------------------------------------+-------------------------------------+
| scimark_lu              | 246 ms                               | 232 ms: 1.06x faster (-6%)          |
+-------------------------+--------------------------------------+-------------------------------------+
| pickle_pure_python      | 712 us                               | 674 us: 1.06x faster (-5%)          |
+-------------------------+--------------------------------------+-------------------------------------+
| regex_effbot            | 4.49 ms                              | 4.26 ms: 1.05x faster (-5%)         |
+-------------------------+--------------------------------------+-------------------------------------+
| scimark_monte_carlo     | 160 ms                               | 153 ms: 1.05x faster (-5%)          |
+-------------------------+--------------------------------------+-------------------------------------+
| richards                | 120 ms                               | 115 ms: 1.05x faster (-4%)          |
+-------------------------+--------------------------------------+-------------------------------------+
| 2to3                    | 458 ms                               | 442 ms: 1.04x faster (-4%)          |
+-------------------------+--------------------------------------+-------------------------------------+
| regex_v8                | 33.7 ms                              | 32.5 ms: 1.04x faster (-3%)         |
+-------------------------+--------------------------------------+-------------------------------------+
| scimark_sparse_mat_mult | 7.16 ms                              | 6.93 ms: 1.03x faster (-3%)         |
+-------------------------+--------------------------------------+-------------------------------------+
| deltablue               | 12.1 ms                              | 11.7 ms: 1.03x faster (-3%)         |
+-------------------------+--------------------------------------+-------------------------------------+
| regex_dna               | 268 ms                               | 261 ms: 1.03x faster (-3%)          |
+-------------------------+--------------------------------------+-------------------------------------+
| meteor_contest          | 152 ms                               | 148 ms: 1.03x faster (-3%)          |
+-------------------------+--------------------------------------+-------------------------------------+
| genshi_xml              | 89.0 ms                              | 87.1 ms: 1.02x faster (-2%)         |
+-------------------------+--------------------------------------+-------------------------------------+
| logging_simple          | 12.8 us                              | 12.5 us: 1.02x faster (-2%)         |
+-------------------------+--------------------------------------+-------------------------------------+
| genshi_text             | 42.4 ms                              | 41.5 ms: 1.02x faster (-2%)         |
+-------------------------+--------------------------------------+-------------------------------------+
| nbody                   | 215 ms                               | 211 ms: 1.02x faster (-2%)          |
+-------------------------+--------------------------------------+-------------------------------------+

Not significant (35): chameleon; django_template; dulwich_log; fannkuch; float; json_dumps; json_loads; logging_format; mako; nqueens; pathlib; pickle; pickle_dict; pickle_list; pidigits; python_startup; python_startup_no_site; regex_compile; scimark_fft; spectral_norm; sqlalchemy_declarative; sqlalchemy_imperative; sqlite_synth; sympy_expand; sympy_sum; sympy_str; telco; tornado_http; unpack_sequence; unpickle; unpickle_list; xml_etree_parse; xml_etree_iterparse; xml_etree_generate; xml_etree_process; sympy_integrate

----------
assignee: pablogsal
components: Interpreter Core
messages: 379083
nosy: pablogsal
priority: normal
severity: normal
status: open
title: Add opcode cache for LOAD_ATTR
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42093>
_______________________________________

From report at bugs.python.org  Mon Oct 19 23:19:20 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 20 Oct 2020 03:19:20 +0000
Subject: [issue42093] Add opcode cache for LOAD_ATTR
In-Reply-To: <1603163916.18.0.528007796853.issue42093@roundup.psfhosted.org>
Message-ID: <1603163960.81.0.521546901387.issue42093@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +21760
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22803

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42093>
_______________________________________

From report at bugs.python.org  Mon Oct 19 23:31:21 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 20 Oct 2020 03:31:21 +0000
Subject: [issue42093] Add opcode cache for LOAD_ATTR
In-Reply-To: <1603163916.18.0.528007796853.issue42093@roundup.psfhosted.org>
Message-ID: <1603164681.41.0.807214705674.issue42093@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42093>
_______________________________________

From report at bugs.python.org  Mon Oct 19 17:36:34 2020
From: report at bugs.python.org (CaptainMitsumoto)
Date: Mon, 19 Oct 2020 21:36:34 +0000
Subject: [issue42074] setup error on windows
In-Reply-To: <1603059379.48.0.235326479045.issue42074@roundup.psfhosted.org>
Message-ID: <CAN7MT1W2Q9fTZD+UzxYjLFXEBcARYEg=hzaJQsGHTmH1YEvJ1A@mail.gmail.com>


CaptainMitsumoto <rikkuguzai at gmail.com> added the comment:

LOG FILE (Occurring yesterday)

I have administrator privileges in my laptop. I have the latest .NET
framework. I tried installing Python before 3.9.0 and no good luck. I'm
using Windows 10 and the version is 1703. I don't think there are problems
with OS installation...

On Mon, Oct 19, 2020 at 6:17 AM Steven D'Aprano <report at bugs.python.org>
wrote:

>
> Steven D'Aprano <steve+python at pearwood.info> added the comment:
>
> Hi CaptainMitsumoto,
>
> Did you follow the instructions given by the installer to read the log
> file? We don't have access to your log file, only you do. Can you see what
> file cannot be found?
>
> Did you try some basic googling? I'm not a Windows guru, but this:
>
>
> https://answers.microsoft.com/en-us/windows/forum/windows_10-windows_install/0x80070002-the-system-cannot-find-the-file/cad10f8d-79f2-4a10-953f-b85478b3e1b7
>
>
> suggests that the problem is related to permissions, or your OS
> installation, not to the installer itself. Do you have administrator
> privileges? Did you check your .Net framework? What version of Windows are
> you using?
>
> If you have already received some suggestions which did not work, would
> you mind telling us what you already tried so we don't waste our time, and
> yours, telling you what you have already tried.
>
> Did you successfully install the older version of Python? If so, there is
> nothing stopping you from coding in 3.8 and upgrading later.
>
> ----------
> nosy: +steven.daprano
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue42074>
> _______________________________________
>

----------
Added file: https://bugs.python.org/file49529/Python 3.9.0 (64-bit)_20201019050706.log

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42074>
_______________________________________
-------------- next part --------------
[25EC:0F98][2020-10-19T05:07:03]i001: Burn v3.11.1.2318, Windows v10.0 (Build 15063: Service Pack 0), path: C:\Users\SOMEUSERC108~1\AppData\Local\Temp\{B0954F86-E2A7-4381-9CA2-792FAC978B58}\.cr\python-3.9.0-amd64.exe
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'ActionLikeInstalling' to value 'Installing'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'ActionLikeInstallation' to value 'Setup'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'ShortVersion' to value '3.9'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'ShortVersionNoDot' to value '39'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'WinVer' to value '3.9'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'WinVerNoDot' to value '39'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'InstallAllUsers' to value '0'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'InstallLauncherAllUsers' to value '1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'TargetDir' to value ''
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'DefaultAllUsersTargetDir' to value '[ProgramFiles64Folder]Python[WinVerNoDot]'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'TargetPlatform' to value 'x64'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'DefaultJustForMeTargetDir' to value '[LocalAppDataFolder]Programs\Python\Python[WinVerNoDot]'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'OptionalFeaturesRegistryKey' to value 'Software\Python\PythonCore\[WinVer]\InstalledFeatures'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'TargetDiSOMEUSERegistryKey' to value 'Software\Python\PythonCore\[WinVer]\InstallPath'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'DefaultCustomTargetDir' to value ''
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'InstallAllUsersState' to value 'enabled'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'InstallLauncherAllUsersState' to value 'enabled'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'CustomInstallLauncherAllUsersState' to value '[InstallLauncherAllUsersState]'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'TargetDirState' to value 'enabled'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'CustomBrowseButtonState' to value 'enabled'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Include_core' to value '1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Include_exe' to value '1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Include_dev' to value '1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Include_lib' to value '1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Include_test' to value '1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Include_doc' to value '1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Include_tools' to value '1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Include_tcltk' to value '1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Include_pip' to value '1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Include_launcher' to value '-1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'Include_launcherState' to value 'enabled'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Include_symbols' to value '0'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Include_debug' to value '0'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'LauncherOnly' to value '0'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'DetectedLauncher' to value '0'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'DetectedOldLauncher' to value '0'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'AssociateFiles' to value '1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'Shortcuts' to value '1'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'PrependPath' to value '0'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'CompileAll' to value '0'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing numeric variable 'SimpleInstall' to value '0'
[25EC:0F98][2020-10-19T05:07:03]i000: Initializing string variable 'SimpleInstallDescription' to value ''
[25EC:0F98][2020-10-19T05:07:03]i009: Command Line: '"-burn.clean.room=C:\Users\ SOMEUSER\Downloads\python-3.9.0-amd64.exe" -burn.filehandle.attached=548 -burn.filehandle.self=632'
[25EC:0F98][2020-10-19T05:07:03]i000: Setting string variable 'WixBundleOriginalSource' to value 'C:\Users\ SOMEUSER\Downloads\python-3.9.0-amd64.exe'
[25EC:0F98][2020-10-19T05:07:03]i000: Setting string variable 'WixBundleOriginalSourceFolder' to value 'C:\Users\SOMEUSER\Downloads\'
[25EC:0F98][2020-10-19T05:07:06]i000: Setting string variable 'WixBundleLog' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706.log'
[25EC:0F98][2020-10-19T05:07:06]i000: Setting string variable 'WixBundleName' to value 'Python 3.9.0 (64-bit)'
[25EC:0F98][2020-10-19T05:07:06]i000: Setting string variable 'WixBundleManufacturer' to value 'Python Software Foundation'
[25EC:0F98][2020-10-19T05:07:06]i000: Setting numeric variable 'CRTInstalled' to value 1
[25EC:2B5C][2020-10-19T05:07:06]i000: Did not find C:\Users\SOMEUSER\Downloads\unattend.xml
[25EC:2B5C][2020-10-19T05:07:06]i000: Setting string variable 'ActionLikeInstalling' to value 'Installing'
[25EC:2B5C][2020-10-19T05:07:06]i000: Setting string variable 'ActionLikeInstallation' to value 'Setup'
[25EC:2B5C][2020-10-19T05:07:06]i000: Setting version variable 'WixBundleFileVersion' to value '3.9.150.0'
[25EC:2B5C][2020-10-19T05:07:06]i000: Target OS is Windows 10 or later
[25EC:0F98][2020-10-19T05:07:06]i100: Detect begin, 52 packages
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: ucrt_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: ucrt_JustForMe, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: core_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: core_AllUsers_pdb, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: core_AllUsers_d, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: core_JustForMe, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: core_JustForMe_pdb, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: core_JustForMe_d, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: dev_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: dev_AllUsers_d, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: dev_JustForMe, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: dev_JustForMe_d, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: exe_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: exe_AllUsers, feature: DefaultFeature, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: exe_AllUsers, feature: Shortcuts, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: exe_AllUsers_pdb, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: exe_AllUsers_d, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: exe_JustForMe, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: exe_JustForMe, feature: DefaultFeature, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: exe_JustForMe, feature: Shortcuts, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: exe_JustForMe_pdb, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: exe_JustForMe_d, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: lib_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: lib_AllUsers_pdb, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: lib_AllUsers_d, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: lib_JustForMe, state: Absent, cached: Complete
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: lib_JustForMe_pdb, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: lib_JustForMe_d, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: test_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: test_AllUsers_pdb, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: test_AllUsers_d, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: test_JustForMe, state: Absent, cached: Complete
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: test_JustForMe_pdb, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: test_JustForMe_d, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: doc_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: doc_AllUsers, feature: DefaultFeature, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: doc_AllUsers, feature: Shortcuts, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: doc_JustForMe, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: doc_JustForMe, feature: DefaultFeature, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: doc_JustForMe, feature: Shortcuts, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: tools_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: tools_JustForMe, state: Absent, cached: Complete
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: tcltk_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: tcltk_AllUsers, feature: DefaultFeature, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: tcltk_AllUsers, feature: AssociateFiles, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: tcltk_AllUsers, feature: Shortcuts, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: tcltk_AllUsers_pdb, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: tcltk_AllUsers_pdb, feature: Symbols, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: tcltk_AllUsers_d, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: tcltk_AllUsers_d, feature: DebugBinaries, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: tcltk_JustForMe, state: Absent, cached: Complete
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: tcltk_JustForMe, feature: DefaultFeature, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: tcltk_JustForMe, feature: AssociateFiles, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: tcltk_JustForMe, feature: Shortcuts, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: tcltk_JustForMe_pdb, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: tcltk_JustForMe_pdb, feature: Symbols, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: tcltk_JustForMe_d, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: tcltk_JustForMe_d, feature: DebugBinaries, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: launcher_AllUsers, state: Absent, cached: Complete
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: launcher_AllUsers, feature: DefaultFeature, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: launcher_AllUsers, feature: AssociateFiles, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: launcher_JustForMe, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: launcher_JustForMe, feature: DefaultFeature, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i104: Detected package: launcher_JustForMe, feature: AssociateFiles, state: Absent
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: pip_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: pip_JustForMe, state: Absent, cached: Complete
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: path_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: path_JustForMe, state: Absent, cached: Complete
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: compileall_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: compileallO_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: compileallOO_AllUsers, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: compileall_JustForMe, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: compileallO_JustForMe, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i101: Detected package: compileallOO_JustForMe, state: Absent, cached: None
[25EC:0F98][2020-10-19T05:07:06]i000: Setting numeric variable 'Include_launcher' to value 1
[25EC:0F98][2020-10-19T05:07:06]i000: Setting string variable 'TargetDir' to value 'C:\Users\SOMEUSER\AppData\Local\Programs\Python\Python39'
[25EC:0F98][2020-10-19T05:07:06]i199: Detect complete, result: 0x0
[25EC:2B5C][2020-10-19T05:07:06]i052: Condition 'not WixBundleElevated and (InstallAllUsers or (Include_launcher and InstallLauncherAllUsers and not DetectedLauncher))' evaluates to true.
[25EC:2B5C][2020-10-19T05:07:17]i000: Setting numeric variable 'InstallLauncherAllUsers' to value 1
[25EC:2B5C][2020-10-19T05:07:17]i000: Setting numeric variable 'PrependPath' to value 1
[25EC:2B5C][2020-10-19T05:07:17]i000: Setting numeric variable 'CompileAll' to value 0
[25EC:2B5C][2020-10-19T05:07:17]i000: Setting string variable 'ActionLikeInstalling' to value 'Installing'
[25EC:2B5C][2020-10-19T05:07:17]i000: Setting string variable 'ActionLikeInstallation' to value 'Setup'
[25EC:0F98][2020-10-19T05:07:17]i200: Plan begin, 52 packages, action: Install
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and not CRTInstalled and (Include_core or Include_exe or Include_pip) and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and not CRTInstalled and (Include_core or Include_exe or Include_pip) and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: ucrt_AllUsers, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and not CRTInstalled and (Include_core or Include_exe or Include_pip) and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and not CRTInstalled and (Include_core or Include_exe or Include_pip) and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and (Include_core or Include_exe or Include_launcher or Include_pip) and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and (Include_core or Include_exe or Include_launcher or Include_pip) and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: core_AllUsers, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and (Include_core or Include_exe or Include_launcher or Include_pip) and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and (Include_core or Include_exe or Include_launcher or Include_pip) and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: core_AllUsers_pdb, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and (Include_core or Include_exe or Include_launcher or Include_pip) and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and (Include_core or Include_exe or Include_launcher or Include_pip) and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: core_AllUsers_d, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and (Include_core or Include_exe or Include_launcher or Include_pip) and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and (Include_core or Include_exe or Include_launcher or Include_pip) and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleRollbackLog_core_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_000_core_JustForMe_rollback.log'
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleLog_core_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_000_core_JustForMe.log'
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and (Include_core or Include_exe or Include_launcher or Include_pip) and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and (Include_core or Include_exe or Include_launcher or Include_pip) and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and (Include_core or Include_exe or Include_launcher or Include_pip) and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and (Include_core or Include_exe or Include_launcher or Include_pip) and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_dev and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_dev and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: dev_AllUsers, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_dev and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_dev and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: dev_AllUsers_d, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_dev and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_dev and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleRollbackLog_dev_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_001_dev_JustForMe_rollback.log'
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleLog_dev_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_001_dev_JustForMe.log'
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_dev and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_dev and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and (Include_exe or Include_launcher or Include_pip) and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and (Include_exe or Include_launcher or Include_pip) and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i204: Plan 2 msi features for package: exe_AllUsers
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: DefaultFeature, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: Shortcuts, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: exe_AllUsers, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and (Include_exe or Include_launcher or Include_pip) and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and (Include_exe or Include_launcher or Include_pip) and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: exe_AllUsers_pdb, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and (Include_exe or Include_launcher or Include_pip) and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and (Include_exe or Include_launcher or Include_pip) and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: exe_AllUsers_d, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and (Include_exe or Include_launcher or Include_pip) and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and (Include_exe or Include_launcher or Include_pip) and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i204: Plan 2 msi features for package: exe_JustForMe
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: DefaultFeature, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: Shortcuts, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleRollbackLog_exe_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_002_exe_JustForMe_rollback.log'
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleLog_exe_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_002_exe_JustForMe.log'
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and (Include_exe or Include_launcher or Include_pip) and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and (Include_exe or Include_launcher or Include_pip) and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and (Include_exe or Include_launcher or Include_pip) and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and (Include_exe or Include_launcher or Include_pip) and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_lib and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_lib and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: lib_AllUsers, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_lib and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_lib and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: lib_AllUsers_pdb, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_lib and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_lib and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: lib_AllUsers_d, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_lib and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_lib and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleRollbackLog_lib_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_003_lib_JustForMe_rollback.log'
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleLog_lib_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_003_lib_JustForMe.log'
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_lib and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_lib and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_lib and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_lib and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_test and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_test and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: test_AllUsers, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_test and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_test and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: test_AllUsers_pdb, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_test and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_test and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: test_AllUsers_d, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_test and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_test and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleRollbackLog_test_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_004_test_JustForMe_rollback.log'
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleLog_test_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_004_test_JustForMe.log'
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_test and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_test and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_test and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_test and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_doc and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_doc and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i204: Plan 2 msi features for package: doc_AllUsers
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: DefaultFeature, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: Shortcuts, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: doc_AllUsers, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_doc and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_doc and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i204: Plan 2 msi features for package: doc_JustForMe
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: DefaultFeature, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: Shortcuts, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleRollbackLog_doc_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_005_doc_JustForMe_rollback.log'
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleLog_doc_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_005_doc_JustForMe.log'
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_tools and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_tools and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: tools_AllUsers, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_tools and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_tools and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleRollbackLog_tools_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_006_tools_JustForMe_rollback.log'
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleLog_tools_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_006_tools_JustForMe.log'
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_tcltk and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_tcltk and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i204: Plan 3 msi features for package: tcltk_AllUsers
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: DefaultFeature, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: AssociateFiles, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: Shortcuts, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: tcltk_AllUsers, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_tcltk and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_tcltk and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i204: Plan 1 msi features for package: tcltk_AllUsers_pdb
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: Symbols, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: tcltk_AllUsers_pdb, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_tcltk and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_tcltk and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i204: Plan 1 msi features for package: tcltk_AllUsers_d
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: DebugBinaries, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: tcltk_AllUsers_d, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_tcltk and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_tcltk and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i204: Plan 3 msi features for package: tcltk_JustForMe
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: DefaultFeature, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: AssociateFiles, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: Shortcuts, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleRollbackLog_tcltk_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_007_tcltk_JustForMe_rollback.log'
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleLog_tcltk_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_007_tcltk_JustForMe.log'
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_tcltk and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_tcltk and Include_symbols and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i204: Plan 1 msi features for package: tcltk_JustForMe_pdb
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: Symbols, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_tcltk and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_tcltk and Include_debug and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i204: Plan 1 msi features for package: tcltk_JustForMe_d
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: DebugBinaries, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i052: Condition '(InstallAllUsers or InstallLauncherAllUsers) and Include_launcher and not DetectedLauncher' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition '(InstallAllUsers or InstallLauncherAllUsers) and Include_launcher and not DetectedLauncher' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i204: Plan 2 msi features for package: launcher_AllUsers
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: DefaultFeature, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: AssociateFiles, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: launcher_AllUsers, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleLog_launcher_AllUsers' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_008_launcher_AllUsers.log'
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not (InstallAllUsers or InstallLauncherAllUsers) and Include_launcher and not DetectedLauncher' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not (InstallAllUsers or InstallLauncherAllUsers) and Include_launcher and not DetectedLauncher' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i204: Plan 2 msi features for package: launcher_JustForMe
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: DefaultFeature, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i203: Planned feature: AssociateFiles, state: Absent, default requested: Unknown, ba requested: Local, execute action: AddLocal, rollback action: Remove
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_pip and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and Include_pip and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: pip_AllUsers, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_pip and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and Include_pip and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleRollbackLog_pip_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_009_pip_JustForMe_rollback.log'
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleLog_pip_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_009_pip_JustForMe.log'
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and PrependPath and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and PrependPath and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w322: Skipping cross-scope dependency registration on package: path_AllUsers, bundle scope: PerUser, package scope: PerMachine
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and PrependPath and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and PrependPath and not LauncherOnly' evaluates to true.
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleRollbackLog_path_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_010_path_JustForMe_rollback.log'
[25EC:0F98][2020-10-19T05:07:17]i000: Setting string variable 'WixBundleLog_path_JustForMe' to value 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_010_path_JustForMe.log'
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and CompileAll and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and CompileAll and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w321: Skipping dependency registration on package with no dependency providers: compileall_AllUsers
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and CompileAll and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and CompileAll and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w321: Skipping dependency registration on package with no dependency providers: compileallO_AllUsers
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and CompileAll and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'InstallAllUsers and CompileAll and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w321: Skipping dependency registration on package with no dependency providers: compileallOO_AllUsers
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and CompileAll and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and CompileAll and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w321: Skipping dependency registration on package with no dependency providers: compileall_JustForMe
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and CompileAll and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and CompileAll and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w321: Skipping dependency registration on package with no dependency providers: compileallO_JustForMe
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and CompileAll and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]i052: Condition 'not InstallAllUsers and CompileAll and not LauncherOnly' evaluates to false.
[25EC:0F98][2020-10-19T05:07:17]w321: Skipping dependency registration on package with no dependency providers: compileallOO_JustForMe
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: ucrt_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: ucrt_JustForMe, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: core_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: core_AllUsers_pdb, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: core_AllUsers_d, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: core_JustForMe, state: Absent, default requested: Present, ba requested: Present, execute: Install, rollback: Uninstall, cache: Yes, uncache: No, dependency: Register
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: core_JustForMe_pdb, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: core_JustForMe_d, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: dev_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: dev_AllUsers_d, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: dev_JustForMe, state: Absent, default requested: Present, ba requested: Present, execute: Install, rollback: Uninstall, cache: Yes, uncache: No, dependency: Register
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: dev_JustForMe_d, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: exe_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: exe_AllUsers_pdb, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: exe_AllUsers_d, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: exe_JustForMe, state: Absent, default requested: Present, ba requested: Present, execute: Install, rollback: Uninstall, cache: Yes, uncache: No, dependency: Register
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: exe_JustForMe_pdb, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: exe_JustForMe_d, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: lib_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: lib_AllUsers_pdb, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: lib_AllUsers_d, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: lib_JustForMe, state: Absent, default requested: Present, ba requested: Present, execute: Install, rollback: Uninstall, cache: No, uncache: No, dependency: Register
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: lib_JustForMe_pdb, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: lib_JustForMe_d, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: test_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: test_AllUsers_pdb, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: test_AllUsers_d, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: test_JustForMe, state: Absent, default requested: Present, ba requested: Present, execute: Install, rollback: Uninstall, cache: No, uncache: No, dependency: Register
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: test_JustForMe_pdb, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: test_JustForMe_d, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: doc_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: doc_JustForMe, state: Absent, default requested: Present, ba requested: Present, execute: Install, rollback: Uninstall, cache: Yes, uncache: No, dependency: Register
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: tools_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: tools_JustForMe, state: Absent, default requested: Present, ba requested: Present, execute: Install, rollback: Uninstall, cache: No, uncache: No, dependency: Register
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: tcltk_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: tcltk_AllUsers_pdb, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: tcltk_AllUsers_d, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: tcltk_JustForMe, state: Absent, default requested: Present, ba requested: Present, execute: Install, rollback: Uninstall, cache: No, uncache: No, dependency: Register
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: tcltk_JustForMe_pdb, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: tcltk_JustForMe_d, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: launcher_AllUsers, state: Absent, default requested: Present, ba requested: Present, execute: Install, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: launcher_JustForMe, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: pip_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: pip_JustForMe, state: Absent, default requested: Present, ba requested: Present, execute: Install, rollback: Uninstall, cache: No, uncache: No, dependency: Register
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: path_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: path_JustForMe, state: Absent, default requested: Present, ba requested: Present, execute: Install, rollback: Uninstall, cache: No, uncache: No, dependency: Register
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: compileall_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: compileallO_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: compileallOO_AllUsers, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: compileall_JustForMe, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: compileallO_JustForMe, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i201: Planned package: compileallOO_JustForMe, state: Absent, default requested: Absent, ba requested: Absent, execute: None, rollback: None, cache: No, uncache: No, dependency: None
[25EC:0F98][2020-10-19T05:07:17]i299: Plan complete, result: 0x0
[25EC:0F98][2020-10-19T05:07:17]i300: Apply begin
[25EC:0F98][2020-10-19T05:07:17]i010: Launching elevated engine process.
[25EC:0F98][2020-10-19T05:07:21]i011: Launched elevated engine process.
[25EC:0F98][2020-10-19T05:07:21]i012: Connected to elevated engine.
[0498:0C70][2020-10-19T05:07:21]i358: Pausing automatic updates.
[0498:0C70][2020-10-19T05:07:21]i359: Paused automatic updates.
[0498:0C70][2020-10-19T05:07:21]i360: Creating a system restore point.
[0498:0C70][2020-10-19T05:07:22]w363: Could not create system restore point, eSOMEUSERor: 0x80070422. Continuing...
[25EC:0F98][2020-10-19T05:07:22]i370: Session begin, registration key: SOFTWARE\Microsoft\Windows\CuSOMEUSERentVersion\Uninstall\{a2a37ca0-8ebd-4d7e-b4b8-e6b1740c2ce0}, options: 0x7, disable resume: No
[25EC:0F98][2020-10-19T05:07:22]i000: Caching bundle from: 'C:\Users\SOMEUSERC108~1\AppData\Local\Temp\{0B8DCD1E-9719-4A78-B263-E4EB6EC0645F}\.be\python-3.9.0-amd64.exe' to: 'C:\Users\SOMEUSER\AppData\Local\Package Cache\{a2a37ca0-8ebd-4d7e-b4b8-e6b1740c2ce0}\python-3.9.0-amd64.exe'
[25EC:0F98][2020-10-19T05:07:22]i320: Registering bundle dependency provider: CPython-3.9, version: 3.9.150.0
[25EC:0F98][2020-10-19T05:07:22]i371: Updating session, registration key: SOFTWARE\Microsoft\Windows\CuSOMEUSERentVersion\Uninstall\{a2a37ca0-8ebd-4d7e-b4b8-e6b1740c2ce0}, resume: Active, restart initiated: No, disable resume: No
[25EC:1D88][2020-10-19T05:07:23]i305: Verified acquired payload: core_JustForMe at path: C:\Users\SOMEUSER\AppData\Local\Package Cache\.unverified\core_JustForMe, moving to: C:\Users\SOMEUSER\AppData\Local\Package Cache\{92F322B1-D69A-43D1-82B4-24ADEBE5C650}v3.9.150.0\core.msi.
[25EC:0F98][2020-10-19T05:07:23]i323: Registering package dependency provider: {92F322B1-D69A-43D1-82B4-24ADEBE5C650}, version: 3.9.150.0, package: core_JustForMe
[25EC:1D88][2020-10-19T05:07:23]i305: Verified acquired payload: dev_JustForMe at path: C:\Users\SOMEUSER\AppData\Local\Package Cache\.unverified\dev_JustForMe, moving to: C:\Users\SOMEUSER\AppData\Local\Package Cache\{E73FE192-7766-49FA-B28A-32F700D98A15}v3.9.150.0\dev.msi.
[25EC:1D88][2020-10-19T05:07:23]i305: Verified acquired payload: exe_JustForMe at path: C:\Users\SOMEUSER\AppData\Local\Package Cache\.unverified\exe_JustForMe, moving to: C:\Users\SOMEUSER\AppData\Local\Package Cache\{A9F718BA-8B5F-4AE7-ADDA-EFFF431948DB}v3.9.150.0\exe.msi.
[25EC:0F98][2020-10-19T05:07:23]i301: Applying execute package: core_JustForMe, action: Install, path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{92F322B1-D69A-43D1-82B4-24ADEBE5C650}v3.9.150.0\core.msi, arguments: ' ARPSYSTEMCOMPONENT="1" MSIFASTINSTALL="7" TARGETDIR="C:\Users\SOMEUSER\AppData\Local\Programs\Python\Python39" OPTIONALFEATURESREGISTRYKEY="Software\Python\PythonCore\3.9\InstalledFeatures"'
[25EC:1D88][2020-10-19T05:07:25]i304: Verified existing payload: lib_JustForMe at path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{42480EE5-670F-4AF3-A619-2E761A398340}v3.9.150.0\lib.msi.
[25EC:1D88][2020-10-19T05:07:25]i304: Verified existing payload: test_JustForMe at path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{9141E990-BD45-4F42-BB32-B3012969355D}v3.9.150.0\test.msi.
[25EC:1D88][2020-10-19T05:07:25]i305: Verified acquired payload: doc_JustForMe at path: C:\Users\SOMEUSER\AppData\Local\Package Cache\.unverified\doc_JustForMe, moving to: C:\Users\SOMEUSER\AppData\Local\Package Cache\{35E94198-B9F1-4D1E-A869-636AD5E6BCA8}v3.9.150.0\doc.msi.
[25EC:1D88][2020-10-19T05:07:25]i304: Verified existing payload: tools_JustForMe at path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{35DC2DFB-0AEA-4DC2-AFA5-4EA2D2612B51}v3.9.150.0\tools.msi.
[25EC:1D88][2020-10-19T05:07:26]i304: Verified existing payload: tcltk_JustForMe at path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{4460A893-EFF6-4B33-BF21-BAA2159F57E6}v3.9.150.0\tcltk.msi.
[0498:250C][2020-10-19T05:07:26]i304: Verified existing payload: launcher_AllUsers at path: C:\ProgramData\Package Cache\{E45E56A4-FCDD-4C4A-966A-4FB81C932219}v3.9.7217.0\launcher.msi.
[25EC:1D88][2020-10-19T05:07:27]i304: Verified existing payload: pip_JustForMe at path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{27FF09D8-6DE6-4F63-A3DD-8758D615D543}v3.9.150.0\pip.msi.
[25EC:0F98][2020-10-19T05:07:27]e000: ESOMEUSERor 0x80070002: Failed to install MSI package.
[25EC:0F98][2020-10-19T05:07:27]e000: ESOMEUSERor 0x80070002: Failed to configure per-user MSI package.
[25EC:0F98][2020-10-19T05:07:27]i319: Applied execute package: core_JustForMe, result: 0x80070002, restart: None
[25EC:0F98][2020-10-19T05:07:27]e000: ESOMEUSERor 0x80070002: Failed to execute MSI package.
[25EC:0F98][2020-10-19T05:07:27]i318: Skipped rollback of package: core_JustForMe, action: Uninstall, already: Absent
[25EC:0F98][2020-10-19T05:07:27]i319: Applied rollback package: core_JustForMe, result: 0x0, restart: None
[25EC:0F98][2020-10-19T05:07:27]i329: Removed package dependency provider: {92F322B1-D69A-43D1-82B4-24ADEBE5C650}, package: core_JustForMe
[25EC:0F98][2020-10-19T05:07:27]i351: Removing cached package: core_JustForMe, from path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{92F322B1-D69A-43D1-82B4-24ADEBE5C650}v3.9.150.0\
[25EC:0F98][2020-10-19T05:07:27]i329: Removed package dependency provider: {3C0B614C-AE7A-4E17-839D-08E1E6C977A1}, package: ucrt_JustForMe
[25EC:1D88][2020-10-19T05:07:27]i304: Verified existing payload: path_JustForMe at path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{4F5E962C-96E9-45B9-8F14-9A91748981C6}v3.9.150.0\path.msi.
[25EC:1D88][2020-10-19T05:07:27]e000: ESOMEUSERor 0x80070642: BA aborted verify of payload: path_JustForMe
[25EC:1D88][2020-10-19T05:07:27]e314: Failed to cache payload: path_JustForMe from working path: C:\Users\SOMEUSERC108~1\AppData\Local\Temp\{0B8DCD1E-9719-4A78-B263-E4EB6EC0645F}\path_JustForMe, eSOMEUSERor: 0x80070642.
[25EC:1D88][2020-10-19T05:07:27]i351: Removing cached package: pip_JustForMe, from path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{27FF09D8-6DE6-4F63-A3DD-8758D615D543}v3.9.150.0\
[25EC:1D88][2020-10-19T05:07:27]i351: Removing cached package: tcltk_JustForMe, from path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{4460A893-EFF6-4B33-BF21-BAA2159F57E6}v3.9.150.0\
[25EC:1D88][2020-10-19T05:07:27]i351: Removing cached package: tools_JustForMe, from path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{35DC2DFB-0AEA-4DC2-AFA5-4EA2D2612B51}v3.9.150.0\
[25EC:1D88][2020-10-19T05:07:27]i351: Removing cached package: doc_JustForMe, from path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{35E94198-B9F1-4D1E-A869-636AD5E6BCA8}v3.9.150.0\
[25EC:1D88][2020-10-19T05:07:27]i351: Removing cached package: test_JustForMe, from path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{9141E990-BD45-4F42-BB32-B3012969355D}v3.9.150.0\
[25EC:1D88][2020-10-19T05:07:27]i351: Removing cached package: lib_JustForMe, from path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{42480EE5-670F-4AF3-A619-2E761A398340}v3.9.150.0\
[25EC:1D88][2020-10-19T05:07:27]i351: Removing cached package: exe_JustForMe, from path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{A9F718BA-8B5F-4AE7-ADDA-EFFF431948DB}v3.9.150.0\
[25EC:1D88][2020-10-19T05:07:27]i351: Removing cached package: dev_JustForMe, from path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{E73FE192-7766-49FA-B28A-32F700D98A15}v3.9.150.0\
[25EC:1D88][2020-10-19T05:07:27]i351: Removing cached package: core_JustForMe, from path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{92F322B1-D69A-43D1-82B4-24ADEBE5C650}v3.9.150.0\
[25EC:1D88][2020-10-19T05:07:27]w353: Unable to remove cached package: core_JustForMe, from path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{92F322B1-D69A-43D1-82B4-24ADEBE5C650}v3.9.150.0\, reason: 0x80070003. Continuing...
[25EC:0F98][2020-10-19T05:07:27]i372: Session end, registration key: SOFTWARE\Microsoft\Windows\CuSOMEUSERentVersion\Uninstall\{a2a37ca0-8ebd-4d7e-b4b8-e6b1740c2ce0}, resume: None, restart: None, disable resume: No
[25EC:0F98][2020-10-19T05:07:27]i330: Removed bundle dependency provider: CPython-3.9
[25EC:0F98][2020-10-19T05:07:27]i352: Removing cached bundle: {a2a37ca0-8ebd-4d7e-b4b8-e6b1740c2ce0}, from path: C:\Users\SOMEUSER\AppData\Local\Package Cache\{a2a37ca0-8ebd-4d7e-b4b8-e6b1740c2ce0}\
[25EC:0F98][2020-10-19T05:07:27]i371: Updating session, registration key: SOFTWARE\Microsoft\Windows\CuSOMEUSERentVersion\Uninstall\{a2a37ca0-8ebd-4d7e-b4b8-e6b1740c2ce0}, resume: None, restart initiated: No, disable resume: No
[25EC:0F98][2020-10-19T05:07:28]i399: Apply complete, result: 0x80070002, restart: None, ba requested restart:  No
[25EC:0F98][2020-10-19T05:07:29]i500: Shutting down, exit code: 0x2
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: ActionLikeInstallation = Setup
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: ActionLikeInstalling = Installing
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: AssociateFiles = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: CompileAll = 0
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: CRTInstalled = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: CustomBrowseButtonState = enabled
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: CustomInstallLauncherAllUsersState = enabled
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: DefaultAllUsersTargetDir = C:\Program Files\Python39
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: DefaultCustomTargetDir = 
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: DefaultJustForMeTargetDir = C:\Users\SOMEUSER\AppData\Local\Programs\Python\Python39
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: DetectedLauncher = 0
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: DetectedOldLauncher = 0
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_core = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_debug = 0
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_dev = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_doc = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_exe = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_launcher = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_launcherState = enabled
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_lib = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_pip = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_symbols = 0
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_tcltk = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_test = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Include_tools = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: InstallAllUsers = 0
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: InstallAllUsersState = enabled
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: InstallLauncherAllUsers = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: InstallLauncherAllUsersState = enabled
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: LauncherOnly = 0
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: LocalAppDataFolder = C:\Users\SOMEUSER\AppData\Local\
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: OptionalFeaturesRegistryKey = Software\Python\PythonCore\3.9\InstalledFeatures
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: PrependPath = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: ProgramFiles64Folder = C:\Program Files\
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: Shortcuts = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: ShortVersion = 3.9
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: ShortVersionNoDot = 39
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: SimpleInstall = 0
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: SimpleInstallDescription = 
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: TargetDir = C:\Users\SOMEUSER\AppData\Local\Programs\Python\Python39
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: TargetDiSOMEUSERegistryKey = Software\Python\PythonCore\3.9\InstallPath
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: TargetDirState = enabled
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: TargetPlatform = x64
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WinVer = 3.9
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WinVerNoDot = 39
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleAction = 5
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleElevated = 1
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleFileVersion = 3.9.150.0
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleInstalled = 0
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleLog = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleLog_core_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_000_core_JustForMe.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleLog_dev_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_001_dev_JustForMe.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleLog_doc_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_005_doc_JustForMe.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleLog_exe_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_002_exe_JustForMe.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleLog_launcher_AllUsers = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_008_launcher_AllUsers.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleLog_lib_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_003_lib_JustForMe.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleLog_path_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_010_path_JustForMe.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleLog_pip_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_009_pip_JustForMe.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleLog_tcltk_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_007_tcltk_JustForMe.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleLog_test_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_004_test_JustForMe.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleLog_tools_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_006_tools_JustForMe.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleManufacturer = Python Software Foundation
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleName = Python 3.9.0 (64-bit)
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleOriginalSource = C:\Users\SOMEUSER\Downloads\python-3.9.0-amd64.exe
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleOriginalSourceFolder = C:\Users\SOMEUSER\Downloads\
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleProviderKey = CPython-3.9
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleRollbackLog_core_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_000_core_JustForMe_rollback.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleRollbackLog_dev_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_001_dev_JustForMe_rollback.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleRollbackLog_doc_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_005_doc_JustForMe_rollback.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleRollbackLog_exe_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_002_exe_JustForMe_rollback.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleRollbackLog_lib_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_003_lib_JustForMe_rollback.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleRollbackLog_path_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_010_path_JustForMe_rollback.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleRollbackLog_pip_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_009_pip_JustForMe_rollback.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleRollbackLog_tcltk_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_007_tcltk_JustForMe_rollback.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleRollbackLog_test_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_004_test_JustForMe_rollback.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleRollbackLog_tools_JustForMe = C:\Users\SOMEUSERC108~1\AppData\Local\Temp\Python 3.9.0 (64-bit)_20201019050706_006_tools_JustForMe_rollback.log
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleSourceProcessFolder = C:\Users\SOMEUSER\Downloads\
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleSourceProcessPath = C:\Users\SOMEUSER\Downloads\python-3.9.0-amd64.exe
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleTag = 
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleUILevel = 4
[25EC:0F98][2020-10-19T05:07:29]i410: Variable: WixBundleVersion = 3.9.150.0
[25EC:0F98][2020-10-19T05:07:29]i007: Exit code: 0x2, restarting: No

From report at bugs.python.org  Tue Oct 20 00:19:17 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 04:19:17 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603167557.36.0.311584424422.issue42051@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21761
pull_request: https://github.com/python/cpython/pull/22804

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Tue Oct 20 00:38:37 2020
From: report at bugs.python.org (Ned Deily)
Date: Tue, 20 Oct 2020 04:38:37 +0000
Subject: [issue42051] plistlib inherits XML vulnerabilities: we should
 document them
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603168717.35.0.418579302436.issue42051@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset a158fb9c5138db94adf24fbc5690467cda811163 by Miss Skeleton (bot) in branch '3.6':
bpo-42051: Reject XML entity declarations in plist files (GH-22760) (GH-22801) (GH-22804)
https://github.com/python/cpython/commit/a158fb9c5138db94adf24fbc5690467cda811163


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Tue Oct 20 00:44:06 2020
From: report at bugs.python.org (Ned Deily)
Date: Tue, 20 Oct 2020 04:44:06 +0000
Subject: [issue42051] [security] Avoid plistlib XML vulnerabilities by
 rejecting entity directives
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603169046.58.0.0581473411751.issue42051@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
keywords: +security_issue
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
title: plistlib inherits XML vulnerabilities: we should document them -> [security] Avoid plistlib XML vulnerabilities by rejecting entity directives
versions: +Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Tue Oct 20 00:46:17 2020
From: report at bugs.python.org (Ned Deily)
Date: Tue, 20 Oct 2020 04:46:17 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1603169177.91.0.673613500022.issue41944@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset e912e945f2960029d039d3390ea08835ad39374b by Miss Skeleton (bot) in branch '3.6':
bpo-41944: No longer call eval() on content received via HTTP in the CJK codec tests (GH-22566) (GH-22579)
https://github.com/python/cpython/commit/e912e945f2960029d039d3390ea08835ad39374b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct 20 00:47:52 2020
From: report at bugs.python.org (Ned Deily)
Date: Tue, 20 Oct 2020 04:47:52 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1603169272.04.0.0590998741468.issue41944@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
keywords: +security_issue
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Tue Oct 20 01:04:39 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 20 Oct 2020 05:04:39 +0000
Subject: [issue4356] Add "key" argument to "bisect" module functions
In-Reply-To: <1227115048.67.0.318831592843.issue4356@psf.upfronthosting.co.za>
Message-ID: <1603170279.39.0.252549141179.issue4356@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4356>
_______________________________________

From report at bugs.python.org  Tue Oct 20 01:04:10 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 20 Oct 2020 05:04:10 +0000
Subject: [issue4356] Add "key" argument to "bisect" module functions
In-Reply-To: <1227115048.67.0.318831592843.issue4356@psf.upfronthosting.co.za>
Message-ID: <1603170250.34.0.510416819845.issue4356@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 871934d4cf00687b3d1411c6e344af311646c1ae by Raymond Hettinger in branch 'master':
bpo-4356: Add key function support to the bisect module (GH-20556)
https://github.com/python/cpython/commit/871934d4cf00687b3d1411c6e344af311646c1ae


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4356>
_______________________________________

From report at bugs.python.org  Tue Oct 20 01:10:17 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 20 Oct 2020 05:10:17 +0000
Subject: [issue41397] Restore default implementation of __ne__ in Counter
In-Reply-To: <1595751952.59.0.424974344046.issue41397@roundup.psfhosted.org>
Message-ID: <1603170617.05.0.371902275717.issue41397@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41397>
_______________________________________

From report at bugs.python.org  Tue Oct 20 01:22:52 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 20 Oct 2020 05:22:52 +0000
Subject: [issue42093] Add opcode cache for LOAD_ATTR
In-Reply-To: <1603163916.18.0.528007796853.issue42093@roundup.psfhosted.org>
Message-ID: <1603171372.52.0.127247587234.issue42093@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 109826c8508dd02e06ae0f1784f1d202495a8680 by Pablo Galindo in branch 'master':
bpo-42093: Add opcode cache for LOAD_ATTR (GH-22803)
https://github.com/python/cpython/commit/109826c8508dd02e06ae0f1784f1d202495a8680


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42093>
_______________________________________

From report at bugs.python.org  Tue Oct 20 01:27:36 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 20 Oct 2020 05:27:36 +0000
Subject: [issue42093] Add opcode cache for LOAD_ATTR
In-Reply-To: <1603163916.18.0.528007796853.issue42093@roundup.psfhosted.org>
Message-ID: <1603171656.24.0.0995580177064.issue42093@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42093>
_______________________________________

From report at bugs.python.org  Tue Oct 20 01:45:04 2020
From: report at bugs.python.org (Markus Israelsson)
Date: Tue, 20 Oct 2020 05:45:04 +0000
Subject: [issue42037] Documentation confusion in CookieJar functions
In-Reply-To: <1602689022.88.0.876415237077.issue42037@roundup.psfhosted.org>
Message-ID: <1603172704.32.0.90539691435.issue42037@roundup.psfhosted.org>


Markus Israelsson <markus.israelsson at surgicalscience.com> added the comment:

The way I read the documentation for add_cookie_header is:

These methods must exist in the Request object:
- get_full_url()
- get_host()
- get_type()
- unverifiable... and so on.


The documentation for the request objects claims however that:
These methods are removed since version 3.4:
- add_data
- has_data
- get_data
- get_type
- get_host - This method , and some others, are listed as requirements for the add_cookie_header and extract_cookies functions. See list above or link I posted above to the correct places in the docs.


So it is only the documentation that is inconsistent. Not the code.
Unless, like I said, I misunderstand something in the documentation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42037>
_______________________________________

From report at bugs.python.org  Tue Oct 20 01:53:07 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 20 Oct 2020 05:53:07 +0000
Subject: [issue38144] Add the root_dir and dir_fd parameters in glob.glob()
In-Reply-To: <1568313061.34.0.998675763501.issue38144@roundup.psfhosted.org>
Message-ID: <1603173187.69.0.966097243732.issue38144@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +21762
pull_request: https://github.com/python/cpython/pull/22805

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38144>
_______________________________________

From report at bugs.python.org  Tue Oct 20 01:54:59 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 20 Oct 2020 05:54:59 +0000
Subject: [issue38144] Add the root_dir and dir_fd parameters in glob.glob()
In-Reply-To: <1568313061.34.0.998675763501.issue38144@roundup.psfhosted.org>
Message-ID: <1603173299.65.0.936013238488.issue38144@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Thank you for catching this. It was an error introduced by merge.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38144>
_______________________________________

From report at bugs.python.org  Tue Oct 20 02:03:12 2020
From: report at bugs.python.org (Stanislav Levin)
Date: Tue, 20 Oct 2020 06:03:12 +0000
Subject: [issue41954] [mock] Recursion on mocking inspect.isfunction
In-Reply-To: <1601968342.61.0.658071347558.issue41954@roundup.psfhosted.org>
Message-ID: <1603173792.04.0.497513061875.issue41954@roundup.psfhosted.org>


Stanislav Levin <slev at altlinux.org> added the comment:

I see, thank you for your time.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41954>
_______________________________________

From report at bugs.python.org  Tue Oct 20 03:13:53 2020
From: report at bugs.python.org (Erik Cederstrand)
Date: Tue, 20 Oct 2020 07:13:53 +0000
Subject: [issue42094] isoformat() / fromisoformat() for datetime.timedelta
Message-ID: <1603178033.64.0.797359415965.issue42094@roundup.psfhosted.org>


New submission from Erik Cederstrand <erik at cederstrand.dk>:

Python 3.7 gained support for parsing ISO 8601 formatted time, date and datetime strings via the fromisoformat() methods. Python has seen improved support for ISO 8601 in general; ISO calendar format codes were added in Python 3.6, and fromisocalendar() was added in Python 3.8.

ISO 8601 also has a standard for durations: https://en.wikipedia.org/wiki/ISO_8601#Durations

For consistency with the other objects in the datetime module, I suggest adding isoformat()/fromisoformat() methods for datetime.timedelta that implement ISO 8601 durations.

ISO 8601 durations support years and months that are not valid timedelta arguments because they are non-precise durations. I suggest throwing an exception if the conversion to or from timedelta cannot be done safely.

https://pypi.org/project/isodate/ implements a parse_duration() method that could be used for inspiration.

----------
components: Library (Lib)
messages: 379091
nosy: Erik Cederstrand
priority: normal
severity: normal
status: open
title: isoformat() / fromisoformat() for datetime.timedelta
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42094>
_______________________________________

From report at bugs.python.org  Tue Oct 20 03:17:30 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 20 Oct 2020 07:17:30 +0000
Subject: [issue41471] After installing python 3.x on Mac pip doesn't work at
 all
In-Reply-To: <1596537267.29.0.654374340764.issue41471@roundup.psfhosted.org>
Message-ID: <1603178250.55.0.59779551237.issue41471@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:


New changeset aa7b03b31bf09b21a012b24e21977538e66b0172 by Miss Skeleton (bot) in branch '3.9':
bpo-41471: Ignore invalid prefix lengths in system proxy settings on macOS (GH-22762) (GH-22773)
https://github.com/python/cpython/commit/aa7b03b31bf09b21a012b24e21977538e66b0172


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41471>
_______________________________________

From report at bugs.python.org  Tue Oct 20 03:18:01 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 20 Oct 2020 07:18:01 +0000
Subject: [issue41471] After installing python 3.x on Mac pip doesn't work at
 all
In-Reply-To: <1596537267.29.0.654374340764.issue41471@roundup.psfhosted.org>
Message-ID: <1603178281.95.0.161944271672.issue41471@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:


New changeset e7c5a43984f82ef9634cb0b2b8c4750b2fd431a0 by Miss Skeleton (bot) in branch '3.8':
bpo-41471: Ignore invalid prefix lengths in system proxy settings on macOS (GH-22762) (GH-22774)
https://github.com/python/cpython/commit/e7c5a43984f82ef9634cb0b2b8c4750b2fd431a0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41471>
_______________________________________

From report at bugs.python.org  Tue Oct 20 03:18:20 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 20 Oct 2020 07:18:20 +0000
Subject: [issue41471] After installing python 3.x on Mac pip doesn't work at
 all
In-Reply-To: <1596537267.29.0.654374340764.issue41471@roundup.psfhosted.org>
Message-ID: <1603178300.81.0.222442274921.issue41471@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41471>
_______________________________________

From report at bugs.python.org  Tue Oct 20 03:24:21 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 20 Oct 2020 07:24:21 +0000
Subject: [issue42095] plistlib: Add tests that compare with plutil(1)
Message-ID: <1603178661.31.0.803001342032.issue42095@roundup.psfhosted.org>


New submission from Ronald Oussoren <ronaldoussoren at mac.com>:

plistlib is a library that reads and writes files that should be compatible with Apple tooling/libraries.

Add some tests that verify interop (when ran on macOS):
- Generate plist files with plistlib and parse with plutil
- Generate plist files with plutil and parse with plistlib

Do this both for xml and binary plist files.

----------
components: Library (Lib), macOS
keywords: easy
messages: 379094
nosy: ned.deily, ronaldoussoren
priority: normal
severity: normal
stage: needs patch
status: open
title: plistlib: Add tests that compare with plutil(1)
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42095>
_______________________________________

From report at bugs.python.org  Tue Oct 20 03:25:20 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 20 Oct 2020 07:25:20 +0000
Subject: [issue42095] plistlib: Add tests that compare with plutil(1)
In-Reply-To: <1603178661.31.0.803001342032.issue42095@roundup.psfhosted.org>
Message-ID: <1603178720.04.0.989428087347.issue42095@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
keywords: +patch
pull_requests: +21763
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22764

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42095>
_______________________________________

From report at bugs.python.org  Tue Oct 20 03:26:41 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 20 Oct 2020 07:26:41 +0000
Subject: [issue41491] plistlib can't load macOS BigSur system LaunchAgent
In-Reply-To: <1596665779.04.0.552451730401.issue41491@roundup.psfhosted.org>
Message-ID: <1603178801.23.0.0637450751074.issue41491@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:


New changeset 3185267400be853404f22a1e06bb9fe1210735c7 by Ronald Oussoren in branch 'master':
bpo-41491: plistlib: accept hexadecimal integer values in xml plist files (GH-22764)
https://github.com/python/cpython/commit/3185267400be853404f22a1e06bb9fe1210735c7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41491>
_______________________________________

From report at bugs.python.org  Tue Oct 20 03:26:47 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 07:26:47 +0000
Subject: [issue41491] plistlib can't load macOS BigSur system LaunchAgent
In-Reply-To: <1596665779.04.0.552451730401.issue41491@roundup.psfhosted.org>
Message-ID: <1603178807.92.0.05315935392.issue41491@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21764
pull_request: https://github.com/python/cpython/pull/22806

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41491>
_______________________________________

From report at bugs.python.org  Tue Oct 20 03:26:55 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 07:26:55 +0000
Subject: [issue41491] plistlib can't load macOS BigSur system LaunchAgent
In-Reply-To: <1596665779.04.0.552451730401.issue41491@roundup.psfhosted.org>
Message-ID: <1603178815.72.0.888555222916.issue41491@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21765
pull_request: https://github.com/python/cpython/pull/22807

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41491>
_______________________________________

From report at bugs.python.org  Tue Oct 20 03:31:20 2020
From: report at bugs.python.org (Erik Cederstrand)
Date: Tue, 20 Oct 2020 07:31:20 +0000
Subject: [issue42094] isoformat() / fromisoformat() for datetime.timedelta
In-Reply-To: <1603178033.64.0.797359415965.issue42094@roundup.psfhosted.org>
Message-ID: <1603179080.06.0.914776714006.issue42094@roundup.psfhosted.org>


Erik Cederstrand <erik at cederstrand.dk> added the comment:

Among other things, ISO 8601 duration strings are commonly used to communicate offset values in timezone definitions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42094>
_______________________________________

From report at bugs.python.org  Tue Oct 20 03:57:56 2020
From: report at bugs.python.org (Martin Panter)
Date: Tue, 20 Oct 2020 07:57:56 +0000
Subject: [issue42094] isoformat() / fromisoformat() for datetime.timedelta
In-Reply-To: <1603178033.64.0.797359415965.issue42094@roundup.psfhosted.org>
Message-ID: <1603180676.85.0.645078670674.issue42094@roundup.psfhosted.org>


Martin Panter <vadmium+py at gmail.com> added the comment:

There is related discussion in Issue 41254, about duration formats more generally.

----------
nosy: +martin.panter

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42094>
_______________________________________

From report at bugs.python.org  Tue Oct 20 04:05:26 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 20 Oct 2020 08:05:26 +0000
Subject: [issue41491] plistlib can't load macOS BigSur system LaunchAgent
In-Reply-To: <1596665779.04.0.552451730401.issue41491@roundup.psfhosted.org>
Message-ID: <1603181126.92.0.684569225472.issue41491@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:


New changeset 3fc7080220b8dd2e1b067b3224879133d895ea80 by Miss Skeleton (bot) in branch '3.9':
bpo-41491: plistlib: accept hexadecimal integer values in xml plist files (GH-22764) (GH-22806)
https://github.com/python/cpython/commit/3fc7080220b8dd2e1b067b3224879133d895ea80


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41491>
_______________________________________

From report at bugs.python.org  Tue Oct 20 04:05:43 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 20 Oct 2020 08:05:43 +0000
Subject: [issue41491] plistlib can't load macOS BigSur system LaunchAgent
In-Reply-To: <1596665779.04.0.552451730401.issue41491@roundup.psfhosted.org>
Message-ID: <1603181143.5.0.386287984025.issue41491@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:


New changeset d1eb75585ef4c108732ec815cdc0adef087b1c3e by Miss Skeleton (bot) in branch '3.8':
bpo-41491: plistlib: accept hexadecimal integer values in xml plist files (GH-22764) (GH-22807)
https://github.com/python/cpython/commit/d1eb75585ef4c108732ec815cdc0adef087b1c3e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41491>
_______________________________________

From report at bugs.python.org  Tue Oct 20 04:06:18 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 20 Oct 2020 08:06:18 +0000
Subject: [issue41491] plistlib can't load macOS BigSur system LaunchAgent
In-Reply-To: <1596665779.04.0.552451730401.issue41491@roundup.psfhosted.org>
Message-ID: <1603181178.27.0.522661036883.issue41491@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41491>
_______________________________________

From report at bugs.python.org  Tue Oct 20 04:10:30 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 20 Oct 2020 08:10:30 +0000
Subject: [issue42095] plistlib: Add tests that compare with plutil(1)
In-Reply-To: <1603178661.31.0.803001342032.issue42095@roundup.psfhosted.org>
Message-ID: <1603181430.65.0.364231824007.issue42095@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Also:
- Tests that verify plutil behaviour (such #41491, #42051, #40381)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42095>
_______________________________________

From report at bugs.python.org  Tue Oct 20 04:13:00 2020
From: report at bugs.python.org (ruozeng.w)
Date: Tue, 20 Oct 2020 08:13:00 +0000
Subject: [issue35608] python3 multiprocessing queue deadlock when use thread
 and process at same time
In-Reply-To: <1546052022.11.0.920360901938.issue35608@roundup.psfhosted.org>
Message-ID: <1603181580.45.0.00927708090047.issue35608@roundup.psfhosted.org>


ruozeng.w <dukewrz at 163.com> added the comment:

I ran into the same issue.
I'm using Ansible to deliver thousands of  remote tasks. One TaskQueueManager starts multiple worker processes, each worker process executes a remote task and send task result data to TaskQueueManager through MultiProcessing.Queue, so there are 1 consumer and thousands of producers(every producer should exit after sending task result). In high concurrency scenarios, this MAY happen and many worker processes will never exit?

Example:
sending ansible ping task (which executes very fast and returns very short result) to 20000 targets.

Environment
==============================
python 3.6.5
oel 7.4

gdb debug info of worker process
==============================
(gdb) py-list
1067            # If the lock is acquired, the C code is done, and self._stop() is
1068            # called.  That sets ._is_stopped to True, and ._tstate_lock to None.
1069            lock = self._tstate_lock
1070            if lock is None:  # already determined that the C code is done
1071                assert self._is_stopped
>1072            elif lock.acquire(block, timeout):
1073                lock.release()
1074                self._stop()
1075    
1076        @property
1077        def name(self):
(gdb) py-bt
Traceback (most recent call first):
  <built-in method acquire of _thread.lock object at remote 0x7f94b2190918>
  File "/usr/local/lib/python3.6/threading.py", line 1072, in _wait_for_tstate_lock
    elif lock.acquire(block, timeout):
  File "/usr/local/lib/python3.6/threading.py", line 1056, in join
    self._wait_for_tstate_lock()
  File "/usr/local/lib/python3.6/multiprocessing/queues.py", line 191, in _finalize_join
    thread.join()
  File "/usr/local/lib/python3.6/multiprocessing/util.py", line 186, in __call__
    res = self._callback(*self._args, **self._kwargs)
  File "/usr/local/lib/python3.6/multiprocessing/util.py", line 262, in _run_finalizers
    finalizer()
  File "/usr/local/lib/python3.6/multiprocessing/util.py", line 322, in _exit_function
    _run_finalizers()
  File "/usr/local/lib/python3.6/multiprocessing/process.py", line 261, in _bootstrap
    util._exit_function()
  File "/usr/local/lib/python3.6/multiprocessing/popen_fork.py", line 73, in _launch
    code = process_obj._bootstrap()
  File "/usr/local/lib/python3.6/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/usr/local/lib/python3.6/multiprocessing/context.py", line 277, in _Popen
    return Popen(process_obj)
  File "/usr/local/lib/python3.6/multiprocessing/context.py", line 223, in _Popen
    return _default_context.get_context().Process._Popen(process_obj)
  File "/usr/local/lib/python3.6/multiprocessing/process.py", line 105, in start
    self._popen = self._Popen(self)
  File "/usr/local/lib/python3.6/site-packages/ansible-2.7.0.post0-py3.6.egg/ansible/plugins/strategy/__init__.py", line 328, in _queue_task
    worker_prc.start()
  File "/usr/local/lib/python3.6/site-packages/ansible-2.7.0.post0-py3.6.egg/ansible/plugins/strategy/telinear.py", line 301, in run
    self._queue_task(host, task, task_vars, play_context)
  File "/usr/local/lib/python3.6/site-packages/ansible-2.7.0.post0-py3.6.egg/ansible/executor/task_queue_manager.py", line 308, in run
    play_return = strategy.run(iterator, play_context)



Anyone can help? Thx!

----------
nosy: +dukewrz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35608>
_______________________________________

From report at bugs.python.org  Tue Oct 20 04:20:20 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 08:20:20 +0000
Subject: [issue42035] [C API] PyType_GetSlot cannot get tp_name
In-Reply-To: <1602683525.08.0.938781399322.issue42035@roundup.psfhosted.org>
Message-ID: <1603182020.75.0.905808251168.issue42035@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

The slots are originally intended for defining types (PyType_FromSpec); PyType_GetSlot is not as useful as it could be.
tp_name can be exposed, but it needs to also be handled properly PyType_FromSpec -- e.g. raise an error.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42035>
_______________________________________

From report at bugs.python.org  Tue Oct 20 04:31:02 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 08:31:02 +0000
Subject: [issue41726] Update refcounts info of PyType_FromModuleAndSpec in
 refcounts.dat
In-Reply-To: <1599320432.34.0.409671228483.issue41726@roundup.psfhosted.org>
Message-ID: <1603182662.58.0.440851600288.issue41726@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21766
pull_request: https://github.com/python/cpython/pull/22808

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41726>
_______________________________________

From report at bugs.python.org  Tue Oct 20 04:31:37 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 08:31:37 +0000
Subject: [issue41726] Update refcounts info of PyType_FromModuleAndSpec in
 refcounts.dat
In-Reply-To: <1599320432.34.0.409671228483.issue41726@roundup.psfhosted.org>
Message-ID: <1603182697.1.0.857994787655.issue41726@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Definitely. Sorry for the delay -- I missed the notification here.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41726>
_______________________________________

From report at bugs.python.org  Tue Oct 20 04:47:58 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 08:47:58 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1603183678.44.0.962140455896.issue41798@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Also note that the capsule generally needs to hold references to the objects in exposes, and not rely on the module object to keep things alive. (Module objects with multi-phase init are not unique nor immortal.)
_ctypes is an exception, since it doesn't have ant PyObject*. But in most others the destructor should also contain some DECREFs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Tue Oct 20 04:51:47 2020
From: report at bugs.python.org (Alex Roussel)
Date: Tue, 20 Oct 2020 08:51:47 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
Message-ID: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>


New submission from Alex Roussel <alexandredrr14 at gmail.com>:

Hello, 

I've come across an issue that seems similar to the false positives problem outlined in this ticket (https://bugs.python.org/issue28494), however this issue relates to a single gzipped json file which is incorrectly identified as a .zip archive because (I suspect) is_zipfile is mistaking bytes in the file's data for the ending bytes that correspond to a .zip archive.

I'm afraid I'm not well versed on the way is_zipfile 'seeks' the bytes of a file to compare its magic number, so I apologise if my description isn't completely accurate. 

Here's my attempt at a summary of the problem:

My .json.gz file includes the correct magic number (1f8b) to identify it as a gzipped file, however when zipfile.is_zipfile is called on the filepath, it returns True.

I'm going to ask if I'm allowed to upload the file directly for you (it's work related), in the meantime I've included a head and tail of the file's hexdump below.

I am running Python 3.6.9 on Ubuntu 18.04.

----------

~/T?l?chargements ? python3                                                   
Python 3.6.9 (default, Oct  8 2020, 12:12:24) 
[GCC 8.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import zipfile
>>> zipfile.is_zipfile('2020-10-18-1602979256-http_get_7549.json.gz')
True

----------

~/T?l?chargements ? xxd 2020-10-18-1602979256-http_get_7549.json.gz | head                   
00000000: 1f8b 0800 7090 8b5f 0003 ecbd 5993 e338  ....p.._....Y..8
00000010: 922e fa7e 7fc6 bcea 588a 8b28 8ad7 ec3c  ...~....X..(...<
00000020: 883b 292e e2be bc71 91b8 5394 b8f3 d8fd  .;)....q..S.....
00000030: ef17 9422 3223 22ab 2ab3 7ba6 67a6 e774  ..."2#".*.{.g..t
00000040: 5bab 4209 6175 7738 3e77 3880 fff3 6f71  [.B.auw8>w8...oq
00000050: d005 fff6 fffe 9bc1 ea96 451d 2629 6712  ..........E.&)g.
00000060: 853e 4202 830d 3145 7221 6af7 fe11 3ae9  .>B...1Er!j...:.
00000070: 1c0b f9e6 2db1 c0bf 25ea 38a9 1479 f650  ....-...%.8..y.P

----------

~/T?l?chargements ? xxd 2020-10-18-1602979256-http_get_7549.json.gz | tail
01d492b0: 98a2 3d5c 25e1 c5b8 d9c5 3287 c5d8 3d7c  ..=\%.....2...=|
01d492c0: 968f 3652 6fd4 4a0c 243b 166d 5640 97b5  ..6Ro.J.$;.mV at ..
01d492d0: 9308 8376 fe17 1fac 0c90 0fdb b3e3 4e4a  ...v..........NJ
01d492e0: 605c a870 5120 955b 6267 e318 406f e1e2  `\.pQ .[bg.. at o..
01d492f0: 2c50 12ec 5eb0 43cc 8d97 4daf 6017 3412  ,P..^.C...M.`.4.
01d49300: 3bdb 40ce 743f 7aa8 6ff9 f30d 796f f784  ;. at .t?z.o...yo..
01d49310: cec2 c45d b012 7e07 c70c dafd e16e fee2  ...]..~......n..
01d49320: c8a6 c01c 627f e004 f9c7 4770 e5e7 6bbf  ....b.....Gp..k.
01d49330: 44d5 97bb ffdf ffe7 ff03 2263 b46f 3d5c  D........."c.o=\
01d49340: cb04                                     ..

----------
components: Library (Lib)
messages: 379105
nosy: aroussel
priority: normal
severity: normal
status: open
title: zipfile.is_zipfile incorrectly identifying a gzipped file as a zip archive
type: behavior
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Tue Oct 20 04:53:28 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 20 Oct 2020 08:53:28 +0000
Subject: [issue31818] [macOS] _scproxy.get_proxies() crash -- get_proxies() is
 not fork-safe?
In-Reply-To: <1508409035.64.0.213398074469.issue31818@psf.upfronthosting.co.za>
Message-ID: <1603184008.34.0.635564435654.issue31818@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

> My understanding is that this is specifically a problem with the Objective-C 
> runtime that _scproxy.c accesses.  The runtime is not thread safe and 
> whereas in earlier versions of macOS, it silently failed, now macOS is 
> explicitly aborting the process.

Note quite, the ObjC runtime is thread safe (and so are most high-level APIs) but a number of APIs use threads or process-level state that needs to be reset in a child proces and isn't. To phrase this in CPython API: Apple doesn't use the equivalent of PyOS_AfterFork_Child in a number of places where this would be needed to be able to use APIs in child processes.  Instead of that recentish version of macOS just detect that the process-id changed and bail out.

This is a quality of implementation issue, and could also happen on other platforms (locks held across fork(), ...), especially when using threads. 

"A process shall be created with a single thread. If a multi-threaded process calls fork(), the new process shall contain a replica of the calling thread and its entire address space, possibly including the states of mutexes and other resources. Consequently, to avoid errors, the child process may only execute async-signal-safe operations until such time as one of the exec functions is called."
<https://pubs.opengroup.org/onlinepubs/9699919799/>

----------
versions: +Python 3.10, Python 3.9 -Python 2.7, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31818>
_______________________________________

From report at bugs.python.org  Tue Oct 20 04:56:18 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 08:56:18 +0000
Subject: [issue38787] PEP 573: Module State Access from C Extension Methods
In-Reply-To: <1573655440.57.0.563143759574.issue38787@roundup.psfhosted.org>
Message-ID: <1603184178.31.0.821091146979.issue38787@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Thanks Victor, Hai Shi, Pablo, Stefan, Dong-hee Na and Mariatta for reviews!

I did not put all the details in the documentation because there are still feature gaps. So, a full write-up is now in the informational PEP 630.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38787>
_______________________________________

From report at bugs.python.org  Tue Oct 20 05:03:52 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 20 Oct 2020 09:03:52 +0000
Subject: [issue41491] plistlib can't load macOS BigSur system LaunchAgent
In-Reply-To: <1596665779.04.0.552451730401.issue41491@roundup.psfhosted.org>
Message-ID: <1603184632.73.0.152057775139.issue41491@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Does plutil support octal (0o) and binary (0b) literals?

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41491>
_______________________________________

From report at bugs.python.org  Tue Oct 20 05:10:50 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 09:10:50 +0000
Subject: [issue42035] [C API] PyType_GetSlot cannot get tp_name
In-Reply-To: <1602683525.08.0.938781399322.issue42035@roundup.psfhosted.org>
Message-ID: <1603185050.45.0.0123289182919.issue42035@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Ah, scratch that: PyType_GetSlot returns a function pointer.
To be correct, we should to expose a new function like PyType_GetName.

It's true that CPython currently doesn't always honor the distinction between data and function pointers, but the C standard says they're distinct, so it might bite us in the future.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42035>
_______________________________________

From report at bugs.python.org  Tue Oct 20 05:26:32 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 09:26:32 +0000
Subject: [issue41618] [C API] How many slots of static types should be exposed
 in PyType_GetSlot()
In-Reply-To: <1598172498.12.0.869607269568.issue41618@roundup.psfhosted.org>
Message-ID: <1603185992.77.0.635082586279.issue41618@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Also: PyType_GetSlot should return a function pointer, not data.

For some slots (Py_tp_doc, Py_tp_methods, Py_tp_members, Py_tp_getset) that ship has sailed, but for new ones, we should honor the distinction between data and function pointers. The C standard says they're distinct, so it might bite us in the future (e.g. compiling to WebAssembly).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41618>
_______________________________________

From report at bugs.python.org  Tue Oct 20 05:50:56 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 09:50:56 +0000
Subject: [issue34067] Problem with contextlib.nullcontext
In-Reply-To: <1530984805.95.0.56676864532.issue34067@psf.upfronthosting.co.za>
Message-ID: <1603187456.72.0.177048642991.issue34067@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
pull_requests: +21767
pull_request: https://github.com/python/cpython/pull/22811

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34067>
_______________________________________

From report at bugs.python.org  Tue Oct 20 05:52:24 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 09:52:24 +0000
Subject: [issue34067] Problem with contextlib.nullcontext
In-Reply-To: <1530984805.95.0.56676864532.issue34067@psf.upfronthosting.co.za>
Message-ID: <1603187544.22.0.303698572962.issue34067@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34067>
_______________________________________

From report at bugs.python.org  Tue Oct 20 06:02:11 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 10:02:11 +0000
Subject: [issue31686] GZip library doesn't properly close files
In-Reply-To: <1507074488.46.0.213398074469.issue31686@psf.upfronthosting.co.za>
Message-ID: <1603188131.6.0.756099537139.issue31686@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> works for me
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31686>
_______________________________________

From report at bugs.python.org  Tue Oct 20 06:11:30 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 10:11:30 +0000
Subject: [issue36568] Typo in socket.CAN_RAW_FD_FRAMES library documentation
In-Reply-To: <1554776259.35.0.774393301329.issue36568@roundup.psfhosted.org>
Message-ID: <1603188690.26.0.916455866156.issue36568@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36568>
_______________________________________

From report at bugs.python.org  Tue Oct 20 06:14:20 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 10:14:20 +0000
Subject: [issue32902] FileInput "inplace" redirects output of other threads
In-Reply-To: <1519257688.59.0.467229070634.issue32902@psf.upfronthosting.co.za>
Message-ID: <1603188860.5.0.900188446201.issue32902@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32902>
_______________________________________

From report at bugs.python.org  Tue Oct 20 06:19:15 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 10:19:15 +0000
Subject: [issue29986] Documentation recommends raising TypeError from
 tp_richcompare
In-Reply-To: <1491346313.99.0.131506773991.issue29986@psf.upfronthosting.co.za>
Message-ID: <1603189155.65.0.193831077273.issue29986@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29986>
_______________________________________

From report at bugs.python.org  Tue Oct 20 06:21:34 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 10:21:34 +0000
Subject: [issue21257] Document parse_headers function of http.client
In-Reply-To: <1397666699.47.0.0992171618243.issue21257@psf.upfronthosting.co.za>
Message-ID: <1603189294.38.0.545697480248.issue21257@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21257>
_______________________________________

From report at bugs.python.org  Tue Oct 20 06:23:19 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 20 Oct 2020 10:23:19 +0000
Subject: [issue41491] plistlib can't load macOS BigSur system LaunchAgent
In-Reply-To: <1596665779.04.0.552451730401.issue41491@roundup.psfhosted.org>
Message-ID: <1603189399.31.0.257355731296.issue41491@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

It doesn't, both 0b101 and 0o101 get rejected as syntax errors.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41491>
_______________________________________

From report at bugs.python.org  Tue Oct 20 06:29:22 2020
From: report at bugs.python.org (hai shi)
Date: Tue, 20 Oct 2020 10:29:22 +0000
Subject: [issue41726] Update refcounts info of PyType_FromModuleAndSpec in
 refcounts.dat
In-Reply-To: <1599320432.34.0.409671228483.issue41726@roundup.psfhosted.org>
Message-ID: <1603189762.49.0.989320922431.issue41726@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

> Definitely. Sorry for the delay -- I missed the notification here.
No problem. This is not a block issue :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41726>
_______________________________________

From report at bugs.python.org  Tue Oct 20 06:42:44 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 10:42:44 +0000
Subject: [issue20119] pdb c(ont(inue)) optional one-time-only breakpoint (like
 perl debugger)
In-Reply-To: <1388808811.19.0.853662131976.issue20119@psf.upfronthosting.co.za>
Message-ID: <1603190564.06.0.232905942145.issue20119@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> out of date
stage: test needed -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20119>
_______________________________________

From report at bugs.python.org  Tue Oct 20 06:49:12 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 10:49:12 +0000
Subject: [issue11305] TextIOWrapper.readline and str.splitlines have different
 behavior
In-Reply-To: <1298513992.9.0.559771255242.issue11305@psf.upfronthosting.co.za>
Message-ID: <1603190952.24.0.646827116575.issue11305@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> out of date
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11305>
_______________________________________

From report at bugs.python.org  Tue Oct 20 06:57:24 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 10:57:24 +0000
Subject: [issue24538] os.setxattr PermissionError on panfs propagates up
 causing `copystat`, `copytree`, and `pip install .` to fail unhepfully
In-Reply-To: <1435666041.75.0.103684760482.issue24538@psf.upfronthosting.co.za>
Message-ID: <1603191444.82.0.953975674825.issue24538@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24538>
_______________________________________

From report at bugs.python.org  Tue Oct 20 07:01:58 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 11:01:58 +0000
Subject: [issue34514] assertEqual doesn't use maxDiff when comparing
 dictionaries
In-Reply-To: <1535336469.7.0.56676864532.issue34514@psf.upfronthosting.co.za>
Message-ID: <1603191718.24.0.540993339686.issue34514@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34514>
_______________________________________

From report at bugs.python.org  Tue Oct 20 07:09:23 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 11:09:23 +0000
Subject: [issue33592] Document contextvars C API
In-Reply-To: <1526923723.99.0.682650639539.issue33592@psf.upfronthosting.co.za>
Message-ID: <1603192163.03.0.137959898662.issue33592@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33592>
_______________________________________

From report at bugs.python.org  Tue Oct 20 07:16:26 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 11:16:26 +0000
Subject: [issue40860] Exception in multiprocessing/context.py under load
In-Reply-To: <1591239973.04.0.347860195364.issue40860@roundup.psfhosted.org>
Message-ID: <1603192586.87.0.456682036983.issue40860@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Multiprocessing docs don't describe thread-safety

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40860>
_______________________________________

From report at bugs.python.org  Tue Oct 20 07:39:57 2020
From: report at bugs.python.org (Steve Dower)
Date: Tue, 20 Oct 2020 11:39:57 +0000
Subject: [issue38324] [Windows] test__locale fails on Windows local machines
In-Reply-To: <1569849277.36.0.00648751871696.issue38324@roundup.psfhosted.org>
Message-ID: <1603193997.6.0.0548232073058.issue38324@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset f2312037e3a974d26ed3e23884f94c6af111a27a by TIGirardi in branch 'master':
bpo-38324: Fix test__locale.py Windows failures (GH-20529)
https://github.com/python/cpython/commit/f2312037e3a974d26ed3e23884f94c6af111a27a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38324>
_______________________________________

From report at bugs.python.org  Tue Oct 20 07:40:12 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 11:40:12 +0000
Subject: [issue38324] [Windows] test__locale fails on Windows local machines
In-Reply-To: <1569849277.36.0.00648751871696.issue38324@roundup.psfhosted.org>
Message-ID: <1603194012.23.0.393190760707.issue38324@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 8.0 -> 9.0
pull_requests: +21768
pull_request: https://github.com/python/cpython/pull/22812

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38324>
_______________________________________

From report at bugs.python.org  Tue Oct 20 07:40:17 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 11:40:17 +0000
Subject: [issue38324] [Windows] test__locale fails on Windows local machines
In-Reply-To: <1569849277.36.0.00648751871696.issue38324@roundup.psfhosted.org>
Message-ID: <1603194017.94.0.11098135633.issue38324@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21769
pull_request: https://github.com/python/cpython/pull/22813

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38324>
_______________________________________

From report at bugs.python.org  Tue Oct 20 07:44:22 2020
From: report at bugs.python.org (sheidan)
Date: Tue, 20 Oct 2020 11:44:22 +0000
Subject: [issue37640] telnetlib crash in Python3 while receiving un-printable
 characters from server
In-Reply-To: <1563700628.04.0.824275375582.issue37640@roundup.psfhosted.org>
Message-ID: <1603194262.94.0.558697342885.issue37640@roundup.psfhosted.org>


Change by sheidan <sh3idan at gmail.com>:


----------
nosy: +shei dan
nosy_count: 1.0 -> 2.0
pull_requests: +21770
pull_request: https://github.com/python/cpython/pull/22814

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37640>
_______________________________________

From report at bugs.python.org  Tue Oct 20 07:48:48 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 11:48:48 +0000
Subject: [issue40703] PyType_FromSpec*() overwrites the type's "__module__"
In-Reply-To: <1590009872.3.0.237127808252.issue40703@roundup.psfhosted.org>
Message-ID: <1603194528.42.0.747382758226.issue40703@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Thank you, Stefan!

This should have a test as well.
I'm willing to mentor someone who wants to get into the C-API, otherwise this has low priority for me.

----------
resolution:  -> fixed
stage: test needed -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40703>
_______________________________________

From report at bugs.python.org  Tue Oct 20 07:48:55 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 11:48:55 +0000
Subject: [issue40703] PyType_FromSpec*() overwrites the type's "__module__"
In-Reply-To: <1590009872.3.0.237127808252.issue40703@roundup.psfhosted.org>
Message-ID: <1603194535.2.0.683328919788.issue40703@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40703>
_______________________________________

From report at bugs.python.org  Tue Oct 20 07:50:34 2020
From: report at bugs.python.org (Steve Dower)
Date: Tue, 20 Oct 2020 11:50:34 +0000
Subject: [issue38324] [Windows] test__locale fails on Windows local machines
In-Reply-To: <1569849277.36.0.00648751871696.issue38324@roundup.psfhosted.org>
Message-ID: <1603194634.37.0.786249603669.issue38324@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Thanks!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38324>
_______________________________________

From report at bugs.python.org  Tue Oct 20 07:58:17 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 11:58:17 +0000
Subject: [issue38324] [Windows] test__locale fails on Windows local machines
In-Reply-To: <1569849277.36.0.00648751871696.issue38324@roundup.psfhosted.org>
Message-ID: <1603195097.52.0.541265033426.issue38324@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 4cde523aa467c92a713674c793ab87e7c56486c4 by Miss Skeleton (bot) in branch '3.8':
bpo-38324: Fix test__locale.py Windows failures (GH-20529)
https://github.com/python/cpython/commit/4cde523aa467c92a713674c793ab87e7c56486c4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38324>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:01:16 2020
From: report at bugs.python.org (Steve Dower)
Date: Tue, 20 Oct 2020 12:01:16 +0000
Subject: [issue30612] Unusual Windows registry path syntax
In-Reply-To: <1497000804.0.0.079840477122.issue30612@psf.upfronthosting.co.za>
Message-ID: <1603195276.2.0.633175400136.issue30612@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset ff1ae3dd334faa2006394c2318db385cdc42030a by Zackery Spytz in branch 'master':
bpo-30612: Tweak Windows registry path syntax in the docs (GH-20281)
https://github.com/python/cpython/commit/ff1ae3dd334faa2006394c2318db385cdc42030a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30612>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:01:28 2020
From: report at bugs.python.org (Steve Dower)
Date: Tue, 20 Oct 2020 12:01:28 +0000
Subject: [issue30612] Unusual Windows registry path syntax
In-Reply-To: <1497000804.0.0.079840477122.issue30612@psf.upfronthosting.co.za>
Message-ID: <1603195288.91.0.518578907255.issue30612@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
nosy:  -miss-islington
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30612>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:01:28 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 12:01:28 +0000
Subject: [issue30612] Unusual Windows registry path syntax
In-Reply-To: <1497000804.0.0.079840477122.issue30612@psf.upfronthosting.co.za>
Message-ID: <1603195288.77.0.986626748285.issue30612@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 8.0 -> 9.0
pull_requests: +21771
pull_request: https://github.com/python/cpython/pull/22815

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30612>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:01:39 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 12:01:39 +0000
Subject: [issue30612] Unusual Windows registry path syntax
In-Reply-To: <1497000804.0.0.079840477122.issue30612@psf.upfronthosting.co.za>
Message-ID: <1603195299.22.0.616705349174.issue30612@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
pull_requests: +21772
pull_request: https://github.com/python/cpython/pull/22816

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30612>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:07:17 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 12:07:17 +0000
Subject: [issue38324] [Windows] test__locale fails on Windows local machines
In-Reply-To: <1569849277.36.0.00648751871696.issue38324@roundup.psfhosted.org>
Message-ID: <1603195637.62.0.243916240393.issue38324@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c17ff5cad2952d9abd63aeae060cae5658257b0c by Miss Skeleton (bot) in branch '3.9':
bpo-38324: Fix test__locale.py Windows failures (GH-20529)
https://github.com/python/cpython/commit/c17ff5cad2952d9abd63aeae060cae5658257b0c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38324>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:11:28 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 12:11:28 +0000
Subject: [issue30612] Unusual Windows registry path syntax
In-Reply-To: <1497000804.0.0.079840477122.issue30612@psf.upfronthosting.co.za>
Message-ID: <1603195888.97.0.387098355684.issue30612@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f53ea8adaecacfe8c1e4a093136fb5318b15d779 by Miss Skeleton (bot) in branch '3.8':
bpo-30612: Tweak Windows registry path syntax in the docs (GH-20281)
https://github.com/python/cpython/commit/f53ea8adaecacfe8c1e4a093136fb5318b15d779


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30612>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:21:14 2020
From: report at bugs.python.org (Steve Dower)
Date: Tue, 20 Oct 2020 12:21:14 +0000
Subject: [issue38439] Python needs higher resolution app/menu icons
In-Reply-To: <1570749295.67.0.980962290264.issue38439@roundup.psfhosted.org>
Message-ID: <1603196474.82.0.721277621826.issue38439@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset faddc7449d07e883b8ad8bb95dd68ce6dbdc06e8 by Miro Hron?ok in branch 'master':
bpo-38439: Add 256px IDLE icon to the .ico, drop gifs from it (GH-19648)
https://github.com/python/cpython/commit/faddc7449d07e883b8ad8bb95dd68ce6dbdc06e8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38439>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:21:35 2020
From: report at bugs.python.org (Steve Dower)
Date: Tue, 20 Oct 2020 12:21:35 +0000
Subject: [issue38439] Python needs higher resolution app/menu icons
In-Reply-To: <1570749295.67.0.980962290264.issue38439@roundup.psfhosted.org>
Message-ID: <1603196495.91.0.392202184167.issue38439@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +21773
pull_request: https://github.com/python/cpython/pull/22817

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38439>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:23:43 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 12:23:43 +0000
Subject: [issue30612] Unusual Windows registry path syntax
In-Reply-To: <1497000804.0.0.079840477122.issue30612@psf.upfronthosting.co.za>
Message-ID: <1603196623.17.0.421245667309.issue30612@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset bd9d76bbbb9eb226d99e186dae39e06ba8977485 by Miss Skeleton (bot) in branch '3.9':
bpo-30612: Tweak Windows registry path syntax in the docs (GH-20281)
https://github.com/python/cpython/commit/bd9d76bbbb9eb226d99e186dae39e06ba8977485


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30612>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:30:27 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 12:30:27 +0000
Subject: [issue41726] Update refcounts info of PyType_FromModuleAndSpec in
 refcounts.dat
In-Reply-To: <1599320432.34.0.409671228483.issue41726@roundup.psfhosted.org>
Message-ID: <1603197027.53.0.49953630705.issue41726@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41726>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:30:09 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 12:30:09 +0000
Subject: [issue41726] Update refcounts info of PyType_FromModuleAndSpec in
 refcounts.dat
In-Reply-To: <1599320432.34.0.409671228483.issue41726@roundup.psfhosted.org>
Message-ID: <1603197009.71.0.535664186674.issue41726@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset 38a17d0752781c70fd971f372ddc8d3caf5ded88 by Miss Skeleton (bot) in branch '3.9':
bpo-41726: Update the refcounts info of PyType_FromModuleAndSpec in refcounts.dat (GH-22112) (GH-22808)
https://github.com/python/cpython/commit/38a17d0752781c70fd971f372ddc8d3caf5ded88


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41726>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:33:28 2020
From: report at bugs.python.org (hai shi)
Date: Tue, 20 Oct 2020 12:33:28 +0000
Subject: [issue41726] Update refcounts info of PyType_FromModuleAndSpec in
 refcounts.dat
In-Reply-To: <1599320432.34.0.409671228483.issue41726@roundup.psfhosted.org>
Message-ID: <1603197208.15.0.56920125977.issue41726@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

Thanks petr for your review and merge.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41726>
_______________________________________

From report at bugs.python.org  Tue Oct 20 08:46:47 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 12:46:47 +0000
Subject: [issue41737] Improper NotADirectoryError when opening a file in a
 fake directory
In-Reply-To: <1599492997.14.0.974001441191.issue41737@roundup.psfhosted.org>
Message-ID: <1603198007.15.0.445208192058.issue41737@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +patch
pull_requests: +21774
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22818

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41737>
_______________________________________

From report at bugs.python.org  Tue Oct 20 09:15:54 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Tue, 20 Oct 2020 13:15:54 +0000
Subject: [issue42090] zipfile.Path.joinpath API inconsistent with
 pathlib.Path.joinpath
In-Reply-To: <1603141108.13.0.969027124293.issue42090@roundup.psfhosted.org>
Message-ID: <1603199754.04.0.203792637835.issue42090@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

This sounds like a worthy improvement. Are you interested in preparing a patch? Would you consider contributing it to https://github.com/jaraco/zipp first?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42090>
_______________________________________

From report at bugs.python.org  Tue Oct 20 09:18:07 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Tue, 20 Oct 2020 13:18:07 +0000
Subject: [issue42089] Better message in PackageNotFoundError
In-Reply-To: <1603140651.15.0.510180378799.issue42089@roundup.psfhosted.org>
Message-ID: <1603199887.31.0.193375482831.issue42089@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42089>
_______________________________________

From report at bugs.python.org  Tue Oct 20 09:31:56 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Tue, 20 Oct 2020 13:31:56 +0000
Subject: [issue33754] f-strings should be part of the Grammar
In-Reply-To: <1528030778.27.0.592728768989.issue33754@psf.upfronthosting.co.za>
Message-ID: <1603200716.82.0.806733947745.issue33754@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
nosy: +lys.nikolaou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33754>
_______________________________________

From report at bugs.python.org  Tue Oct 20 09:50:48 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 20 Oct 2020 13:50:48 +0000
Subject: [issue41768] unittest.mock spec calls class properties
In-Reply-To: <1599873024.24.0.929930382889.issue41768@roundup.psfhosted.org>
Message-ID: <1603201848.95.0.0469871989119.issue41768@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +cjw296, lisroach, mariocj89

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41768>
_______________________________________

From report at bugs.python.org  Tue Oct 20 09:54:41 2020
From: report at bugs.python.org (Danny Lin)
Date: Tue, 20 Oct 2020 13:54:41 +0000
Subject: [issue41737] Improper NotADirectoryError when opening a file in a
 fake directory
In-Reply-To: <1599492997.14.0.974001441191.issue41737@roundup.psfhosted.org>
Message-ID: <1603202081.28.0.223373371019.issue41737@roundup.psfhosted.org>


Danny Lin <danny0838 at gmail.com> added the comment:

By writing "except FileNotFoundError:", the intention is to catch an error when the file being opened is not found, and don't catch an error for other cases, such as an existing file without adequate permission. Writing "except OSError:" catches just too much cases including unwanted ones.

As they are not equivalent, you cannot say that the latter is the "correct" way for the former.

And you totally omitted the argument for the inadequate documentation for NotADirectoryError. It says NotADirectoryError is raises when a DIRECTORY operation is requested, and does not cover the case of opening a file.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41737>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:05:36 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 14:05:36 +0000
Subject: [issue39693] tarfile's extractfile documentation is misleading
In-Reply-To: <1582182731.51.0.0387908483587.issue39693@roundup.psfhosted.org>
Message-ID: <1603202736.01.0.102863652809.issue39693@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 5.0 -> 6.0
pull_requests: +21775
pull_request: https://github.com/python/cpython/pull/22819

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39693>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:05:17 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 14:05:17 +0000
Subject: [issue39693] tarfile's extractfile documentation is misleading
In-Reply-To: <1582182731.51.0.0387908483587.issue39693@roundup.psfhosted.org>
Message-ID: <1603202717.27.0.524504892985.issue39693@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:


New changeset ec42789e6e14f6b6ac13569aeadc13798d7173a8 by Andrey Doroschenko in branch 'master':
bpo-39693: mention KeyError in tarfile extractfile documentation (GH-18639)
https://github.com/python/cpython/commit/ec42789e6e14f6b6ac13569aeadc13798d7173a8


----------
nosy: +akuchling

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39693>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:08:47 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 14:08:47 +0000
Subject: [issue40554] Add escape to the glossary?
In-Reply-To: <1588887417.08.0.726428643093.issue40554@roundup.psfhosted.org>
Message-ID: <1603202927.45.0.999903407531.issue40554@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:

Closing issue, since the consensus is to not add the term.

----------
nosy: +akuchling
resolution:  -> wont fix
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40554>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:23:09 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 14:23:09 +0000
Subject: [issue41737] Improper NotADirectoryError when opening a file in a
 fake directory
In-Reply-To: <1599492997.14.0.974001441191.issue41737@roundup.psfhosted.org>
Message-ID: <1603203789.69.0.167775073225.issue41737@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Hi Danny, 

I'm not saying that OSError and FileNotFoundError are equivalent. I'm saying that the open() API, as documented, raises OSError when opening the file fails.

The way to check whether a file exists is to use os.path.exists(path) or os.path.isfile(path). 

I don't quite follow your last point - opening a file is indeed a file operation, but it contains within it a directory operation (finding the file).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41737>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:31:22 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 14:31:22 +0000
Subject: [issue39693] tarfile's extractfile documentation is misleading
In-Reply-To: <1582182731.51.0.0387908483587.issue39693@roundup.psfhosted.org>
Message-ID: <1603204282.19.0.541489426578.issue39693@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:


New changeset b249aeae89f55b9da5cdff082ba271e2b15b7825 by Miss Skeleton (bot) in branch '3.9':
bpo-39693: mention KeyError in tarfile extractfile documentation (GH-18639) 
https://github.com/python/cpython/commit/b249aeae89f55b9da5cdff082ba271e2b15b7825


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39693>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:32:18 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 14:32:18 +0000
Subject: [issue39693] tarfile's extractfile documentation is misleading
In-Reply-To: <1582182731.51.0.0387908483587.issue39693@roundup.psfhosted.org>
Message-ID: <1603204338.42.0.301510902208.issue39693@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:

Closing after applying the PR.  Thanks!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39693>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:36:13 2020
From: report at bugs.python.org (Danny Lin)
Date: Tue, 20 Oct 2020 14:36:13 +0000
Subject: [issue41737] Improper NotADirectoryError when opening a file in a
 fake directory
In-Reply-To: <1599492997.14.0.974001441191.issue41737@roundup.psfhosted.org>
Message-ID: <1603204573.55.0.51956407971.issue41737@roundup.psfhosted.org>


Danny Lin <danny0838 at gmail.com> added the comment:

I don't think a general developer would expect that open('/path/to/file/somename.txt') implies a directory operation, and it also doesn't on Windows.

I suggest that a further notice be added to NotADirectoryError, such as:

    Raised when a directory operation (such as os.listdir()) is requested on something which is not a directory. Corresponds to errno ENOTDIR. In some filesystem such as POSIX, NotADirectoryError (ENOTDIR) is raised when attempting to open a path whose ancestor is not a directory.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41737>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:36:31 2020
From: report at bugs.python.org (Andrew de Quincey)
Date: Tue, 20 Oct 2020 14:36:31 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
Message-ID: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>


New submission from Andrew de Quincey <Adq at tvsquared.com>:

We've been having some mysterious hangs in our threaded code. Debugging with GDB shows it ends up deadlocking during logging inside logging._acquireLock()

I googled and found someone else with the same issue: https://stackoverflow.com/questions/62059975/python-multiprocessing-logging-hangs

I'm able to replicate this on python 3.7.9 on two entirely separate machines (one ubuntu, one arch linux), though I had to bump up the number of iterations to 1000.

----------
components: Library (Lib)
files: test.py
messages: 379132
nosy: Adq
priority: normal
severity: normal
status: open
title: Python 3.7.9 logging/threading/fork hang
type: behavior
versions: Python 3.7
Added file: https://bugs.python.org/file49531/test.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:40:35 2020
From: report at bugs.python.org (Andrew de Quincey)
Date: Tue, 20 Oct 2020 14:40:35 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
In-Reply-To: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>
Message-ID: <1603204835.5.0.292254652504.issue42097@roundup.psfhosted.org>


Andrew de Quincey <Adq at tvsquared.com> added the comment:

Debugging a bit more shows our code is deadlocked at:
  File "/usr/lib/python3.7/logging/__init__.py", line 219, in _acquireLock
    _lock.acquire()
  File "/usr/lib/python3.7/logging/config.py", line 501, in configure
    logging._acquireLock()
  File "/usr/lib/python3.7/logging/config.py", line 800, in dictConfig
    dictConfigClass(config).configure()
  File "/home/backend/backend/lib/request.py", line 591, in init
    logging.config.dictConfig(getLoggingDict(loglevel=self.loglevel))



Looking at other threads, I found this:
  File "/usr/lib/python3.7/logging/__init__.py", line 219, in _acquireLock
    _lock.acquire()
  File "/usr/lib/python3.7/logging/__init__.py", line 776, in _removeHandlerRef
    acquire()
  Garbage-collecting
  File "/home/backend/backend/lib/common/log/logstash.py", line 13, in fix_log_message
    for k, v in logmessage.items():
  File "/home/backend/backend/lib/common/log/logstash.py", line 14, in fix_log_message
    logmessage[k] = self.fix_log_message(v)
  File "/home/backend/backend/lib/common/log/logstash.py", line 14, in fix_log_message
    logmessage[k] = self.fix_log_message(v)
  File "/home/backend/backend/lib/common/log/logstash.py", line 14, in fix_log_message
    logmessage[k] = self.fix_log_message(v)
  File "/home/backend/backend/lib/common/log/logstash.py", line 66, in format
    return self.serialize(self.fix_log_message(message))
  File "/home/backend/venv/lib/python3.7/site-packages/logstash/handler_tcp.py", line 25, in makePickle
    return self.formatter.format(record) + b'\n'
  File "/usr/lib/python3.7/logging/handlers.py", line 631, in emit
    s = self.makePickle(record)
  File "/usr/lib/python3.7/logging/__init__.py", line 894, in handle
    self.emit(record)
  File "/usr/lib/python3.7/logging/__init__.py", line 1586, in callHandlers
    hdlr.handle(record)
  File "/usr/lib/python3.7/logging/__init__.py", line 1524, in handle
    self.callHandlers(record)
  File "/usr/lib/python3.7/logging/__init__.py", line 1514, in _log
    self.handle(record)
  File "/usr/lib/python3.7/logging/__init__.py", line 1378, in info
    self._log(INFO, msg, args, **kwargs)



It looks like its trying to free a lock that is already locked during garbage collection?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:41:11 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 14:41:11 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603204871.72.0.750808145169.issue41192@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:


New changeset 0c37269be7065b9b15b7b3a4406084f9535a793a by Andrew Kuchling in branch 'master':
bpo-41192: Clarify the sys module's description of the auditing feature (GH-22768)
https://github.com/python/cpython/commit/0c37269be7065b9b15b7b3a4406084f9535a793a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:41:39 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 14:41:39 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603204899.59.0.340682798116.issue41192@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21776
pull_request: https://github.com/python/cpython/pull/22820

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:51:41 2020
From: report at bugs.python.org (Andrew de Quincey)
Date: Tue, 20 Oct 2020 14:51:41 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
In-Reply-To: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>
Message-ID: <1603205501.58.0.372297707129.issue42097@roundup.psfhosted.org>


Andrew de Quincey <Adq at tvsquared.com> added the comment:

My colleague reports it does happen on their Mac as well, but that it took about 50 tries for it to trigger.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:53:27 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 14:53:27 +0000
Subject: [issue41737] Improper NotADirectoryError when opening a file in a
 fake directory
In-Reply-To: <1599492997.14.0.974001441191.issue41737@roundup.psfhosted.org>
Message-ID: <1603205607.36.0.301023221689.issue41737@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

> I don't think a general developer would expect that open('/path/to/file/somename.txt') implies a directory operation, and it also doesn't on Windows.


Really? It's not obvious that finding a file would involve directory operations?

In what sense does it even matter whether you expect a directory operation to happen? The contract is that if the open() fails you get an OSError. The documentation doesn't say which OSError, and that is in fact a platform-specific implementation detail.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41737>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:54:25 2020
From: report at bugs.python.org (Steve Dower)
Date: Tue, 20 Oct 2020 14:54:25 +0000
Subject: [issue38439] Python needs higher resolution app/menu icons
In-Reply-To: <1570749295.67.0.980962290264.issue38439@roundup.psfhosted.org>
Message-ID: <1603205665.0.0.977067003275.issue38439@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 6d883fbe14751b58d9ed2fd708322613d8931035 by Steve Dower in branch 'master':
bpo-38439: Update the Windows Store package's icons for IDLE. Artwork by Andrew Clover (GH-22817)
https://github.com/python/cpython/commit/6d883fbe14751b58d9ed2fd708322613d8931035


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38439>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:54:55 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Tue, 20 Oct 2020 14:54:55 +0000
Subject: [issue42037] Documentation confusion in CookieJar functions
In-Reply-To: <1602689022.88.0.876415237077.issue42037@roundup.psfhosted.org>
Message-ID: <1603205695.33.0.253026679794.issue42037@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Ah, I see it now: get_host and get_type are in both lists!

Would you like to contribute a fix for the docs?
If yes, help is here: https://devguide.python.org/docquality/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42037>
_______________________________________

From report at bugs.python.org  Tue Oct 20 10:59:03 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 14:59:03 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603205943.66.0.0656024554943.issue41192@roundup.psfhosted.org>


Change by A.M. Kuchling <amk at amk.ca>:


----------
pull_requests: +21777
pull_request: https://github.com/python/cpython/pull/22821

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Tue Oct 20 11:05:18 2020
From: report at bugs.python.org (Andrew de Quincey)
Date: Tue, 20 Oct 2020 15:05:18 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
In-Reply-To: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>
Message-ID: <1603206318.58.0.276553166386.issue42097@roundup.psfhosted.org>


Andrew de Quincey <Adq at tvsquared.com> added the comment:

Before anyone suggests it might be the logstash code we're calling in the comment, it ain't. 

The bug is easily replicated using entirely python built in code. See test.py attached.

If you're having trouble triggering it (seems to vary per machine), find:
        pl.map(do_work, range(10000))

And add a few zeros into the range()

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Tue Oct 20 11:15:15 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 15:15:15 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603206915.69.0.818638665081.issue41192@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:


New changeset a797fd74fe11ef5968b8593b0d39b6aa6ba5aef1 by Miss Skeleton (bot) in branch '3.8':
bpo-41192: Clarify the sys module's description of the auditing feature (GH-22820)
https://github.com/python/cpython/commit/a797fd74fe11ef5968b8593b0d39b6aa6ba5aef1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Tue Oct 20 11:26:54 2020
From: report at bugs.python.org (Danny Lin)
Date: Tue, 20 Oct 2020 15:26:54 +0000
Subject: [issue41737] Improper NotADirectoryError when opening a file in a
 fake directory
In-Reply-To: <1599492997.14.0.974001441191.issue41737@roundup.psfhosted.org>
Message-ID: <1603207614.73.0.714475822959.issue41737@roundup.psfhosted.org>


Danny Lin <danny0838 at gmail.com> added the comment:

> Really? It's not obvious that finding a file would involve directory operations?

Not in some senses, and that's possibly why Windows does not raise NotADirectoryError in such case.

I agree that it's a platform-specific implementation detail. However, there are lots of platform-specific implementation details written in documentation elsewhere already, especially OS related modules such as os and os.path. I don't think mentioning platform-specific implementation details for subclasses of OSError would be any less reasonable than that.

Adding such notice for NotADirectoryError helps people who want a EAFP style code for nonexistent file by preventing them getting trapped writing a cross-platform code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41737>
_______________________________________

From report at bugs.python.org  Tue Oct 20 11:30:53 2020
From: report at bugs.python.org (Ned Deily)
Date: Tue, 20 Oct 2020 15:30:53 +0000
Subject: [issue39640] fall back os.fdatasync() to fsync() on POSIX systems
 without fdatasync() support
In-Reply-To: <1581793568.31.0.586113837137.issue39640@roundup.psfhosted.org>
Message-ID: <1603207853.83.0.074553101964.issue39640@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
nosy: +ronaldoussoren

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39640>
_______________________________________

From report at bugs.python.org  Tue Oct 20 11:31:54 2020
From: report at bugs.python.org (Andrew de Quincey)
Date: Tue, 20 Oct 2020 15:31:54 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
In-Reply-To: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>
Message-ID: <1603207914.04.0.672750173997.issue42097@roundup.psfhosted.org>


Change by Andrew de Quincey <Adq at tvsquared.com>:


Removed file: https://bugs.python.org/file49531/test.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Tue Oct 20 11:37:00 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 15:37:00 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603208220.65.0.149566576694.issue41192@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:


New changeset b948d13ec076e757b7f6904aa67df2f36e4671b7 by Andrew Kuchling in branch '3.9':
[3.9] bpo-41192: Clarify the sys module's description of the auditing feature (GH-22821)
https://github.com/python/cpython/commit/b948d13ec076e757b7f6904aa67df2f36e4671b7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Tue Oct 20 12:03:29 2020
From: report at bugs.python.org (Lewis Gaul)
Date: Tue, 20 Oct 2020 16:03:29 +0000
Subject: [issue38865] [subinterpreters] Can Py_Finalize() be called if the
 current interpreter is not the main interpreter?
In-Reply-To: <1574264524.01.0.330569638863.issue38865@roundup.psfhosted.org>
Message-ID: <1603209809.76.0.552712343387.issue38865@roundup.psfhosted.org>


Change by Lewis Gaul <lewis.gaul at gmail.com>:


----------
nosy: +LewisGaul
nosy_count: 4.0 -> 5.0
pull_requests: +21778
pull_request: https://github.com/python/cpython/pull/17575

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38865>
_______________________________________

From report at bugs.python.org  Tue Oct 20 12:08:53 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 20 Oct 2020 16:08:53 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
In-Reply-To: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>
Message-ID: <1603210133.29.0.359263263232.issue42097@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +vinay.sajip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Tue Oct 20 12:12:42 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 20 Oct 2020 16:12:42 +0000
Subject: [issue42087] Remove pre-AIX 6.1 dead code paths
In-Reply-To: <1603139085.09.0.736153857755.issue42087@roundup.psfhosted.org>
Message-ID: <1603210362.05.0.85291977349.issue42087@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
nosy: +corona10, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42087>
_______________________________________

From report at bugs.python.org  Tue Oct 20 12:45:46 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 20 Oct 2020 16:45:46 +0000
Subject: [issue38144] Add the root_dir and dir_fd parameters in glob.glob()
In-Reply-To: <1568313061.34.0.998675763501.issue38144@roundup.psfhosted.org>
Message-ID: <1603212346.01.0.809144404296.issue38144@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 1d3469988e2c1f53ca84ffdc979d548c04ba3906 by Serhiy Storchaka in branch 'master':
bpo-38144: Re-add accidentally removed audition for glob. (GH-22805)
https://github.com/python/cpython/commit/1d3469988e2c1f53ca84ffdc979d548c04ba3906


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38144>
_______________________________________

From report at bugs.python.org  Tue Oct 20 12:49:00 2020
From: report at bugs.python.org (Ken Jin)
Date: Tue, 20 Oct 2020 16:49:00 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1603212540.62.0.197141921295.issue42010@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
pull_requests: +21779
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22822

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Tue Oct 20 12:58:57 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 16:58:57 +0000
Subject: [issue38439] Python needs higher resolution app/menu icons
In-Reply-To: <1570749295.67.0.980962290264.issue38439@roundup.psfhosted.org>
Message-ID: <1603213137.41.0.137039633078.issue38439@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21781
pull_request: https://github.com/python/cpython/pull/22824

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38439>
_______________________________________

From report at bugs.python.org  Tue Oct 20 12:59:07 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 16:59:07 +0000
Subject: [issue38439] Python needs higher resolution app/menu icons
In-Reply-To: <1570749295.67.0.980962290264.issue38439@roundup.psfhosted.org>
Message-ID: <1603213147.92.0.0042376111796.issue38439@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21782
pull_request: https://github.com/python/cpython/pull/22825

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38439>
_______________________________________

From report at bugs.python.org  Tue Oct 20 12:59:15 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 16:59:15 +0000
Subject: [issue38439] Python needs higher resolution app/menu icons
In-Reply-To: <1570749295.67.0.980962290264.issue38439@roundup.psfhosted.org>
Message-ID: <1603213155.38.0.915011935159.issue38439@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21783
pull_request: https://github.com/python/cpython/pull/22826

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38439>
_______________________________________

From report at bugs.python.org  Tue Oct 20 12:58:50 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 16:58:50 +0000
Subject: [issue38439] Python needs higher resolution app/menu icons
In-Reply-To: <1570749295.67.0.980962290264.issue38439@roundup.psfhosted.org>
Message-ID: <1603213130.2.0.809785881861.issue38439@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21780
pull_request: https://github.com/python/cpython/pull/22823

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38439>
_______________________________________

From report at bugs.python.org  Tue Oct 20 13:17:25 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 17:17:25 +0000
Subject: [issue38439] Python needs higher resolution app/menu icons
In-Reply-To: <1570749295.67.0.980962290264.issue38439@roundup.psfhosted.org>
Message-ID: <1603214245.41.0.200347837704.issue38439@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 333782a3f40baf8bb916da4b5fc04b3d2a749e0c by Miss Skeleton (bot) in branch '3.8':
bpo-38439: Update the Windows Store package's icons for IDLE. Artwork by Andrew Clover (GH-22817)
https://github.com/python/cpython/commit/333782a3f40baf8bb916da4b5fc04b3d2a749e0c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38439>
_______________________________________

From report at bugs.python.org  Tue Oct 20 13:17:34 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 17:17:34 +0000
Subject: [issue38439] Python needs higher resolution app/menu icons
In-Reply-To: <1570749295.67.0.980962290264.issue38439@roundup.psfhosted.org>
Message-ID: <1603214254.54.0.73591009036.issue38439@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset d84e411005401b3c22d7f5836fa366e7aeeb1f21 by Miss Skeleton (bot) in branch '3.8':
bpo-38439: Add 256px IDLE icon to the .ico, drop gifs from it (GH-19648)
https://github.com/python/cpython/commit/d84e411005401b3c22d7f5836fa366e7aeeb1f21


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38439>
_______________________________________

From report at bugs.python.org  Tue Oct 20 13:20:12 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 17:20:12 +0000
Subject: [issue38439] Python needs higher resolution app/menu icons
In-Reply-To: <1570749295.67.0.980962290264.issue38439@roundup.psfhosted.org>
Message-ID: <1603214412.82.0.14106852592.issue38439@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset d12afba507990b6d75f701b398d4f342576be5d7 by Miss Skeleton (bot) in branch '3.9':
bpo-38439: Update the Windows Store package's icons for IDLE. Artwork by Andrew Clover (GH-22817)
https://github.com/python/cpython/commit/d12afba507990b6d75f701b398d4f342576be5d7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38439>
_______________________________________

From report at bugs.python.org  Tue Oct 20 13:33:23 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 20 Oct 2020 17:33:23 +0000
Subject: [issue38456] Reduce the time test_subprocess takes to complete.
In-Reply-To: <1570915664.41.0.600749429007.issue38456@roundup.psfhosted.org>
Message-ID: <1603215203.88.0.563452066027.issue38456@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

fyi - handy command to get that

python -m test.regrtest -v test_subprocess | ts '.%s'

then process that using whatever you want to compute deltas and sort.  i fed the output of that into:

```
#!/usr/bin/python3
"""Parse `python -m test.regrtest -v | ts '.%s'` output, report slowest."""

import sys
from typing import Sequence, Tuple


infile = sys.stdin

deltas: Sequence[Tuple[float, str]] = []

prev_secs: float = 0.
prev_test: str = ''
for line in infile:
  stripped_line = line.strip()
  if ' ' not in stripped_line:
    continue
  num, test = stripped_line.split(None, 1)
  secs = float(num)
  delta = secs - prev_secs if prev_secs else 0.
  if '... ok' or '... skipped' in test:  # Not extraneous output.
    # Assign the accumulated time to the previous test.
    deltas.append((delta, prev_test))
    prev_secs = secs
    prev_test = test

for secs, test in reversed(sorted(deltas, key=lambda x:x[0])[-23:]):
  print(f'{secs:.3} {test}')
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38456>
_______________________________________

From report at bugs.python.org  Tue Oct 20 13:40:39 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 20 Oct 2020 17:40:39 +0000
Subject: [issue41586] Allow to set pipe size on subprocess.Popen.
In-Reply-To: <1597815960.69.0.196461399013.issue41586@roundup.psfhosted.org>
Message-ID: <1603215639.14.0.980588731376.issue41586@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

this caused a variety of buildbot failures.  investigating.

----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41586>
_______________________________________

From report at bugs.python.org  Tue Oct 20 13:41:55 2020
From: report at bugs.python.org (twisteroid ambassador)
Date: Tue, 20 Oct 2020 17:41:55 +0000
Subject: [issue39116] StreamReader.readexactly() raises GeneratorExit on
 ProactorEventLoop
In-Reply-To: <1576944276.46.0.229840779815.issue39116@roundup.psfhosted.org>
Message-ID: <1603215715.93.0.0714635793826.issue39116@roundup.psfhosted.org>


twisteroid ambassador <twisteroid.ambassador at gmail.com> added the comment:

I have attached a script that should be able to reproduces this problem. It's not a minimal reproduction, but hopefully easy enough to trigger.

The script is a SOCKS5 proxy server listening on localhost:1080. In its current form it does not need any external dependencies. Run it on Windows 10 + Python 3.9, set a browser to use the proxy server, and browse a little bit, it should soon start printing mysterious errors involving GeneratorExit.

----------
Added file: https://bugs.python.org/file49532/prettysocks.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39116>
_______________________________________

From report at bugs.python.org  Tue Oct 20 14:04:19 2020
From: report at bugs.python.org (Vladimir Matveev)
Date: Tue, 20 Oct 2020 18:04:19 +0000
Subject: [issue42085] Add dedicated slot for sending values
In-Reply-To: <1603136296.98.0.312180912341.issue42085@roundup.psfhosted.org>
Message-ID: <1603217059.2.0.461214882372.issue42085@roundup.psfhosted.org>


Change by Vladimir Matveev <desco.by at gmail.com>:


----------
type:  -> performance

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42085>
_______________________________________

From report at bugs.python.org  Tue Oct 20 14:18:14 2020
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 20 Oct 2020 18:18:14 +0000
Subject: [issue41737] Improper NotADirectoryError when opening a file in a
 fake directory
In-Reply-To: <1599492997.14.0.974001441191.issue41737@roundup.psfhosted.org>
Message-ID: <1603217894.76.0.180599308078.issue41737@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

Regarding documentation, builtin open() and the io and os modules generally do not provide information about platform-specific errors. But documenting the behavior for the NotADirectoryError exception itself may be useful considering it applies to many POSIX functions that access filepaths, such as stat, open, mkdir, rmdir, unlink, and rename.

Regarding behavior, I don't see anything reasonable that can or should be done for POSIX. In Windows, it should be possible to know whether FileNotFoundError is due to a bad path prefix (ERROR_PATH_NOT_FOUND, 3) or a missing file (ERROR_FILE_NOT_FOUND, 2), but io.FileIO currently only uses standard C errno, which maps both of these cases to ENOENT. So one behavior that *can* be fixed in this situation is to get the actual Windows error code from MSVC _doserrno, such that the raised FileNotFoundError would have the relevant Windows error code in its winerror attribute.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41737>
_______________________________________

From report at bugs.python.org  Tue Oct 20 14:32:02 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 18:32:02 +0000
Subject: [issue13348] test_unicode_file fails: shutil.copy2 says "same file"
In-Reply-To: <1320490682.69.0.905628343655.issue13348@psf.upfronthosting.co.za>
Message-ID: <1603218722.67.0.84925110407.issue13348@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

May we assume that a unit test failure from 9 years ago is no longer relevant?

----------
nosy: +iritkatriel
status: pending -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13348>
_______________________________________

From report at bugs.python.org  Tue Oct 20 14:41:01 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 18:41:01 +0000
Subject: [issue40640] Tutorial for Continue missing ... line
In-Reply-To: <1589608941.53.0.91951505263.issue40640@roundup.psfhosted.org>
Message-ID: <1603219261.48.0.491434808961.issue40640@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Chas - there is a conflict in the PR. Would you mind refreshing it? I'll try to make sure it gets merged this time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40640>
_______________________________________

From report at bugs.python.org  Tue Oct 20 14:59:33 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 20 Oct 2020 18:59:33 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1603220373.63.0.718554049219.issue42010@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I think kj's patch is ready to merge.  Guido, do you want to take a look?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Tue Oct 20 15:17:14 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 19:17:14 +0000
Subject: [issue42098] Test suite should verify auditing events get triggered
Message-ID: <1603221434.24.0.924056156868.issue42098@roundup.psfhosted.org>


New submission from A.M. Kuchling <amk at amk.ca>:

During the 3.10 development process, a call to `sys.audit()` got accidentally removed from the glob module. No tests caught it.

This is clearly bad. sys.audit() is intended for security-related purposes and can result in operations being cancelled, so someone may be relying on a particular event being triggered to catch a risky situation. If we then accidentally remove the audit event, that's a security hole.

The test suite should be verifying that audit events get triggered when we expect.  Presumably we'll need some kind of context manager or assertion that will do something like: 

  with self.assertAuditEventTriggered('glob.glob', 'path'):    
    glob.glob('path')

----------
components: Tests
messages: 379154
nosy: akuchling
priority: normal
severity: normal
status: open
title: Test suite should verify auditing events get triggered
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42098>
_______________________________________

From report at bugs.python.org  Tue Oct 20 15:18:59 2020
From: report at bugs.python.org (Neil Schemenauer)
Date: Tue, 20 Oct 2020 19:18:59 +0000
Subject: [issue42099] Fix reference to ob_type in unionobject.c and ceval
Message-ID: <1603221539.38.0.388949807312.issue42099@roundup.psfhosted.org>


New submission from Neil Schemenauer <nas-python at arctrix.com>:

It is great that access to ob_type has been cleaned up to use an access macro.  There are two spots that still need fixing.

I think we should do something to help avoid this kind of thing slipping into the code in the future.  E.g. a special build flag that renames the ob_type member would work.  I'll make a separate bug for that.

----------
assignee: vstinner
components: Interpreter Core
messages: 379155
nosy: nascheme, vstinner
priority: normal
severity: normal
stage: patch review
status: open
title: Fix reference to ob_type in unionobject.c and ceval
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42099>
_______________________________________

From report at bugs.python.org  Tue Oct 20 15:22:34 2020
From: report at bugs.python.org (Neil Schemenauer)
Date: Tue, 20 Oct 2020 19:22:34 +0000
Subject: [issue42099] Fix reference to ob_type in unionobject.c and ceval
In-Reply-To: <1603221539.38.0.388949807312.issue42099@roundup.psfhosted.org>
Message-ID: <1603221754.47.0.36663433269.issue42099@roundup.psfhosted.org>


Change by Neil Schemenauer <nas-python at arctrix.com>:


----------
keywords: +patch
pull_requests: +21784
pull_request: https://github.com/python/cpython/pull/22829

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42099>
_______________________________________

From report at bugs.python.org  Tue Oct 20 15:22:37 2020
From: report at bugs.python.org (Kevin)
Date: Tue, 20 Oct 2020 19:22:37 +0000
Subject: [issue42087] Remove pre-AIX 6.1 dead code paths
In-Reply-To: <1603139085.09.0.736153857755.issue42087@roundup.psfhosted.org>
Message-ID: <1603221757.35.0.537233428509.issue42087@roundup.psfhosted.org>


Change by Kevin <kadler at us.ibm.com>:


----------
keywords: +patch
pull_requests: +21785
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22830

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42087>
_______________________________________

From report at bugs.python.org  Tue Oct 20 15:23:22 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 19:23:22 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603221802.57.0.9529277684.issue41192@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:


New changeset 3f7e990fd49dbabc1dde41ce58c1bdda9f56ead7 by Saiyang Gou in branch 'master':
bpo-41192: Add documentation of undocumented audit events (GH-21308)
https://github.com/python/cpython/commit/3f7e990fd49dbabc1dde41ce58c1bdda9f56ead7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Tue Oct 20 15:23:45 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 19:23:45 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603221825.45.0.690825833103.issue41192@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21787
pull_request: https://github.com/python/cpython/pull/22832

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Tue Oct 20 15:23:36 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 19:23:36 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603221816.98.0.346116315347.issue41192@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21786
pull_request: https://github.com/python/cpython/pull/22831

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Tue Oct 20 15:44:15 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 19:44:15 +0000
Subject: [issue23510] multiprocessing bug SyncManager and 'with'
In-Reply-To: <1424784474.12.0.228863603483.issue23510@psf.upfronthosting.co.za>
Message-ID: <1603223055.45.0.99013242562.issue23510@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Yes, it was fixed in version 3.3, under issue15064:

https://github.com/python/cpython/commit/ac38571f00ccb5e1e0346ad27a8fac96d05e61c3

----------
resolution:  -> duplicate
stage: needs patch -> resolved
status: open -> closed
superseder:  -> Use context manager protocol for more multiprocessing types

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23510>
_______________________________________

From report at bugs.python.org  Tue Oct 20 15:44:59 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 19:44:59 +0000
Subject: [issue23510] multiprocessing bug SyncManager and 'with'
In-Reply-To: <1424784474.12.0.228863603483.issue23510@psf.upfronthosting.co.za>
Message-ID: <1603223099.77.0.949474302778.issue23510@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution: duplicate -> out of date

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23510>
_______________________________________

From report at bugs.python.org  Tue Oct 20 15:48:53 2020
From: report at bugs.python.org (Mark Keller)
Date: Tue, 20 Oct 2020 19:48:53 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603223333.87.0.595599120439.issue42041@roundup.psfhosted.org>


Mark Keller <markooo.keller at gmail.com> added the comment:

+1 to what Steve said

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Tue Oct 20 16:02:27 2020
From: report at bugs.python.org (Paul Moore)
Date: Tue, 20 Oct 2020 20:02:27 +0000
Subject: [issue42041] venv subprocess call to python resolves to wrong
 interpreter
In-Reply-To: <1602741057.44.0.746329954435.issue42041@roundup.psfhosted.org>
Message-ID: <1603224147.95.0.426096443693.issue42041@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:


New changeset 5ab27cc518f614a0b954ff3eb125290f264242d5 by Paul Moore in branch 'master':
bpo-42041: Clarify how subprocess searches for the executable (GH-22715)
https://github.com/python/cpython/commit/5ab27cc518f614a0b954ff3eb125290f264242d5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42041>
_______________________________________

From report at bugs.python.org  Tue Oct 20 16:05:16 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 20:05:16 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603224316.71.0.910590069493.issue41192@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:


New changeset 46130f85381f697dc7f609b2659cc046d2370417 by Miss Skeleton (bot) in branch '3.9':
bpo-41192: Add documentation of undocumented audit events (GH-22831)
https://github.com/python/cpython/commit/46130f85381f697dc7f609b2659cc046d2370417


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Tue Oct 20 16:05:59 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 20:05:59 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603224359.04.0.457774678802.issue41192@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:


New changeset 058affc09f0f105444ec62c880907a512b785b72 by Miss Skeleton (bot) in branch '3.8':
bpo-41192: Add documentation of undocumented audit events (GH-22832)
https://github.com/python/cpython/commit/058affc09f0f105444ec62c880907a512b785b72


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Tue Oct 20 16:10:34 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 20:10:34 +0000
Subject: [issue41192] Some audit events are undocumented
In-Reply-To: <1593671252.05.0.986281783812.issue41192@roundup.psfhosted.org>
Message-ID: <1603224634.91.0.78702754752.issue41192@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:

After this flurry of commits, I think everything associated with the issue is now fixed.  

Along the way, I also noticed that the sys.audit() call had disappeared from the glob module (it's now restored) and filed issue #42098 to improve the test suite's checking of audit events.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41192>
_______________________________________

From report at bugs.python.org  Tue Oct 20 16:27:53 2020
From: report at bugs.python.org (Alfred Perlstein)
Date: Tue, 20 Oct 2020 20:27:53 +0000
Subject: [issue35753] Importing call from unittest.mock directly causes
 ValueError
In-Reply-To: <1547669844.88.0.953853980523.issue35753@roundup.psfhosted.org>
Message-ID: <1603225673.47.0.242025304232.issue35753@roundup.psfhosted.org>


Change by Alfred Perlstein <alfred at freebsd.org>:


----------
keywords: +patch
nosy: +splbio
nosy_count: 4.0 -> 5.0
pull_requests: +21788
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/22834

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35753>
_______________________________________

From report at bugs.python.org  Tue Oct 20 16:35:05 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 20:35:05 +0000
Subject: [issue42100] Add _PyType_GetModuleByDef
Message-ID: <1603226105.52.0.971925860816.issue42100@roundup.psfhosted.org>


New submission from Petr Viktorin <encukou at gmail.com>:

I would like to add an internal _PyType_GetModuleByDef function to unblock further work on isolating extension modules, as discussed here: https://mail.python.org/archives/list/capi-sig at python.org/thread/T3P2QNLNLBRFHWSKYSTPMVEIL2EEKFJU/

----------
messages: 379163
nosy: petr.viktorin
priority: normal
severity: normal
status: open
title: Add _PyType_GetModuleByDef

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42100>
_______________________________________

From report at bugs.python.org  Tue Oct 20 16:35:51 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 20:35:51 +0000
Subject: [issue42100] Add _PyType_GetModuleByDef
In-Reply-To: <1603226105.52.0.971925860816.issue42100@roundup.psfhosted.org>
Message-ID: <1603226151.08.0.34187715811.issue42100@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
components: +C API
type:  -> enhancement
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42100>
_______________________________________

From report at bugs.python.org  Tue Oct 20 16:36:38 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 20:36:38 +0000
Subject: [issue42100] Add _PyType_GetModuleByDef
In-Reply-To: <1603226105.52.0.971925860816.issue42100@roundup.psfhosted.org>
Message-ID: <1603226198.73.0.137098510108.issue42100@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
keywords: +patch
pull_requests: +21789
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22835

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42100>
_______________________________________

From report at bugs.python.org  Tue Oct 20 17:17:19 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 21:17:19 +0000
Subject: [issue22210] pdb-run-restarting-a-pdb-session
In-Reply-To: <1408164262.59.0.0117890122292.issue22210@psf.upfronthosting.co.za>
Message-ID: <1603228639.88.0.987895091515.issue22210@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22210>
_______________________________________

From report at bugs.python.org  Tue Oct 20 17:18:09 2020
From: report at bugs.python.org (Matthias Bussonnier)
Date: Tue, 20 Oct 2020 21:18:09 +0000
Subject: [issue42101] Allow inheritance of Venvs
Message-ID: <1603228689.04.0.730975944826.issue42101@roundup.psfhosted.org>


New submission from Matthias Bussonnier <bussonniermatthias at gmail.com>:

Followup from Python Idea: 

https://mail.python.org/archives/list/python-ideas at python.org/thread/KTIYUEYF6XBHOGOLV744RQXMTETVSTOF/

Goal would be to allow layering on virtualenv to speedup creation and use less disk space in the case of many large venv having the same base. 

This would be based on an private internal patch that would be upstreamed.

----------
messages: 379164
nosy: mbussonn
priority: normal
severity: normal
status: open
title: Allow inheritance of Venvs
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42101>
_______________________________________

From report at bugs.python.org  Tue Oct 20 17:27:18 2020
From: report at bugs.python.org (A.M. Kuchling)
Date: Tue, 20 Oct 2020 21:27:18 +0000
Subject: [issue29981] Update Index for set, dict,
 and generator 'comprehensions'
In-Reply-To: <1491328871.52.0.864348862414.issue29981@psf.upfronthosting.co.za>
Message-ID: <1603229238.46.0.970687785234.issue29981@roundup.psfhosted.org>


A.M. Kuchling <amk at amk.ca> added the comment:


New changeset 2d55aa9e37c9c84f4f6a8135d0326da0bcd8f38b by Florian Dahlitz in branch 'master':
bpo-29981: Add examples and update index for set, dict, and generator comprehensions'(GH-20272)
https://github.com/python/cpython/commit/2d55aa9e37c9c84f4f6a8135d0326da0bcd8f38b


----------
nosy: +akuchling

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29981>
_______________________________________

From report at bugs.python.org  Tue Oct 20 17:27:25 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 21:27:25 +0000
Subject: [issue29981] Update Index for set, dict,
 and generator 'comprehensions'
In-Reply-To: <1491328871.52.0.864348862414.issue29981@psf.upfronthosting.co.za>
Message-ID: <1603229245.53.0.891903349366.issue29981@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
keywords: +patch
nosy: +miss-islington
nosy_count: 6.0 -> 7.0
pull_requests: +21790
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22836

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29981>
_______________________________________

From report at bugs.python.org  Tue Oct 20 17:27:33 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 21:27:33 +0000
Subject: [issue29981] Update Index for set, dict,
 and generator 'comprehensions'
In-Reply-To: <1491328871.52.0.864348862414.issue29981@psf.upfronthosting.co.za>
Message-ID: <1603229253.18.0.491832860648.issue29981@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21791
pull_request: https://github.com/python/cpython/pull/22837

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29981>
_______________________________________

From report at bugs.python.org  Tue Oct 20 17:30:54 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 20 Oct 2020 21:30:54 +0000
Subject: [issue37105] Add deprecated-remove information on stream doc
In-Reply-To: <1559266839.05.0.214061892347.issue37105@roundup.psfhosted.org>
Message-ID: <1603229454.79.0.893260389001.issue37105@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I'd say close it, the deprecation can be a separate issue (usually is) and I don't think we need to backport such a minor docs issue to 3.8. The PR is old enough that it made 3.9+3.10 I think (did you check?).

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37105>
_______________________________________

From report at bugs.python.org  Tue Oct 20 17:43:10 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 21:43:10 +0000
Subject: [issue37105] Add deprecated-remove information on stream doc
In-Reply-To: <1559266839.05.0.214061892347.issue37105@roundup.psfhosted.org>
Message-ID: <1603230190.72.0.345221079492.issue37105@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I checked earlier that it's not in 3.8 and 3.9, but now I double-checked and saw that it's not in master either. It was reverted here: 
https://github.com/python/cpython/pull/13251

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37105>
_______________________________________

From report at bugs.python.org  Tue Oct 20 17:44:56 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 21:44:56 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1603230296.68.0.308289955964.issue1635741@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
nosy: +petr.viktorin
nosy_count: 18.0 -> 19.0
pull_requests: +21792
pull_request: https://github.com/python/cpython/pull/22838

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Tue Oct 20 17:46:57 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 21:46:57 +0000
Subject: [issue37105] Add deprecated-remove information on stream doc
In-Reply-To: <1559266839.05.0.214061892347.issue37105@roundup.psfhosted.org>
Message-ID: <1603230417.66.0.272881234142.issue37105@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Or more directly here: https://github.com/python/cpython/commit/6758e6e12a71ef5530146161881f88df1fa43382#diff-f82013fb4ae87c622d4c38a232b5a52e72ce06cd0f956b3d4684341f18890baa

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37105>
_______________________________________

From report at bugs.python.org  Tue Oct 20 17:48:49 2020
From: report at bugs.python.org (Shantanu)
Date: Tue, 20 Oct 2020 21:48:49 +0000
Subject: [issue42102] Make builtins.callable "generic"
Message-ID: <1603230529.81.0.174539582672.issue42102@roundup.psfhosted.org>


New submission from Shantanu <hauntsaninja at gmail.com>:

In the post PEP 585 world, it seems like a bit of a stumbling block for builtins.callable to not able to be parametrised (in a runtime context). Post PEP 604, I'd expect typing.Callable to be the most used typing import after typing.Any, so much of PEP 585's rationale should apply to this case too.

Concretely, one way to implement this would be to turn callable into a type whose __new__ returns a bool and which implements __class_getitem__. We could throw in an __instancecheck__ so that `isinstance(x, callable) == callable(x)`.


PS: Despite being code that crashes instantly, I was still able to find some instances of `isinstance(x, callable)` on popular Github projects: https://grep.app/search?q=isinstance%5C%28.%2A%2C%20callable%5C%29&regexp=true&case=true

----------
messages: 379169
nosy: hauntsaninja
priority: normal
severity: normal
status: open
title: Make builtins.callable "generic"
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42102>
_______________________________________

From report at bugs.python.org  Tue Oct 20 17:51:29 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 20 Oct 2020 21:51:29 +0000
Subject: [issue37105] Add deprecated-remove information on stream doc
In-Reply-To: <1559266839.05.0.214061892347.issue37105@roundup.psfhosted.org>
Message-ID: <1603230689.63.0.445513005991.issue37105@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Whoops, never mind me. Irit can you friend me on Discourse?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37105>
_______________________________________

From report at bugs.python.org  Tue Oct 20 17:57:53 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 20 Oct 2020 21:57:53 +0000
Subject: [issue40891] Use PEP 573 in functools
In-Reply-To: <1591468044.26.0.252061125305.issue40891@roundup.psfhosted.org>
Message-ID: <1603231073.89.0.701175678098.issue40891@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Here is a PR for _PyType_GetModuleByDef: https://github.com/python/cpython/pull/22835

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40891>
_______________________________________

From report at bugs.python.org  Tue Oct 20 18:59:25 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 20 Oct 2020 22:59:25 +0000
Subject: [issue42064] Convert sqlite3 to multi-phase initialisation (PEP 489)
In-Reply-To: <1602963425.44.0.576962569847.issue42064@roundup.psfhosted.org>
Message-ID: <1603234765.28.0.484464579466.issue42064@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Connection.__init__() fixed by iterating though tp_bases in order to find the correct base class to load the state from. There should be a better way to do this than to dig through type member internals.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42064>
_______________________________________

From report at bugs.python.org  Tue Oct 20 19:18:26 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 20 Oct 2020 23:18:26 +0000
Subject: [issue41586] Allow to set pipe size on subprocess.Popen.
In-Reply-To: <1597815960.69.0.196461399013.issue41586@roundup.psfhosted.org>
Message-ID: <1603235906.44.0.044310001531.issue41586@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
pull_requests: +21793
stage: commit review -> patch review
pull_request: https://github.com/python/cpython/pull/22839

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41586>
_______________________________________

From report at bugs.python.org  Tue Oct 20 19:26:58 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 20 Oct 2020 23:26:58 +0000
Subject: [issue37105] Add deprecated-remove information on stream doc
In-Reply-To: <1559266839.05.0.214061892347.issue37105@roundup.psfhosted.org>
Message-ID: <1603236418.45.0.736462975616.issue37105@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37105>
_______________________________________

From report at bugs.python.org  Tue Oct 20 19:38:21 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 20 Oct 2020 23:38:21 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1603237101.13.0.247365174572.issue42010@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 7cdf30fff39ea97f403b5472096349998d190e30 by kj in branch 'master':
bpo-42010: [docs] Clarify subscription of types (GH-22822)
https://github.com/python/cpython/commit/7cdf30fff39ea97f403b5472096349998d190e30


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Tue Oct 20 19:38:34 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 23:38:34 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1603237114.96.0.365235962336.issue42010@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 5.0 -> 6.0
pull_requests: +21794
pull_request: https://github.com/python/cpython/pull/22840

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Tue Oct 20 19:58:56 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 20 Oct 2020 23:58:56 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1603238336.58.0.130386634274.issue42010@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset d05514ace652769457e6228f0186d4f830b676b9 by Miss Skeleton (bot) in branch '3.9':
[3.9] bpo-42010: [docs] Clarify subscription of types (GH-22822) (GH-22840)
https://github.com/python/cpython/commit/d05514ace652769457e6228f0186d4f830b676b9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Tue Oct 20 20:01:22 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 21 Oct 2020 00:01:22 +0000
Subject: [issue42010] Generic types accept indexing/subscripting,
 causing confusion
In-Reply-To: <1602488772.63.0.453170836227.issue42010@roundup.psfhosted.org>
Message-ID: <1603238482.94.0.447514772378.issue42010@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42010>
_______________________________________

From report at bugs.python.org  Tue Oct 20 20:12:06 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 21 Oct 2020 00:12:06 +0000
Subject: [issue42102] Make builtins.callable "generic"
In-Reply-To: <1603230529.81.0.174539582672.issue42102@roundup.psfhosted.org>
Message-ID: <1603239126.03.0.572474925001.issue42102@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
nosy: +gvanrossum, levkivskyi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42102>
_______________________________________

From report at bugs.python.org  Tue Oct 20 20:18:03 2020
From: report at bugs.python.org (Eric Snow)
Date: Wed, 21 Oct 2020 00:18:03 +0000
Subject: [issue36876] [subinterpreters] Global C variables are a problem
In-Reply-To: <1557514902.13.0.853517754348.issue36876@roundup.psfhosted.org>
Message-ID: <1603239483.24.0.518286942168.issue36876@roundup.psfhosted.org>


Change by Eric Snow <ericsnowcurrently at gmail.com>:


----------
pull_requests: +21795
pull_request: https://github.com/python/cpython/pull/22841

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36876>
_______________________________________

From report at bugs.python.org  Tue Oct 20 20:25:11 2020
From: report at bugs.python.org (Robert Wessen)
Date: Wed, 21 Oct 2020 00:25:11 +0000
Subject: [issue42103] DoS (MemError via CPU and RAM exhaustion) when
 processing malformed Apple Property List files in binary format
Message-ID: <1603239911.48.0.657036824442.issue42103@roundup.psfhosted.org>


New submission from Robert Wessen <wessen at gmail.com>:

In versions of Python from 3.4-3.10, the Python core plistlib library supports Apple's binary plist format. When given malformed input, the implementation can be forced to create an argument to struct.unpack() which consumes all available CPU and memory until a MemError is thrown as it builds the 'format' argument to unpack().

This can be seen with the following malformed example binary plist input:

```
$ xxd binary_plist_dos.bplist
00000000: 6270 6c69 7374 3030 d101 0255 614c 6973  bplist00...UaLis
00000010: 74a5 0304 0506 0000 00df 4251 4351 44a3  t.........BQCQD.
00000020: 0809 0a10 0110 0210 0308 0b11 1719 1b1d  ................
00000030: 0000 0101 0000 0000 0000 000b 0000 0000  ................
00000040: 0000 0000 0000 0000 0000 0029            ...........)

```
The error is reached in the following lines of plistlib.py:
(https://github.com/python/cpython/blob/e9959c71185d0850c84e3aba0301fbc238f194a9/Lib/plistlib.py#L485)

```
    def _read_ints(self, n, size):
        data = self._fp.read(size * n)
        if size in _BINARY_FORMAT:
            return struct.unpack('>' + _BINARY_FORMAT[size] * n, data)
```
When the malicious example above is opened by plistlib, it results in 'n' being controlled by the input and it can be forced to be very large. Plistlib attempts to build a string which is as long as 'n', consuming excessive resources.

Apple's built in utilities for handling plist files detects this same file as malformed and will not process it.

----------
components: Interpreter Core
messages: 379175
nosy: wessen
priority: normal
severity: normal
status: open
title: DoS (MemError via CPU and RAM exhaustion) when processing malformed Apple Property List files in binary format
type: resource usage
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42103>
_______________________________________

From report at bugs.python.org  Tue Oct 20 20:37:33 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Wed, 21 Oct 2020 00:37:33 +0000
Subject: [issue41586] Allow to set pipe size on subprocess.Popen.
In-Reply-To: <1597815960.69.0.196461399013.issue41586@roundup.psfhosted.org>
Message-ID: <1603240653.64.0.608947370081.issue41586@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset 786addd9d07b6c712b8ea9ee06e1f9f41c1b67a1 by Gregory P. Smith in branch 'master':
bpo-41586: Attempt to make the pipesize tests more robust. (GH-22839)
https://github.com/python/cpython/commit/786addd9d07b6c712b8ea9ee06e1f9f41c1b67a1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41586>
_______________________________________

From report at bugs.python.org  Tue Oct 20 21:00:20 2020
From: report at bugs.python.org (David Antonini)
Date: Wed, 21 Oct 2020 01:00:20 +0000
Subject: [issue35753] Importing call from unittest.mock directly causes
 ValueError
In-Reply-To: <1547669844.88.0.953853980523.issue35753@roundup.psfhosted.org>
Message-ID: <1603242020.06.0.865492402503.issue35753@roundup.psfhosted.org>


David Antonini <davidantonini at hotmail.com> added the comment:

Somehow I missed the follow up here until now. I don't remember the original code, but I'm fairly confident that mocked_print is the patched print function eg 
with patch('dionysus_app.class_functions.print') as mocked_print:

Probably solved in this commit dated the same day as the bug report:
https://github.com/toonarmycaptain/dionysus/commit/4f0eb7ca32b891d99106441b92a6c1accd0bb96d

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35753>
_______________________________________

From report at bugs.python.org  Tue Oct 20 21:06:46 2020
From: report at bugs.python.org (Ned Deily)
Date: Wed, 21 Oct 2020 01:06:46 +0000
Subject: [issue42103] [security] DoS (MemError via CPU and RAM exhaustion)
 when processing malformed Apple Property List files in binary format
In-Reply-To: <1603239911.48.0.657036824442.issue42103@roundup.psfhosted.org>
Message-ID: <1603242406.53.0.540091247859.issue42103@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
components: +Library (Lib) -Interpreter Core
keywords: +security_issue
nosy: +ned.deily, ronaldoussoren, serhiy.storchaka
title: DoS (MemError via CPU and RAM exhaustion) when processing malformed Apple Property List files in binary format -> [security] DoS (MemError via CPU and RAM exhaustion) when processing malformed Apple Property List files in binary format

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42103>
_______________________________________

From report at bugs.python.org  Tue Oct 20 21:19:48 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 21 Oct 2020 01:19:48 +0000
Subject: [issue41859] Uncaught ValueError
In-Reply-To: <1601007125.39.0.397372093674.issue41859@roundup.psfhosted.org>
Message-ID: <1603243188.49.0.239923580761.issue41859@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
Removed message: https://bugs.python.org/msg377737

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41859>
_______________________________________

From report at bugs.python.org  Tue Oct 20 21:20:24 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 21 Oct 2020 01:20:24 +0000
Subject: [issue41859] Uncaught ValueError
In-Reply-To: <1601007125.39.0.397372093674.issue41859@roundup.psfhosted.org>
Message-ID: <1603243224.05.0.808832548886.issue41859@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


Removed file: https://bugs.python.org/file49480/debian-desktop.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41859>
_______________________________________

From report at bugs.python.org  Tue Oct 20 21:20:38 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 21 Oct 2020 01:20:38 +0000
Subject: [issue41859] Uncaught ValueError
In-Reply-To: <1601007125.39.0.397372093674.issue41859@roundup.psfhosted.org>
Message-ID: <1603243238.77.0.924203074717.issue41859@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
nosy:  -patanjalisutra666

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41859>
_______________________________________

From report at bugs.python.org  Tue Oct 20 21:29:21 2020
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 21 Oct 2020 01:29:21 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1603243761.85.0.115002336771.issue41902@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 25492a5b59c5b74328278f195540e318ab87674f by Dong-hee Na in branch 'master':
bpo-41902: Micro optimization for compute_item of range (GH-22492)
https://github.com/python/cpython/commit/25492a5b59c5b74328278f195540e318ab87674f


----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Tue Oct 20 21:48:07 2020
From: report at bugs.python.org (Ken Jin)
Date: Wed, 21 Oct 2020 01:48:07 +0000
Subject: [issue42102] Make builtins.callable "generic"
In-Reply-To: <1603230529.81.0.174539582672.issue42102@roundup.psfhosted.org>
Message-ID: <1603244887.69.0.111932044199.issue42102@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

+1 to this. I'm more surprised that callable wasn't already able to do that (also surprised at the ``isinstance(x, callable)`` code crashing). 

I think the implementation would be slightly different than what you proposed. I'd like to give it a shot if you aren't already doing this, and if there's more support for this too.

----------
nosy: +kj

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42102>
_______________________________________

From report at bugs.python.org  Tue Oct 20 22:08:27 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 02:08:27 +0000
Subject: [issue23706] pathlib.Path.write_text should include a newline argument
In-Reply-To: <1426757561.17.0.481870343329.issue23706@psf.upfronthosting.co.za>
Message-ID: <1603246107.11.0.577918372394.issue23706@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 5f227413400c4dfdba210cc0f8c9305421638bc1 by ?????? in branch 'master':
bpo-23706: Add newline parameter to pathlib.Path.write_text (GH-22420) (GH-22420)
https://github.com/python/cpython/commit/5f227413400c4dfdba210cc0f8c9305421638bc1


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23706>
_______________________________________

From report at bugs.python.org  Tue Oct 20 22:19:28 2020
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 21 Oct 2020 02:19:28 +0000
Subject: [issue23706] pathlib.Path.write_text should include a newline argument
In-Reply-To: <1426757561.17.0.481870343329.issue23706@psf.upfronthosting.co.za>
Message-ID: <1603246768.22.0.582229761075.issue23706@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Thank you

----------
nosy: +methane
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23706>
_______________________________________

From report at bugs.python.org  Tue Oct 20 22:24:55 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 21 Oct 2020 02:24:55 +0000
Subject: [issue42102] Make builtins.callable "generic"
In-Reply-To: <1603230529.81.0.174539582672.issue42102@roundup.psfhosted.org>
Message-ID: <1603247095.41.0.852173957017.issue42102@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I'm not against this, though I'm not sure it really buys us much (Any still has to be imported from typing). Maybe you can submit a PR? Running the tests might be informative.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42102>
_______________________________________

From report at bugs.python.org  Tue Oct 20 22:30:09 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Wed, 21 Oct 2020 02:30:09 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1603247409.16.0.312813948669.issue41902@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:


New changeset c0f22fb8b3006936757cebb959cee94e285bc503 by Dong-hee Na in branch 'master':
bpo-41902: Micro optimization for range.index if step is 1 (GH-22479)
https://github.com/python/cpython/commit/c0f22fb8b3006936757cebb959cee94e285bc503


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Tue Oct 20 22:39:25 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Wed, 21 Oct 2020 02:39:25 +0000
Subject: [issue41902] Micro optimization for range.index if step is 1
In-Reply-To: <1601559765.96.0.883895901539.issue41902@roundup.psfhosted.org>
Message-ID: <1603247965.42.0.403772734659.issue41902@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41902>
_______________________________________

From report at bugs.python.org  Tue Oct 20 22:50:11 2020
From: report at bugs.python.org (Ammar Askar)
Date: Wed, 21 Oct 2020 02:50:11 +0000
Subject: [issue38980] Compile libpython with -fno-semantic-interposition
In-Reply-To: <1575561631.45.0.417730594345.issue38980@roundup.psfhosted.org>
Message-ID: <1603248611.36.0.459881445118.issue38980@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

Hey Victor, should we try to land this in Python 3.10? 

Given that no one has brought up any big concerns aside from LD_PRELOAD based hacks and how clang has already had this as the default I think it's relatively safe to make a default for with-optimizations.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38980>
_______________________________________

From report at bugs.python.org  Tue Oct 20 22:54:16 2020
From: report at bugs.python.org (karl)
Date: Wed, 21 Oct 2020 02:54:16 +0000
Subject: [issue42104] xml.etree should support contains() function
Message-ID: <1603248856.3.0.186912878202.issue42104@roundup.psfhosted.org>


New submission from karl <karl+pythonbugs at la-grange.net>:

In XPath 1.0 
The function contains() is available 

> Function: boolean contains(string, string)
> The contains function returns true if the first argument string contains the second argument string, and otherwise returns false.

In https://www.w3.org/TR/1999/REC-xpath-19991116/#function-contains


```
<body>
   <p class="doc">One attribute: doc</p>
   <p class="doc test">Two Attributes: doc test</p>
   <p class="test">One Attribute: test</p>
</body>
```

Currently, we can do this

```
>>> from lxml import etree
>>> root = etree.fromstring("""<body>
...    <p class="doc">One attribute</p>
...    <p class="doc test">Two Attributes: doc test</p>
...    <p class="doc2 test">Two Attributes: doc2 test</p>
... </body>
... """)
>>> elts = root.xpath("//p[@class='doc']")
>>> elts, etree.tostring(elts[0])
([<Element p at 0x102670900>], b'<p class="doc">One attribute</p>\n   ')
```


One way of extracting the list of 2 elements which contains the attribute doc with XPath is:


```
>>> root.xpath("//p[contains(@class, 'doc')]")
[<Element p at 0x1026708c0>, <Element p at 0x102670780>]
>>> [etree.tostring(elt) for elt in root.xpath("//p[contains(@class, 'doc')]")]
[b'<p class="doc">One attribute: doc</p>\n   ', b'<p class="doc test">Two Attributes: doc test</p>\n   ']
```


There is no easy way to extract all elements containing a "doc" value in a multi-values attribute in python 3.10 with xml.etree, which is quite common in html. 


```
>>> import xml.etree.ElementTree as ET
>>> root = ET.fromstring("""<body>
...    <p class="doc">One attribute: doc</p>
...    <p class="doc test">Two Attributes: doc test</p>
...    <p class="test">One Attribute: test</p>
... </body>"""
... )
>>> root.xpath("//p[contains(@class, 'doc')]")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
AttributeError: 'xml.etree.ElementTree.Element' object has no attribute 'xpath'
```

----------
components: Library (Lib)
messages: 379185
nosy: karlcow
priority: normal
severity: normal
status: open
title: xml.etree should support contains() function
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42104>
_______________________________________

From report at bugs.python.org  Tue Oct 20 23:23:56 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 21 Oct 2020 03:23:56 +0000
Subject: [issue42085] Add dedicated slot for sending values
In-Reply-To: <1603136296.98.0.312180912341.issue42085@roundup.psfhosted.org>
Message-ID: <1603250636.07.0.285906600998.issue42085@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
nosy: +asvetlov, yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42085>
_______________________________________

From report at bugs.python.org  Tue Oct 20 23:25:55 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 21 Oct 2020 03:25:55 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
In-Reply-To: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>
Message-ID: <1603250755.87.0.300959475128.issue42097@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Have you found this in 3.8+?  Since last June, 3.7 only gets security fixes, and this might have been fixed in later versions.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Tue Oct 20 23:47:27 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 21 Oct 2020 03:47:27 +0000
Subject: [issue41736] test_site: test_s_option() failed on AMD64 Windows8.1
 Refleaks 3.7
In-Reply-To: <1599488018.49.0.898281203833.issue41736@roundup.psfhosted.org>
Message-ID: <1603252047.29.0.381349293475.issue41736@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

On Windows 10 and master, I ran 12 copies of test_site in parallel 10 times.  Then I ran -R 3:100 3 times.  All pass.  

Unless refleaks are considered security holes, perhaps this should be closed until it re-occurs in a normally maintained branch.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41736>
_______________________________________

From report at bugs.python.org  Tue Oct 20 23:58:04 2020
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 21 Oct 2020 03:58:04 +0000
Subject: [issue38980] Compile libpython with -fno-semantic-interposition
In-Reply-To: <1575561631.45.0.417730594345.issue38980@roundup.psfhosted.org>
Message-ID: <1603252684.52.0.755108969534.issue38980@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

+1

----------
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38980>
_______________________________________

From report at bugs.python.org  Wed Oct 21 00:31:49 2020
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 21 Oct 2020 04:31:49 +0000
Subject: [issue30680] textwrap should treat Unicode em-dash like ASCII em-dash
In-Reply-To: <1497553740.26.0.99906894046.issue30680@psf.upfronthosting.co.za>
Message-ID: <1603254709.22.0.135379153082.issue30680@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> Agreed. It makes great sense that textwrap started as highly ASCII-centric. But in the Python 3, Unicode-friendly era, ASCII-biased isn't where we should leave things.

It needs Unicode experts. If we support Unicode, we should implemente UAX #14.
http://www.unicode.org/reports/tr14/tr14-45.html

But I am not sure some core developer love textwrap and Unicode enough to implement it.
It can be implemented in 3rd party package before adding it in stdlib.

Then, is U+2014 really important to implement even though we can not implement UAX#14 in foreseeable future?
It doesn't make sense to me.

----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30680>
_______________________________________

From report at bugs.python.org  Wed Oct 21 00:33:09 2020
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 21 Oct 2020 04:33:09 +0000
Subject: [issue30680] textwrap should treat Unicode em-dash like ASCII em-dash
In-Reply-To: <1497553740.26.0.99906894046.issue30680@psf.upfronthosting.co.za>
Message-ID: <1603254789.39.0.860294269893.issue30680@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
versions: +Python 3.10 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30680>
_______________________________________

From report at bugs.python.org  Wed Oct 21 01:15:26 2020
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 21 Oct 2020 05:15:26 +0000
Subject: [issue41744] NuGet python.props only works in python nuget,
 not other variants
In-Reply-To: <1599579230.23.0.203265478789.issue41744@roundup.psfhosted.org>
Message-ID: <1603257326.18.0.517080093315.issue41744@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset d0bfce992c4ce0e6e71f13a993c91903a97a62f3 by Miss Skeleton (bot) in branch '3.9':
bpo-41744: Package python.props with correct name in NuGet package (GH-22154)
https://github.com/python/cpython/commit/d0bfce992c4ce0e6e71f13a993c91903a97a62f3


----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41744>
_______________________________________

From report at bugs.python.org  Wed Oct 21 01:16:29 2020
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 21 Oct 2020 05:16:29 +0000
Subject: [issue41646] shutil.copy documentation should clarify support for
 path-like objects
In-Reply-To: <1598522026.83.0.0983078348702.issue41646@roundup.psfhosted.org>
Message-ID: <1603257389.46.0.450690102031.issue41646@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 6443a8ccc886749f5e83a8ca073006742b605d90 by Miss Skeleton (bot) in branch '3.8':
bpo-41646: Mention path-like objects support in the docs for shutil.copy() (GH-22208)
https://github.com/python/cpython/commit/6443a8ccc886749f5e83a8ca073006742b605d90


----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41646>
_______________________________________

From report at bugs.python.org  Wed Oct 21 01:16:50 2020
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 21 Oct 2020 05:16:50 +0000
Subject: [issue41646] shutil.copy documentation should clarify support for
 path-like objects
In-Reply-To: <1598522026.83.0.0983078348702.issue41646@roundup.psfhosted.org>
Message-ID: <1603257410.31.0.89965821882.issue41646@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 19019eccdeeb8dea027bd7766ca9fe2892972da4 by Miss Skeleton (bot) in branch '3.9':
bpo-41646: Mention path-like objects support in the docs for shutil.copy() (GH-22208)
https://github.com/python/cpython/commit/19019eccdeeb8dea027bd7766ca9fe2892972da4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41646>
_______________________________________

From report at bugs.python.org  Wed Oct 21 01:29:09 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 05:29:09 +0000
Subject: [issue41316] tarfile: Do not write full path in FNAME field
In-Reply-To: <1594924643.04.0.7239005729.issue41316@roundup.psfhosted.org>
Message-ID: <1603258149.62.0.0103311345296.issue41316@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 7917170c5b4793ca9443f753aaecb8fbb3ad54ef by Miss Skeleton (bot) in branch '3.9':
bpo-41316: Make tarfile follow specs for FNAME (GH-21511)
https://github.com/python/cpython/commit/7917170c5b4793ca9443f753aaecb8fbb3ad54ef


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41316>
_______________________________________

From report at bugs.python.org  Wed Oct 21 01:29:53 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 05:29:53 +0000
Subject: [issue41316] tarfile: Do not write full path in FNAME field
In-Reply-To: <1594924643.04.0.7239005729.issue41316@roundup.psfhosted.org>
Message-ID: <1603258193.35.0.391395088011.issue41316@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset e866f33a48ee24e447fafd181f0da5f9584e0340 by Miss Skeleton (bot) in branch '3.8':
bpo-41316: Make tarfile follow specs for FNAME (GH-21511)
https://github.com/python/cpython/commit/e866f33a48ee24e447fafd181f0da5f9584e0340


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41316>
_______________________________________

From report at bugs.python.org  Wed Oct 21 01:29:00 2020
From: report at bugs.python.org (Daniel Sheppard)
Date: Wed, 21 Oct 2020 05:29:00 +0000
Subject: [issue19699] Update zipimport for PEP 451
In-Reply-To: <1385137762.02.0.629134883022.issue19699@psf.upfronthosting.co.za>
Message-ID: <1603258140.22.0.954851347406.issue19699@roundup.psfhosted.org>


Daniel Sheppard <dansheps at gmail.com> added the comment:

With issue 25711 closed, was this ever resolved under that issue or is this still a pending task?

----------
nosy: +dansheps

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19699>
_______________________________________

From report at bugs.python.org  Wed Oct 21 02:04:04 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Wed, 21 Oct 2020 06:04:04 +0000
Subject: [issue41586] Allow to set pipe size on subprocess.Popen.
In-Reply-To: <1597815960.69.0.196461399013.issue41586@roundup.psfhosted.org>
Message-ID: <1603260244.12.0.632998355323.issue41586@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
resolution:  -> fixed
stage: patch review -> commit review
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41586>
_______________________________________

From report at bugs.python.org  Wed Oct 21 02:22:59 2020
From: report at bugs.python.org (Shantanu)
Date: Wed, 21 Oct 2020 06:22:59 +0000
Subject: [issue42102] Make builtins.callable "generic"
In-Reply-To: <1603230529.81.0.174539582672.issue42102@roundup.psfhosted.org>
Message-ID: <1603261379.05.0.55841853062.issue42102@roundup.psfhosted.org>


Change by Shantanu <hauntsaninja at gmail.com>:


----------
keywords: +patch
pull_requests: +21796
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22848

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42102>
_______________________________________

From report at bugs.python.org  Wed Oct 21 02:32:41 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 21 Oct 2020 06:32:41 +0000
Subject: [issue42102] Make builtins.callable "generic"
In-Reply-To: <1603230529.81.0.174539582672.issue42102@roundup.psfhosted.org>
Message-ID: <1603261961.3.0.851194750736.issue42102@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Callable is very special generic. It differs in many ways from List or Awaitable. You cannot just use GenericAlias.

Also, in contrary to list() or dict(), callable() is not a constructor, it is a predicate. callable[[int], str]() does not make sense.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42102>
_______________________________________

From report at bugs.python.org  Wed Oct 21 02:53:01 2020
From: report at bugs.python.org (Shantanu)
Date: Wed, 21 Oct 2020 06:53:01 +0000
Subject: [issue42102] Make builtins.callable "generic"
In-Reply-To: <1603230529.81.0.174539582672.issue42102@roundup.psfhosted.org>
Message-ID: <1603263181.0.0.00873183883959.issue42102@roundup.psfhosted.org>


Shantanu <hauntsaninja at gmail.com> added the comment:

Sure, I put together a draft PR here: https://github.com/python/cpython/pull/22848 Tests pass cleanly, though timeit indicates callable is slower.

I haven't added instancecheck, which we should consider doing, since `isinstance(x, callable)` would now return False, instead of raising TypeError.

@serhiy
I hack around that using `callable.__new__`, so `callable[[int], str]()` raises a TypeError in my draft PR. Note that `callable[[int], str](f)` would work the same as `callable(f)` does today (which from a typechecking perspective is similar to the fact that `list[int](("a", "b", "c"))` works).
I agree that callable being a predicate means that there probably isn't an aesthetically pleasing way of doing this.

@kj
I'm a little out of my comfort zone, so please let me know if you see a better way of doing things :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42102>
_______________________________________

From report at bugs.python.org  Wed Oct 21 03:12:45 2020
From: report at bugs.python.org (Markus Israelsson)
Date: Wed, 21 Oct 2020 07:12:45 +0000
Subject: [issue42037] Documentation confusion in CookieJar functions
In-Reply-To: <1602689022.88.0.876415237077.issue42037@roundup.psfhosted.org>
Message-ID: <1603264365.68.0.778029563659.issue42037@roundup.psfhosted.org>


Markus Israelsson <markus.israelsson at surgicalscience.com> added the comment:

Sure.

But I will need to get an ok from my company to spend some time on this because I really am not very used to git yet (recently switched).

Also, is it possible to make the request/changes through the company github account or must that in that case be tied directly to this bug report account?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42037>
_______________________________________

From report at bugs.python.org  Wed Oct 21 03:13:55 2020
From: report at bugs.python.org (Markus Israelsson)
Date: Wed, 21 Oct 2020 07:13:55 +0000
Subject: [issue42037] Documentation confusion in CookieJar functions
In-Reply-To: <1602689022.88.0.876415237077.issue42037@roundup.psfhosted.org>
Message-ID: <1603264435.28.0.273998120178.issue42037@roundup.psfhosted.org>


Markus Israelsson <markus.israelsson at surgicalscience.com> added the comment:

I guess due to something having to be signed I would have to create a personal github account :/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42037>
_______________________________________

From report at bugs.python.org  Wed Oct 21 04:10:09 2020
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 21 Oct 2020 08:10:09 +0000
Subject: [issue41316] tarfile: Do not write full path in FNAME field
In-Reply-To: <1594924643.04.0.7239005729.issue41316@roundup.psfhosted.org>
Message-ID: <1603267809.12.0.387840314906.issue41316@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41316>
_______________________________________

From report at bugs.python.org  Wed Oct 21 04:30:54 2020
From: report at bugs.python.org (Markus Israelsson)
Date: Wed, 21 Oct 2020 08:30:54 +0000
Subject: [issue42037] Documentation confusion in CookieJar functions
In-Reply-To: <1602689022.88.0.876415237077.issue42037@roundup.psfhosted.org>
Message-ID: <1603269054.87.0.320633738026.issue42037@roundup.psfhosted.org>


Markus Israelsson <markus.israelsson at surgicalscience.com> added the comment:

I got ok from the higherups.
Will plan this into next sprint so it will take a week or 2 before I get to it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42037>
_______________________________________

From report at bugs.python.org  Wed Oct 21 04:51:48 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 08:51:48 +0000
Subject: [issue40084] HTTPStatus has incomplete dir() listing
In-Reply-To: <1585293405.13.0.478935860244.issue40084@roundup.psfhosted.org>
Message-ID: <1603270308.58.0.932381817122.issue40084@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21797
pull_request: https://github.com/python/cpython/pull/22853

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40084>
_______________________________________

From report at bugs.python.org  Wed Oct 21 04:51:59 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 08:51:59 +0000
Subject: [issue40084] HTTPStatus has incomplete dir() listing
In-Reply-To: <1585293405.13.0.478935860244.issue40084@roundup.psfhosted.org>
Message-ID: <1603270319.18.0.348662411799.issue40084@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21798
pull_request: https://github.com/python/cpython/pull/22854

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40084>
_______________________________________

From report at bugs.python.org  Wed Oct 21 04:55:42 2020
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 21 Oct 2020 08:55:42 +0000
Subject: [issue41819] Fix some compiler warnings
In-Reply-To: <1600582202.7.0.502087072911.issue41819@roundup.psfhosted.org>
Message-ID: <1603270542.18.0.0643130094441.issue41819@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset c756c2b507b088919ac0c1aa8b0d8c8bdbdd75ee by Miss Skeleton (bot) in branch '3.8':
bpo-41819: Fix compiler warning in init_dump_ascii_wstr() (GH-22332)
https://github.com/python/cpython/commit/c756c2b507b088919ac0c1aa8b0d8c8bdbdd75ee


----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41819>
_______________________________________

From report at bugs.python.org  Wed Oct 21 04:55:59 2020
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 21 Oct 2020 08:55:59 +0000
Subject: [issue41819] Fix some compiler warnings
In-Reply-To: <1600582202.7.0.502087072911.issue41819@roundup.psfhosted.org>
Message-ID: <1603270559.33.0.699321017664.issue41819@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41819>
_______________________________________

From report at bugs.python.org  Wed Oct 21 05:44:15 2020
From: report at bugs.python.org (Ganesh Kumar)
Date: Wed, 21 Oct 2020 09:44:15 +0000
Subject: [issue42105] allow_abbrev not working as intended in
 "argparse.ArgumentParser" in Python 3.9.0
Message-ID: <1603273455.18.0.937271574309.issue42105@roundup.psfhosted.org>


New submission from Ganesh Kumar <ganesh-kumar at live.com>:

the "allow_abbrev" in "argparse.ArgumentParser" behavior does not work as intended in python 3.9.0

$ python3 --version
Python 3.5.3
$ python3 mcve.py -S
$ python3 mcve.py -SS
usage: mcve.py [-h] [-S]
mcve.py: error: unrecognized arguments: -SS

$ python3.9 --version
Python 3.9.0
$ python3.9 mcve.py -S
$ python3.9 mcve.py -SS # no erros raised here
$

Have attached a sample file to check this

----------
components: Library (Lib)
files: mcve.py
messages: 379202
nosy: Rin
priority: normal
severity: normal
status: open
title: allow_abbrev not working as intended in "argparse.ArgumentParser" in Python 3.9.0
type: behavior
versions: Python 3.9
Added file: https://bugs.python.org/file49533/mcve.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42105>
_______________________________________

From report at bugs.python.org  Wed Oct 21 05:59:57 2020
From: report at bugs.python.org (Xavier Morel)
Date: Wed, 21 Oct 2020 09:59:57 +0000
Subject: [issue42106] docs.python.org prioritises search horribly
Message-ID: <1603274397.05.0.508797986319.issue42106@roundup.psfhosted.org>


New submission from Xavier Morel <xavier.morel at masklinn.net>:

I expect it simply uses sphinx and I don't know if sphinx's search is easily customisable but the experience is really terrible when looking for the doc of a specific thing, *especially* when that thing is or is related to a builtin, which I'd expect to be extremely common. Though I expect part of the issue might also be that builtin or ABC methods are not documented *as such*, they're just written as code in tables.

For instance if you search "append": https://docs.python.org/3/search.html?q=append

On my end, neither list nor MutableSequence appear anywhere on this page, even scrolling down.

Searching for "list": https://docs.python.org/3/search.html?q=list

The documentation for the builtin "list" object also doesn't appear on the page. "Data Structures"[0] and "built-in types"[1] appear below the fold and the former is genuinely useful but also very easy to miss (I had not actually noticed it before going back in order to get the various links and try to extensively describe the issue). Neither actually links to the `list` builtin type though.

Above the fold we find various "list" methods and classes from the stdlib as well as the PDB `list` comment, none of which seems like the best match for the query.

And even Google doesn't help much there, most of the hits are for third-party documentation, and the one docs.python.org link is to the Data Structures page *of Python 2.7*.

[0] https://docs.python.org/3/tutorial/datastructures.html?highlight=list
[1] https://docs.python.org/3/library/stdtypes.html?highlight=list

----------
assignee: docs at python
components: Documentation
messages: 379203
nosy: docs at python, xmorel
priority: normal
severity: normal
status: open
title: docs.python.org prioritises search horribly
type: enhancement
versions: Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42106>
_______________________________________

From report at bugs.python.org  Wed Oct 21 06:37:25 2020
From: report at bugs.python.org (Seth Junot)
Date: Wed, 21 Oct 2020 10:37:25 +0000
Subject: [issue42107] Monotonic time on macOS 10.12+ should use
 mach_continuous_time()
Message-ID: <1603276645.14.0.842497391602.issue42107@roundup.psfhosted.org>


New submission from Seth Junot <xsetech at gmail.com>:

This blog post describes an issue with Apple's "CLOCK_UPTIME_RAW" where the clock is reset after a system that hibernates:

https://rachelbythebay.com/w/2020/10/20/ticktock/

According to Apple's documentation, CLOCK_UPTIME_RAW corresponds to mach_absolute_time():

https://developer.apple.com/documentation/kernel/1462446-mach_absolute_time

CPython is using mach_absolute_time() for its time.monotonic() implementation:

https://github.com/python/cpython/blob/f660567/Python/pytime.c#L7

time.monotonic() ought to be backed by the more appropriate mach_continuous_time() ("CLOCK_MONOTONIC_RAW"). Note it was introduced in macOS 10.12+:

https://developer.apple.com/documentation/kernel/1646199-mach_continuous_time

----------
components: macOS
messages: 379204
nosy: ned.deily, ronaldoussoren, sjunot
priority: normal
severity: normal
status: open
title: Monotonic time on macOS 10.12+ should use mach_continuous_time()
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42107>
_______________________________________

From report at bugs.python.org  Wed Oct 21 07:03:28 2020
From: report at bugs.python.org (twisteroid ambassador)
Date: Wed, 21 Oct 2020 11:03:28 +0000
Subject: [issue39116] StreamReader.readexactly() raises GeneratorExit on
 ProactorEventLoop
In-Reply-To: <1576944276.46.0.229840779815.issue39116@roundup.psfhosted.org>
Message-ID: <1603278208.04.0.0294118695089.issue39116@roundup.psfhosted.org>


twisteroid ambassador <twisteroid.ambassador at gmail.com> added the comment:

Well this is unexpected, the same code running on Linux is throwing GeneratorExit-related mysterious exceptions as well. I'm not sure whether this is the same problem, but this one has a clearer traceback. I will attach the full error log, but the most pertinent part seems to be this:


During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/lib/python3.8/contextlib.py", line 662, in __aexit__
    cb_suppress = await cb(*exc_details)
  File "/usr/lib/python3.8/contextlib.py", line 189, in __aexit__
    await self.gen.athrow(typ, value, traceback)
  File "/opt/prettysocks/prettysocks.py", line 332, in closing_writer
    await writer.wait_closed()
  File "/usr/lib/python3.8/asyncio/streams.py", line 376, in wait_closed
    await self._protocol._get_close_waiter(self)
RuntimeError: cannot reuse already awaited coroutine


closing_writer() is an async context manager that calls close() and await wait_closed() on the given StreamWriter. So it looks like wait_closed() can occasionally reuse a coroutine?

----------
Added file: https://bugs.python.org/file49534/error_log_on_linux_python38.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39116>
_______________________________________

From report at bugs.python.org  Wed Oct 21 07:23:18 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Wed, 21 Oct 2020 11:23:18 +0000
Subject: [issue41100] Build failure on macOS 11 (beta)
In-Reply-To: <1592999467.1.0.372512113251.issue41100@roundup.psfhosted.org>
Message-ID: <1603279398.1.0.512513476096.issue41100@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
pull_requests: +21799
pull_request: https://github.com/python/cpython/pull/22855

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41100>
_______________________________________

From report at bugs.python.org  Wed Oct 21 08:10:36 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 21 Oct 2020 12:10:36 +0000
Subject: [issue42105] allow_abbrev not working as intended in
 "argparse.ArgumentParser" in Python 3.9.0
In-Reply-To: <1603273455.18.0.937271574309.issue42105@roundup.psfhosted.org>
Message-ID: <1603282236.86.0.235081758514.issue42105@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +paul.j3, rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42105>
_______________________________________

From report at bugs.python.org  Wed Oct 21 08:46:23 2020
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 21 Oct 2020 12:46:23 +0000
Subject: [issue42106] docs.python.org prioritises search horribly
In-Reply-To: <1603274397.05.0.508797986319.issue42106@roundup.psfhosted.org>
Message-ID: <1603284383.95.0.595871841915.issue42106@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Can we add search box using DuckDuckGo?
https://duckduckgo.com/?q=site%3Adocs.python.org%2F3%2F+list+append

----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42106>
_______________________________________

From report at bugs.python.org  Wed Oct 21 09:36:39 2020
From: report at bugs.python.org (Xavier Morel)
Date: Wed, 21 Oct 2020 13:36:39 +0000
Subject: [issue42106] docs.python.org prioritises search horribly
In-Reply-To: <1603274397.05.0.508797986319.issue42106@roundup.psfhosted.org>
Message-ID: <1603287399.56.0.629063090216.issue42106@roundup.psfhosted.org>


Xavier Morel <xavier.morel at masklinn.net> added the comment:

Apparently it's at least a possibility on DDG's side (https://duckduckgo.com/search_box), don't know how easy it'd be to integrate in sphinx, or whether a hard dependency on an external search engine is acceptable / desirable.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42106>
_______________________________________

From report at bugs.python.org  Wed Oct 21 09:49:30 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Wed, 21 Oct 2020 13:49:30 +0000
Subject: [issue41747] dataclasses: generated method's using the wrong qualname
In-Reply-To: <1599597537.61.0.699248126431.issue41747@roundup.psfhosted.org>
Message-ID: <1603288170.03.0.502539734704.issue41747@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:


New changeset c7437e2c0216e05fbf17bf96294cb20954e36e48 by Batuhan Taskaya in branch 'master':
bpo-41747: Ensure all dataclass methods uses their parents' qualname (GH-22155)
https://github.com/python/cpython/commit/c7437e2c0216e05fbf17bf96294cb20954e36e48


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41747>
_______________________________________

From report at bugs.python.org  Wed Oct 21 09:50:18 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Wed, 21 Oct 2020 13:50:18 +0000
Subject: [issue41747] dataclasses: generated method's using the wrong qualname
In-Reply-To: <1599597537.61.0.699248126431.issue41747@roundup.psfhosted.org>
Message-ID: <1603288218.06.0.511002190654.issue41747@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Thanks for the PR!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41747>
_______________________________________

From report at bugs.python.org  Wed Oct 21 10:22:51 2020
From: report at bugs.python.org (Socob)
Date: Wed, 21 Oct 2020 14:22:51 +0000
Subject: [issue15125] argparse: positional arguments containing - in name not
 handled well
In-Reply-To: <1340292847.64.0.123942573403.issue15125@psf.upfronthosting.co.za>
Message-ID: <1603290171.56.0.0606485238981.issue15125@roundup.psfhosted.org>


Change by Socob <206a8535 at opayq.com>:


----------
nosy: +Socob

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15125>
_______________________________________

From report at bugs.python.org  Wed Oct 21 10:23:25 2020
From: report at bugs.python.org (Socob)
Date: Wed, 21 Oct 2020 14:23:25 +0000
Subject: [issue9334] argparse does not accept options taking arguments
 beginning with dash (regression from optparse)
In-Reply-To: <1279836939.11.0.811316280273.issue9334@psf.upfronthosting.co.za>
Message-ID: <1603290205.79.0.277322461212.issue9334@roundup.psfhosted.org>


Change by Socob <206a8535 at opayq.com>:


----------
nosy: +Socob

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9334>
_______________________________________

From report at bugs.python.org  Wed Oct 21 10:28:09 2020
From: report at bugs.python.org (=?utf-8?q?Micka=C3=ABl_Schoentgen?=)
Date: Wed, 21 Oct 2020 14:28:09 +0000
Subject: [issue42108] HTTPSConnection hangs forever when the percentage
 completed of the upload drops from 100 to 0
Message-ID: <1603290489.3.0.079937646803.issue42108@roundup.psfhosted.org>


New submission from Micka?l Schoentgen <contact at tiger-222.fr>:

I will try to summarize my findings. I do not think having real data is revelant here, it seems to be a behavior issue.

I was originally using the `requests` module to `POST` some small data. The server will then do its stuff and it would take about 5 minutes to really complete. But for some reason, that call never ends.

I tried to isolate the "bad" code and tried more specific code: I reproduced the issue with `urllib3`, and then with `http.client.HTTPSConnection()`. I did not manage to go lower than that, but I may be able to try some C code with some help.

After having traced the script using `http.client.HTTPSConnection()`, the code is blocked at the `count = SSL_read(self->ssl, mem, len);` call [1].

This is it for the Python side.


Then, I translated the HTTP request to a cURL command (using the same machine, with the same headers and `POST` data). Surprisingly, atfer ~5 minutes, the call ended successfully.

Here is the verbose output of cURL:

  100   104    0     0  100   104      0    217 --:--:-- --:--:-- --:--:--   216
  100   104    0     0  100   104      0     70  0:00:01  0:00:01 --:--:--    70
  100   104    0     0  100   104      0     41  0:00:02  0:00:02 --:--:--    41
  100   104    0     0  100   104      0     29  0:00:03  0:00:03 --:--:--    29
  100   104    0     0  100   104      0     23  0:00:04  0:00:04 --:--:--    23
  100   104    0     0  100   104      0     18  0:00:05  0:00:05 --:--:--     0
  100   104    0     0  100   104      0     15  0:00:06  0:00:06 --:--:--     0
  100   104    0     0  100   104      0     13  0:00:08  0:00:07  0:00:01     0
  100   104    0     0  100   104      0     12  0:00:08  0:00:08 --:--:--     0
  100   104    0     0  100   104      0     10  0:00:10  0:00:09  0:00:01     0
  100   104    0     0  100   104      0      9  0:00:11  0:00:10  0:00:01     0
  100   104    0     0  100   104      0      9  0:00:11  0:00:11 --:--:--     0
  100   104    0     0  100   104      0      8  0:00:13  0:00:12  0:00:01     0
  100   104    0     0  100   104      0      7  0:00:14  0:00:13  0:00:01     0
  100   104    0     0  100   104      0      7  0:00:14  0:00:14 --:--:--     0
  100   104    0     0  100   104      0      6  0:00:17  0:00:15  0:00:02     0
  100   104    0     0  100   104      0      6  0:00:17  0:00:16  0:00:01     0
  100   104    0     0  100   104      0      5  0:00:20  0:00:17  0:00:03     0
  100   104    0     0  100   104      0      5  0:00:20  0:00:18  0:00:02     0
  100   104    0     0  100   104      0      5  0:00:20  0:00:19  0:00:01     0
  100   104    0     0  100   104      0      5  0:00:20  0:00:20 --:--:--     0
  100   104    0     0  100   104      0      4  0:00:26  0:00:21  0:00:05     0
  100   104    0     0  100   104      0      4  0:00:26  0:00:22  0:00:04     0
  100   104    0     0  100   104      0      4  0:00:26  0:00:23  0:00:03     0
  100   104    0     0  100   104      0      4  0:00:26  0:00:24  0:00:02     0
  100   104    0     0  100   104      0      4  0:00:26  0:00:25  0:00:01     0
  100   104    0     0  100   104      0      3  0:00:34  0:00:26  0:00:08     0
  100   104    0     0  100   104      0      3  0:00:34  0:00:27  0:00:07     0
  100   104    0     0  100   104      0      3  0:00:34  0:00:28  0:00:06     0
  100   104    0     0  100   104      0      3  0:00:34  0:00:29  0:00:05     0
  100   104    0     0  100   104      0      3  0:00:34  0:00:30  0:00:04     0
  100   104    0     0  100   104      0      3  0:00:34  0:00:31  0:00:03     0
  100   104    0     0  100   104      0      3  0:00:34  0:00:32  0:00:02     0
  100   104    0     0  100   104      0      3  0:00:34  0:00:33  0:00:01     0
  100   104    0     0  100   104      0      3  0:00:34  0:00:34 --:--:--     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:35  0:00:17     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:36  0:00:16     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:37  0:00:15     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:38  0:00:14     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:39  0:00:13     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:40  0:00:12     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:41  0:00:11     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:42  0:00:10     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:43  0:00:09     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:44  0:00:08     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:45  0:00:07     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:46  0:00:06     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:47  0:00:05     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:48  0:00:04     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:49  0:00:03     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:50  0:00:02     0
  100   104    0     0  100   104      0      2  0:00:52  0:00:51  0:00:01     0
  100   104    0     0  100   104      0      1  0:01:44  0:00:52  0:00:52     0
  100   104    0     0  100   104      0      1  0:01:44  0:00:53  0:00:51     0
  100   104    0     0  100   104      0      1  0:01:44  0:00:54  0:00:50     0
  100   104    0     0  100   104      0      1  0:01:44  0:00:55  0:00:49     0
  100   104    0     0  100   104      0      1  0:01:44  0:00:56  0:00:48     0
  100   104    0     0  100   104      0      1  0:01:44  0:00:57  0:00:47     0
  100   104    0     0  100   104      0      1  0:01:44  0:00:58  0:00:46     0
  100   104    0     0  100   104      0      1  0:01:44  0:00:59  0:00:45     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:00  0:00:44     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:01  0:00:43     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:02  0:00:42     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:03  0:00:41     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:04  0:00:40     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:05  0:00:39     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:06  0:00:38     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:07  0:00:37     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:08  0:00:36     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:09  0:00:35     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:10  0:00:34     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:11  0:00:33     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:12  0:00:32     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:13  0:00:31     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:14  0:00:30     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:15  0:00:29     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:16  0:00:28     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:17  0:00:27     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:18  0:00:26     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:19  0:00:25     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:20  0:00:24     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:21  0:00:23     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:22  0:00:22     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:23  0:00:21     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:24  0:00:20     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:25  0:00:19     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:26  0:00:18     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:27  0:00:17     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:28  0:00:16     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:29  0:00:15     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:30  0:00:14     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:31  0:00:13     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:32  0:00:12     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:33  0:00:11     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:34  0:00:10     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:35  0:00:09     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:36  0:00:08     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:37  0:00:07     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:38  0:00:06     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:39  0:00:05     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:40  0:00:04     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:41  0:00:03     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:42  0:00:02     0
  100   104    0     0  100   104      0      1  0:01:44  0:01:43  0:00:01     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:44 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:45 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:46 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:47 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:48 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:49 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:50 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:51 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:52 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:53 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:54 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:55 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:56 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:57 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:58 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:01:59 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:00 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:01 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:02 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:03 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:04 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:05 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:06 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:07 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:08 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:09 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:10 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:11 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:12 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:13 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:14 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:15 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:16 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:17 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:18 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:19 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:20 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:21 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:22 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:23 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:24 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:25 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:26 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:27 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:28 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:29 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:31 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:32 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:33 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:34 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:35 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:36 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:37 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:38 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:39 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:40 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:41 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:42 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:43 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:44 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:45 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:46 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:47 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:48 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:49 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:50 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:51 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:52 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:53 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:54 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:55 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:56 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:57 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:58 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:02:59 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:00 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:01 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:02 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:03 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:04 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:05 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:06 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:07 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:08 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:09 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:10 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:11 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:12 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:13 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:14 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:15 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:16 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:17 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:18 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:19 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:20 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:21 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:22 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:23 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:24 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:25 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:26 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:27 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:28 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:29 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:30 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:31 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:32 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:33 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:34 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:35 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:36 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:37 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:38 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:39 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:40 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:41 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:42 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:43 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:44 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:45 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:46 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:47 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:48 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:49 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:50 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:51 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:52 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:53 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:54 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:55 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:56 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:57 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:58 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:03:59 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:00 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:01 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:02 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:03 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:04 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:05 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:06 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:07 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:08 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:09 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:10 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:11 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:12 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:13 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:14 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:15 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:16 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:17 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:18 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:19 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:20 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:21 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:22 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:23 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:24 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:25 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:26 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:27 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:28 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:29 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:30 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:31 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:32 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:33 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:34 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:35 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:36 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:37 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:38 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:39 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:40 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:41 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:42 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:43 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:44 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:45 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:46 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:47 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:48 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:49 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:50 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:51 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:52 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:53 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:54 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:55 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:56 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:57 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:58 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:04:59 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:00 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:01 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:02 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:03 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:04 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:05 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:06 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:07 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:08 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:09 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:10 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:11 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:12 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:13 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:14 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:15 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:16 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:17 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:18 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:19 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:20 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:21 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:22 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:23 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:24 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:25 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:26 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:27 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:28 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:29 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:30 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:31 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:32 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:33 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:34 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:35 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:36 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:37 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:38 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:39 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:40 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:41 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:42 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:43 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:44 --:--:--     0
  100   104    0     0    0   104      0      0 --:--:--  0:05:45 --:--:--     0

That output is explained here [2]. 

I am not an expert at all, but it does not make sens to me that the 5th column (percentage completed of the upload) drops from 100 to 0 at some point. And the request is still valid and continued.

Do you think I hit some corner-case bug here? I am desperate to move forward and can try anything to help debugging that issue.

Unfortunalty, the URL is private, and I have no power on the server (Tomcat). Even if there is something silly on the server, I would love to see Python making that HTTP call as cURL is handling it.

I may also say that doing the same request from a browser works too (using JavaScript). So it really seems Python-specific.

The issue is present since at least Python 3.7.7. I tried 3.7.8, 3.7.9, 3.8.6 and the master branch of today.

[1] https://github.com/python/cpython/blob/cb115e36e1aba04b90b0ecac6f043e60064ac65b/Modules/_ssl.c#L2586
[2] https://ec.haxx.se/cmdline/cmdline-progressmeter

----------
assignee: christian.heimes
components: SSL
messages: 379210
nosy: Tiger-222, christian.heimes
priority: normal
severity: normal
status: open
title: HTTPSConnection hangs forever when the percentage completed of the upload drops from 100 to 0
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42108>
_______________________________________

From report at bugs.python.org  Wed Oct 21 10:41:57 2020
From: report at bugs.python.org (lorb)
Date: Wed, 21 Oct 2020 14:41:57 +0000
Subject: [issue41906] logging.config.dictConfig does not work with callable
 filters
In-Reply-To: <1601599406.74.0.279190575587.issue41906@roundup.psfhosted.org>
Message-ID: <1603291317.04.0.953086621009.issue41906@roundup.psfhosted.org>


lorb <ritzer.christoph at gmail.com> added the comment:

I looked into implementing this and it's not entirely clear how it could work. The main issue I encountered is how to distinguish between a callable that is a factory that takes one argument and a callable that is a filter.

One possible approach I see is to rely on the absence of any other keys in the configuration sub-directory. Not entirely happy with that (and have to think how to treat factory with optional parameter vs filter with optional parameter).
So this would be assumed to be a filter, if inspection reveals that fltr takes an argument:
    'myfilter': {
        '()': fltr,
    }
while this would be assumed to be a factory:
    'myfilter': {
        '()': fctry,
        'bar': 'baz',
    }

A different approach that I think would be not optimal is to just call the callable with a dummy LogRecord passed ind and see if it returns a boolean or callable (or throws).

----------
nosy: +lorb

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41906>
_______________________________________

From report at bugs.python.org  Wed Oct 21 11:08:19 2020
From: report at bugs.python.org (Blaze Spinnaker)
Date: Wed, 21 Oct 2020 15:08:19 +0000
Subject: [issue33523] loop.run_until_complete re-entrancy to support more
 complicated codebases in transition to asyncio
In-Reply-To: <1526401266.56.0.682650639539.issue33523@psf.upfronthosting.co.za>
Message-ID: <1603292899.25.0.553239283857.issue33523@roundup.psfhosted.org>


Blaze Spinnaker <blazespinnaker at gmail.com> added the comment:

I know this issue is closed, but can you folks review:

https://github.com/ipython/ipykernel/issues/548#issuecomment-713637954

The nest_asyncio patch is becoming a defacto contract to fixing this amongst a lot of people.  But the patch doesn't really event work (IMHO).

It would be ideal to address this in a more central manner, either with change of code, better errors, more clear APIs, better documentation, etc.   Lots of options, but hopefully it will be addressed.

----------
nosy: +blazespinnaker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33523>
_______________________________________

From report at bugs.python.org  Wed Oct 21 11:12:25 2020
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 21 Oct 2020 15:12:25 +0000
Subject: [issue37840] bytearray_getitem() handles negative index incorrectly
In-Reply-To: <1565697002.74.0.85786305512.issue37840@roundup.psfhosted.org>
Message-ID: <1603293145.64.0.154443473651.issue37840@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37840>
_______________________________________

From report at bugs.python.org  Wed Oct 21 11:10:51 2020
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 21 Oct 2020 15:10:51 +0000
Subject: [issue31922] Can't receive replies from multicast UDP with asyncio
In-Reply-To: <1509619876.25.0.213398074469.issue31922@psf.upfronthosting.co.za>
Message-ID: <1603293051.46.0.0137686945932.issue31922@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31922>
_______________________________________

From report at bugs.python.org  Wed Oct 21 11:16:10 2020
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 21 Oct 2020 15:16:10 +0000
Subject: [issue33394] the build of the shared modules is quiet/non-visible
 when GNU make gets passed macros
In-Reply-To: <1525109371.22.0.682650639539.issue33394@psf.upfronthosting.co.za>
Message-ID: <1603293370.81.0.518414098862.issue33394@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33394>
_______________________________________

From report at bugs.python.org  Wed Oct 21 11:23:52 2020
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 21 Oct 2020 15:23:52 +0000
Subject: [issue29745] asyncio: Make pause/resume_reading idepotent and no-op
 for closed transports
In-Reply-To: <1488846253.21.0.430989162462.issue29745@psf.upfronthosting.co.za>
Message-ID: <1603293832.51.0.934628371215.issue29745@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed
superseder:  -> asyncio: Make transport.pause_reading()/resume_reading() idempotent; add transport.is_reading()

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29745>
_______________________________________

From report at bugs.python.org  Wed Oct 21 11:31:15 2020
From: report at bugs.python.org (paul j3)
Date: Wed, 21 Oct 2020 15:31:15 +0000
Subject: [issue42105] allow_abbrev not working as intended in
 "argparse.ArgumentParser" in Python 3.9.0
In-Reply-To: <1603273455.18.0.937271574309.issue42105@roundup.psfhosted.org>
Message-ID: <1603294275.82.0.648693787566.issue42105@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

argparse : allow_abbrev behavior between 3.7 and 3.8
https://bugs.python.org/issue41534

covers this issue well enough.  That latest change to `allow_abbrev` was prompted by:

argparse: allow_abbrev=False stops -vv from working
https://bugs.python.org/issue26967

You also raised this issue on StackOverFlow.  That may be a better place to discuss this.

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42105>
_______________________________________

From report at bugs.python.org  Wed Oct 21 11:40:08 2020
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 21 Oct 2020 15:40:08 +0000
Subject: [issue39524] Escape sequences in doc string of ast._pad_whitespace
In-Reply-To: <1580616588.9.0.5083341091.issue39524@roundup.psfhosted.org>
Message-ID: <1603294808.65.0.715389888473.issue39524@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
pull_requests: +21800
pull_request: https://github.com/python/cpython/pull/22857

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39524>
_______________________________________

From report at bugs.python.org  Wed Oct 21 11:42:18 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Wed, 21 Oct 2020 15:42:18 +0000
Subject: [issue41052] Opt out serialization/deserialization for heap type
In-Reply-To: <1592659049.98.0.596314769567.issue41052@roundup.psfhosted.org>
Message-ID: <1603294938.46.0.802498623119.issue41052@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

> It would be better to fix copyreg._reduce_ex() instead of disabling pickling for these types one by one

I agree :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41052>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:07:21 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 16:07:21 +0000
Subject: [issue38439] Python needs higher resolution app/menu icons
In-Reply-To: <1570749295.67.0.980962290264.issue38439@roundup.psfhosted.org>
Message-ID: <1603296441.31.0.531000844239.issue38439@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 871c6ccf4a883fbc05410284b21e6d668b832f2c by Miss Skeleton (bot) in branch '3.9':
bpo-38439: Add 256px IDLE icon to the .ico, drop gifs from it (GH-19648)
https://github.com/python/cpython/commit/871c6ccf4a883fbc05410284b21e6d668b832f2c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38439>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:19:38 2020
From: report at bugs.python.org (Steve Dower)
Date: Wed, 21 Oct 2020 16:19:38 +0000
Subject: [issue38439] Python needs higher resolution app/menu icons
In-Reply-To: <1570749295.67.0.980962290264.issue38439@roundup.psfhosted.org>
Message-ID: <1603297178.89.0.36114826019.issue38439@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

This seems complete to me, but feel free to reopen if it is not.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38439>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:21:04 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 16:21:04 +0000
Subject: [issue39524] Escape sequences in doc string of ast._pad_whitespace
In-Reply-To: <1580616588.9.0.5083341091.issue39524@roundup.psfhosted.org>
Message-ID: <1603297264.59.0.989498611003.issue39524@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f3982d666c1df290373a4810edd501b2176b45c7 by Irit Katriel in branch '3.8':
[3.8] bpo-39524: Fixed doc-string in ast._pad_whitespace (GH-18340) (GH-22857)
https://github.com/python/cpython/commit/f3982d666c1df290373a4810edd501b2176b45c7


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39524>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:22:40 2020
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 21 Oct 2020 16:22:40 +0000
Subject: [issue39524] Escape sequences in doc string of ast._pad_whitespace
In-Reply-To: <1580616588.9.0.5083341091.issue39524@roundup.psfhosted.org>
Message-ID: <1603297360.57.0.721903437802.issue39524@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39524>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:25:00 2020
From: report at bugs.python.org (Steve Dower)
Date: Wed, 21 Oct 2020 16:25:00 +0000
Subject: [issue40747] sysconfig.get_config_var("py_version_nodot") should
 return 3_10
In-Reply-To: <1590266866.08.0.16909581495.issue40747@roundup.psfhosted.org>
Message-ID: <1603297500.11.0.253717569201.issue40747@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
nosy: +steve.dower
nosy_count: 4.0 -> 5.0
pull_requests: +21801
pull_request: https://github.com/python/cpython/pull/22858

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40747>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:30:22 2020
From: report at bugs.python.org (Christopher Marchfelder)
Date: Wed, 21 Oct 2020 16:30:22 +0000
Subject: [issue40592] `Shutil.which` incosistent with windows's `where`
In-Reply-To: <1589187015.71.0.593402074503.issue40592@roundup.psfhosted.org>
Message-ID: <1603297822.93.0.595956512506.issue40592@roundup.psfhosted.org>


Christopher Marchfelder <marchfelder at googlemail.com> added the comment:

@steve.dower Added the changes in the PR - could you please re-check? Thank you!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40592>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:30:55 2020
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 21 Oct 2020 16:30:55 +0000
Subject: [issue31432] Documention for CERT_OPTIONAL is misleading
In-Reply-To: <1505232519.67.0.963615295738.issue31432@psf.upfronthosting.co.za>
Message-ID: <1603297855.37.0.539176642501.issue31432@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31432>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:31:22 2020
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 21 Oct 2020 16:31:22 +0000
Subject: [issue26835] Add file-sealing ops to fcntl
In-Reply-To: <1461505999.3.0.387096384665.issue26835@psf.upfronthosting.co.za>
Message-ID: <1603297882.82.0.742196384607.issue26835@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26835>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:33:09 2020
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 21 Oct 2020 16:33:09 +0000
Subject: [issue32549] Travis: Test with OpenSSL 1.1.0
In-Reply-To: <1515926387.7.0.467229070634.issue32549@psf.upfronthosting.co.za>
Message-ID: <1603297989.65.0.631744556456.issue32549@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32549>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:37:07 2020
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 21 Oct 2020 16:37:07 +0000
Subject: [issue28022] SSL releated deprecation for 3.6
In-Reply-To: <1473347942.69.0.310193437319.issue28022@psf.upfronthosting.co.za>
Message-ID: <1603298227.26.0.0238078601951.issue28022@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
versions: +Python 3.10 -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28022>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:39:48 2020
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 21 Oct 2020 16:39:48 +0000
Subject: [issue34915] LWPCookieJar.save() creates *.lwp file in 644 mode
In-Reply-To: <1538834336.96.0.545547206417.issue34915@psf.upfronthosting.co.za>
Message-ID: <1603298388.63.0.220148051376.issue34915@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
assignee: christian.heimes -> 
nosy:  -christian.heimes
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.7, Python 3.4, Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34915>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:40:32 2020
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 21 Oct 2020 16:40:32 +0000
Subject: [issue33570] OpenSSL 1.1.1 / TLS 1.3 cipher suite changes
In-Reply-To: <1526648438.42.0.682650639539.issue33570@psf.upfronthosting.co.za>
Message-ID: <1603298432.4.0.722550998917.issue33570@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33570>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:43:15 2020
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 21 Oct 2020 16:43:15 +0000
Subject: [issue35324] ssl: FileNotFoundError when do handshake
In-Reply-To: <1543300721.51.0.788709270274.issue35324@psf.upfronthosting.co.za>
Message-ID: <1603298595.14.0.0126965429448.issue35324@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

I'm not able to reproduce the issue. Please re-open this issue if you are still having issue with more recent version of Python and OpenSSL.

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35324>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:43:27 2020
From: report at bugs.python.org (Alan Jenkins)
Date: Wed, 21 Oct 2020 16:43:27 +0000
Subject: [issue35749] Rewrite asyncio signal handler
In-Reply-To: <1547626646.01.0.761930434303.issue35749@roundup.psfhosted.org>
Message-ID: <1603298607.16.0.804931248036.issue35749@roundup.psfhosted.org>


Alan Jenkins <alan.christopher.jenkins at gmail.com> added the comment:

Here's a simple test case that fails on the main branch.

https://github.com/sourcejedi/cpython/commit/50184ea3b354fd775866d036ccee058ec6734927

> the patch assumes that python signal handler will be called *before* reading from self-pipe. 
> Otherwise, a signal callback will be postponed up to next writing to the pipe, which looks like a hidden bug.

I think it will be?  I can imagine it being a concern for future changes though.  I thought it could break if anyone takes seriously the comment "XXX Signals should be recorded per thread, now we have thread state." :-).

But if we're not confident, surely all we have to do is make sure to call _write_to_self() at the end of the python signal handler (_UnixSelectorEventLoop._sig_handler()).

It seems a pity not to have example code we can point to, that handles signals correctly.  Even if it's too tedious to explain the correct way in the official docs.

----------
nosy: +sourcejedi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35749>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:46:36 2020
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 21 Oct 2020 16:46:36 +0000
Subject: [issue37553] SendfileUsingSendTest tests timeout too short for
 Windows ARM32
In-Reply-To: <1562802865.66.0.679596534727.issue37553@roundup.psfhosted.org>
Message-ID: <1603298796.55.0.872383135049.issue37553@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37553>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:46:37 2020
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 21 Oct 2020 16:46:37 +0000
Subject: [issue36709] Asyncio SSL keep-alive connections raise errors after
 loop close.
In-Reply-To: <1556095707.61.0.53219784779.issue36709@roundup.psfhosted.org>
Message-ID: <1603298797.79.0.177850587818.issue36709@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

This seems to be an asyncio problem.

----------
assignee: christian.heimes -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36709>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:46:03 2020
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 21 Oct 2020 16:46:03 +0000
Subject: [issue37048] ssl module: QUIC support for HTTP/3
In-Reply-To: <1558813454.34.0.910569571788.issue37048@roundup.psfhosted.org>
Message-ID: <1603298763.34.0.784566574061.issue37048@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

OpenSSL 3.0.0 is not going support QUIC, https://www.openssl.org/blog/blog/2020/02/17/QUIC-and-OpenSSL/

----------
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37048>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:48:10 2020
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 21 Oct 2020 16:48:10 +0000
Subject: [issue37355] SSLSocket.read does a GIL round-trip for every 16KB TLS
 record
In-Reply-To: <1561056169.29.0.814417679233.issue37355@roundup.psfhosted.org>
Message-ID: <1603298890.96.0.430575511223.issue37355@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
assignee: christian.heimes -> 
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37355>
_______________________________________

From report at bugs.python.org  Wed Oct 21 12:49:05 2020
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 21 Oct 2020 16:49:05 +0000
Subject: [issue41061] Incorrect expressions / assert with side effect in
 hashtable
In-Reply-To: <1592729577.35.0.278051056824.issue41061@roundup.psfhosted.org>
Message-ID: <1603298945.55.0.502971301661.issue41061@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41061>
_______________________________________

From report at bugs.python.org  Wed Oct 21 13:11:37 2020
From: report at bugs.python.org (Antoine Pitrou)
Date: Wed, 21 Oct 2020 17:11:37 +0000
Subject: [issue41052] Opt out serialization/deserialization for heap type
In-Reply-To: <1592659049.98.0.596314769567.issue41052@roundup.psfhosted.org>
Message-ID: <1603300297.54.0.815175515916.issue41052@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

At some point, pickle protocols 0 and 1 should be deprecated and slated for removal.  Protocol 2 is 17 years ago already, and protocol 3 has become the default in Python 3.

That would probably be a better use of contributor time than trying to make heap types compatible with those obsolete protocols.

----------
nosy: +pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41052>
_______________________________________

From report at bugs.python.org  Wed Oct 21 13:13:54 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 17:13:54 +0000
Subject: [issue39416] Document default numeric string formats
In-Reply-To: <1579660529.58.0.0341841917197.issue39416@roundup.psfhosted.org>
Message-ID: <1603300434.54.0.330559857753.issue39416@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c60394c7fc9cc09b16e9675a3eeb5844b6d8523f by kpinc in branch 'master':
bpo-39416: Document some restrictions on the default string representations of numeric classes (GH-18111)
https://github.com/python/cpython/commit/c60394c7fc9cc09b16e9675a3eeb5844b6d8523f


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39416>
_______________________________________

From report at bugs.python.org  Wed Oct 21 13:14:16 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 17:14:16 +0000
Subject: [issue39416] Document default numeric string formats
In-Reply-To: <1579660529.58.0.0341841917197.issue39416@roundup.psfhosted.org>
Message-ID: <1603300456.24.0.203306963444.issue39416@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21802
pull_request: https://github.com/python/cpython/pull/22860

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39416>
_______________________________________

From report at bugs.python.org  Wed Oct 21 13:14:27 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 17:14:27 +0000
Subject: [issue39416] Document default numeric string formats
In-Reply-To: <1579660529.58.0.0341841917197.issue39416@roundup.psfhosted.org>
Message-ID: <1603300467.1.0.362537840036.issue39416@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21803
pull_request: https://github.com/python/cpython/pull/22861

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39416>
_______________________________________

From report at bugs.python.org  Wed Oct 21 13:16:18 2020
From: report at bugs.python.org (Antoine Pitrou)
Date: Wed, 21 Oct 2020 17:16:18 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
In-Reply-To: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>
Message-ID: <1603300578.43.0.193973425407.issue42097@roundup.psfhosted.org>


Change by Antoine Pitrou <pitrou at free.fr>:


----------
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Wed Oct 21 13:30:01 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 21 Oct 2020 17:30:01 +0000
Subject: [issue38980] Compile libpython with -fno-semantic-interposition
In-Reply-To: <1575561631.45.0.417730594345.issue38980@roundup.psfhosted.org>
Message-ID: <1603301401.78.0.492629319365.issue38980@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +21804
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22862

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38980>
_______________________________________

From report at bugs.python.org  Wed Oct 21 13:37:14 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 21 Oct 2020 17:37:14 +0000
Subject: [issue38980] Compile libpython with -fno-semantic-interposition
In-Reply-To: <1575561631.45.0.417730594345.issue38980@roundup.psfhosted.org>
Message-ID: <1603301834.14.0.260059787836.issue38980@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Victor is on vacation for some weeks, so I am creating a PR to push this forward.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38980>
_______________________________________

From report at bugs.python.org  Wed Oct 21 13:38:33 2020
From: report at bugs.python.org (Paul Ganssle)
Date: Wed, 21 Oct 2020 17:38:33 +0000
Subject: [issue42109] Use hypothesis for testing the standard library,
 falling back to stubs
Message-ID: <1603301913.79.0.22425692211.issue42109@roundup.psfhosted.org>


New submission from Paul Ganssle <p.ganssle at gmail.com>:

Following up on this year's language summit, I would like to propose that we start integrating property tests into the standard library. Zac Hatfield-Dodds (along with myself and Carl Friedrich Bolz-Tereick) have put together this repository of tests that we run against the standard library as is: https://github.com/Zac-HD/stdlib-property-tests

Here is the blog post covering the proposal from the language summit: https://pyfound.blogspot.com/2020/05/property-based-testing-for-python.html

The biggest challenges here are logistical:

1. Pulling in third party dependencies is difficult to do reliably on CI, but checking in hypothesis's entire dependency tree is probably not feasible.
2. We don't necessarily want to require developers running their tests locally to have to set up a hypothesis environment just to run the tests.
3. Hypothesis tests are not (by default) deterministic, which some are concerned may lead to flakiness by themselves.


To allay these concerns, I propose that we implement a compatibility interface for hypothesis that uses the third party module when it's installed, but otherwise falls back to stubs. The way I see the stubs working is that `@given` *without* `@example`s would simply skip the test. If you specify `@given` and one or more `@example`s, the test falls back to a simple parameterized test when hypothesis is not available.

At least at first, we won't attempt to add a mandatory PR job that runs with hypothesis installed. Instead, I'd like to run either an optional job on PR or have one or more buildbots that runs the hypothesis tests.

I would also like to suggest a policy of including at least one example in each property test, so that on PR at least some of the inputs are tested.

----------
assignee: p-ganssle
components: Tests
messages: 379226
nosy: Zac Hatfield-Dodds, p-ganssle, terry.reedy
priority: normal
severity: normal
stage: patch review
status: open
title: Use hypothesis for testing the standard library, falling back to stubs
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42109>
_______________________________________

From report at bugs.python.org  Wed Oct 21 13:43:43 2020
From: report at bugs.python.org (Paul Ganssle)
Date: Wed, 21 Oct 2020 17:43:43 +0000
Subject: [issue42109] Use hypothesis for testing the standard library,
 falling back to stubs
In-Reply-To: <1603301913.79.0.22425692211.issue42109@roundup.psfhosted.org>
Message-ID: <1603302223.29.0.0522099683801.issue42109@roundup.psfhosted.org>


Change by Paul Ganssle <p.ganssle at gmail.com>:


----------
keywords: +patch
pull_requests: +21805
pull_request: https://github.com/python/cpython/pull/22863

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42109>
_______________________________________

From report at bugs.python.org  Wed Oct 21 13:52:59 2020
From: report at bugs.python.org (Ned Deily)
Date: Wed, 21 Oct 2020 17:52:59 +0000
Subject: [issue42107] Monotonic time on macOS 10.12+ should use
 mach_continuous_time()
In-Reply-To: <1603276645.14.0.842497391602.issue42107@roundup.psfhosted.org>
Message-ID: <1603302779.4.0.349449571434.issue42107@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42107>
_______________________________________

From report at bugs.python.org  Wed Oct 21 14:29:31 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Wed, 21 Oct 2020 18:29:31 +0000
Subject: [issue35181] Doc: Namespace Packages: Inconsistent documentation of
 __loader__ being None
In-Reply-To: <1541543349.68.0.788709270274.issue35181@psf.upfronthosting.co.za>
Message-ID: <1603304971.75.0.348703013639.issue35181@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

Apologies for the long delay in reviewing this bug.  I'm looking at it now, however since Python 3.7 is in security-only mode, this will only apply to 3.10, 3.9, and 3.8.

----------
versions: +Python 3.10, Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35181>
_______________________________________

From report at bugs.python.org  Wed Oct 21 14:40:05 2020
From: report at bugs.python.org (=?utf-8?q?Andr=C3=A9s_Delfino?=)
Date: Wed, 21 Oct 2020 18:40:05 +0000
Subject: [issue19438] Where is NoneType in Python 3?
In-Reply-To: <1383078691.36.0.6145513581.issue19438@psf.upfronthosting.co.za>
Message-ID: <1603305605.29.0.408410752988.issue19438@roundup.psfhosted.org>


Andr?s Delfino <adelfino at gmail.com> added the comment:

As per https://github.com/python/cpython/pull/22336 I believe this issue can be closed now.

My PR is not relevant to the problem stated by OP, so I'm "unlinking" it.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19438>
_______________________________________

From report at bugs.python.org  Wed Oct 21 14:44:25 2020
From: report at bugs.python.org (Alan Jenkins)
Date: Wed, 21 Oct 2020 18:44:25 +0000
Subject: [issue42110] race condition in ThreadChildWatcher (default) and
 MultiLoopChildWatcher
Message-ID: <1603305865.86.0.468384454532.issue42110@roundup.psfhosted.org>


New submission from Alan Jenkins <alan.christopher.jenkins at gmail.com>:

## Test program ##

import asyncio
import time
import os
import signal
import sys

# This bug happens with the default, ThreadedChildWatcher
# It also happens with MultiLoopChildWatcher,
# but not the other three watcher types.
#asyncio.set_child_watcher(asyncio.MultiLoopChildWatcher())

# Patch os.kill to call sleep(1) first,
# opening up the window for a race condition
os_kill = os.kill
def kill(p, n):
    time.sleep(1)
    os_kill(p, n)

os.kill = kill

async def main():
    p = await asyncio.create_subprocess_exec(sys.executable, '-c', 'import sys; sys.exit(0)')
    p.send_signal(signal.SIGTERM)
    # cleanup
    await p.wait()

asyncio.run(main())


## Test output ##

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/alan-sysop/src/cpython/Lib/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/home/alan-sysop/src/cpython/Lib/asyncio/base_events.py", line 642, in run_until_complete
    return future.result()
  File "<stdin>", line 3, in main
  File "/home/alan-sysop/src/cpython/Lib/asyncio/subprocess.py", line 138, in send_signal
    self._transport.send_signal(signal)
  File "/home/alan-sysop/src/cpython/Lib/asyncio/base_subprocess.py", line 146, in send_signal
    self._proc.send_signal(signal)
  File "/home/alan-sysop/src/cpython/Lib/subprocess.py", line 2081, in send_signal
    os.kill(self.pid, sig)
  File "<stdin>", line 3, in kill
ProcessLookupError: [Errno 3] No such process


## Tested versions ##

* v3.10.0a1-121-gc60394c7fc
* python39-3.9.0-1.fc32.x86_64
* python3-3.8.6-1.fc32.x86_64


## Race condition ##

main thread	vs	ThreadedChildWatcher._do_waitpid() thread

p=create_subprocess_exec(...)
			waitpid(...)  # wait for process exit
<Process p exits>
			<waitpid() returns.  Process p is reaped, and no longer exists>
p.send_signal(9)


## Result ##

A signal is sent to p.pid, after p.pid has been reaped by waitpid().  It might raise an error because p.pid no longer exists.

In the worst case the signal will be sent successfully - because an unrelated process has started with the same PID.


## How easy is it to reproduce? ##

It turns out the window for this race condition has been kept short, due to mitigations in the subprocess module.  IIUC, the mitigation protects against incorrect parallel use of a subprocess object by multiple threads.

        def send_signal(self, sig):
            # bpo-38630: Polling reduces the risk of sending a signal to the
            # wrong process if the process completed, the Popen.returncode
            # attribute is still None, and the pid has been reassigned
            # (recycled) to a new different process. This race condition can
            # happens in two cases [...]
            self.poll()
            if self.returncode is not None:
                # Skip signalling a process that we know has already died.
                return
            os.kill(self.pid, sig)




## Possible workarounds ##

* SafeChildWatcher and FastChildWatcher should not have this defect.  However we use ThreadedChildWatcher and MultiLoopChildWatcher to support running event loops in different threads.

* PidfdChildWatcher should not have this defect.  It is only available on Linux, kernel version 5.3 or above.

It would be possible to avoid the ThreadedChildWatcher race by using native code and pthread_cancel(), so that the corresponding waitpid() call is canceled before sending a signal.  Except the current implementation of pthread_cancel() is also unsound, because of race conditions.

* https://lwn.net/Articles/683118/ "This is why we can't have safe cancellation points"
* https://sourceware.org/bugzilla/show_bug.cgi?id=12683 "Race conditions in pthread cancellation"

----------
components: asyncio
messages: 379229
nosy: asvetlov, sourcejedi, yselivanov
priority: normal
severity: normal
status: open
title: race condition in ThreadChildWatcher (default) and MultiLoopChildWatcher
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42110>
_______________________________________

From report at bugs.python.org  Wed Oct 21 14:46:07 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Wed, 21 Oct 2020 18:46:07 +0000
Subject: [issue41100] Build failure on macOS 11 (beta)
In-Reply-To: <1592999467.1.0.372512113251.issue41100@roundup.psfhosted.org>
Message-ID: <1603305967.44.0.105821679843.issue41100@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

https://github.com/python/cpython/pull/22855 is currently the most complete PR, and should be almost ready for merging (although there hasn't been any code review at this point).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41100>
_______________________________________

From report at bugs.python.org  Wed Oct 21 14:55:54 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Wed, 21 Oct 2020 18:55:54 +0000
Subject: [issue42107] Monotonic time on macOS 10.12+ should use
 mach_continuous_time()
In-Reply-To: <1603276645.14.0.842497391602.issue42107@roundup.psfhosted.org>
Message-ID: <1603306554.52.0.209633336244.issue42107@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

See also #41303, which discusses using mach_continuous_time in another context.

If using a different clock is necessary I'd prefer to use clock_gettime(CLOCK_MONOTONIC_RAW) instead of mach_continuous_time(), as the former is a more cross-platform API.

BTW. Please hold off from merging a patch for this until the macOS 11 support code in #41100 is in, this is bound to cause a merge conflict otherwise.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42107>
_______________________________________

From report at bugs.python.org  Wed Oct 21 14:56:25 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 18:56:25 +0000
Subject: [issue39416] Document default numeric string formats
In-Reply-To: <1579660529.58.0.0341841917197.issue39416@roundup.psfhosted.org>
Message-ID: <1603306585.07.0.85841204601.issue39416@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 89fac4c3748aa7eb23d09922331e90a62ce782fd by Miss Skeleton (bot) in branch '3.8':
[3.8] bpo-39416: Document some restrictions on the default string representations of numeric classes (GH-18111) (GH-22861)
https://github.com/python/cpython/commit/89fac4c3748aa7eb23d09922331e90a62ce782fd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39416>
_______________________________________

From report at bugs.python.org  Wed Oct 21 14:56:25 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 18:56:25 +0000
Subject: [issue39416] Document default numeric string formats
In-Reply-To: <1579660529.58.0.0341841917197.issue39416@roundup.psfhosted.org>
Message-ID: <1603306584.99.0.854555257747.issue39416@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ec62b47ebc8f29007942c8e9f3f260af91ca58cb by Miss Skeleton (bot) in branch '3.9':
[3.9] bpo-39416: Document some restrictions on the default string representations of numeric classes (GH-18111) (GH-22860)
https://github.com/python/cpython/commit/ec62b47ebc8f29007942c8e9f3f260af91ca58cb


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39416>
_______________________________________

From report at bugs.python.org  Wed Oct 21 14:56:24 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 18:56:24 +0000
Subject: [issue39416] Document default numeric string formats
In-Reply-To: <1579660529.58.0.0341841917197.issue39416@roundup.psfhosted.org>
Message-ID: <1603306584.99.0.854555257747.issue39416@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ec62b47ebc8f29007942c8e9f3f260af91ca58cb by Miss Skeleton (bot) in branch '3.9':
[3.9] bpo-39416: Document some restrictions on the default string representations of numeric classes (GH-18111) (GH-22860)
https://github.com/python/cpython/commit/ec62b47ebc8f29007942c8e9f3f260af91ca58cb


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39416>
_______________________________________

From report at bugs.python.org  Wed Oct 21 14:57:12 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Wed, 21 Oct 2020 18:57:12 +0000
Subject: [issue39416] Document default numeric string formats
In-Reply-To: <1579660529.58.0.0341841917197.issue39416@roundup.psfhosted.org>
Message-ID: <1603306632.02.0.161222146321.issue39416@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Thanks for the patch!

----------
nosy: +eric.araujo
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39416>
_______________________________________

From report at bugs.python.org  Wed Oct 21 14:59:20 2020
From: report at bugs.python.org (Paul Ganssle)
Date: Wed, 21 Oct 2020 18:59:20 +0000
Subject: [issue42025] zoneinfo: wrong time difference across transition when
 tzinfo is equal
In-Reply-To: <1602579676.45.0.837169580708.issue42025@roundup.psfhosted.org>
Message-ID: <1603306760.32.0.503503701572.issue42025@roundup.psfhosted.org>


Paul Ganssle <p.ganssle at gmail.com> added the comment:

Yeah, people are very confused by this, which is why I wrote that article.

Maybe there is a place for big warnings somewhere? I have been mulling over the possibility of proposing a backwards-incompatible (though minimally so, hopefully) change to arithmetic semantics that would work well with how people think this should work, but I think any such backwards-incompatible change would be a Big Deal?, and unfortunately quite hard to warn about with a proper deprecation period.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42025>
_______________________________________

From report at bugs.python.org  Wed Oct 21 15:01:11 2020
From: report at bugs.python.org (=?utf-8?q?Jeremy_Lain=C3=A9?=)
Date: Wed, 21 Oct 2020 19:01:11 +0000
Subject: [issue37048] ssl module: QUIC support for HTTP/3
In-Reply-To: <1558813454.34.0.910569571788.issue37048@roundup.psfhosted.org>
Message-ID: <1603306871.89.0.133075920366.issue37048@roundup.psfhosted.org>


Jeremy Lain? <jeremy.laine at m4x.org> added the comment:

The OpenSSL authors make a fair point, QUIC seems to be taking a long time to stabilize with little consideration for backwards compatibility at this stage.

As stated previously though it's perfectly feasible to implement a QUIC stack by linking to an unpatched OpenSSL if you're willing to implement a stripped-down TLS 1.3 engine yourself.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37048>
_______________________________________

From report at bugs.python.org  Wed Oct 21 15:03:08 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Wed, 21 Oct 2020 19:03:08 +0000
Subject: [issue41746] Add optional type information to asdl_seq objects
In-Reply-To: <1599597077.35.0.913235954629.issue41746@roundup.psfhosted.org>
Message-ID: <1603306988.04.0.012133169512.issue41746@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
pull_requests: +21806
pull_request: https://github.com/python/cpython/pull/22864

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41746>
_______________________________________

From report at bugs.python.org  Wed Oct 21 15:05:57 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 19:05:57 +0000
Subject: [issue41959] Doc/library/asyncio-policy.rst grammar error
In-Reply-To: <1601992264.68.0.320872676637.issue41959@roundup.psfhosted.org>
Message-ID: <1603307157.42.0.0674474040595.issue41959@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset caff2934f46510920a6169e192707d59e9c55f6b by Ra?l Cumplido in branch 'master':
bpo-41959: Fix grammar around class asyncio.MultiLoopChildWatcher text (GH-22580)
https://github.com/python/cpython/commit/caff2934f46510920a6169e192707d59e9c55f6b


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41959>
_______________________________________

From report at bugs.python.org  Wed Oct 21 15:06:03 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 19:06:03 +0000
Subject: [issue41959] Doc/library/asyncio-policy.rst grammar error
In-Reply-To: <1601992264.68.0.320872676637.issue41959@roundup.psfhosted.org>
Message-ID: <1603307163.91.0.644849495763.issue41959@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21807
pull_request: https://github.com/python/cpython/pull/22865

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41959>
_______________________________________

From report at bugs.python.org  Wed Oct 21 15:06:11 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 19:06:11 +0000
Subject: [issue41959] Doc/library/asyncio-policy.rst grammar error
In-Reply-To: <1601992264.68.0.320872676637.issue41959@roundup.psfhosted.org>
Message-ID: <1603307171.85.0.430221743507.issue41959@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21808
pull_request: https://github.com/python/cpython/pull/22866

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41959>
_______________________________________

From report at bugs.python.org  Wed Oct 21 15:44:22 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Wed, 21 Oct 2020 19:44:22 +0000
Subject: [issue42103] [security] DoS (MemError via CPU and RAM exhaustion)
 when processing malformed Apple Property List files in binary format
In-Reply-To: <1603239911.48.0.657036824442.issue42103@roundup.psfhosted.org>
Message-ID: <1603309462.0.0.480343465165.issue42103@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Thanks for the report. I can reproduce the issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42103>
_______________________________________

From report at bugs.python.org  Wed Oct 21 15:51:20 2020
From: report at bugs.python.org (Paul Ganssle)
Date: Wed, 21 Oct 2020 19:51:20 +0000
Subject: [issue30155] Add ability to get tzinfo from a datetime instance in C
 API
In-Reply-To: <1493047646.24.0.156322797242.issue30155@psf.upfronthosting.co.za>
Message-ID: <1603309880.39.0.304413259466.issue30155@roundup.psfhosted.org>


Change by Paul Ganssle <p.ganssle at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30155>
_______________________________________

From report at bugs.python.org  Wed Oct 21 15:52:52 2020
From: report at bugs.python.org (Paul Ganssle)
Date: Wed, 21 Oct 2020 19:52:52 +0000
Subject: [issue41056] minor NULL pointer and sign issues reported by Coverity
In-Reply-To: <1592674710.76.0.0208418742118.issue41056@roundup.psfhosted.org>
Message-ID: <1603309972.36.0.624929155533.issue41056@roundup.psfhosted.org>


Change by Paul Ganssle <p.ganssle at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41056>
_______________________________________

From report at bugs.python.org  Wed Oct 21 15:53:22 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Wed, 21 Oct 2020 19:53:22 +0000
Subject: [issue41746] Add optional type information to asdl_seq objects
In-Reply-To: <1599597077.35.0.913235954629.issue41746@roundup.psfhosted.org>
Message-ID: <1603310002.12.0.485897657873.issue41746@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:


New changeset 2e5ca9e3f68b33abb7d2c66d22ffc18dec40641a by Lysandros Nikolaou in branch 'master':
bpo-41746: Cast to typed seqs in CHECK macros to avoid type erasure (GH-22864)
https://github.com/python/cpython/commit/2e5ca9e3f68b33abb7d2c66d22ffc18dec40641a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41746>
_______________________________________

From report at bugs.python.org  Wed Oct 21 15:55:02 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Wed, 21 Oct 2020 19:55:02 +0000
Subject: [issue41746] Add optional type information to asdl_seq objects
In-Reply-To: <1599597077.35.0.913235954629.issue41746@roundup.psfhosted.org>
Message-ID: <1603310102.47.0.664187400644.issue41746@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

Last bit of work is now done.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41746>
_______________________________________

From report at bugs.python.org  Wed Oct 21 15:58:56 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Wed, 21 Oct 2020 19:58:56 +0000
Subject: [issue42111] Make the xxlimited module an example of best extension
 module practices
Message-ID: <1603310336.9.0.27411366123.issue42111@roundup.psfhosted.org>


New submission from Petr Viktorin <encukou at gmail.com>:

The "xxlimited" module (Modules/xxlimited.c) was added as part of PEP 
384 (Defining a Stable ABI), and is undocumented. As far as I can tell, 
it was added partly to test the stable ABI, and partly as an example of 
how to write a module (like "xx" from xxmodule.c).
In the last few years the module has not seen much maintenance, and I 
believe it's no longer a good example to follow: it works, but there are 
now better ways to do things.

I would like to take over maintenance of the module and make it into an 
example of how to write a low-level C extension with isolated module 
state, as described in PEP 630 (Isolating Extension Modules) -- an 
informational PEP that I plan to convert to a HOWTO doc when everything 
is ready.

The old module will be kept around to test the 3.5 stable ABI.

Past discussion: https://mail.python.org/archives/list/python-dev at python.org/thread/FO3YPG3YLG2XF5FKHICJHNINSPY4OHEL/#YITRQXGUOIEHK22QP5K4C5E45QA356U3

----------
components: C API
messages: 379241
nosy: petr.viktorin
priority: normal
severity: normal
status: open
title: Make the xxlimited module an example of best extension module practices
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42111>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:12:18 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Wed, 21 Oct 2020 20:12:18 +0000
Subject: [issue33754] f-strings should be part of the Grammar
In-Reply-To: <1528030778.27.0.592728768989.issue33754@psf.upfronthosting.co.za>
Message-ID: <1603311138.97.0.727702706234.issue33754@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Just some notes to consider before work starts on this in earnest:

We need to decide what sort of changes we'll accept, if any. For at least the first round of this, I'm okay with "absolutely no change will be acceptable".

For example, here's a good change (IMO): allowing f'{"\n" if cond else ""}'. I'd like to be able to use backslashes inside strings that are in an expression.

A questionable change: f'{'foo'}'. Nesting the same type of quotes.

I think we should be explicit about what we will accept, because editors, etc. will need to adapt. In msg318550 I mention that some external tools use the same lexer they use for strings to lex f-strings. Are we okay with break that?

And the f-string '=' feature maybe be hard to support. Although if we are able to support it, then I think the same solution will be applicable to string annotations without unparsing them.

----------
nosy: +emilyemorehouse, pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33754>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:12:55 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Wed, 21 Oct 2020 20:12:55 +0000
Subject: [issue42103] [security] DoS (MemError via CPU and RAM exhaustion)
 when processing malformed Apple Property List files in binary format
In-Reply-To: <1603239911.48.0.657036824442.issue42103@roundup.psfhosted.org>
Message-ID: <1603311175.71.0.970823614804.issue42103@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

One Apple implementation of binary plist parsing is here: https://opensource.apple.com/source/CF/CF-550/CFBinaryPList.c.

That seems to work from a buffer (or mmap) of the entire file, making consistency checks somewhat easier, and I don't think they have a hardcoded limit on the number of items in the plist (but: it's getting late and might have missed that).

An easy fix for this issue is to limit the amount of values read by _read_ints, but that immediately begs the question what that limit should be. It is clear that 1B items in the array is too much (in this case 1B object refs for dictionary keys). 

I don't know what a sane limit would be. The largest plist file on my system is 10MB. Limiting *n* to 20M would be easily enough to parse that file, and doesn't consume too much memory (about 160MB for the read buffer at most). 

Another thing the current code doesn't do is check that the "ref" argument to _read_object is in range. That's less problematic because the code will raise an exception regardless (IndexErrox, instead of the nicer InvalidFileException).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42103>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:16:14 2020
From: report at bugs.python.org (Karl O. Pinc)
Date: Wed, 21 Oct 2020 20:16:14 +0000
Subject: [issue39416] Document default numeric string formats
In-Reply-To: <1579660529.58.0.0341841917197.issue39416@roundup.psfhosted.org>
Message-ID: <1603311374.57.0.398699163377.issue39416@roundup.psfhosted.org>


Change by Karl O. Pinc <kop at karlpinc.com>:


----------
pull_requests: +21809
pull_request: https://github.com/python/cpython/pull/22867

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39416>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:16:37 2020
From: report at bugs.python.org (Matan Perelman)
Date: Wed, 21 Oct 2020 20:16:37 +0000
Subject: [issue42112] ZipFIle.write remove slash at the beginning of member's
 path
Message-ID: <1603311397.53.0.661224858745.issue42112@roundup.psfhosted.org>


Change by Matan Perelman <matan1008 at gmail.com>:


----------
components: Library (Lib)
nosy: matan1008
priority: normal
severity: normal
status: open
title: ZipFIle.write remove slash at the beginning of member's path
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42112>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:18:40 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Wed, 21 Oct 2020 20:18:40 +0000
Subject: [issue41626] port shebang of tools from python2 to python3
In-Reply-To: <1598286525.38.0.443257169426.issue41626@roundup.psfhosted.org>
Message-ID: <1603311520.33.0.000221158916763.issue41626@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

This is a minor thing, and not a particularly visible bug, but it could create confusion about how to run scripts so could be fixed.

1) For stdlib modules, I think the intended usage is `python3 -m encodings.rot_13`; I don?t expect anyone to run `python3 /usr/lib/python3.10/encodings/rot_13.py` to do a decoding in the terminal!
So for these easter eggs / hidden gems in the stdlib, I would delete the shebang and remove the executable bit.  There are 18 such modules, ignoring test, lib2to3, turtledemo and a few others named below.

1.1) There may be some exceptions: for Lib/idlelib/pyshell.py for example, maybe the IDLE entry point is just a symlink to that file, and removing the executable bit would break it.  So this can?t be a mass update but each case should be reviewed.

2) Some of the files in the PR are used during development of CPython: Tools/clinic/clinic.py Python/makeopcodetargets.py Parser/asdl_c.py Objects/typeslots.py Modules/_sha3/cleanup.py Lib/ctypes/macholib/fetch_macholib Mac/BuildScript/build-installer.py
I think some of these work with any Python, but some need the locally built interpreter to give correct results.
It could avoid confusion and mistakes to remove the shebangs and executable bits from the scripts that need a local Python, and make dure their documentation mentions `./python path/to/tool`.

2.1) One recent example, Tools/peg_generator/pegen/__main__.py is documented to work with Python 3.8+, and confusingly is both a __main__ module (to support python3 -m pegen and an executable script with shebang!)

2.2) In Tools/ssl, we have `/usr/bin/env python3` in make_ssl_data.py and `./python` in multissltests.py.  Are these working?!

3) The files in Tools/scripts are documented as ?useful for building Python? or ?generally useful scripts?.  They nearly all executable and nearly all use `#!/usr/bin/env python3`, so fixing the few `python` references there seems ok.  Likewise for Tools/pynche/pynche.

3.1) For Tools/gdb/libpython.py I don?t know how it?s meant to be used; if it?s not distributed but only for debugging a locally built CPython, then removing the shebang seems correct.

(Oh and by the way, Tools/scripts/fixps.py is a tool to replace `/usr/local/bin/python` shebangs with `/usr/bin/env python`?  You can judge if that is useful and/or correct.)


So if things are changed (let?s get a couple opinions here), maybe this needs separate PRs for 1/2/3, and make sure to get reviews to ensure we don?t break IDLE / Mac installers / pegen / etc.

----------
components: +Demos and Tools, Library (Lib)
nosy: +corona10, eric.araujo, ned.deily, petr.viktorin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41626>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:31:03 2020
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 21 Oct 2020 20:31:03 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603312263.61.0.584052323151.issue42096@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Are you able to attach a file with which you see this problem?
Have you tried with newer Python versions?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:30:43 2020
From: report at bugs.python.org (Ned Deily)
Date: Wed, 21 Oct 2020 20:30:43 +0000
Subject: [issue41626] port shebang of tools from python2 to python3
In-Reply-To: <1598286525.38.0.443257169426.issue41626@roundup.psfhosted.org>
Message-ID: <1603312243.29.0.818405094166.issue41626@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

To address some of the concerns:

- The shebang line in Mac/BuildScript/build-installer.py can be safely removed.

- "Lib/idlelib/pyshell.py for example, maybe the IDLE entry point is just a symlink to that file"
It's not, at least for unix-y builds. In [install-prefix], an "idle*" script is installed of the form:

#![install-prefix]/bin/python3.10

from idlelib.pyshell import main
if __name__ == '__main__':
    main()

So there is an abolute link to the correct interpreter and shebang is not used.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41626>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:32:27 2020
From: report at bugs.python.org (Ned Deily)
Date: Wed, 21 Oct 2020 20:32:27 +0000
Subject: [issue41626] port shebang of tools from python2 to python3
In-Reply-To: <1598286525.38.0.443257169426.issue41626@roundup.psfhosted.org>
Message-ID: <1603312347.95.0.52007940995.issue41626@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

To address some of the concerns:

- The shebang line in Mac/BuildScript/build-installer.py can be safely removed.

- "Lib/idlelib/pyshell.py for example, maybe the IDLE entry point is just a symlink to that file"
It's not, at least for unix-y builds. In [install-prefix], an "idle*" script is installed of the form:

#![install-prefix]/bin/python3.[n]

from idlelib.pyshell import main
if __name__ == '__main__':
    main()

So there is an absolute link to the correct interpreter and the shebang in pyshell.py is not used.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41626>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:32:39 2020
From: report at bugs.python.org (Ned Deily)
Date: Wed, 21 Oct 2020 20:32:39 +0000
Subject: [issue41626] port shebang of tools from python2 to python3
In-Reply-To: <1598286525.38.0.443257169426.issue41626@roundup.psfhosted.org>
Message-ID: <1603312359.41.0.10295362059.issue41626@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
Removed message: https://bugs.python.org/msg379245

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41626>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:33:27 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 20:33:27 +0000
Subject: [issue41959] Doc/library/asyncio-policy.rst grammar error
In-Reply-To: <1601992264.68.0.320872676637.issue41959@roundup.psfhosted.org>
Message-ID: <1603312407.57.0.161727393303.issue41959@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ba666747af83aa465ffa8b55efbbb7f992647e12 by Miss Skeleton (bot) in branch '3.8':
[3.8] bpo-41959: Fix grammar around class asyncio.MultiLoopChildWatcher text (GH-22580) (GH-22866)
https://github.com/python/cpython/commit/ba666747af83aa465ffa8b55efbbb7f992647e12


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41959>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:34:23 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 20:34:23 +0000
Subject: [issue39416] Document default numeric string formats
In-Reply-To: <1579660529.58.0.0341841917197.issue39416@roundup.psfhosted.org>
Message-ID: <1603312463.52.0.974403397278.issue39416@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f8b1ccd63c94bcde1c15d56d24add89861b6ceee by kpinc in branch 'master':
Fix bpo-39416: Change "Numeric" to lower case; an english word, not a class name (GH-22867)
https://github.com/python/cpython/commit/f8b1ccd63c94bcde1c15d56d24add89861b6ceee


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39416>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:34:31 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 20:34:31 +0000
Subject: [issue39416] Document default numeric string formats
In-Reply-To: <1579660529.58.0.0341841917197.issue39416@roundup.psfhosted.org>
Message-ID: <1603312471.83.0.640986160039.issue39416@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21810
pull_request: https://github.com/python/cpython/pull/22868

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39416>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:34:35 2020
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 21 Oct 2020 20:34:35 +0000
Subject: [issue41959] Doc/library/asyncio-policy.rst grammar error
In-Reply-To: <1601992264.68.0.320872676637.issue41959@roundup.psfhosted.org>
Message-ID: <1603312475.53.0.956725090126.issue41959@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:


New changeset c3442fd8a7f6e34ba888efea085c3701b75c0b71 by Miss Skeleton (bot) in branch '3.9':
bpo-41959: Fix grammar around class asyncio.MultiLoopChildWatcher text (GH-22580) (#22865)
https://github.com/python/cpython/commit/c3442fd8a7f6e34ba888efea085c3701b75c0b71


----------
nosy: +asvetlov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41959>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:34:39 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 20:34:39 +0000
Subject: [issue39416] Document default numeric string formats
In-Reply-To: <1579660529.58.0.0341841917197.issue39416@roundup.psfhosted.org>
Message-ID: <1603312479.79.0.134647760278.issue39416@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21811
pull_request: https://github.com/python/cpython/pull/22869

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39416>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:41:17 2020
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 21 Oct 2020 20:41:17 +0000
Subject: [issue41959] Doc/library/asyncio-policy.rst grammar error
In-Reply-To: <1601992264.68.0.320872676637.issue41959@roundup.psfhosted.org>
Message-ID: <1603312877.25.0.326626864942.issue41959@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41959>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:47:44 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 21 Oct 2020 20:47:44 +0000
Subject: [issue41052] Opt out serialization/deserialization for heap type
In-Reply-To: <1592659049.98.0.596314769567.issue41052@roundup.psfhosted.org>
Message-ID: <1603313264.43.0.559550345145.issue41052@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +21812
pull_request: https://github.com/python/cpython/pull/22870

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41052>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:52:33 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 21 Oct 2020 20:52:33 +0000
Subject: [issue41052] Opt out serialization/deserialization for heap type
In-Reply-To: <1592659049.98.0.596314769567.issue41052@roundup.psfhosted.org>
Message-ID: <1603313553.4.0.509288379809.issue41052@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I came to the same conclusion after trying to fix it. But we cannot just do it now. We have to fix bugs in Python 3.9 and support protocols 0 and 1 for some deprecation period.

Also protocols 0 and 1 are used in some third-party implementations for other programming languages, so they can be used for interoperability with other languages.

The proposed patch adds additional check. It uses the fact that the __new__ attribute for classes implemented in C is a bultin function with __self__ pointing to this class (it is created in tp_new_wrapper()).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41052>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:54:43 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 20:54:43 +0000
Subject: [issue39416] Document default numeric string formats
In-Reply-To: <1579660529.58.0.0341841917197.issue39416@roundup.psfhosted.org>
Message-ID: <1603313683.27.0.647215056399.issue39416@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 224ed378b9aadad9dbbd890064677433188aecd9 by Miss Skeleton (bot) in branch '3.9':
Fix bpo-39416: Change "Numeric" to lower case; an english word, not a class name (GH-22867)
https://github.com/python/cpython/commit/224ed378b9aadad9dbbd890064677433188aecd9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39416>
_______________________________________

From report at bugs.python.org  Wed Oct 21 16:57:52 2020
From: report at bugs.python.org (Matan Perelman)
Date: Wed, 21 Oct 2020 20:57:52 +0000
Subject: [issue42112] ZipFIle.write remove slash at the beginning of member's
 path
Message-ID: <1603313872.53.0.878023518012.issue42112@roundup.psfhosted.org>


Change by Matan Perelman <matan1008 at gmail.com>:


----------
keywords: +patch
pull_requests: +21813
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22871

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42112>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:17:39 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 21:17:39 +0000
Subject: [issue35181] Doc: Namespace Packages: Inconsistent documentation of
 __loader__ being None
In-Reply-To: <1541543349.68.0.788709270274.issue35181@psf.upfronthosting.co.za>
Message-ID: <1603315059.44.0.640554799656.issue35181@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 27f1bd8787d24ac53cc3dc6ea5eb00b8a3499839 by G?ry Ogam in branch 'master':
bpo-35181: Correct importlib documentation for some module attributes (GH-15190)
https://github.com/python/cpython/commit/27f1bd8787d24ac53cc3dc6ea5eb00b8a3499839


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35181>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:17:50 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 21:17:50 +0000
Subject: [issue35181] Doc: Namespace Packages: Inconsistent documentation of
 __loader__ being None
In-Reply-To: <1541543349.68.0.788709270274.issue35181@psf.upfronthosting.co.za>
Message-ID: <1603315070.4.0.747613098072.issue35181@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21814
pull_request: https://github.com/python/cpython/pull/22872

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35181>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:17:58 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 21:17:58 +0000
Subject: [issue35181] Doc: Namespace Packages: Inconsistent documentation of
 __loader__ being None
In-Reply-To: <1541543349.68.0.788709270274.issue35181@psf.upfronthosting.co.za>
Message-ID: <1603315078.32.0.605553459694.issue35181@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21815
pull_request: https://github.com/python/cpython/pull/22873

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35181>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:22:43 2020
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 21 Oct 2020 21:22:43 +0000
Subject: [issue41910] Document that object.__eq__ implements `a is b`
In-Reply-To: <1601652122.88.0.984647748564.issue41910@roundup.psfhosted.org>
Message-ID: <1603315363.79.0.959114747715.issue41910@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
keywords: +patch
pull_requests: +21816
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22874

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41910>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:27:18 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 21:27:18 +0000
Subject: [issue35181] Doc: Namespace Packages: Inconsistent documentation of
 __loader__ being None
In-Reply-To: <1541543349.68.0.788709270274.issue35181@psf.upfronthosting.co.za>
Message-ID: <1603315638.99.0.0643042554837.issue35181@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 916ac9520108831d2099b13992a45884b112b193 by Miss Skeleton (bot) in branch '3.8':
bpo-35181: Correct importlib documentation for some module attributes (GH-15190)
https://github.com/python/cpython/commit/916ac9520108831d2099b13992a45884b112b193


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35181>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:36:41 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 21 Oct 2020 21:36:41 +0000
Subject: [issue42103] [security] DoS (MemError via CPU and RAM exhaustion)
 when processing malformed Apple Property List files in binary format
In-Reply-To: <1603239911.48.0.657036824442.issue42103@roundup.psfhosted.org>
Message-ID: <1603316201.98.0.436946514314.issue42103@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

There are two issues here.

The simple one is building a large format string for struct.unpack(). It has simple solution: use f'>{n}{_BINARY_FORMAT[size]}'.

The hard issue is that read(n) allocates n bytes in memory even if there are not so many bytes in the file. It affects not only plistlib and should be fixed in the file implementation itself. There is an open issue for this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42103>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:39:50 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 21:39:50 +0000
Subject: [issue35181] Doc: Namespace Packages: Inconsistent documentation of
 __loader__ being None
In-Reply-To: <1541543349.68.0.788709270274.issue35181@psf.upfronthosting.co.za>
Message-ID: <1603316390.2.0.53010309082.issue35181@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6e842bcdf8a47fe081c9f2edc2b8875e1f3e2f18 by Miss Skeleton (bot) in branch '3.9':
bpo-35181: Correct importlib documentation for some module attributes (GH-15190)
https://github.com/python/cpython/commit/6e842bcdf8a47fe081c9f2edc2b8875e1f3e2f18


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35181>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:46:56 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 21 Oct 2020 21:46:56 +0000
Subject: [issue38980] Compile libpython with -fno-semantic-interposition
In-Reply-To: <1575561631.45.0.417730594345.issue38980@roundup.psfhosted.org>
Message-ID: <1603316816.36.0.160387177029.issue38980@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset b451b0e9a772f009f4161f7a46476190d0d17ac1 by Pablo Galindo in branch 'master':
bpo-38980: Add -fno-semantic-interposition when building with optimizations (GH-22862)
https://github.com/python/cpython/commit/b451b0e9a772f009f4161f7a46476190d0d17ac1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38980>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:47:06 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 21 Oct 2020 21:47:06 +0000
Subject: [issue38980] Compile libpython with -fno-semantic-interposition
In-Reply-To: <1575561631.45.0.417730594345.issue38980@roundup.psfhosted.org>
Message-ID: <1603316826.41.0.815498906132.issue38980@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38980>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:54:46 2020
From: report at bugs.python.org (Vladimir Matveev)
Date: Wed, 21 Oct 2020 21:54:46 +0000
Subject: [issue42113] Replace _asyncio.TaskWakeupMethWrapper with PyCFunction
Message-ID: <1603317285.99.0.989650690321.issue42113@roundup.psfhosted.org>


New submission from Vladimir Matveev <desco.by at gmail.com>:

`TaskWakeupMethWrapper` looks like a more limited version of `PyCFunction` so it can be replaced with one.
Pros: remove a bunch of code, use better calling convention
Cons: now `wakeup` object will expose slightly more properties but I'm not sure whether this is bad

----------
components: asyncio
messages: 379258
nosy: asvetlov, v2m, yselivanov
priority: normal
severity: normal
status: open
title: Replace _asyncio.TaskWakeupMethWrapper with PyCFunction
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42113>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:55:34 2020
From: report at bugs.python.org (Vladimir Matveev)
Date: Wed, 21 Oct 2020 21:55:34 +0000
Subject: [issue42113] Replace _asyncio.TaskWakeupMethWrapper with PyCFunction
In-Reply-To: <1603317285.99.0.989650690321.issue42113@roundup.psfhosted.org>
Message-ID: <1603317334.29.0.716973259418.issue42113@roundup.psfhosted.org>


Change by Vladimir Matveev <desco.by at gmail.com>:


----------
keywords: +patch
pull_requests: +21817
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22875

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42113>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:56:13 2020
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 21 Oct 2020 21:56:13 +0000
Subject: [issue41911] Language reference for expressions incorrectly specifies
 what type of object(s) are expected
In-Reply-To: <1601652453.05.0.89373160388.issue41911@roundup.psfhosted.org>
Message-ID: <1603317373.77.0.356593208501.issue41911@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

It turns out the "expressions" page of the language reference makes multiple claims about types which do not hold, e.g. for multiplication, "The arguments must either both be numbers, or one argument must be an integer and the other must be a sequence", or for `&` that its arguments "must be integers".

So this is much larger than just comparison operators.

----------
assignee: brett.cannon -> docs at python
nosy: +docs at python
title: Language reference incorrectly says comparison expressions return boolean values -> Language reference for expressions incorrectly specifies what type of object(s) are expected

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41911>
_______________________________________

From report at bugs.python.org  Wed Oct 21 17:57:10 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Wed, 21 Oct 2020 21:57:10 +0000
Subject: [issue35181] Doc: Namespace Packages: Inconsistent documentation of
 __loader__ being None
In-Reply-To: <1541543349.68.0.788709270274.issue35181@psf.upfronthosting.co.za>
Message-ID: <1603317430.42.0.894214481622.issue35181@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

@maggyero - I haven't merged PR 10016, but I left some additional comments.  Are you still interested in shepherding this PR?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35181>
_______________________________________

From report at bugs.python.org  Wed Oct 21 18:02:15 2020
From: report at bugs.python.org (Joseph Fox-Rabinovitz)
Date: Wed, 21 Oct 2020 22:02:15 +0000
Subject: [issue42114] Documentation of
Message-ID: <1603317735.12.0.0166150677555.issue42114@roundup.psfhosted.org>


New submission from Joseph Fox-Rabinovitz <jfoxrabinovitz at gmail.com>:

ctypes.CDLL initializer defined in version 3.8 and beyond as

```
def __init__(self, name, mode=DEFAULT_MODE, handle=None,
             use_errno=False,
             use_last_error=False,
             winmode=None):
```

Documentation says `winmode=0`:

```
class ctypes.CDLL(name, mode=DEFAULT_MODE, handle=None, use_errno=False, use_last_error=False, winmode=0)
```

Loading of normal DLL from custom directory works when `winmode=0`, but when `winmode=None` To reproduce, any combination of adding the fol += der containing the DLL to `os.evia ron['PATH']`, `os.add_dll_directory(...)`

Discoveryos.pathsep + ... triggered by https://stackoverflow.co, `sys.path.appen

Worked prior to 3.8 because there was no `winmode` parameter, and d(...)` does not change the behavior.m/q/`mode` was passed in directly, 59330863/298873`ctypes0. .DEFAULT_MODE == 0`.

I don't know whether it's better to update the code, the docs, or something else, but based on current info, would prefer updating the code.Some info summarized in https://stackoverflow.com/a/{8,9,}64472088/2988730.

Link to do pagecscorresponding : https://docs.python.org/3.10/library/ctypes.html#ctypes.CDLL
730.
Link to GitHub code: https://github.com/python/cpython/blob/3.{8,9}/Lib/ctypes/__init__.py#L340

----------
components: ctypes
messages: 379261
nosy: madphysicist
priority: normal
severity: normal
status: open
title: Documentation of
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42114>
_______________________________________

From report at bugs.python.org  Wed Oct 21 18:02:35 2020
From: report at bugs.python.org (Joseph Fox-Rabinovitz)
Date: Wed, 21 Oct 2020 22:02:35 +0000
Subject: [issue42114] Documentation of ctypes.CDLL does not correspond to code
In-Reply-To: <1603317735.12.0.0166150677555.issue42114@roundup.psfhosted.org>
Message-ID: <1603317755.29.0.541266994418.issue42114@roundup.psfhosted.org>


Change by Joseph Fox-Rabinovitz <jfoxrabinovitz at gmail.com>:


----------
title: Documentation of -> Documentation of ctypes.CDLL does not correspond to code

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42114>
_______________________________________

From report at bugs.python.org  Wed Oct 21 18:10:45 2020
From: report at bugs.python.org (Joseph Fox-Rabinovitz)
Date: Wed, 21 Oct 2020 22:10:45 +0000
Subject: [issue42114] Documentation of ctypes.CDLL does not correspond to code
In-Reply-To: <1603317735.12.0.0166150677555.issue42114@roundup.psfhosted.org>
Message-ID: <1603318245.71.0.632077513871.issue42114@roundup.psfhosted.org>


Joseph Fox-Rabinovitz <jfoxrabinovitz at gmail.com> added the comment:

Company firewall mutilated the text. Here is another attempt:

ctypes.CDLL initializer defined in version 3.8 and beyond as

```
def __init__(self, name, mode=DEFAULT_MODE, handle=None,
             use_errno=False,
             use_last_error=False,
             winmode=None):
```

Documentation says `winmode=0`:

```
class ctypes.CDLL(name, mode=DEFAULT_MODE, handle=None, use_errno=False, use_last_error=False, winmode=0)
```

Loading of normal DLL from custom directory works when `winmode=0`, but not when `winmode=None`. To reproduce, any combination of adding the folder containing the DLL via `os.eviron['PATH'] += os.pathsep + ...`, `os.add_dll_directory(...)`, `sys.path.append(...)` does not change the behavior.

Worked prior to 3.8 because there was no `parameter, and `mode` was passed in direcCompany firewall mutilated the text. Here is another attempt:

ctypes.CDLL initializer defined in version 3.8 and beyond as

```
def __init__(self, name, mode=DEFAULT_MODE, handle=None,
             use_errno=False,
             use_last_error=False,
             winmode=None):
```

Documentation says `winmode=0`:

```
class ctypes.CDLL(name, mode=DEFAULT_MODE, handle=None, use_errno=False, use_last_error=False, winmode=0)
```

Loading of normal DLL from custom directory works when `winmode=0`, but not when `winmode=None`. To reproduce, any combination of adding the folder containing the DLL via `os.eviron['PATH'] += os.pathsep + ...`, `os.add_dll_directory(...)`, `sys.path.append(...)` does not change the behavior.

Worked prior to 3.8 because there was no `winmode` parameter, `mode` was passed in diretly, and `ctypes.DEFAULT_MODE == 0`.

I don't know whether it's better to update the code, the docs, or something else, but based on current info, would prefer updating the code.

Discovery triggered by https://stackoverflow.com/q/59330863/2988730.
Some info summarized in https://stackoverflow.com/a/64472088/2988730.

yink to docs: https://docs.python.org/3.{8,9,10}/library/ctypes.html#ctypes.CDLL
Link to GitHub code: https://github.com/python/cpython/blob/3.{8,9}/Lib/ctypes/__init__.py#L340t.ly, `ctyp. .DEFAULT_MODE == 0`.
I don't know whether it's better to update the code, the docs, or something else, but based on current info, would prefer updating the code.

Discovery triggered by https://stackoverflow.com/q/59330863/2988730.
Some info summarized in https://stackoverflow.com/a/64472088/2988730.

yink to docs: https://docs.python.org/3.{8,9,10}/library/ctypes.html#ctypes.CDLL
Link to GitHub code: https://github.com/python/cpython/blob/3.{8,9}/Lib/ctypes/__init__.py#L340

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42114>
_______________________________________

From report at bugs.python.org  Wed Oct 21 18:12:43 2020
From: report at bugs.python.org (Joseph Fox-Rabinovitz)
Date: Wed, 21 Oct 2020 22:12:43 +0000
Subject: [issue42114] Documentation of ctypes.CDLL does not correspond to code
In-Reply-To: <1603317735.12.0.0166150677555.issue42114@roundup.psfhosted.org>
Message-ID: <1603318363.26.0.12815473561.issue42114@roundup.psfhosted.org>


Joseph Fox-Rabinovitz <jfoxrabinovitz at gmail.com> added the comment:

Last attempt before I give up:

ctypes.CDLL initializer defined in version 3.8 and beyond as

```
def __init__(self, name, mode=DEFAULT_MODE, handle=None,
             use_errno=False,
             use_last_error=False,
             winmode=None):
```

Documentation says `winmode=0`:

```
class ctypes.CDLL(name, mode=DEFAULT_MODE, handle=None, use_errno=False, use_last_error=False, winmode=0)
```

Loading of normal DLL from custom directory works when `winmode=0`, but not when `winmode=None`. To reproduce, any combination of adding the folder containing the DLL via `os.eviron['PATH'] += os.pathsep + ...`, `os.add_dll_directory(...)`, `sys.path.append(...)` does not change the behavior.

Worked prior to 3.8 because there was no `winmode` parameter, `mode` was passed in diretly, and `ctypes.DEFAULT_MODE == 0`.

I don't know whether it's better to update the code, the docs, or something else, but based on current info, would prefer updating the code.

Discovery triggered by https://stackoverflow.com/q/59330863/2988730.
Some info summarized in https://stackoverflow.com/a/64472088/2988730.

Link to docs: https://docs.python.org/3.{8,9,10}/library/ctypes.html#ctypes.CDLL
Link to GitHub code: https://github.com/python/cpython/blob/3.{8,9}/Lib/ctypes/__init__.py#L340

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42114>
_______________________________________

From report at bugs.python.org  Wed Oct 21 19:24:47 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 23:24:47 +0000
Subject: [issue41910] Document that object.__eq__ implements `a is b`
In-Reply-To: <1601652122.88.0.984647748564.issue41910@roundup.psfhosted.org>
Message-ID: <1603322687.52.0.734653783328.issue41910@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 3c69f0c933d4790855929f1fcd74e4a0fefb5d52 by Brett Cannon in branch 'master':
bpo-41910: specify the default implementations of object.__eq__ and object.__ne__ (GH-22874)
https://github.com/python/cpython/commit/3c69f0c933d4790855929f1fcd74e4a0fefb5d52


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41910>
_______________________________________

From report at bugs.python.org  Wed Oct 21 19:25:13 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 23:25:13 +0000
Subject: [issue41910] Document that object.__eq__ implements `a is b`
In-Reply-To: <1601652122.88.0.984647748564.issue41910@roundup.psfhosted.org>
Message-ID: <1603322713.96.0.0908712957864.issue41910@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21819
pull_request: https://github.com/python/cpython/pull/22877

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41910>
_______________________________________

From report at bugs.python.org  Wed Oct 21 19:25:05 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 21 Oct 2020 23:25:05 +0000
Subject: [issue41910] Document that object.__eq__ implements `a is b`
In-Reply-To: <1601652122.88.0.984647748564.issue41910@roundup.psfhosted.org>
Message-ID: <1603322705.76.0.232163937614.issue41910@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21818
pull_request: https://github.com/python/cpython/pull/22876

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41910>
_______________________________________

From report at bugs.python.org  Wed Oct 21 20:07:47 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 00:07:47 +0000
Subject: [issue41910] Document that object.__eq__ implements `a is b`
In-Reply-To: <1601652122.88.0.984647748564.issue41910@roundup.psfhosted.org>
Message-ID: <1603325267.4.0.482435771.issue41910@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset c3538b83816663d7b767391a375179a0ce923990 by Miss Skeleton (bot) in branch '3.9':
bpo-41910: specify the default implementations of object.__eq__ and object.__ne__ (GH-22874) (#22876)
https://github.com/python/cpython/commit/c3538b83816663d7b767391a375179a0ce923990


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41910>
_______________________________________

From report at bugs.python.org  Wed Oct 21 20:08:02 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 00:08:02 +0000
Subject: [issue41910] Document that object.__eq__ implements `a is b`
In-Reply-To: <1601652122.88.0.984647748564.issue41910@roundup.psfhosted.org>
Message-ID: <1603325282.82.0.596126970414.issue41910@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset b2b3803081f07600710273b4f902b5be6e5596e7 by Miss Skeleton (bot) in branch '3.8':
bpo-41910: specify the default implementations of object.__eq__ and object.__ne__ (GH-22874) (#22877)
https://github.com/python/cpython/commit/b2b3803081f07600710273b4f902b5be6e5596e7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41910>
_______________________________________

From report at bugs.python.org  Wed Oct 21 20:49:32 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Thu, 22 Oct 2020 00:49:32 +0000
Subject: [issue42113] Replace _asyncio.TaskWakeupMethWrapper with PyCFunction
In-Reply-To: <1603317285.99.0.989650690321.issue42113@roundup.psfhosted.org>
Message-ID: <1603327772.01.0.617695876255.issue42113@roundup.psfhosted.org>


Change by Yury Selivanov <yselivanov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42113>
_______________________________________

From report at bugs.python.org  Wed Oct 21 21:33:19 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 01:33:19 +0000
Subject: [issue41910] Document that object.__eq__ implements `a is b`
In-Reply-To: <1601652122.88.0.984647748564.issue41910@roundup.psfhosted.org>
Message-ID: <1603330399.93.0.0560241617992.issue41910@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Brett, I presume you want this closed.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41910>
_______________________________________

From report at bugs.python.org  Wed Oct 21 22:06:11 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 22 Oct 2020 02:06:11 +0000
Subject: [issue42057] peephole optimizer bug relating to JUMP_IF_NOT_EXC_MATCH
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1603332371.51.0.888172939849.issue42057@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 07a44d9572c7746568a7fe2fbcd42127fd6d4019 by Inada Naoki in branch '3.9':
bpo-42057: Fix peephole optimizer (GH-22802)
https://github.com/python/cpython/commit/07a44d9572c7746568a7fe2fbcd42127fd6d4019


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Wed Oct 21 22:06:52 2020
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 22 Oct 2020 02:06:52 +0000
Subject: [issue41910] Document that object.__eq__ implements `a is b`
In-Reply-To: <1601652122.88.0.984647748564.issue41910@roundup.psfhosted.org>
Message-ID: <1603332412.61.0.727267078403.issue41910@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Thanks, Terry!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41910>
_______________________________________

From report at bugs.python.org  Wed Oct 21 22:10:33 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 22 Oct 2020 02:10:33 +0000
Subject: [issue42057] peephole optimizer bug relating to JUMP_IF_NOT_EXC_MATCH
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1603332633.26.0.642268166509.issue42057@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +21820
pull_request: https://github.com/python/cpython/pull/22878

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Wed Oct 21 22:28:43 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 22 Oct 2020 02:28:43 +0000
Subject: [issue42057] peephole optimizer bug relating to JUMP_IF_NOT_EXC_MATCH
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1603333723.51.0.836715807539.issue42057@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 8f6787d93db1b6022db44b1e1d22460c2b74f60b by Inada Naoki in branch '3.9':
bpo-42057: Add a test case (GH-22878)
https://github.com/python/cpython/commit/8f6787d93db1b6022db44b1e1d22460c2b74f60b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Wed Oct 21 22:38:03 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 22 Oct 2020 02:38:03 +0000
Subject: [issue32431] Two bytes objects of zero length don't compare equal
In-Reply-To: <1514387834.13.0.213398074469.issue32431@psf.upfronthosting.co.za>
Message-ID: <1603334283.2.0.292593028508.issue32431@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32431>
_______________________________________

From report at bugs.python.org  Wed Oct 21 22:38:54 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 22 Oct 2020 02:38:54 +0000
Subject: [issue42057] peephole optimizer bug relating to JUMP_IF_NOT_EXC_MATCH
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1603334334.52.0.156710984144.issue42057@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Thank you for reporting with reproducer.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Wed Oct 21 23:21:38 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 22 Oct 2020 03:21:38 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
Message-ID: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

After https://bugs.python.org/issue42093 and https://bugs.python.org/issue26219 is being clear that we can leverage some cache for different information in the evaluation loop to speed up CPython. This observation is also based on the fact that although Python is dynamic, there is plenty of code that does not exercise said dynamism and therefore factoring out the "dynamic" parts of the execution by using a cache mechanism can yield excellent results. 

So far we have two big improvements in performance for caching LOAD_ATTR and LOAD_GLOBAL (in some cases up to 10-14%) but I think we can do much much more. Here are some observations of what I think we can do:

* Instead of adding more caches using the current mechanism, which adds some inlined code in every opcode in the evaluation loop, we can try to formalize some kind of caching mechanism that has some better API that will allow adding more opcodes in the future. Having the code inline in ceval.c is going to become difficult to maintain if we keep adding more stuff directly there.

* Instead of handling the specialization in the same opcode as the original one (LOAD_ATTR is doing the slow and the fast path) we could mutate the original code object and replacing the slow and generic opcodes for the more specialized ones and these will also be in charge of changing it back to the generic and slow ones if the assumptions that activated them appear.

Obviously, mutating code objects is scary, so we could have some "specialized" version of the bytecode in the cache and use that if is present. Ideas that we could do with this cached stuff:

- For binary operators, we can grab both operands, resolve the addition function and cache that together with the types and the version tags and if the types and the version tags are the same, use directly the addition function instead of resolving it.

- For loading methods, we could cache the bound method as proposed by Yury originally here: https://mail.python.org/pipermail/python-dev/2016-January/142945.html.

- We could also do the same for operations like "some_container[]" if the container is some builtin. We can substitute/specialize the opcode for someone that directly uses built-in operations instead of the generic BINARY_SUBSCR.

The plan will be:

- Making some infrastructure/framework for the caching that allows us to optimize/deoptimize individual opcodes.
- Refactor the existing specialization for LOAD_GLOBAL/LOAD_ATTR to use said infrastructure.
- Thinking of what operations could benefit from specialization and start adding them one by one.

----------
components: C API
messages: 379272
nosy: Mark.Shannon, methane, nascheme, pablogsal, vstinner, yselivanov
priority: normal
severity: normal
status: open
title: Caching infrastructure for the evaluation loop: specialised opcodes
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Wed Oct 21 23:24:42 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 22 Oct 2020 03:24:42 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603337082.78.0.53398842019.issue42115@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

To clarify what I mean with:

> - We could also do the same for operations like "some_container[]" if the container is some builtin. We can substitute/specialize the opcode for someone that directly uses built-in operations instead of the generic BINARY_SUBSCR.

If a given function has a BINARY_SUBSCR opcode and when executing it a given number of times we see that the object to get the subscript is always a list, we change the BINARY_SUBSCR to BINARY_SUBSCR_FOR_LISTS and it that opcode we do a quick check for PyList_CheckExact and if is correct we call "Objects/listobject.c:list_subscript" directly and if is false we put back a BINARY_SUBSCR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Wed Oct 21 23:27:38 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 22 Oct 2020 03:27:38 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603337258.71.0.610741342532.issue42115@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Also, many of these ideas are not new, and many of them are inspired or taken from Yury's email (https://mail.python.org/pipermail/python-dev/2016-January/142945.html) but I wanted to add that I think that with some coordination between us we can achieve some excellent speedups for Python 3.10!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Wed Oct 21 23:59:17 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Thu, 22 Oct 2020 03:59:17 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
In-Reply-To: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>
Message-ID: <1603339157.68.0.43136475228.issue42097@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

If you use os.fork() or any of the multiprocessing start methods that call os.fork() with a process involving threads, this is expected behavior.  os.fork() cannot be used in processes that have threads without potential for deadlock.

Specifically, make sure you explicitly call:

 multiprocessing.set_start_method('spawn')

before using multiprocessing in any application where threads exist.

It is possible to use 'forkserver' as well, but only if you ensure the multiprocessing forkserver process is started before your application has launched any threads.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Thu Oct 22 00:38:39 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Thu, 22 Oct 2020 04:38:39 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603341519.76.0.405236193528.issue42115@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

Few thoughts in no particular order:

- I'd suggest implementing the cache for 2-3 more opcodes on top of the existing infrastructure to get more experience and then refactoring it to make it more generic.

- Generalizing LOAD_METHOD to work for methods with **kwargs, caching concrete operator implementations for opcodes like BINARY_ADD etc. are all possible on top of the current infra.

- Rewriting code objects in place is wrong, IMO: you always need to have a way to deoptimize the entire thing, so you need to keep the original one. It might be that you have well defined and static types for the first 10000 invocations and something entirely different on 10001. So IMO we need a SpecializedCode object with the necessary bailout guards. But that's not a simple thing to implement, so unless someone will be working on this fulltime for a long time I'd suggest working off what we have now. (That said I'd take a close look at what Dino is building).

- There are multiple different approaches we can choose for optimizing CPython, ranging from hidden classes to a full blown JIT. I hope someone will do them one day. But IMO the current simple "opcode cache" (I wish we had a better name) mechanism we have would allow us to squeeze up to 15-25% median improvement in our benchmarks with relatively limited dev time. Maybe that's good enough for 3.10.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Thu Oct 22 00:45:10 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 22 Oct 2020 04:45:10 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603341910.38.0.621223380042.issue42115@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> - Rewriting code objects in place is wrong, IMO: you always need to have a way to deoptimize the entire thing, so you need to keep the original one. It might be that you have well defined and static types for the first 10000 invocations and something entirely different on 10001. So IMO we need a SpecializedCode object with the necessary bailout guards.

Imagine that we have a secondary copy of the bytecode in the cache inside the code object and we mutate that instead. The key difference with the current cache infrastructure is that we don't accumulate all the optimizations on the same opcode, which can be very verbose. Instead, we change the generic opcode to a more specialised to optimize and we change it back to deoptimize. The advantage is that BINARY_SUBSCRIPT for example won't be this gigantic block of text that will do different things depending if is specialising for dicts or lists or tuples, but we will have a different opcode for every of them, which I think is much easier to manage.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Thu Oct 22 01:29:50 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Thu, 22 Oct 2020 05:29:50 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603344590.31.0.960684579992.issue42115@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

> Imagine that we have a secondary copy of the bytecode in the cache inside the code object and we mutate that instead. The key difference with the current cache infrastructure is that we don't accumulate all the optimizations on the same opcode, which can be very verbose. Instead, we change the generic opcode to a more specialised to optimize and we change it back to deoptimize.

Yeah, I follow. As long as we keep the original list of opcodes we're good ;)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Thu Oct 22 03:06:08 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 07:06:08 +0000
Subject: [issue41626] port shebang of tools from python2 to python3
In-Reply-To: <1598286525.38.0.443257169426.issue41626@roundup.psfhosted.org>
Message-ID: <1603350368.01.0.714922378641.issue41626@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Thoughts I wrote on the PR that belong here.  (Thanks for the reminder,  ?ric.):
*The use of #! in both stdlib and tools seems rather inconsistent.

* Stdlib modules are best run with <python> -m mod so as to run the code with the exact python binary they are meant for. So maybe the marker should be be removed at least from /Lib/*.  But...

-- I was not really aware of idlelib.pyshell.  Running with an explicit  binary seems particularly important for IDLE.  About once a month on SO, some beginner posts about not being able to import a module they downloaded when running IDLE (maybe only sometimes).  Nearly always, they have 2 pythons, such as from Anaconda and python.org.

I may want or need to deprecate using pyshell as entry instead of idle.py/idlew.py/idle.bat as I want to move startup code from pyshell to either idle.py or a separate startup only file.  I am not sure how to get from here to there, partly because I don't really know what 'here' is in practice. 

* With 2.7 put to bed, the line is hardly needed to select between latest 2.x and latest 3.x.

* The response of py.exe to shebang lines needs to be detailed and considered.  I believe it only knows about python.org installs, so it will only start the latest python.org install.  I don't know what it does if 32- and 64- bit versions are both present.  I also don't know what it runs if the 'default' installed version is not the latest installed version.  Does py.exe know what the default is, or does that just affect what 'python' runs?

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41626>
_______________________________________

From report at bugs.python.org  Thu Oct 22 04:06:09 2020
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 22 Oct 2020 08:06:09 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1603353969.28.0.54646847323.issue1635741@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

The commit

    bpo-1635741: Port multiprocessing ext to multiphase init (GH-21378)
    https://github.com/python/cpython/commit/1d541c25c8019f7a0b80b3e1b437abe171e40b65


introduced a NULL pointer deref:

        if (py_sem_value_max == NULL) {
            Py_DECREF(py_sem_value_max);
            return -1;
        }

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Thu Oct 22 04:09:09 2020
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 22 Oct 2020 08:09:09 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1603354149.35.0.697682379105.issue1635741@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
pull_requests: +21821
pull_request: https://github.com/python/cpython/pull/22880

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Thu Oct 22 04:19:37 2020
From: report at bugs.python.org (Alex Roussel)
Date: Thu, 22 Oct 2020 08:19:37 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603354777.23.0.277797194893.issue42096@roundup.psfhosted.org>


Alex Roussel <alexandredrr14 at gmail.com> added the comment:

Hi Irit, 

Thank you for the response, I'm afraid I'm not allowed to upload the file myself, however the file in question is '2020-10-18-1602979256-http_get_7549.json.gz', which is available at this link https://opendata.rapid7.com/sonar.http/?page=1. It becomes free to download one month after release so I'll make sure to come back on the 18th Nov and upload it once it is made freely available.

In the meantime, I've tested on python 3.8.5 and 3.9 and I get the same issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Thu Oct 22 05:27:10 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 22 Oct 2020 09:27:10 +0000
Subject: [issue42103] [security] DoS (MemError via CPU and RAM exhaustion)
 when processing malformed Apple Property List files in binary format
In-Reply-To: <1603239911.48.0.657036824442.issue42103@roundup.psfhosted.org>
Message-ID: <1603358830.43.0.278909539555.issue42103@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21822
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22882

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42103>
_______________________________________

From report at bugs.python.org  Thu Oct 22 05:37:46 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 22 Oct 2020 09:37:46 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603359466.12.0.873875674403.issue42115@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

FWIW, php7 is about 5x faster than Python on spectral norm benchmark.
https://benchmarksgame-team.pages.debian.net/benchmarksgame/fastest/php-python3.html

There two major reasons:

* PHP uses scalar type for float and int
* PHP uses type-specialized bytecode (PHP8 will use JIT, but PHP7 dosn't)

Source code is here:
php: https://benchmarksgame-team.pages.debian.net/benchmarksgame/program/spectralnorm-php-1.html
Python: https://benchmarksgame-team.pages.debian.net/benchmarksgame/program/spectralnorm-python3-8.html

The most hot function is eval_A()

```
def eval_A(i, j): # i and j are int.
    ij = i + j
    return ij * (ij + 1) // 2 + i + 1
```

And its bytecode:

```
Disassembly of <code object eval_A at 0x107fd8500, file "x.py", line 1>:
  2           0 LOAD_FAST                0 (i)
              2 LOAD_FAST                1 (j)
              4 BINARY_ADD
              6 STORE_FAST               2 (ij)

  3           8 LOAD_FAST                2 (ij)
             10 LOAD_FAST                2 (ij)
             12 LOAD_CONST               1 (1)
             14 BINARY_ADD
             16 BINARY_MULTIPLY
             18 LOAD_CONST               2 (2)
             20 BINARY_FLOOR_DIVIDE
             22 LOAD_FAST                0 (i)
             24 BINARY_ADD
             26 LOAD_CONST               1 (1)
             28 BINARY_ADD
             30 RETURN_VALUE
```

My thoughts:

* bytecode specialized for `int op int` will some help.
* there are many incref/decref overhead.
  * multi operand bytecode (e.g. BINARY_ADD_FAST_FAST, BINARY_ADD_FAST_CONST, etc) will reduce refcount overhead.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Thu Oct 22 05:40:45 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Thu, 22 Oct 2020 09:40:45 +0000
Subject: [issue42103] [security] DoS (MemError via CPU and RAM exhaustion)
 when processing malformed Apple Property List files in binary format
In-Reply-To: <1603239911.48.0.657036824442.issue42103@roundup.psfhosted.org>
Message-ID: <1603359645.42.0.967036901642.issue42103@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Serhiy, thanks. Just the change in the format string would fix this particular example.

I see you're working on a PR with better validation. The current state of the draft looks good to me, but I haven't checked yet if there are other potential problems that can be added to the list of invalid binary plists.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42103>
_______________________________________

From report at bugs.python.org  Thu Oct 22 05:42:40 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 22 Oct 2020 09:42:40 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603359760.57.0.478124458132.issue42115@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

One more idea: BINARY_ADD_INT. Operand is int immediate.
This idea can be implemented without opcode cache. I will try it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Thu Oct 22 05:47:54 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 22 Oct 2020 09:47:54 +0000
Subject: [issue42103] [security] DoS (MemError via CPU and RAM exhaustion)
 when processing malformed Apple Property List files in binary format
In-Reply-To: <1603239911.48.0.657036824442.issue42103@roundup.psfhosted.org>
Message-ID: <1603360074.06.0.92759339828.issue42103@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

PR 22882 fixes problem in _read_ints(), adds validation for string size, and adds many tests for mailformed binary Plists.

There may be problems with recursive collections. I'll try to solve them too.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42103>
_______________________________________

From report at bugs.python.org  Thu Oct 22 05:59:32 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 22 Oct 2020 09:59:32 +0000
Subject: [issue42103] [security] DoS (MemError via CPU and RAM exhaustion)
 when processing malformed Apple Property List files in binary format
In-Reply-To: <1603239911.48.0.657036824442.issue42103@roundup.psfhosted.org>
Message-ID: <1603360772.29.0.441306666143.issue42103@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

No, with recursive collections all is good.

Then I'll just add a NEWS entry and maybe few more tests.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42103>
_______________________________________

From report at bugs.python.org  Thu Oct 22 06:20:44 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 10:20:44 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1603362044.21.0.669455090711.issue1635741@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset dde91b1953c0f0d51c4dde056727ff84b7655190 by Christian Heimes in branch 'master':
bpo-1635741: Fix NULL ptr deref in multiprocessing (GH-22880)
https://github.com/python/cpython/commit/dde91b1953c0f0d51c4dde056727ff84b7655190


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Thu Oct 22 06:42:56 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 22 Oct 2020 10:42:56 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603363376.89.0.352651000975.issue42115@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Thu Oct 22 06:44:59 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 22 Oct 2020 10:44:59 +0000
Subject: [issue24165] Free list for single-digits ints
In-Reply-To: <1431352769.3.0.375640200007.issue24165@psf.upfronthosting.co.za>
Message-ID: <1603363499.94.0.52757649149.issue24165@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +21823
pull_request: https://github.com/python/cpython/pull/22884

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24165>
_______________________________________

From report at bugs.python.org  Thu Oct 22 06:47:43 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 22 Oct 2020 10:47:43 +0000
Subject: [issue24165] Free list for single-digits ints
In-Reply-To: <1431352769.3.0.375640200007.issue24165@psf.upfronthosting.co.za>
Message-ID: <1603363663.25.0.248572752784.issue24165@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I updated the patch.
I can not run pyperformance for now, because:

  AssertionError: would build wheel with unsupported tag ('cp310', 'cp310', 'linux_x86_64'

I added this config, but it can not solve the problem:

```
$ cat ~/.config/pip/pip.conf
[global]
no-cache-dir = true
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24165>
_______________________________________

From report at bugs.python.org  Thu Oct 22 06:48:44 2020
From: report at bugs.python.org (Gold Games)
Date: Thu, 22 Oct 2020 10:48:44 +0000
Subject: [issue42116] Inspect library ignore comments at the end of a function
 (inspect.getsource)
Message-ID: <1603363723.99.0.873580527867.issue42116@roundup.psfhosted.org>


New submission from Gold Games <noureddine.hamid at usmba.ac.ma>:

inspect.getsource ignore comments at the end of the function:

for example this function:

def matmul_single(A, x, out):
  from numpy import matmul
  out[:] = matmul(A, x)
  # Some comment here...

using the inspect library:
>>> inspect.getsource(matmul_single)                                                                                                                                     
>>> "def omp_matmul_single(A, x, out):\n  from numpy import matmul\n out[:] = matmul(A, x)\n"

the result does not contain the comments at the end of the function.

----------
components: Library (Lib)
messages: 379289
nosy: noureddine.hamid
priority: normal
severity: normal
status: open
title: Inspect library ignore comments at the end of a function (inspect.getsource)
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42116>
_______________________________________

From report at bugs.python.org  Thu Oct 22 06:50:14 2020
From: report at bugs.python.org (Gold Games)
Date: Thu, 22 Oct 2020 10:50:14 +0000
Subject: [issue42116] Inspect library ignore comments at the end of a function
 (inspect.getsource)
In-Reply-To: <1603363723.99.0.873580527867.issue42116@roundup.psfhosted.org>
Message-ID: <1603363814.75.0.479612139332.issue42116@roundup.psfhosted.org>


Change by Gold Games <noureddine.hamid at usmba.ac.ma>:


----------
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42116>
_______________________________________

From report at bugs.python.org  Thu Oct 22 08:19:20 2020
From: report at bugs.python.org (Marco Sulla)
Date: Thu, 22 Oct 2020 12:19:20 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1603369160.11.0.809491576682.issue41835@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

Another bench:

python -m pyperf timeit --rigorous "dict(ihinvdono='doononon', gowwondwon='nwog', bdjbodbob='nidnnpn', nwonwno='vndononon', dooodbob='iohiwipwgpw', doidonooq='ndwnnpnpnp', fndionqinqn='ndjboqoqjb', nonoeoqgoqb='bdboboqbgoqeb', jdnvonvoddo='nvdjnvndvonoq', njnvodnoo='hiehgieba', nvdnvwnnp='wghgihpa', nvfnwnnq='nvdknnnqkm', ndonvnipnq='fndjnaobobvob', fjafosboab='ndjnodvobvojb', nownwnojwjw='nvknnndnow', niownviwnwnwi='nownvwinvwnwnwj')"

Result without pull:
Mean +- std dev: 486 ns +- 8 ns

Result with pull:
Mean +- std dev: 328 ns +- 4 ns

I compiled both with optimizations and lto.

Some arch info:

python -VV
Python 3.10.0a1+ (heads/master-dirty:dde91b1953, Oct 22 2020, 14:00:51) 
[GCC 10.1.1 20200718]

uname -a
Linux buzz 4.15.0-118-generic #119-Ubuntu SMP Tue Sep 8 12:30:01 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

lsb_release -a
No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 18.04.5 LTS

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Thu Oct 22 09:22:12 2020
From: report at bugs.python.org (fancitron)
Date: Thu, 22 Oct 2020 13:22:12 +0000
Subject: [issue42035] [C API] PyType_GetSlot cannot get tp_name
In-Reply-To: <1602683525.08.0.938781399322.issue42035@roundup.psfhosted.org>
Message-ID: <1603372932.12.0.669490145324.issue42035@roundup.psfhosted.org>


fancitron <fancitron at gmail.com> added the comment:

True enough.  Btw, PyType_FromSpec accepts Py_tp_doc (char *), Py_tp_base (PyTypeObject *), etc ... so to be strictly standard compliant, a union would be necessary.

PyType_GetName() sounds great.

One "proper" workaround at the moment is PyObject_GetAttrString(Py_TYPE(x), "__name__") and then process the result.  This is somewhat "heavy" and strips the module name.  "Py_tp_name" provides a convenient, exception safe, and backward compatible way to access tp_name.

What I actually do right now is to access the (opaque) PyTypeObject::tp_name by pointer offset.  This certain defies the purpose of stable ABI!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42035>
_______________________________________

From report at bugs.python.org  Thu Oct 22 09:47:16 2020
From: report at bugs.python.org (Blaze Spinnaker)
Date: Thu, 22 Oct 2020 13:47:16 +0000
Subject: [issue42117] asyncio calls from sync/async, better docs or api support
Message-ID: <1603374436.81.0.314726165729.issue42117@roundup.psfhosted.org>


New submission from Blaze Spinnaker <blazespinnaker at gmail.com>:

In jupyter / ipython, other repls, as well as from libraries,  asyncio code can be called.  To simplify integration, there should be a way for libraries to transparently do the right thing, call await or start a new global running event loop.  

This can be done without breaking the colored functions design constraint (only async can call async) and would not lead to dynamic coroutine architectures like gevent / lua.

The change would significantly reduce confusion that is pervasive in the python ecosystem and has lead to many people using a defacto approach of monkey patching (a monkey patch which only works on the surface).

Alternative, if this approach simply can not be accepted, better and more emphasized headline asyncio documentation would be appropriate to explain why the constraint is in place and the best patterns to use to work around the problem.   

It took me a lot of googling before I understood the reasoning of what is a very significant design choice.

There are many instances of this issue causing problems, but let me highlight this link:

https://github.com/ipython/ipykernel/issues/548#issuecomment-713637954

----------
components: asyncio
messages: 379292
nosy: asvetlov, blazespinnaker, yselivanov
priority: normal
severity: normal
status: open
title: asyncio calls from sync/async, better docs or api support
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42117>
_______________________________________

From report at bugs.python.org  Thu Oct 22 10:04:12 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Thu, 22 Oct 2020 14:04:12 +0000
Subject: [issue38980] Compile libpython with -fno-semantic-interposition
In-Reply-To: <1575561631.45.0.417730594345.issue38980@roundup.psfhosted.org>
Message-ID: <1603375452.74.0.735506288027.issue38980@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

I was too eager in reviewing this :(
It turns out `-fno-semantic-interposition` is GCC 5.3, so [builds fail on older GCC](https://buildbot.python.org/all/#/builders/96/builds/216).

I'm researching how to make this conditional in autotools.

----------
nosy: +petr.viktorin
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38980>
_______________________________________

From report at bugs.python.org  Thu Oct 22 10:08:31 2020
From: report at bugs.python.org (Blaze Spinnaker)
Date: Thu, 22 Oct 2020 14:08:31 +0000
Subject: [issue42117] asyncio calls from sync/async, better docs or api support
In-Reply-To: <1603374436.81.0.314726165729.issue42117@roundup.psfhosted.org>
Message-ID: <1603375711.94.0.658431577503.issue42117@roundup.psfhosted.org>


Change by Blaze Spinnaker <blazespinnaker at gmail.com>:


----------
versions: +Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42117>
_______________________________________

From report at bugs.python.org  Thu Oct 22 10:08:36 2020
From: report at bugs.python.org (Zac Hatfield-Dodds)
Date: Thu, 22 Oct 2020 14:08:36 +0000
Subject: [issue39046] collections.abc.Reversible should not be a subclass of
 Hashable
In-Reply-To: <1576317847.63.0.718393349876.issue39046@roundup.psfhosted.org>
Message-ID: <1603375716.48.0.538209980134.issue39046@roundup.psfhosted.org>


Zac Hatfield-Dodds <zac.hatfield.dodds at gmail.com> added the comment:

I'm closing this as not-a-bug.

The way protocols just check methods does make sense (thanks for your comment Guido!), and a later refactoring of the code that prompted this issue (to deal only in concrete classes) dissolved the problem.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39046>
_______________________________________

From report at bugs.python.org  Thu Oct 22 10:19:41 2020
From: report at bugs.python.org (Blaze Spinnaker)
Date: Thu, 22 Oct 2020 14:19:41 +0000
Subject: [issue42117] asyncio calls from sync/async, better docs or api support
In-Reply-To: <1603374436.81.0.314726165729.issue42117@roundup.psfhosted.org>
Message-ID: <1603376381.28.0.342822078307.issue42117@roundup.psfhosted.org>


Blaze Spinnaker <blazespinnaker at gmail.com> added the comment:

Note that the biggest problem are obviously repls, and there are quite a few (iPython has issues due to it's high coupling with jupyter).  Providing a contract for them will ensure consistent support across the ecosystem rather than a hodge podge of barely working hacks.


One solution, not meant to be prescriptive, is to provide a repl only API meant to execute at the top of the stack (from perspective of user) only.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42117>
_______________________________________

From report at bugs.python.org  Thu Oct 22 10:26:38 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Thu, 22 Oct 2020 14:26:38 +0000
Subject: [issue38980] Compile libpython with -fno-semantic-interposition
In-Reply-To: <1575561631.45.0.417730594345.issue38980@roundup.psfhosted.org>
Message-ID: <1603376798.69.0.10311286703.issue38980@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
pull_requests: +21824
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/22892

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38980>
_______________________________________

From report at bugs.python.org  Thu Oct 22 10:29:06 2020
From: report at bugs.python.org (Alan Jenkins)
Date: Thu, 22 Oct 2020 14:29:06 +0000
Subject: [issue42110] race condition in ThreadChildWatcher (default) and
 MultiLoopChildWatcher
In-Reply-To: <1603305865.86.0.468384454532.issue42110@roundup.psfhosted.org>
Message-ID: <1603376946.92.0.628134739178.issue42110@roundup.psfhosted.org>


Alan Jenkins <alan.christopher.jenkins at gmail.com> added the comment:

There's one way to fix this in MultiLoopChildWatcher (but not ThreadedChildWatcher).  Make sure the waitpid() runs on the same thread that created the subprocess.  Prototype: https://github.com/sourcejedi/cpython/commit/92f979bce4582e807facb1c274a962b3caf0d2eb

The other approach would be to copy subprocess.wait(timeout) - keep waking up regularly and polling to see if the process has exited yet.

I'm not convinced ThreadedChildWatcher is fixable.  You can't call waitpid() in one thread, and let someone call kill() in a different thread.

You could try avoiding calling waitpid() until someone does `await asyncio.subprocess.Process.wait()`.  I think I didn't like it because - what happens if you cancel a wait() task?  I think you want to cancel the waitpid() so you could safely kill() again... And we don't have any way to cancel the blocking waitpid() call, at least not from python, definitely not since PEP-475.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42110>
_______________________________________

From report at bugs.python.org  Thu Oct 22 10:32:26 2020
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 22 Oct 2020 14:32:26 +0000
Subject: [issue42057] peephole optimizer bug relating to JUMP_IF_NOT_EXC_MATCH
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1603377146.85.0.44589295899.issue42057@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
pull_requests: +21825
pull_request: https://github.com/python/cpython/pull/22893

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:09:14 2020
From: report at bugs.python.org (Alan Jenkins)
Date: Thu, 22 Oct 2020 15:09:14 +0000
Subject: [issue42110] race condition in ThreadChildWatcher (default) and
 MultiLoopChildWatcher
In-Reply-To: <1603305865.86.0.468384454532.issue42110@roundup.psfhosted.org>
Message-ID: <1603379354.86.0.775958990646.issue42110@roundup.psfhosted.org>


Alan Jenkins <alan.christopher.jenkins at gmail.com> added the comment:

Put the other way, if you wanted to fix this bug in ThreadedChildWatcher, and go as far as allowing cancelling Process.wait(), followed by kill() / send_signal(), then I think you need -

* siginterrupt(SIGCHLD, 1)
* not to mind about any random C code that doesn't really handle being interrupted.  Like printf(), ho hum.  https://groups.google.com/g/comp.unix.programmer/c/QZmFw1VytYs/m/BSBXBHTI1REJ
* add & use a new call like os.waitpid_interruptible(), which doesn't restart on EINTR, as a workaround for PEP-475.
* set a "stop" flag for the watcher thread
* use threading.pthread_kill() (available on *most* python platforms) to interrupt the watcher thread.  Spoof SIGCHLD, this will avoid conflicts with a python handler for any other signal.
* wait for the watcher thread to finish using Thread.join()
* now you can safely find out whether the child process has been reaped, or whether it's safe to kill it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42110>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:14:28 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 22 Oct 2020 15:14:28 +0000
Subject: [issue42111] Make the xxlimited module an example of best extension
 module practices
In-Reply-To: <1603310336.9.0.27411366123.issue42111@roundup.psfhosted.org>
Message-ID: <1603379668.95.0.240769812858.issue42111@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42111>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:15:23 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 22 Oct 2020 15:15:23 +0000
Subject: [issue42111] Make the xxlimited module an example of best extension
 module practices
In-Reply-To: <1603310336.9.0.27411366123.issue42111@roundup.psfhosted.org>
Message-ID: <1603379723.8.0.321281499197.issue42111@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

I am +1 on this idea.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42111>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:36:53 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Thu, 22 Oct 2020 15:36:53 +0000
Subject: [issue42086] AST: Document / re-design? the simple constructor nodes
 from sums
In-Reply-To: <1603137502.35.0.449039325711.issue42086@roundup.psfhosted.org>
Message-ID: <1603381013.87.0.551775167868.issue42086@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

After doing experiments with annotating the operator nodes with position information, it is concluded that it doesn't worth the efforts of changing all occurrences of operators from enum to a struct. Other than that, it was designated that we'll keep this behavior and document it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42086>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:38:20 2020
From: report at bugs.python.org (Jason Schwefel)
Date: Thu, 22 Oct 2020 15:38:20 +0000
Subject: [issue42118] TypeError gives wrong reserved name
Message-ID: <1603381100.92.0.596798918231.issue42118@roundup.psfhosted.org>


New submission from Jason Schwefel <jason.schwefel78 at gmail.com>:

The following code gives a "TypeError: 'str' object is not callable" exception:

int = ''
s = '3500:day'
a = s.split(':')
i = int(a[0])

Proper exception message should be "TypeError: 'int' object is not callable" 

Only able to test on 3.8 and 3.9

----------
components: Interpreter Core
messages: 379300
nosy: jason.schwefel78
priority: normal
severity: normal
status: open
title: TypeError gives wrong reserved name
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42118>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:39:22 2020
From: report at bugs.python.org (Steve Dower)
Date: Thu, 22 Oct 2020 15:39:22 +0000
Subject: [issue25655] Python errors related to failures loading DLL's lack
 information
In-Reply-To: <1447835823.22.0.872666546521.issue25655@psf.upfronthosting.co.za>
Message-ID: <1603381162.08.0.687967216793.issue25655@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset b6f2fc90409e291822166d74ce7402e0ef4dba91 by Philippe Ombredanne in branch 'master':
bpo-25655: Improve Win DLL loading failures doc (GH-22372)
https://github.com/python/cpython/commit/b6f2fc90409e291822166d74ce7402e0ef4dba91


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25655>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:39:37 2020
From: report at bugs.python.org (Mark Roseman)
Date: Thu, 22 Oct 2020 15:39:37 +0000
Subject: [issue27477] IDLE: Switch search dialogs to ttk widgets,
 and other refinement
In-Reply-To: <1468181977.57.0.555586182066.issue27477@psf.upfronthosting.co.za>
Message-ID: <1603381177.89.0.709111381422.issue27477@roundup.psfhosted.org>


Mark Roseman <mark at markroseman.com> added the comment:

Just noting that the current search dialogs (and others) do not have a ttk.Frame directly inside the toplevel which encloses all other widgets. They therefore still display the mismatched backgrounds on macOS.

Given that, should #33987 be reopened? The patches seem to change the existing frames to the ttk equivalent, but don't add the new intervening frame.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27477>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:39:44 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 15:39:44 +0000
Subject: [issue25655] Python errors related to failures loading DLL's lack
 information
In-Reply-To: <1447835823.22.0.872666546521.issue25655@psf.upfronthosting.co.za>
Message-ID: <1603381184.72.0.511476568141.issue25655@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 8.0 -> 9.0
pull_requests: +21826
pull_request: https://github.com/python/cpython/pull/22894

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25655>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:39:53 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 15:39:53 +0000
Subject: [issue25655] Python errors related to failures loading DLL's lack
 information
In-Reply-To: <1447835823.22.0.872666546521.issue25655@psf.upfronthosting.co.za>
Message-ID: <1603381193.56.0.698828792752.issue25655@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21827
pull_request: https://github.com/python/cpython/pull/22895

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25655>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:41:25 2020
From: report at bugs.python.org (Steve Dower)
Date: Thu, 22 Oct 2020 15:41:25 +0000
Subject: [issue25655] Python errors related to failures loading DLL's lack
 information
In-Reply-To: <1447835823.22.0.872666546521.issue25655@psf.upfronthosting.co.za>
Message-ID: <1603381285.36.0.160955379393.issue25655@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Thanks for the PR!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25655>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:42:36 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 22 Oct 2020 15:42:36 +0000
Subject: [issue42057] peephole optimizer bug relating to JUMP_IF_NOT_EXC_MATCH
In-Reply-To: <1602902009.62.0.945717377776.issue42057@roundup.psfhosted.org>
Message-ID: <1603381356.69.0.933319979551.issue42057@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:


New changeset b52432cb8cd7f5f1fc71ea3b7c0ea11573d504f0 by Mark Shannon in branch 'master':
bpo-42057: Add regression test to master. (GH-22893)
https://github.com/python/cpython/commit/b52432cb8cd7f5f1fc71ea3b7c0ea11573d504f0


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42057>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:44:25 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Thu, 22 Oct 2020 15:44:25 +0000
Subject: [issue42086] AST: Document / re-design? the simple constructor nodes
 from sums
In-Reply-To: <1603137502.35.0.449039325711.issue42086@roundup.psfhosted.org>
Message-ID: <1603381465.04.0.0533693847197.issue42086@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
keywords: +patch
pull_requests: +21828
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22896

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42086>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:44:53 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 22 Oct 2020 15:44:53 +0000
Subject: [issue42118] TypeError gives wrong reserved name
In-Reply-To: <1603381100.92.0.596798918231.issue42118@roundup.psfhosted.org>
Message-ID: <1603381493.76.0.564627989449.issue42118@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

You've rebound "int" to a string. I think the error message is correct.

Here's a simpler case:

>>> int = ''
>>> int
''
>>> int()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: 'str' object is not callable

What do you expect to gain with the "int = ''" statement?

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42118>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:48:58 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 15:48:58 +0000
Subject: [issue25655] Python errors related to failures loading DLL's lack
 information
In-Reply-To: <1447835823.22.0.872666546521.issue25655@psf.upfronthosting.co.za>
Message-ID: <1603381738.95.0.490748711091.issue25655@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 5d8bc65ba5be5742b3a4cc470dfd990512bdaa93 by Miss Skeleton (bot) in branch '3.8':
bpo-25655: Improve Win DLL loading failures doc (GH-22372)
https://github.com/python/cpython/commit/5d8bc65ba5be5742b3a4cc470dfd990512bdaa93


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25655>
_______________________________________

From report at bugs.python.org  Thu Oct 22 11:50:30 2020
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 22 Oct 2020 15:50:30 +0000
Subject: [issue25655] Python errors related to failures loading DLL's lack
 information
In-Reply-To: <1447835823.22.0.872666546521.issue25655@psf.upfronthosting.co.za>
Message-ID: <1603381830.44.0.448855283923.issue25655@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

Steve, the PR that you pushed has the wrong error and error message. I told Philippe in msg377335 that ctypes raises FileNotFoundError with no error code. For example:

    >>> try: ctypes.CDLL('spam')
    ... except OSError as e: err = e
    ...
    >>> err
    FileNotFoundError("Could not find module 'spam' (or one of its dependencies). Try using the full path with constructor syntax.")
    >>> err.winerror is None
    True

The advice to use dumpbin is fine and works well in simple cases. I wouldn't use it generally since recursiveley parsing through the dependency graph of every dependent DLL could be tedious.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25655>
_______________________________________

From report at bugs.python.org  Thu Oct 22 12:02:52 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 16:02:52 +0000
Subject: [issue42086] AST: Document / re-design? the simple constructor nodes
 from sums
In-Reply-To: <1603137502.35.0.449039325711.issue42086@roundup.psfhosted.org>
Message-ID: <1603382572.1.0.144525884279.issue42086@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b37c994e5ac73268abe23c52005b80cdca099793 by Batuhan Taskaya in branch 'master':
bpo-42086: Document AST operator nodes acts as a singleton (GH-22896)
https://github.com/python/cpython/commit/b37c994e5ac73268abe23c52005b80cdca099793


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42086>
_______________________________________

From report at bugs.python.org  Thu Oct 22 12:02:58 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 16:02:58 +0000
Subject: [issue42086] AST: Document / re-design? the simple constructor nodes
 from sums
In-Reply-To: <1603137502.35.0.449039325711.issue42086@roundup.psfhosted.org>
Message-ID: <1603382578.77.0.902744558136.issue42086@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21829
pull_request: https://github.com/python/cpython/pull/22897

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42086>
_______________________________________

From report at bugs.python.org  Thu Oct 22 12:02:22 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 16:02:22 +0000
Subject: [issue25655] Python errors related to failures loading DLL's lack
 information
In-Reply-To: <1447835823.22.0.872666546521.issue25655@psf.upfronthosting.co.za>
Message-ID: <1603382542.73.0.347817529995.issue25655@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f22f874a66d6ddb32fa74ad4325199db7e4c25fd by Miss Skeleton (bot) in branch '3.9':
bpo-25655: Improve Win DLL loading failures doc (GH-22372)
https://github.com/python/cpython/commit/f22f874a66d6ddb32fa74ad4325199db7e4c25fd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25655>
_______________________________________

From report at bugs.python.org  Thu Oct 22 12:12:01 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Thu, 22 Oct 2020 16:12:01 +0000
Subject: [issue38980] Compile libpython with -fno-semantic-interposition
In-Reply-To: <1575561631.45.0.417730594345.issue38980@roundup.psfhosted.org>
Message-ID: <1603383121.27.0.526473586891.issue38980@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset c6d7e82d19c091af698d4e4b3623648e259843e3 by Petr Viktorin in branch 'master':
bpo-38980: Only apply -fno-semantic-interposition if available (GH-22892)
https://github.com/python/cpython/commit/c6d7e82d19c091af698d4e4b3623648e259843e3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38980>
_______________________________________

From report at bugs.python.org  Thu Oct 22 12:12:29 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Thu, 22 Oct 2020 16:12:29 +0000
Subject: [issue38980] Compile libpython with -fno-semantic-interposition
In-Reply-To: <1575561631.45.0.417730594345.issue38980@roundup.psfhosted.org>
Message-ID: <1603383149.78.0.213368947675.issue38980@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38980>
_______________________________________

From report at bugs.python.org  Thu Oct 22 12:17:04 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 22 Oct 2020 16:17:04 +0000
Subject: [issue24165] Free list for single-digits ints
In-Reply-To: <1431352769.3.0.375640200007.issue24165@psf.upfronthosting.co.za>
Message-ID: <1603383424.79.0.135621660463.issue24165@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Inada-san, you can run pyperformance with this workaround:

python -m pip install pyperformance==1.0.0

We are fixing the error soon after https://discuss.python.org/t/pep-641-using-an-underscore-in-the-version-portion-of-python-3-10-compatibility-tags/5513 lands

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24165>
_______________________________________

From report at bugs.python.org  Thu Oct 22 12:27:41 2020
From: report at bugs.python.org (Daniel Lenski)
Date: Thu, 22 Oct 2020 16:27:41 +0000
Subject: [issue2190] MozillaCookieJar ignores HttpOnly cookies
In-Reply-To: <1203957546.34.0.123660895963.issue2190@psf.upfronthosting.co.za>
Message-ID: <1603384061.25.0.702398875154.issue2190@roundup.psfhosted.org>


Daniel Lenski <dlenski at gmail.com> added the comment:

@terry.reedy, it looks like my PR just needs a core developer to review it. Would you mind taking a look? :-)

https://github.com/python/cpython/pull/22798

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2190>
_______________________________________

From report at bugs.python.org  Thu Oct 22 12:37:47 2020
From: report at bugs.python.org (=?utf-8?q?Fran=C3=A7oise_CONIL?=)
Date: Thu, 22 Oct 2020 16:37:47 +0000
Subject: [issue42119] Error when debugging logging.FileHandler subclass
 __init__ method
Message-ID: <1603384667.68.0.88562918356.issue42119@roundup.psfhosted.org>


New submission from Fran?oise CONIL <fcodvpt at gmail.com>:

In pdb, when I hit "a" to see __init__ parameters of a logging.FileHandler subclass, I get an error because __repr__ needs a logging level. The level has been removed from the parameters by configure_handler() when it instanciates the handler. The level is set after the handler instanciation.

I do not know if it can be changed or if I missed something.

Traceback (most recent call last):
  File "/usr/lib/python3.8/logging/config.py", line 563, in configure
    handler = self.configure_handler(handlers[name])
  File "/usr/lib/python3.8/logging/config.py", line 744, in configure_handler
    result = factory(**kwargs)
  File "/home/fconil/Progs/python/logging/multiprocesses-to-files-with-dict.py", line 53, in __init__
    pfilename = f"{filename}-{os.getpid()}.log"
  File "/home/fconil/Progs/python/logging/multiprocesses-to-files-with-dict.py", line 53, in __init__
    pfilename = f"{filename}-{os.getpid()}.log"
  File "/usr/lib/python3.8/bdb.py", line 88, in trace_dispatch
    return self.dispatch_line(frame)
  File "/usr/lib/python3.8/bdb.py", line 112, in dispatch_line
    self.user_line(frame)
  File "/usr/lib/python3.8/pdb.py", line 262, in user_line
    self.interaction(frame, None)
  File "/usr/lib/python3.8/pdb.py", line 357, in interaction
    self._cmdloop()
  File "/usr/lib/python3.8/pdb.py", line 322, in _cmdloop
    self.cmdloop()
  File "/usr/lib/python3.8/cmd.py", line 138, in cmdloop
    stop = self.onecmd(line)
  File "/usr/lib/python3.8/pdb.py", line 423, in onecmd
    return cmd.Cmd.onecmd(self, line)
  File "/usr/lib/python3.8/cmd.py", line 217, in onecmd
    return func(arg)
  File "/usr/lib/python3.8/pdb.py", line 1146, in do_args
    self.message('%s = %r' % (name, dict[name]))
  File "/usr/lib/python3.8/logging/__init__.py", line 1186, in __repr__
    level = getLevelName(self.level)
AttributeError: 'MultiFileHandler' object has no attribute 'level'

----------
components: Library (Lib)
files: multiprocesses-to-files-with-dict.py
messages: 379313
nosy: fcodvpt
priority: normal
severity: normal
status: open
title: Error when debugging logging.FileHandler subclass __init__ method
type: enhancement
versions: Python 3.8
Added file: https://bugs.python.org/file49535/multiprocesses-to-files-with-dict.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42119>
_______________________________________

From report at bugs.python.org  Thu Oct 22 12:38:14 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 22 Oct 2020 16:38:14 +0000
Subject: [issue42118] TypeError gives wrong reserved name
In-Reply-To: <1603381100.92.0.596798918231.issue42118@roundup.psfhosted.org>
Message-ID: <1603384694.26.0.283157846729.issue42118@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I should point out that this is the same as doing:

>>> ''()
<stdin>:1: SyntaxWarning: 'str' object is not callable; perhaps you missed a comma?
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: 'str' object is not callable

Except for the SyntaxWarning part, where the compiler is trying to be helpful.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42118>
_______________________________________

From report at bugs.python.org  Thu Oct 22 12:40:50 2020
From: report at bugs.python.org (Steve Dower)
Date: Thu, 22 Oct 2020 16:40:50 +0000
Subject: [issue25655] Python errors related to failures loading DLL's lack
 information
In-Reply-To: <1447835823.22.0.872666546521.issue25655@psf.upfronthosting.co.za>
Message-ID: <1603384850.63.0.652110019171.issue25655@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> Steve, the PR that you pushed has the wrong error and error message. 

Ah whoops. I'll reopen and hopefully someone can fix it up.

> The advice to use dumpbin is fine and works well in simple cases. 

It's only meant as a starting point. It's possible to brute force your way through more complex cases, but to describe anything more advanced we'd be writing a tutorial in our docs, which is not appropriate.

----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25655>
_______________________________________

From report at bugs.python.org  Thu Oct 22 12:41:05 2020
From: report at bugs.python.org (Steve Dower)
Date: Thu, 22 Oct 2020 16:41:05 +0000
Subject: [issue25655] Python errors related to failures loading DLL's lack
 information
In-Reply-To: <1447835823.22.0.872666546521.issue25655@psf.upfronthosting.co.za>
Message-ID: <1603384865.24.0.220935840032.issue25655@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25655>
_______________________________________

From report at bugs.python.org  Thu Oct 22 12:42:52 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Thu, 22 Oct 2020 16:42:52 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603384972.44.0.0121809400873.issue42115@roundup.psfhosted.org>


Change by Barry A. Warsaw <barry at python.org>:


----------
nosy: +barry

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Thu Oct 22 13:06:15 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 22 Oct 2020 17:06:15 +0000
Subject: [issue42118] TypeError gives wrong reserved name
In-Reply-To: <1603381100.92.0.596798918231.issue42118@roundup.psfhosted.org>
Message-ID: <1603386375.2.0.804742906811.issue42118@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Closing as "not a bug".

----------
nosy: +rhettinger
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42118>
_______________________________________

From report at bugs.python.org  Thu Oct 22 13:33:31 2020
From: report at bugs.python.org (Brian Kohan)
Date: Thu, 22 Oct 2020 17:33:31 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603388011.87.0.145690611351.issue42096@roundup.psfhosted.org>


Brian Kohan <bckohan at gmail.com> added the comment:

Hi all,

I'm experiencing the same issue. I took a look at the is_zipfile code - seems like its not checking the start of the file for the magic numbers, but looking deeper in. I presume because the magic numbers at the start are considered unreliable for some reason? Seems like this opens the check up to unlucky random false positives though.

Offending file:

https://www.dropbox.com/s/t2kafn6ek1m2huy/CHPI_Rinex.crx?dl=1

----------
nosy: +bckohan
versions: +Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Thu Oct 22 13:54:32 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 17:54:32 +0000
Subject: [issue2350] 'exceptions' import fixer
In-Reply-To: <1205781728.94.0.172904523331.issue2350@psf.upfronthosting.co.za>
Message-ID: <1603389272.18.0.252454735313.issue2350@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Updating the versions, though it seems that you may want to close this as rejected based on the discussion.

----------
keywords:  -needs review, patch
nosy: +iritkatriel
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.7, Python 3.2, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2350>
_______________________________________

From report at bugs.python.org  Thu Oct 22 13:58:00 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 17:58:00 +0000
Subject: [issue16094] Tuple extraction in a lambda isn't supported by 2to3
In-Reply-To: <1349003232.56.0.742514252911.issue16094@psf.upfronthosting.co.za>
Message-ID: <1603389480.5.0.948418354449.issue16094@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Updating the versions, but from the discussion I think this can probably be closed as "won't fix".

----------
nosy: +iritkatriel
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.7, Python 3.2, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16094>
_______________________________________

From report at bugs.python.org  Thu Oct 22 14:35:07 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 18:35:07 +0000
Subject: [issue16515] TypeError message incorrect for max() with one keyword
 arg
In-Reply-To: <1353451017.11.0.598123114389.issue16515@psf.upfronthosting.co.za>
Message-ID: <1603391707.21.0.490337299404.issue16515@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.7, Python 3.2, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16515>
_______________________________________

From report at bugs.python.org  Thu Oct 22 14:49:43 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 18:49:43 +0000
Subject: [issue14979] pdb doc: Explain how to extend debugger instead of
 sending readers to the source
In-Reply-To: <1338555806.37.0.54245715922.issue14979@psf.upfronthosting.co.za>
Message-ID: <1603392583.34.0.613432203794.issue14979@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
type:  -> enhancement
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.7, Python 3.2, Python 3.3, Python 3.4, Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14979>
_______________________________________

From report at bugs.python.org  Thu Oct 22 14:50:14 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 18:50:14 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603392614.27.0.574211720057.issue33987@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
Removed message: https://bugs.python.org/msg332835

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Thu Oct 22 14:51:42 2020
From: report at bugs.python.org (Jason Schwefel)
Date: Thu, 22 Oct 2020 18:51:42 +0000
Subject: [issue42118] TypeError gives wrong reserved name
In-Reply-To: <1603381100.92.0.596798918231.issue42118@roundup.psfhosted.org>
Message-ID: <1603392702.44.0.375820191755.issue42118@roundup.psfhosted.org>


Jason Schwefel <jason.schwefel78 at gmail.com> added the comment:

>What do you expect to gain with the "int = ''" statement?

I did not expect anything. I made a mistake in my initial code and the error message indicated that I rebound 'str'. I could not find where I had used 'str' as a variable name. If it would have said 'int', as that was the function that I rebound as a variable name, I would have immediately known what to look for.

I understand that it is mostly cosmetic, but I am sure I am not the first person that went down the wrong path because of this. 

I understand that I was using the variable named 'int' as a string and therefore referencing it as 'str' object is technically correct. However, I am still relatively new to Python, as many others are, and the the error message could be a bit more clear.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42118>
_______________________________________

From report at bugs.python.org  Thu Oct 22 14:57:31 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 18:57:31 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603393051.3.0.715463727872.issue33987@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I closed this prematurely. Cheryl's PR 11433 converts frames for help and statusbar.  My patch also omitted searchbase, perhaps because this I wanted to refactor at the same time.  In any case, the macOS appearance bug that motivated Mark's post remains, and a patch will have to make sure that the derived dialogs add frames inside the new master frame instead of the toplevel.

The message I deleted meant to say
#35598 converted config_key to ttk, including a ttk frame inside toplevel.

----------
resolution: fixed -> 
stage: resolved -> needs patch
status: closed -> open
versions: +Python 3.10, Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Thu Oct 22 14:59:39 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 22 Oct 2020 18:59:39 +0000
Subject: [issue42118] TypeError gives wrong reserved name
In-Reply-To: <1603381100.92.0.596798918231.issue42118@roundup.psfhosted.org>
Message-ID: <1603393179.7.0.465887213105.issue42118@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Unfortunately there's not much that can be done about this. The code that writes that error message only knows about objects, which don't have names, only types and values.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42118>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:08:50 2020
From: report at bugs.python.org (Erjia Guan)
Date: Thu, 22 Oct 2020 19:08:50 +0000
Subject: [issue42120] Depreciated MACRO of copysign for MSVC
Message-ID: <1603393730.66.0.233789813553.issue42120@roundup.psfhosted.org>


New submission from Erjia Guan <erjia at fb.com>:

At
https://github.com/python/cpython/blob/c60394c7fc9cc09b16e9675a3eeb5844b6d8523f/PC/pyconfig.h#L196, the MACRO converts copysign to _copysign. This MACRO is defined 13 years ago and it's really dangerous to define a lower-letter MACRO at this low level.
Currently, MSVC is supporting copysign (https://docs.microsoft.com/en-us/cpp/c-runtime-library/reference/copysign-copysignf-copysignl-copysign-copysignf-copysignl?view=vs-2019).
I am requesting to remove this MACRO, as my customized copysign API will also be converted to _copysign on MSVC platform.

----------
components: C API
messages: 379323
nosy: ejguan
priority: normal
severity: normal
status: open
title: Depreciated MACRO of copysign for MSVC
type: compile error
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42120>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:09:58 2020
From: report at bugs.python.org (Erjia Guan)
Date: Thu, 22 Oct 2020 19:09:58 +0000
Subject: [issue42120] Depreciated MACRO of copysign for MSVC
In-Reply-To: <1603393730.66.0.233789813553.issue42120@roundup.psfhosted.org>
Message-ID: <1603393798.21.0.287357239446.issue42120@roundup.psfhosted.org>


Change by Erjia Guan <erjia at fb.com>:


----------
versions: +Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42120>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:14:44 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 19:14:44 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603394084.03.0.101181161516.issue33987@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset facb522d44fceaf15de6bc95de1cd680c4621c2a by Cheryl Sabella in branch 'master':
bpo-33987: IDLE: Use ttk Frame on doc window and statusbar (GH-11433)
https://github.com/python/cpython/commit/facb522d44fceaf15de6bc95de1cd680c4621c2a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:15:22 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 19:15:22 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603394122.21.0.999795517747.issue33987@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21830
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22899

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:15:31 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 19:15:31 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603394131.27.0.862471167368.issue33987@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21831
pull_request: https://github.com/python/cpython/pull/22900

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:22:25 2020
From: report at bugs.python.org (Zachary Ware)
Date: Thu, 22 Oct 2020 19:22:25 +0000
Subject: [issue42120] Depreciated MACRO of copysign for MSVC
In-Reply-To: <1603393730.66.0.233789813553.issue42120@roundup.psfhosted.org>
Message-ID: <1603394545.07.0.598374422693.issue42120@roundup.psfhosted.org>


Change by Zachary Ware <zachary.ware at gmail.com>:


----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42120>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:30:37 2020
From: report at bugs.python.org (Steve Dower)
Date: Thu, 22 Oct 2020 19:30:37 +0000
Subject: [issue42120] Depreciated MACRO of copysign for MSVC
In-Reply-To: <1603393730.66.0.233789813553.issue42120@roundup.psfhosted.org>
Message-ID: <1603395037.91.0.511106382595.issue42120@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Sounds good, but I don't think we can backport it. It's not _our_ public API, but it's still going to impact compiling modules.

Also, looking at the docs link above, copysign() is for floats and _copysign() is for doubles, which means it's an actual functional change. If POSIX/libc copysign() is floats, it's probably fine for a 3.10 change, but if we need to preserve the type then it needs to become _Py_copysign throughout.

----------
versions:  -Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42120>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:35:03 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 22 Oct 2020 19:35:03 +0000
Subject: [issue42064] Convert sqlite3 to multi-phase initialisation (PEP 489)
In-Reply-To: <1602963425.44.0.576962569847.issue42064@roundup.psfhosted.org>
Message-ID: <1603395303.1.0.580572329814.issue42064@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Sorted out item 7 (module state). Item 8 is mostly in place, although I get ref. count errors if I add traverse/clear callbacks, so I've temporarily disabled those.

Proof-of-concept of multi-phase init can be found here: https://github.com/erlend-aasland/cpython/commits/bpo-42064/all
I'll try to break items 3 and 7 up in smaller pieces for the reviewer's convenience.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42064>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:39:36 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 19:39:36 +0000
Subject: [issue11831] "pydoc -w" causes "no Python documentation found" error
 when the path is not current directory
In-Reply-To: <1302568965.6.0.204734578124.issue11831@psf.upfronthosting.co.za>
Message-ID: <1603395576.17.0.0207643816425.issue11831@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

pydoc help:

  pydoc -w <name> ...
    Write out the HTML documentation for a module to a file in the current
    directory. [?]

So there is no support for not using the current directory, probably on purpose in order to use the current-dir-in-sys.path trick, so I?m not sure if this should be addressed.

(These days I would be more worried about src directories, which I?ve just tested are not handled well by pydoc, but that would be a different ticket.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11831>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:40:41 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 19:40:41 +0000
Subject: [issue5474] distutils produces invalid RPM packages of prerelease
 python packages
In-Reply-To: <1236744919.07.0.603710480384.issue5474@psf.upfronthosting.co.za>
Message-ID: <1603395641.58.0.755285499994.issue5474@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Given the age of this, the status of distutils and the existence of py2rpm, I am closing it.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5474>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:46:10 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 19:46:10 +0000
Subject: [issue13316] build_py_2to3 does not convert when there was an error
 in the last run
In-Reply-To: <1320182540.3.0.985799836702.issue13316@psf.upfronthosting.co.za>
Message-ID: <1603395970.72.0.731067997279.issue13316@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Closing this.  It was not fixed when it would have been useful, and people mostly use other tools that distutils for packaging and 2to3 for transition.

----------
resolution:  -> wont fix
stage: test needed -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13316>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:48:47 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Thu, 22 Oct 2020 19:48:47 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603396127.61.0.147023086534.issue42115@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

> This idea can be implemented without opcode cache. I will try it.

I'd actually encourage trying to use the opcode cache because this way the optimization will be more generic. E.g. `decimal + decimal` would also be specialized via the cache, because you'd cache a pointer to the specific `+` operator implementation. I'm really not sure that adding specialized byte code is a good idea.

> * PHP uses scalar type for float and int

While at it, maybe we push the number of bits per int digit to 60?

While at it, I'd also increase the digit size

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:49:44 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 19:49:44 +0000
Subject: [issue2774] ctypes documentation not effective
In-Reply-To: <1210091918.21.0.990068864292.issue2774@psf.upfronthosting.co.za>
Message-ID: <1603396184.51.0.492153706833.issue2774@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
assignee:  -> docs at python
components: +ctypes
nosy: +docs at python
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.7, Python 3.2, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2774>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:51:44 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 19:51:44 +0000
Subject: [issue13047] imp.find_module("") and imp.find_module(".")
In-Reply-To: <1316983798.48.0.694425302693.issue13047@psf.upfronthosting.co.za>
Message-ID: <1603396304.73.0.549601407262.issue13047@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13047>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:58:33 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 19:58:33 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603396713.96.0.916706402875.issue33987@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 06c9e01c651c35c2e058eca0f7073dd405578f78 by Miss Skeleton (bot) in branch '3.8':
bpo-33987: IDLE: Use ttk Frame on doc window and statusbar (GH-11433) (GH-22900)
https://github.com/python/cpython/commit/06c9e01c651c35c2e058eca0f7073dd405578f78


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Thu Oct 22 15:58:08 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 19:58:08 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603396688.35.0.0400369235284.issue33987@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 25687bbe0da160ebdd3cd422a01d677ce467e72e by Miss Skeleton (bot) in branch '3.9':
bpo-33987: IDLE: Use ttk Frame on doc window and statusbar (GH-11433) (GH-22899)
https://github.com/python/cpython/commit/25687bbe0da160ebdd3cd422a01d677ce467e72e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:03:29 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Thu, 22 Oct 2020 20:03:29 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603397009.95.0.782362395257.issue42115@roundup.psfhosted.org>


Change by Yury Selivanov <yselivanov at gmail.com>:


----------
Removed message: https://bugs.python.org/msg379330

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:03:33 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Thu, 22 Oct 2020 20:03:33 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603397013.76.0.270191521504.issue42115@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

> This idea can be implemented without opcode cache. I will try it.

I'd actually encourage trying to use the opcode cache because this way the optimization will be more generic. E.g. `decimal + decimal` would also be specialized via the cache, because you'd cache a pointer to the specific `+` operator implementation. I'm really not sure that adding specialized byte code is a good idea.

> * PHP uses scalar type for float and int

While at it, maybe we push the number of bits per int digit to 60?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:05:36 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:05:36 +0000
Subject: [issue40215] Use xdg basedir spec on linux
In-Reply-To: <1586251554.83.0.931067679557.issue40215@roundup.psfhosted.org>
Message-ID: <1603397136.83.0.150285452786.issue40215@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Thanks for the report, but at this stage of the distutils lifecycle (mostly unmaintained, may be removed from stdlib) I don?t think such a change would be useful.  Packaging guides recommend other tools, such as twine or flit, that don?t use this config file.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40215>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:07:03 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:07:03 +0000
Subject: [issue41143] distutils uses the locale encoding for the .pypirc file
In-Reply-To: <1593270849.73.0.549348582361.issue41143@roundup.psfhosted.org>
Message-ID: <1603397223.89.0.737502933184.issue41143@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Probably should have been specified as UTF-8, but now compatibility would prevent changing it.  I recommend no change.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41143>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:09:46 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:09:46 +0000
Subject: [issue41755] Docs: Please remove `from distutils.core import setup`
In-Reply-To: <1599769753.52.0.764816611922.issue41755@roundup.psfhosted.org>
Message-ID: <1603397386.61.0.61266241726.issue41755@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

That page is documenting distutils, so it is correctly showing a distutils import.  The page also starts with a note linking to setuptools doc.  Therefore, I would close this ticket.

----------
resolution:  -> not a bug
status: open -> pending

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41755>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:13:45 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:13:45 +0000
Subject: [issue1109659] distutils argument parsing is bogus
Message-ID: <1603397625.52.0.204010046282.issue1109659@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Given the current status of distutils (mostly used as a base for setuptools, and maybe soon removed from stdlib), I am closing this.

----------
resolution:  -> wont fix
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1109659>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:19:12 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:19:12 +0000
Subject: [issue16729] Document how to provide defaults for setup.py commands
 options
In-Reply-To: <1355924641.52.0.160418711028.issue16729@psf.upfronthosting.co.za>
Message-ID: <1603397952.36.0.877631376403.issue16729@roundup.psfhosted.org>


Change by ?ric Araujo <merwok at netwok.org>:


----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16729>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:20:16 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:20:16 +0000
Subject: [issue24970] Make distutils.Command an ABC
In-Reply-To: <1441040405.44.0.251292116419.issue24970@psf.upfronthosting.co.za>
Message-ID: <1603398016.72.0.252142484719.issue24970@roundup.psfhosted.org>


Change by ?ric Araujo <merwok at netwok.org>:


----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24970>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:21:35 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:21:35 +0000
Subject: [issue27320] ./setup.py --help-commands should sort extra commands
In-Reply-To: <1465926347.78.0.17877088837.issue27320@psf.upfronthosting.co.za>
Message-ID: <1603398094.99.0.30132475326.issue27320@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

This is probably better now that dicts retain insertion order.
If people still think sorting would be better, please forward the feature request to setuptools.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27320>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:26:03 2020
From: report at bugs.python.org (Antony Lee)
Date: Thu, 22 Oct 2020 20:26:03 +0000
Subject: [issue24970] Make distutils.Command an ABC
In-Reply-To: <1441040405.44.0.251292116419.issue24970@psf.upfronthosting.co.za>
Message-ID: <1603398363.99.0.441581239662.issue24970@roundup.psfhosted.org>


Change by Antony Lee <anntzer.lee at gmail.com>:


----------
nosy:  -Antony.Lee

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24970>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:26:22 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Thu, 22 Oct 2020 20:26:22 +0000
Subject: [issue42117] asyncio calls from sync/async, better docs or api support
In-Reply-To: <1603374436.81.0.314726165729.issue42117@roundup.psfhosted.org>
Message-ID: <1603398382.55.0.406303207135.issue42117@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

I'm not sure what you're actually proposing, and only have a vague understanding of what you're complaining about. This is perhaps related to https://bugs.python.org/issue33523? If so then maybe leave a comment there?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42117>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:26:11 2020
From: report at bugs.python.org (Antony Lee)
Date: Thu, 22 Oct 2020 20:26:11 +0000
Subject: [issue27320] ./setup.py --help-commands should sort extra commands
In-Reply-To: <1465926347.78.0.17877088837.issue27320@psf.upfronthosting.co.za>
Message-ID: <1603398371.37.0.573622688336.issue27320@roundup.psfhosted.org>


Change by Antony Lee <anntzer.lee at gmail.com>:


----------
nosy:  -Antony.Lee

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27320>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:34:43 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:34:43 +0000
Subject: [issue24876] distutils.errors not wildcard-import-safe
In-Reply-To: <1439724892.22.0.0558175678878.issue24876@psf.upfronthosting.co.za>
Message-ID: <1603398883.66.0.418873842296.issue24876@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

The docstring is wrong, but I don?t think there is much value in changing it now.  Style guides generally recommend against star imports, and not many people need to import from distutils.errors (setuptools and maybe numpy?).

----------
nosy: +jaraco
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24876>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:37:07 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:37:07 +0000
Subject: [issue31073] Change metadata handling in check command
In-Reply-To: <1501275107.85.0.857178760457.issue31073@psf.upfronthosting.co.za>
Message-ID: <1603399027.32.0.292548348692.issue31073@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Not sure how you read that from my comment ? I merely wanted to be sure about what the spec said! :)

Most people use setuptools than distutils these days, and it?s mostly unmaintained, so your idea to report this issue to setuptols is the right one.  Thanks for the report nonetheless!

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31073>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:39:28 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:39:28 +0000
Subject: [issue29708] support reproducible Python builds
In-Reply-To: <1488540966.18.0.904677570473.issue29708@psf.upfronthosting.co.za>
Message-ID: <1603399168.2.0.0358468230131.issue29708@roundup.psfhosted.org>


Change by ?ric Araujo <merwok at netwok.org>:


----------
dependencies: +Reproducible pyc: frozenset is not serialized in a deterministic order, setup.py sdist --format=gztar should use (equivalent of) `gzip -n`, setup.py sdist should honor SOURCE_DATE_EPOCH

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29708>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:40:05 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:40:05 +0000
Subject: [issue29708] support reproducible Python builds
In-Reply-To: <1488540966.18.0.904677570473.issue29708@psf.upfronthosting.co.za>
Message-ID: <1603399205.5.0.51901370361.issue29708@roundup.psfhosted.org>


Change by ?ric Araujo <merwok at netwok.org>:


----------
dependencies:  -setup.py sdist --format=gztar should use (equivalent of) `gzip -n`, setup.py sdist should honor SOURCE_DATE_EPOCH

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29708>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:39:52 2020
From: report at bugs.python.org (Kyle Stanley)
Date: Thu, 22 Oct 2020 20:39:52 +0000
Subject: [issue28533] Replace asyncore
In-Reply-To: <1477420324.44.0.338895938894.issue28533@psf.upfronthosting.co.za>
Message-ID: <1603399192.25.0.809140419131.issue28533@roundup.psfhosted.org>


Kyle Stanley <aeros167 at gmail.com> added the comment:

Since this issue is now a significant blocker for PEP 594 (remove stdlib dead batteries, which includes asyncore and asynchat), I'm going to prioritize working on this and assign it to myself.

----------
assignee:  -> aeros

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28533>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:41:26 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:41:26 +0000
Subject: [issue38727] setup.py sdist --format=gztar should use (equivalent of)
 `gzip -n`
In-Reply-To: <1573071278.89.0.711333419595.issue38727@roundup.psfhosted.org>
Message-ID: <1603399286.16.0.999420924669.issue38727@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Distutils isn?t used much (directly), I think this should be reported to the tools that create sdists, such as setuptools and flit.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38727>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:44:59 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 20:44:59 +0000
Subject: [issue41669] Case mismatch between "include" and "Include"
In-Reply-To: <1598824086.3.0.112428112748.issue41669@roundup.psfhosted.org>
Message-ID: <1603399499.88.0.796532252595.issue41669@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Is this the same as #24908 ?

----------
nosy: +eric.araujo

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41669>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:46:51 2020
From: report at bugs.python.org (Will Thompson)
Date: Thu, 22 Oct 2020 20:46:51 +0000
Subject: [issue29708] support reproducible Python builds
In-Reply-To: <1488540966.18.0.904677570473.issue29708@psf.upfronthosting.co.za>
Message-ID: <1603399611.73.0.695264055574.issue29708@roundup.psfhosted.org>


Change by Will Thompson <thompson at endlessm.com>:


----------
nosy:  -Will Thompson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29708>
_______________________________________

From report at bugs.python.org  Thu Oct 22 16:54:54 2020
From: report at bugs.python.org (Xuan Wu)
Date: Thu, 22 Oct 2020 20:54:54 +0000
Subject: [issue42121] unable to input certain Unicode characters in Text widget
Message-ID: <1603400094.16.0.618856195633.issue42121@roundup.psfhosted.org>


New submission from Xuan Wu <nobodxbodon.github at gmail.com>:

When creating a text editor with tkinter Text widget, I found that some Chinese punctuations cound't be input correctly.

When input "?", which is open parenthesis in Chinese, it behaves like a back space.
When input "?", close parenthesis in Chinese, it seems like a tab instead.
When input "?", semicolon in Chinese, it does nothing.

Then I tried input the same in IDLE 3.7.6 and the same happened. Also, the same happens in thonny, the python IDE. I suppose they all use Text widget.

Pitifully I don't think of a way to reproduce the issue without using Chinese input method.

Please let me know how to help with debugging. Thanks.

----------
components: Tkinter
messages: 379345
nosy: nobodxbodon
priority: normal
severity: normal
status: open
title: unable to input certain Unicode characters in Text widget
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42121>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:01:48 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Thu, 22 Oct 2020 21:01:48 +0000
Subject: [issue38443] unavailable --with-universal-archs= macOS confgure
 options fail cryptically
In-Reply-To: <1570780434.84.0.507087684939.issue38443@roundup.psfhosted.org>
Message-ID: <1603400508.12.0.696434909015.issue38443@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

A fairly simple change is to check if compiling a file with the specified set of "-arch" flags works, and bail  out with a nice error message if it doesn't.

Something like this works:

diff --git a/configure.ac b/configure.ac
index f0bc8c6258..e26cdc8607 100644
--- a/configure.ac
+++ b/configure.ac
@@ -1976,6 +1976,14 @@ yes)
         EXPORT_MACOSX_DEPLOYMENT_TARGET=''
         AC_MSG_RESULT($MACOSX_DEPLOYMENT_TARGET)
 
+       AC_MSG_CHECKING(if specified build architectures work)
+        AC_COMPILE_IFELSE([AC_LANG_PROGRAM([[]], [[]])],
+            [AC_MSG_RESULT(yes)],
+            [AC_MSG_RESULT(no)
+            AC_MSG_ERROR(check the '--with-universal-archs' option)
+        ])
+
+
         # end of Darwin* tests
         ;;
     esac


I'm not entirely happy with the phrasing, but at least you'll get a clearer message and one that indicate which configure argument can be used to fix it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38443>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:07:25 2020
From: report at bugs.python.org (Christopher Marchfelder)
Date: Thu, 22 Oct 2020 21:07:25 +0000
Subject: [issue40592] `Shutil.which` incosistent with windows's `where`
In-Reply-To: <1589187015.71.0.593402074503.issue40592@roundup.psfhosted.org>
Message-ID: <1603400845.78.0.382910769347.issue40592@roundup.psfhosted.org>


Christopher Marchfelder <marchfelder at googlemail.com> added the comment:

@steve.dower Your advice did it, is fixed and green! :) Thank you again

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40592>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:08:31 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:08:31 +0000
Subject: [issue1222585] C++ compilation support for distutils
Message-ID: <1603400911.47.0.0749162918732.issue1222585@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

setuptools and other active build tools are the better target for this feature.

----------
assignee: eric.araujo -> 
resolution:  -> wont fix
stage: test needed -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1222585>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:09:34 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:09:34 +0000
Subject: [issue40289] Document how to get Python's bin / Scripts directory
In-Reply-To: <1586918438.96.0.496326994048.issue40289@roundup.psfhosted.org>
Message-ID: <1603400974.59.0.0320994103882.issue40289@roundup.psfhosted.org>


Change by ?ric Araujo <merwok at netwok.org>:


----------
stage:  -> needs patch
title: "highlighting" how to get Python's Scripts directory in the documentation -> Document how to get Python's bin / Scripts directory
versions: +Python 3.10 -Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40289>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:16:23 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:16:23 +0000
Subject: [issue16401] mention PKG-INFO in the documentation
In-Reply-To: <1352024381.32.0.925896266965.issue16401@psf.upfronthosting.co.za>
Message-ID: <1603401383.94.0.306538199693.issue16401@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

It is documented here: https://packaging.python.org/guides/using-manifest-in/#how-files-are-included-in-an-sdist

Packaging doc has moved from versioned Python docs to this unique external guide, so I?m closing this.

----------
resolution:  -> works for me
stage:  -> resolved
status: open -> closed
versions:  -Python 2.7, Python 3.2, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16401>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:18:37 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:18:37 +0000
Subject: [issue26955] Implement equivalent to `pip.locations.distutils_scheme`
 in sysconfig
In-Reply-To: <1462378664.68.0.201238634465.issue26955@psf.upfronthosting.co.za>
Message-ID: <1603401517.36.0.727873132787.issue26955@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

If added, this should be in sysconfig, not distutils.

----------
components: +Library (Lib) -Distutils
title: Implement equivalent to `pip.locations.distutils_scheme` in distutils -> Implement equivalent to `pip.locations.distutils_scheme` in sysconfig
versions: +Python 3.10 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26955>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:19:47 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:19:47 +0000
Subject: [issue17311] use distutils terminology in "PyPI package display"
 section
In-Reply-To: <1361988977.92.0.980923457558.issue17311@psf.upfronthosting.co.za>
Message-ID: <1603401587.13.0.469143266358.issue17311@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

That page has been removed in favour of external guide.

----------
resolution:  -> out of date
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17311>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:20:03 2020
From: report at bugs.python.org (Zack Weinberg)
Date: Thu, 22 Oct 2020 21:20:03 +0000
Subject: [issue38727] setup.py sdist --format=gztar should use (equivalent of)
 `gzip -n`
In-Reply-To: <1573071278.89.0.711333419595.issue38727@roundup.psfhosted.org>
Message-ID: <1603401603.13.0.473893791177.issue38727@roundup.psfhosted.org>


Zack Weinberg <zackw at panix.com> added the comment:

The code that needs to be changed is in distutils, setuptools just calls into it. I haven't checked flit but I expect it does the same.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38727>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:20:37 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:20:37 +0000
Subject: [issue12933] Update or remove claims that distutils requires external
 programs
In-Reply-To: <1315411614.16.0.0292960363033.issue12933@psf.upfronthosting.co.za>
Message-ID: <1603401637.53.0.957398723275.issue12933@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

This is obsolete now.

----------
resolution:  -> wont fix
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12933>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:21:44 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:21:44 +0000
Subject: [issue11219] distutils check command: warn if license is specified in
 both the License and Classifier metadata fields
In-Reply-To: <1297826569.81.0.596233570494.issue11219@psf.upfronthosting.co.za>
Message-ID: <1603401704.62.0.0494010598787.issue11219@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

This can be handled by packaging lint tools.
There is also a PEP to use SPDX license identifiers in metadata.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11219>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:22:40 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 21:22:40 +0000
Subject: [issue5043] get_msvcr() returns None rather than []
In-Reply-To: <1232819450.01.0.0863165056727.issue5043@psf.upfronthosting.co.za>
Message-ID: <1603401760.4.0.33195854284.issue5043@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The claimed bug is that when msc_pos is -1 in the code as posted, 'return []' should be executed, but None is returned instead.  When I add 'msc_pos = -1 before the if statement, and call the function, after adding the needed sys import, [] is indeed returned.

The final elif return has two bugs, '%i' and 'Ver':
raise ValueError("Unknown MS Compiler version %i " % msc_Ver)  # Posted
raise ValueError("Unknown MS Compiler version %s " % msc_ver)  # Fixed

With this fix and without -1 forced, the ValueError is raised on all current versions, so this code is out of date in any case.

----------
nosy: +terry.reedy
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5043>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:27:35 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:27:35 +0000
Subject: [issue7726] Remove required metadata warnings for sdist
In-Reply-To: <1263748397.28.0.736883943174.issue7726@psf.upfronthosting.co.za>
Message-ID: <1603402055.1.0.0473308865583.issue7726@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Distutils won?t be changed at this point in time, this request should go to setuptools.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7726>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:31:41 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:31:41 +0000
Subject: [issue38727] setup.py sdist --format=gztar should use (equivalent of)
 `gzip -n`
In-Reply-To: <1573071278.89.0.711333419595.issue38727@roundup.psfhosted.org>
Message-ID: <1603402301.5.0.693948680343.issue38727@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

setuptools has its own copy of distutils now.

flit is independent of distutils.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38727>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:33:25 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:33:25 +0000
Subject: [issue42037] Documentation confusion in CookieJar functions
In-Reply-To: <1602689022.88.0.876415237077.issue42037@roundup.psfhosted.org>
Message-ID: <1603402405.36.0.749213830786.issue42037@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Yes, you will need a github account linked to a bpo (this site) account so that the contributor agreement bot can do its job.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42037>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:35:32 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 21:35:32 +0000
Subject: [issue13348] test_unicode_file fails: shutil.copy2 says "same file"
In-Reply-To: <1320490682.69.0.905628343655.issue13348@psf.upfronthosting.co.za>
Message-ID: <1603402532.04.0.974746872856.issue13348@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> out of date
stage: test needed -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13348>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:35:20 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:35:20 +0000
Subject: [issue15419] distutils: build should use a version-specific build
 directory
In-Reply-To: <1342945976.47.0.537572255215.issue15419@psf.upfronthosting.co.za>
Message-ID: <1603402520.37.0.303099579601.issue15419@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

setuptools is recommended over distutils, and doesn?t have the issue (per previous messages).

----------
assignee: eric.araujo -> 
resolution:  -> wont fix
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15419>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:37:41 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:37:41 +0000
Subject: [issue29411] Option --executable for entry_points
In-Reply-To: <1485945833.17.0.354426636585.issue29411@psf.upfronthosting.co.za>
Message-ID: <1603402661.22.0.356330463174.issue29411@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Closing this; the distutils patch was never attached here, and now setuptools has its own copy of distutils so if this feature request is pursued all the changes will happen there.

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29411>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:44:42 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:44:42 +0000
Subject: [issue8084] pep-0370 on osx duplicates existing functionality
In-Reply-To: <1267964951.32.0.7992829434.issue8084@psf.upfronthosting.co.za>
Message-ID: <1603403082.17.0.102087726724.issue8084@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

It seems that the boat has sailed here

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue8084>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:44:45 2020
From: report at bugs.python.org (Blaze Spinnaker)
Date: Thu, 22 Oct 2020 21:44:45 +0000
Subject: [issue42117] asyncio calls from sync/async, better docs or api support
In-Reply-To: <1603374436.81.0.314726165729.issue42117@roundup.psfhosted.org>
Message-ID: <1603403085.59.0.338672089897.issue42117@roundup.psfhosted.org>


Blaze Spinnaker <blazespinnaker at gmail.com> added the comment:

asyncio code placed in a repl won't execute properly as it may (or may not) be running an event loop already.

This happens not just in traditional repls, but any platform that provides execution shells around code.  Other repls, Spyder, pyppeter, and a lot more.  Some of the maintainers reference running a monkey patch to fix the problem.

The link I provided referenced 40 complaints about this issue.

I am not really proposing anything, just that it be addressed by either new API or better documentation explaining how best to solve the problem.  I do provide an example of an idea.

But addressing is important.  Just leaving it up to the community is causing a lot of chaos, incompatibilities and bugs.   

Some are suggesting using get_event_loop() but you discourage using this api in the documentation.  Not sure what that guidance means exactly as it's not very clear under what constraints the API can be used and when it can't.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42117>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:46:33 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:46:33 +0000
Subject: [issue26033] distutils default compiler API is incomplete
In-Reply-To: <1452126768.68.0.403890898516.issue26033@psf.upfronthosting.co.za>
Message-ID: <1603403193.8.0.392249921876.issue26033@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Distutils does not evolve anymore ? if CFFI still needs something like this, I think it should build on setuptools and request features there.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26033>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:47:25 2020
From: report at bugs.python.org (Blaze Spinnaker)
Date: Thu, 22 Oct 2020 21:47:25 +0000
Subject: [issue42117] asyncio calls from sync/async, better docs or api support
In-Reply-To: <1603374436.81.0.314726165729.issue42117@roundup.psfhosted.org>
Message-ID: <1603403245.29.0.853898436052.issue42117@roundup.psfhosted.org>


Blaze Spinnaker <blazespinnaker at gmail.com> added the comment:

I guess what I'm saying, is you created a design problem with the sync can't call async constraint, but didn't suggest any solutions to solving it, and the solutions people are arriving at are pretty random.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42117>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:48:12 2020
From: report at bugs.python.org (Eric Snow)
Date: Thu, 22 Oct 2020 21:48:12 +0000
Subject: [issue36225] [subinterpreters] Lingering subinterpreters should be
 implicitly cleared on shutdown
In-Reply-To: <1551964663.69.0.686712846789.issue36225@roundup.psfhosted.org>
Message-ID: <1603403292.75.0.748240354779.issue36225@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

> I see multiple non trivial problems:
>
> * To finalize the subinterpreter A, Py_Finalize() may switch the current Python thread state from the main interpreter to a Python thread in the subintrepeter A. It can lead to new funny issues.

I'm not sure what you mean with this.  Are you talking about how another thread might be running that threadstate already?  That doesn't sounds like a problem specific to this issue but rather a problem with Py_EndInterpreter() in general.

> * A subinterpreter can be stuck for whatever reason and refuse to stop. For example, the subinterpreter A may wait for an even from subinterpreter B. If we don't run two interpreters "in parallel" (in threads), it may be stuck forever.

The wait_for_thread_shutdown() call in Py_FinalizeEx() already has a similar behavior.  In the case of one interpreter blocking another like that, how would that be possible where it isn't already a problem?

> * Python 3.10 still has weird code to allow daemon threads to continue to run after Py_Finalize() complete. Maybe we need to add such hacks for subinterpreter which fail to be finalized? For example, kill them (exit) as soon as they attempt to acquire the GIL. Search for tstate_must_exit() in Python/ceval_gil.h.

I consider the problem of daemon threads to be a separate problem.  The solution proposed here for finalization doesn't change any behavior regarding daemon threads.

> By the way, currently Py_Finalize() calls PyInterpreterState_Clear() which call object finalizers in the main thread of the main interpreter, whereas these finalizers might expect to be called from the thread which created them.

Do you have any examples?  I'm having trouble imagining such a case.

> I don't know if we must change anything else.
>
> Again, all these problems are very complex :-(

I agree.  However, automatically finalizing all other interpreters at the beginning of Py_FinalizeEx() doesn't introduce any new problems.  At the same time, it makes sure that any resources in use in other interpreters have a chance to be released and that global resources used there don't cause crashes during runtime finalization.

> The simple option, which is sadly a backward incompatible change, is to raise a fatal error in Py_Finalize() if a subinterpreter is still running.

As long as we require Py_FinalizeEx() to be called from the main interpreter, I don't see how the proposed change (in PR #17575) would be backward incompatible.

> Maybe we can start by logging a warning into stderr for now, before introducing the backward incompatible change. Maybe even only emit it when -X dev is used? https://docs.python.org/dev/library/devmode.html

I'd like to see a ResourceWarning if any other interpreters were still around.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36225>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:48:03 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:48:03 +0000
Subject: [issue13473] Add tests for files byte-compiled by distutils
In-Reply-To: <1322145911.61.0.528651769931.issue13473@psf.upfronthosting.co.za>
Message-ID: <1603403283.62.0.38121336363.issue13473@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

I don?t think tests add value at this stage of the life of distutils; inclined to close this.

----------
stage: needs patch -> 
status: open -> pending
versions:  -Python 2.7, Python 3.4, Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13473>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:49:13 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Thu, 22 Oct 2020 21:49:13 +0000
Subject: [issue22308] add {implementation} to sysconfig.py
In-Reply-To: <1409424576.55.0.363891426892.issue22308@psf.upfronthosting.co.za>
Message-ID: <1603403353.12.0.241212354166.issue22308@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

This is a non-trivial change that would impact many packaging tools, and as such should be discussed on mailing list or https://discuss.python.org/

----------
nosy: +eric.araujo
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22308>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:50:39 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 21:50:39 +0000
Subject: [issue3760] PEP 3121 --- PyType_Copy is missing
In-Reply-To: <1220383344.44.0.399854586534.issue3760@psf.upfronthosting.co.za>
Message-ID: <1603403439.17.0.241834432297.issue3760@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

12 years later there still is no PyType_Copy, at least not by that name, according to the doc index. So it is either not urgently needed or the need has been covered by other additions. I think that this should be closed as out of date and any new additions should be done in the light of the current situation.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3760>
_______________________________________

From report at bugs.python.org  Thu Oct 22 17:52:47 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 21:52:47 +0000
Subject: [issue4573] zsh-style subpattern matching for fnmatch/glob
In-Reply-To: <1228637877.49.0.438531462048.issue4573@psf.upfronthosting.co.za>
Message-ID: <1603403567.85.0.582658416739.issue4573@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Raymond, is this zsh addition still relevant or out of date?

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4573>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:05:16 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 22:05:16 +0000
Subject: [issue5906] Risk of confusion in multiprocessing module - daemonic
 processes
In-Reply-To: <1241281680.28.0.426890622653.issue5906@psf.upfronthosting.co.za>
Message-ID: <1603404316.16.0.0381876725521.issue5906@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Is the paragraph "Usually, daemon processes ..." in Pascal's initial post supposed to be a quote from https://docs.python.org/3/library/multiprocessing.html?  'daemon p' is nowhere in the corrent doc and I find nothing like this paragraph.  Is this issue still relevant?

----------
assignee: jnoller -> 
components: +Documentation
nosy: +terry.reedy
versions: +Python 3.10 -Python 2.6, Python 2.7, Python 3.0, Python 3.1

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5906>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:03:23 2020
From: report at bugs.python.org (Blaze Spinnaker)
Date: Thu, 22 Oct 2020 22:03:23 +0000
Subject: [issue42117] asyncio calls from sync/async, better docs or api support
In-Reply-To: <1603374436.81.0.314726165729.issue42117@roundup.psfhosted.org>
Message-ID: <1603404203.13.0.0229813079363.issue42117@roundup.psfhosted.org>


Blaze Spinnaker <blazespinnaker at gmail.com> added the comment:

btw, this is different than the other issue as I understand you don't want re-entrant calls to async.  Library integration can be done (painfully) by cherry picking the right API to call, but it's more painful with repls as that's not how they're used.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42117>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:05:35 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 22:05:35 +0000
Subject: [issue4573] zsh-style subpattern matching for fnmatch/glob
In-Reply-To: <1228637877.49.0.438531462048.issue4573@psf.upfronthosting.co.za>
Message-ID: <1603404335.39.0.81688701487.issue4573@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
versions: +Python 3.10 -Python 2.7, Python 3.0

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4573>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:08:10 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 22:08:10 +0000
Subject: [issue3760] PEP 3121 --- PyType_Copy is missing
In-Reply-To: <1220383344.44.0.399854586534.issue3760@psf.upfronthosting.co.za>
Message-ID: <1603404490.75.0.820891082094.issue3760@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Zach Ware agreed on a coredev sprint discussion.

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3760>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:17:36 2020
From: report at bugs.python.org (Glyph Lefkowitz)
Date: Thu, 22 Oct 2020 22:17:36 +0000
Subject: [issue8084] pep-0370 on osx duplicates existing functionality
In-Reply-To: <1267964951.32.0.7992829434.issue8084@psf.upfronthosting.co.za>
Message-ID: <1603405056.69.0.643240581541.issue8084@roundup.psfhosted.org>


Glyph Lefkowitz <glyph at twistedmatrix.com> added the comment:

For what it's worth, I've long since adapted to the status quo here, so I'm happy for this to just be closed :-).

(Apple seems to have mostly given up on "domains" as a user-facing or even developer-facing concept, so searching /Network seems like it is not relevant any more.  /System is now read-only even for root and they're deprecating the Python installed there; still, the up-to-date reference for the relevant API is https://developer.apple.com/documentation/foundation/nsfilemanager/1407726-urlsfordirectory?language=objc# )

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue8084>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:20:53 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 22:20:53 +0000
Subject: [issue12174] Multiprocessing logging levels unclear
In-Reply-To: <1306324447.9.0.976036464224.issue12174@psf.upfronthosting.co.za>
Message-ID: <1603405253.67.0.65101272543.issue12174@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> out of date
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12174>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:32:21 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 22:32:21 +0000
Subject: [issue7018] Recommend "*" over "#" in getargs.c typecodes
In-Reply-To: <1254221956.14.0.22830785564.issue7018@psf.upfronthosting.co.za>
Message-ID: <1603405941.6.0.073482646465.issue7018@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7018>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:37:19 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 22:37:19 +0000
Subject: [issue14322] More test coverage for hmac
In-Reply-To: <1331831609.33.0.520236800519.issue14322@psf.upfronthosting.co.za>
Message-ID: <1603406239.18.0.42770800807.issue14322@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

The patch is out of date and needs to be refreshed.

----------
components: +Library (Lib)
nosy: +iritkatriel
stage: patch review -> needs patch
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.7, Python 3.2, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14322>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:42:42 2020
From: report at bugs.python.org (Lewis Gaul)
Date: Thu, 22 Oct 2020 22:42:42 +0000
Subject: [issue38865] [subinterpreters] Can Py_Finalize() be called if the
 current interpreter is not the main interpreter?
In-Reply-To: <1574264524.01.0.330569638863.issue38865@roundup.psfhosted.org>
Message-ID: <1603406562.13.0.620373997892.issue38865@roundup.psfhosted.org>


Change by Lewis Gaul <lewis.gaul at gmail.com>:


----------
pull_requests:  -21778

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38865>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:46:16 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 22:46:16 +0000
Subject: [issue9633] pdb go stack up/down
In-Reply-To: <1282133837.82.0.171010459939.issue9633@psf.upfronthosting.co.za>
Message-ID: <1603406776.43.0.881578828295.issue9633@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I've reproduced the bug on 3.10.

----------
nosy: +iritkatriel
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9633>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:49:58 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 22:49:58 +0000
Subject: [issue41755] Docs: Please remove `from distutils.core import setup`
In-Reply-To: <1599769753.52.0.764816611922.issue41755@roundup.psfhosted.org>
Message-ID: <1603406998.92.0.430304874803.issue41755@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

In that case, I agree.

----------
status: pending -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41755>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:51:04 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 22 Oct 2020 22:51:04 +0000
Subject: [issue41755] Docs: Please remove `from distutils.core import setup`
In-Reply-To: <1599769753.52.0.764816611922.issue41755@roundup.psfhosted.org>
Message-ID: <1603407064.21.0.588033949451.issue41755@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

But notice that even agreeing removes 'pending', making it pretty useless.

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41755>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:53:10 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 22:53:10 +0000
Subject: [issue11646] 2to3: msvcrt.(get|put)ch -> (get|put)wch
In-Reply-To: <1300839645.82.0.653929076098.issue11646@psf.upfronthosting.co.za>
Message-ID: <1603407190.39.0.723487068059.issue11646@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11646>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:55:24 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 22:55:24 +0000
Subject: [issue614557] LookupError etc. need API to get the key
Message-ID: <1603407324.79.0.363305762006.issue614557@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue614557>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:58:44 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 22:58:44 +0000
Subject: [issue9499] DOC: C/API Execution namespace undocumented. (patch
 included)
In-Reply-To: <1280873534.19.0.920563075759.issue9499@psf.upfronthosting.co.za>
Message-ID: <1603407524.45.0.78634185553.issue9499@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
components: +C API
keywords:  -patch
stage:  -> needs patch
title: Python C/API Execution namespace undocumented. (patch included) -> DOC: C/API Execution namespace undocumented. (patch included)
type: behavior -> enhancement
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9499>
_______________________________________

From report at bugs.python.org  Thu Oct 22 18:59:21 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Thu, 22 Oct 2020 22:59:21 +0000
Subject: [issue31522] _mboxMMDF.get_string() fails to pass param to get_bytes()
In-Reply-To: <1505860469.5.0.965882587471.issue31522@psf.upfronthosting.co.za>
Message-ID: <1603407561.96.0.336649486173.issue31522@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

Actually, it looks to me like the PR *does* include unittests, and I see them in the repo, so I'm closing this bug.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31522>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:01:02 2020
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 22 Oct 2020 23:01:02 +0000
Subject: [issue31522] _mboxMMDF.get_string() fails to pass param to get_bytes()
In-Reply-To: <1505860469.5.0.965882587471.issue31522@psf.upfronthosting.co.za>
Message-ID: <1603407662.27.0.982401037044.issue31522@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Right!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31522>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:22:40 2020
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 22 Oct 2020 23:22:40 +0000
Subject: [issue11646] 2to3: msvcrt.(get|put)ch -> (get|put)wch
In-Reply-To: <1300839645.82.0.653929076098.issue11646@psf.upfronthosting.co.za>
Message-ID: <1603408960.44.0.0774712425222.issue11646@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

The bytes type has supported string methods for a long time now. I don't think there's anything else to do here. msvcrt.getch() is a low-level I/O function like os.read(). It should not be automatically converted to msvcrt.getwch(). Unfortunately the function names weren't changed in Python 3. I'd rather that msvcrt.getch() returned str and msvcrt.getchb() returned bytes. Then there would have actually been something for 2to3 to convert (e.g. getch -> getchb, and getwch -> getch).

----------
nosy: +eryksun
resolution:  -> out of date
stage:  -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11646>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:27:09 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Thu, 22 Oct 2020 23:27:09 +0000
Subject: [issue30681] email.utils.parsedate_to_datetime() should return None
 when date cannot be parsed
In-Reply-To: <1497568363.46.0.596536376967.issue30681@psf.upfronthosting.co.za>
Message-ID: <1603409229.62.0.80909734456.issue30681@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

@sim0n - I added a comment to your open PR.

My main question for the rest of the group is whether we can and should backport this.  Given the new defect class being introduced, it seems like this should only land in 3.10.  Thoughts?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30681>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:27:10 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 22 Oct 2020 23:27:10 +0000
Subject: [issue42122] IDLE complains about how fonts are accessed
Message-ID: <1603409230.0.0.859933553088.issue42122@roundup.psfhosted.org>


New submission from Raymond Hettinger <raymond.hettinger at gmail.com>:

This occurs immediately on startup:

$ python310 -m idlelib.idle
2020-10-22 16:20:19.400 python.exe[80008:1598908] CoreText note: Client requested name ".SFNSMono-Regular", it will get Times-Roman rather than the intended font. All system UI font access should be through proper APIs such as CTFontCreateUIFontForLanguage() or +[NSFont systemFontOfSize:].
2020-10-22 16:20:19.400 python.exe[80008:1598908] CoreText note: Set a breakpoint on CTFontLogSystemFontNameRequest to debug.
2020-10-22 16:20:19.450 python.exe[80008:1598908] CoreText note: Client requested name ".SF NS Mono", it will get Times-Roman rather than the intended font. All system UI font access should be through proper APIs such as CTFontCreateUIFontForLanguage() or +[NSFont systemFontOfSize:].
2020-10-22 16:20:28.100 python.exe[80008:1598908] CoreText note: Client requested name ".SFNSMono-Regular", it will get Times-Roman rather than the intended font. All system UI font access should be through proper APIs such as CTFontCreateUIFontForLanguage() or +[NSFont systemFontOfSize:].
2020-10-22 16:20:28.100 python.exe[80008:1598908] CoreText note: Client requested name ".SF NS Mono", it will get Times-Roman rather than the intended font. All system UI font access should be through proper APIs such as CTFontCreateUIFontForLanguage() or +[NSFont systemFontOfSize:].
2020-10-22 16:20:28.101 python.exe[80008:1598908] CoreText note: Client requested name ".SFNSMono-Regular", it will get Times-Roman rather than the intended font. All system UI font access should be through proper APIs such as CTFontCreateUIFontForLanguage() or +[NSFont systemFontOfSize:].
2020-10-22 16:20:28.124 python.exe[80008:1598908] CoreText note: Client requested name ".SFNSMono-Regular", it will get Times-Roman rather than the intended font. All system UI font access should be through proper APIs such as CTFontCreateUIFontForLanguage() or +[NSFont systemFontOfSize:].
2020-10-22 16:20:28.124 python.exe[80008:1598908] CoreText note: Client requested name ".SF NS Mono", it will get Times-Roman rather than the intended font. All system UI font access should be through proper APIs such as CTFontCreateUIFontForLanguage() or +[NSFont systemFontOfSize:].
2020-10-22 16:20:28.124 python.exe[80008:1598908] CoreText note: Client requested name ".SFNSMono-Regular", it will get Times-Roman rather than the intended font. All system UI font access should be through proper APIs such as CTFontCreateUIFontForLanguage() or +[NSFont systemFontOfSize:].

----------
assignee: terry.reedy
components: IDLE
messages: 379382
nosy: rhettinger, terry.reedy
priority: normal
severity: normal
status: open
title: IDLE complains about how fonts are accessed
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42122>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:29:18 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Thu, 22 Oct 2020 23:29:18 +0000
Subject: [issue38486] Dead links in mailbox doc
In-Reply-To: <1571155336.35.0.351516835001.issue38486@roundup.psfhosted.org>
Message-ID: <1603409358.91.0.929608735644.issue38486@roundup.psfhosted.org>


Change by Barry A. Warsaw <barry at python.org>:


----------
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38486>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:33:36 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 23:33:36 +0000
Subject: [issue38486] Dead links in mailbox doc
In-Reply-To: <1571155336.35.0.351516835001.issue38486@roundup.psfhosted.org>
Message-ID: <1603409616.44.0.222849778129.issue38486@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ec388cfb4ede56dace2bb78851ff6f38fa2a6abe by Zackery Spytz in branch 'master':
bpo-38486: Fix dead qmail links in the mailbox docs (GH-22239)
https://github.com/python/cpython/commit/ec388cfb4ede56dace2bb78851ff6f38fa2a6abe


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38486>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:33:59 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 23:33:59 +0000
Subject: [issue38486] Dead links in mailbox doc
In-Reply-To: <1571155336.35.0.351516835001.issue38486@roundup.psfhosted.org>
Message-ID: <1603409639.94.0.251012506674.issue38486@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21834
pull_request: https://github.com/python/cpython/pull/22903

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38486>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:33:52 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 23:33:52 +0000
Subject: [issue38486] Dead links in mailbox doc
In-Reply-To: <1571155336.35.0.351516835001.issue38486@roundup.psfhosted.org>
Message-ID: <1603409632.62.0.952042098593.issue38486@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21833
pull_request: https://github.com/python/cpython/pull/22902

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38486>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:33:45 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 23:33:45 +0000
Subject: [issue38486] Dead links in mailbox doc
In-Reply-To: <1571155336.35.0.351516835001.issue38486@roundup.psfhosted.org>
Message-ID: <1603409625.23.0.692545040693.issue38486@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21832
pull_request: https://github.com/python/cpython/pull/22901

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38486>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:35:43 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Thu, 22 Oct 2020 23:35:43 +0000
Subject: [issue42123] Run the two times,
 only enable invalid_* rules on the second run
Message-ID: <1603409743.28.0.787265357056.issue42123@roundup.psfhosted.org>


New submission from Lysandros Nikolaou <lisandrosnik at gmail.com>:

We can avoid having to go through all the invalid rules (which might be a significant performance boost, since these may call expensive rules like primary or others), if we run the parser two times.

On the first run, all the invalid rules are disabled and do not get expanded. If a parse failure occurs anywhere, then we run the parser a second time with all these rules enabled, in order to get the correct error message.

Some benchmarking by Pablo show a ~4% speedup in the stdlib benchmark and a ~10% in the xxl benchmark.

----------
assignee: lys.nikolaou
components: Interpreter Core
messages: 379384
nosy: gvanrossum, lys.nikolaou, pablogsal
priority: normal
severity: normal
status: open
title: Run the two times, only enable invalid_* rules on the second run
type: performance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42123>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:37:42 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Thu, 22 Oct 2020 23:37:42 +0000
Subject: [issue42123] Run the two times,
 only enable invalid_* rules on the second run
In-Reply-To: <1603409743.28.0.787265357056.issue42123@roundup.psfhosted.org>
Message-ID: <1603409862.77.0.581785156839.issue42123@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
keywords: +patch
pull_requests: +21835
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22111

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42123>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:40:53 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Thu, 22 Oct 2020 23:40:53 +0000
Subject: [issue38486] Dead links in mailbox doc
In-Reply-To: <1571155336.35.0.351516835001.issue38486@roundup.psfhosted.org>
Message-ID: <1603410053.39.0.186653802667.issue38486@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

Thanks for the PR @ZackerySpytz - this has landed in git head and is currently being backported to 3.9 and 3.8 (3.7 is in security-fix only mode).

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38486>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:42:08 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 23:42:08 +0000
Subject: [issue38486] Dead links in mailbox doc
In-Reply-To: <1571155336.35.0.351516835001.issue38486@roundup.psfhosted.org>
Message-ID: <1603410128.6.0.945655212576.issue38486@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset cd894b1094ac472ceb98fe15a28ebeb8301fc079 by Miss Skeleton (bot) in branch '3.8':
[3.8] bpo-38486: Fix dead qmail links in the mailbox docs (GH-22239) (GH-22902)
https://github.com/python/cpython/commit/cd894b1094ac472ceb98fe15a28ebeb8301fc079


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38486>
_______________________________________

From report at bugs.python.org  Thu Oct 22 19:55:13 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 22 Oct 2020 23:55:13 +0000
Subject: [issue38486] Dead links in mailbox doc
In-Reply-To: <1571155336.35.0.351516835001.issue38486@roundup.psfhosted.org>
Message-ID: <1603410913.0.0.776666451933.issue38486@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 69479ecfa86cc2f0e70d5627d52907e82c3f5b9b by Miss Skeleton (bot) in branch '3.9':
[3.9] bpo-38486: Fix dead qmail links in the mailbox docs (GH-22239) (GH-22901)
https://github.com/python/cpython/commit/69479ecfa86cc2f0e70d5627d52907e82c3f5b9b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38486>
_______________________________________

From report at bugs.python.org  Thu Oct 22 20:03:26 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Fri, 23 Oct 2020 00:03:26 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603411406.44.0.892875584235.issue41972@roundup.psfhosted.org>


Change by Dennis Sweeney <sweeney.dennis650 at gmail.com>:


----------
pull_requests: +21836
pull_request: https://github.com/python/cpython/pull/22904

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Thu Oct 22 20:30:01 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Fri, 23 Oct 2020 00:30:01 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603413001.04.0.808430948231.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

I attached a new PR, with a lot of the same ideas.

The major differences between this and the last PR:

* The first character to be checked at each alignment is the first character of the right half, rather than the last.

* If that first character does not match, then the character immediately following the window is looked up in the table, and we jump forward accordingly (Sunday's trick).

I'll post some more benchmarks soon, but preliminarily, it seems like this swapping of the character to first be matched is better for some needles, worse for others, which makes sense. Stringbench.py for example has some needles that have a unique character at the end, which prefers the status quo and old PR, but other strings work better for this PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Thu Oct 22 20:33:49 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 00:33:49 +0000
Subject: [issue26131] Raise ImportWarning when loader.load_module() is used
In-Reply-To: <1452894244.92.0.478987355259.issue26131@psf.upfronthosting.co.za>
Message-ID: <1603413229.36.0.136656938871.issue26131@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
keywords: +patch
pull_requests: +21837
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/22905

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26131>
_______________________________________

From report at bugs.python.org  Thu Oct 22 20:38:05 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 00:38:05 +0000
Subject: [issue26131] Raise ImportWarning when loader.load_module() is used
In-Reply-To: <1452894244.92.0.478987355259.issue26131@psf.upfronthosting.co.za>
Message-ID: <1603413485.3.0.771516777391.issue26131@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

A PR is now up. I ended up deprecating the load_module() methods in importlib itself and then raise ImportWarning in the import system itself when falling back to load_module().

----------
stage: patch review -> test needed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26131>
_______________________________________

From report at bugs.python.org  Thu Oct 22 20:42:58 2020
From: report at bugs.python.org (Eric Snow)
Date: Fri, 23 Oct 2020 00:42:58 +0000
Subject: [issue36876] [subinterpreters] Global C variables are a problem
In-Reply-To: <1557514902.13.0.853517754348.issue36876@roundup.psfhosted.org>
Message-ID: <1603413778.97.0.656250349117.issue36876@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:


New changeset 345cd37abe324ad4f60f80e2c3133b8849e54e9b by Eric Snow in branch 'master':
bpo-36876: Fix the C analyzer tool. (GH-22841)
https://github.com/python/cpython/commit/345cd37abe324ad4f60f80e2c3133b8849e54e9b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36876>
_______________________________________

From report at bugs.python.org  Thu Oct 22 21:10:10 2020
From: report at bugs.python.org (Tim Peters)
Date: Fri, 23 Oct 2020 01:10:10 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603415410.95.0.0735771921927.issue41972@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Note that Sunday doesn't care (at all) where mismatches occur. The "natural" way to add Sunday: follow pure C-P unless/until it finds a mismatching position. Pure C-P then computes a specific shift. Nothing about that changes. But something is added: also compute the shift Sunday suggests, and pick the larger of that and what C-P computed.

C-P and Sunday both have cases where they can justify "supernaturally large" shifts (i.e., as long as len(needle), or even that +1 for Sunday), and they're not always the same cases.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Thu Oct 22 21:48:22 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 23 Oct 2020 01:48:22 +0000
Subject: [issue42122] macOS complains about how fonts are accessed
In-Reply-To: <1603409230.0.0.859933553088.issue42122@roundup.psfhosted.org>
Message-ID: <1603417702.14.0.867053362749.issue42122@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I am sure that this is yet another macOS Catalina+ tcl/tk problem.  3.10 is fine on Mohave.  Those complaints must come from macOS in response to 'Client' tk requests.  IDLE and tkinter do not use those names.  If you want to try to see what tkinter function triggers those messages, try the following in the Python REPL.

import tkinter as tk
from tkinter import font
root = tk.Tk()
fnames = font.names(root)
f1 = font.Font(root=root, name=fnames[0], exists=True)
f2 = font.Font(root=root, name='TkFixedFont', exists=True)

----------
assignee: terry.reedy -> 
components: +Tkinter, macOS -IDLE
nosy: +ned.deily, ronaldoussoren
title: IDLE complains about how fonts are accessed -> macOS complains about how fonts are accessed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42122>
_______________________________________

From report at bugs.python.org  Thu Oct 22 21:52:53 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 23 Oct 2020 01:52:53 +0000
Subject: [issue42122] macOS complains about how fonts are accessed
In-Reply-To: <1603409230.0.0.859933553088.issue42122@roundup.psfhosted.org>
Message-ID: <1603417973.04.0.938498600822.issue42122@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

On my Airbook, 'python310' was not found; 'python3.10' worked.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42122>
_______________________________________

From report at bugs.python.org  Thu Oct 22 21:52:43 2020
From: report at bugs.python.org (Dima Tisnek)
Date: Fri, 23 Oct 2020 01:52:43 +0000
Subject: [issue42117] asyncio calls from sync/async, better docs or api support
In-Reply-To: <1603374436.81.0.314726165729.issue42117@roundup.psfhosted.org>
Message-ID: <1603417963.06.0.786180202545.issue42117@roundup.psfhosted.org>


Dima Tisnek <dimaqq at gmail.com> added the comment:

Blaze, I think this needs a concrete proposal: either a patch, or at least a formal example how the new API would be used.

Note that there's also async-sig mailing list that's less formal, as well as discuss.python.org to bounce ideas off others.

----------
nosy: +Dima.Tisnek

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42117>
_______________________________________

From report at bugs.python.org  Thu Oct 22 21:54:59 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 23 Oct 2020 01:54:59 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1603418099.32.0.35532064601.issue42115@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +21838
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22907

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Thu Oct 22 22:27:04 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 23 Oct 2020 02:27:04 +0000
Subject: [issue24165] Free list for single-digits ints
In-Reply-To: <1431352769.3.0.375640200007.issue24165@psf.upfronthosting.co.za>
Message-ID: <1603420024.89.0.589915009754.issue24165@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I heard pyperformance 1.0.0 works and here is the result of PR-22884.

$ ./python-master -m pyperf compare_to master.json patched.json -G --min-speed=1
Slower (8):
- pathlib: 26.3 ms +- 0.3 ms -> 26.8 ms +- 0.4 ms: 1.02x slower (+2%)
- chameleon: 12.8 ms +- 0.1 ms -> 13.0 ms +- 0.1 ms: 1.02x slower (+2%)
- genshi_text: 38.3 ms +- 0.7 ms -> 38.9 ms +- 0.6 ms: 1.02x slower (+2%)
- sqlalchemy_imperative: 40.4 ms +- 0.9 ms -> 41.0 ms +- 0.8 ms: 1.02x slower (+2%)
- sympy_str: 441 ms +- 4 ms -> 448 ms +- 4 ms: 1.01x slower (+1%)
- chaos: 146 ms +- 1 ms -> 148 ms +- 2 ms: 1.01x slower (+1%)
- unpickle: 18.7 us +- 0.1 us -> 18.9 us +- 0.2 us: 1.01x slower (+1%)
- xml_etree_parse: 177 ms +- 2 ms -> 179 ms +- 3 ms: 1.01x slower (+1%)

Faster (11):
- scimark_sparse_mat_mult: 6.74 ms +- 0.18 ms -> 6.26 ms +- 0.03 ms: 1.08x faster (-7%)
- scimark_fft: 511 ms +- 7 ms -> 496 ms +- 4 ms: 1.03x faster (-3%)
- spectral_norm: 181 ms +- 2 ms -> 176 ms +- 3 ms: 1.03x faster (-3%)
- pidigits: 225 ms +- 1 ms -> 219 ms +- 1 ms: 1.03x faster (-3%)
- pickle_dict: 35.5 us +- 1.3 us -> 34.8 us +- 0.3 us: 1.02x faster (-2%)
- pickle_list: 5.32 us +- 0.09 us -> 5.23 us +- 0.09 us: 1.02x faster (-2%)
- pyflate: 883 ms +- 7 ms -> 867 ms +- 6 ms: 1.02x faster (-2%)
- scimark_sor: 264 ms +- 2 ms -> 259 ms +- 2 ms: 1.02x faster (-2%)
- sqlite_synth: 4.04 us +- 0.10 us -> 3.98 us +- 0.09 us: 1.02x faster (-1%)
- regex_dna: 243 ms +- 3 ms -> 240 ms +- 1 ms: 1.01x faster (-1%)
- crypto_pyaes: 165 ms +- 3 ms -> 163 ms +- 1 ms: 1.01x faster (-1%)

Benchmark hidden because not significant (41)

----------
nosy:  -pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24165>
_______________________________________

From report at bugs.python.org  Thu Oct 22 22:30:27 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 23 Oct 2020 02:30:27 +0000
Subject: [issue2190] MozillaCookieJar ignores HttpOnly cookies
In-Reply-To: <1203957546.34.0.123660895963.issue2190@psf.upfronthosting.co.za>
Message-ID: <1603420227.45.0.464869823077.issue2190@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
assignee: loewis -> 
status: closed -> open
versions:  -Python 3.2, Python 3.3, Python 3.4, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2190>
_______________________________________

From report at bugs.python.org  Thu Oct 22 22:30:49 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Fri, 23 Oct 2020 02:30:49 +0000
Subject: [issue24165] Free list for single-digits ints
In-Reply-To: <1431352769.3.0.375640200007.issue24165@psf.upfronthosting.co.za>
Message-ID: <1603420249.13.0.700792666963.issue24165@roundup.psfhosted.org>


Change by Yury Selivanov <yselivanov at gmail.com>:


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24165>
_______________________________________

From report at bugs.python.org  Thu Oct 22 22:33:38 2020
From: report at bugs.python.org (Yury Selivanov)
Date: Fri, 23 Oct 2020 02:33:38 +0000
Subject: [issue24165] Free list for single-digits ints
In-Reply-To: <1431352769.3.0.375640200007.issue24165@psf.upfronthosting.co.za>
Message-ID: <1603420418.32.0.781808294115.issue24165@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

Inada-san, how do you interpret the results? Looks like it's performance-neutral.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24165>
_______________________________________

From report at bugs.python.org  Thu Oct 22 22:34:27 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 23 Oct 2020 02:34:27 +0000
Subject: [issue42124] FAIL test_asyncio
 test_sendfile_close_peer_in_the_middle_of_receiving
Message-ID: <1603420467.19.0.337945390908.issue42124@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

======================================================================
FAIL: test_sendfile_close_peer_in_the_middle_of_receiving (test.test_asyncio.test_sendfile.ProactorEventLoopTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\a\1\s\lib\test\test_asyncio\test_sendfile.py", line 458, in test_sendfile_close_peer_in_the_middle_of_receiving
    self.run_loop(
AssertionError: ConnectionError not raised

----------
components: Tests, asyncio
messages: 379397
nosy: asvetlov, terry.reedy, yselivanov
priority: normal
severity: normal
stage: needs patch
status: open
title: FAIL test_asyncio test_sendfile_close_peer_in_the_middle_of_receiving
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42124>
_______________________________________

From report at bugs.python.org  Thu Oct 22 22:49:11 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 23 Oct 2020 02:49:11 +0000
Subject: [issue2190] MozillaCookieJar ignores HttpOnly cookies
In-Reply-To: <1203957546.34.0.123660895963.issue2190@psf.upfronthosting.co.za>
Message-ID: <1603421351.68.0.660170681492.issue2190@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

https://developer.mozilla.org/en-US/docs/Web/HTTP/Cookies
Describes the purpose of the HttpOnly attribute used in PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2190>
_______________________________________

From report at bugs.python.org  Thu Oct 22 23:21:19 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 23 Oct 2020 03:21:19 +0000
Subject: [issue24165] Free list for single-digits ints
In-Reply-To: <1431352769.3.0.375640200007.issue24165@psf.upfronthosting.co.za>
Message-ID: <1603423279.43.0.132255733574.issue24165@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I had suspected that pypeformance just don't have enough workload for non-small int.

For example, spectral_norm is integer heavy + some float warkload. But bm_spectral_norm uses `DEFAULT_N = 130`. So most integers are fit into smallint cache.

On the othar hand, spectral_norm in the benchmarkgame uses N=5500.
https://benchmarksgame-team.pages.debian.net/benchmarksgame/program/spectralnorm-python3-8.html

So I ran the benchmark on my machine:

master:
real    1m24.647s
user    5m37.515s

patched:
real    1m19.033s
user    5m14.682s

master+increased small int from [-5, 256] to [-9, 1024]
real    1m23.742s
user    5m33.569s


314.682/337.515 = 0.9323496733478512. So ther is only 7% speedup even when N=5500.

After all, I think it is doubtful. Let's stop this idea until situation is  changed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24165>
_______________________________________

From report at bugs.python.org  Thu Oct 22 23:39:01 2020
From: report at bugs.python.org (Atsuo Ishimoto)
Date: Fri, 23 Oct 2020 03:39:01 +0000
Subject: [issue41567] multiprocessing.Pool from concurrent threads failure on
 3.9.0rc1
In-Reply-To: <1597664250.53.0.724586569237.issue41567@roundup.psfhosted.org>
Message-ID: <1603424341.07.0.707691113731.issue41567@roundup.psfhosted.org>


Atsuo Ishimoto <ishimoto at python.jp> added the comment:

multiprocessing module used to work multithread environment until https://bugs.python.org/issue35943 merged.

I guess we can make multiprocessing thread-safe again if we move local imports to global.
Does it make sense?

----------
nosy: +ishimoto

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41567>
_______________________________________

From report at bugs.python.org  Thu Oct 22 23:41:28 2020
From: report at bugs.python.org (Atsuo Ishimoto)
Date: Fri, 23 Oct 2020 03:41:28 +0000
Subject: [issue41567] multiprocessing.Pool from concurrent threads failure on
 3.9.0rc1
In-Reply-To: <1597664250.53.0.724586569237.issue41567@roundup.psfhosted.org>
Message-ID: <1603424488.68.0.421740604919.issue41567@roundup.psfhosted.org>


Atsuo Ishimoto <ishimoto at python.jp> added the comment:

Some my observation at https://discuss.python.org/t/differences-between-3-8-and-3-9-in-importing-module/5520 .

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41567>
_______________________________________

From report at bugs.python.org  Thu Oct 22 23:44:12 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Fri, 23 Oct 2020 03:44:12 +0000
Subject: [issue6555] distutils config file should have the same name on both
 platforms and all scopes
In-Reply-To: <1248379635.87.0.00387112145543.issue6555@psf.upfronthosting.co.za>
Message-ID: <1603424652.88.0.981161410452.issue6555@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Too late to change this in distutils now.

----------
components:  -Distutils2
nosy: +dstufft
resolution: accepted -> wont fix
stage:  -> resolved
status: open -> closed
versions:  -3rd party, Python 2.7, Python 3.1, Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6555>
_______________________________________

From report at bugs.python.org  Thu Oct 22 23:51:23 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Fri, 23 Oct 2020 03:51:23 +0000
Subject: [issue8918] distutils test_config_cmd failure on Solaris
In-Reply-To: <1275846660.59.0.731483262347.issue8918@psf.upfronthosting.co.za>
Message-ID: <1603425083.55.0.139833021671.issue8918@roundup.psfhosted.org>


Change by ?ric Araujo <merwok at netwok.org>:


----------
assignee: eric.araujo -> 
components:  -Distutils2
nosy: +dstufft
resolution:  -> out of date
stage: test needed -> resolved
status: open -> closed
versions:  -3rd party

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue8918>
_______________________________________

From report at bugs.python.org  Thu Oct 22 23:54:45 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Fri, 23 Oct 2020 03:54:45 +0000
Subject: [issue26541] Add stop_after parameter to setup()
In-Reply-To: <1457718997.42.0.688813904458.issue26541@psf.upfronthosting.co.za>
Message-ID: <1603425285.72.0.311099088201.issue26541@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

distutils isn?t improved anymore.

This might interest the setuptools project, which uses its copy of distutils.

----------
nosy: +jaraco -dstufft
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26541>
_______________________________________

From report at bugs.python.org  Thu Oct 22 23:55:35 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Fri, 23 Oct 2020 03:55:35 +0000
Subject: [issue19394] distutils.core.Extension: empty strings in library_dirs
 and include_dirs should not be allowed
In-Reply-To: <1382724028.67.0.461727040571.issue19394@psf.upfronthosting.co.za>
Message-ID: <1603425335.71.0.882831109434.issue19394@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

distutils isn?t improved anymore.

----------
assignee: eric.araujo -> 
nosy: +jaraco -tarek
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19394>
_______________________________________

From report at bugs.python.org  Fri Oct 23 00:01:39 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Fri, 23 Oct 2020 04:01:39 +0000
Subject: [issue12308] Add link to PEP 0 for topical index in wiki
In-Reply-To: <1307685938.0.0.639002265247.issue12308@psf.upfronthosting.co.za>
Message-ID: <1603425699.04.0.899886716862.issue12308@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Hi Eric!  Are you still interested in this?  I notice that the wiki page hasn?t been updated, and it?s also kind of a dry list with no interactivity (search, sort, jump to section, hyperlinks to PEPs).  Are you still interested?  If yes, do you still think that it is more accessible to edits on the wiki rather than in the PEPs repo (which can get PRs)?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12308>
_______________________________________

From report at bugs.python.org  Fri Oct 23 00:17:05 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Fri, 23 Oct 2020 04:17:05 +0000
Subject: [issue17514] Add the license to argparse.py
In-Reply-To: <1363911732.52.0.330096157772.issue17514@psf.upfronthosting.co.za>
Message-ID: <1603426625.45.0.134212527505.issue17514@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Agreed with the latest comment!

----------
nosy: +eric.araujo, rhettinger
resolution:  -> works for me
stage:  -> resolved
status: open -> closed
versions:  -Python 2.7, Python 3.2, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17514>
_______________________________________

From report at bugs.python.org  Fri Oct 23 00:40:35 2020
From: report at bugs.python.org (Enji Cooper)
Date: Fri, 23 Oct 2020 04:40:35 +0000
Subject: [issue13501] Make libedit support more generic;
 port readline / libedit to FreeBSD
In-Reply-To: <1322579942.3.0.601983912656.issue13501@psf.upfronthosting.co.za>
Message-ID: <1603428035.1.0.0580306048392.issue13501@roundup.psfhosted.org>


Enji Cooper <yaneurabeya at gmail.com> added the comment:

Is there something I can do to help move this change along? 8 years is a long time for an issue to be open :(.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13501>
_______________________________________

From report at bugs.python.org  Fri Oct 23 01:26:53 2020
From: report at bugs.python.org (Eugene Toder)
Date: Fri, 23 Oct 2020 05:26:53 +0000
Subject: [issue42125] linecache cannot get source for the __main__ module with
 a custom loader
Message-ID: <1603430813.16.0.973913314648.issue42125@roundup.psfhosted.org>


New submission from Eugene Toder <eltoder at gmail.com>:

If a module has a loader, linecache calls its get_source() passing __name__ as the argument. This works most of the time, except that the __main__ module has it set to "__main__", which is commonly not the real name of the module. Luckily, we now have __spec__ which has the real name, so we can just use it.

Attached zip file reproduces the problem:
$ python t.zip
Traceback (most recent call last):
  ...
  File "t.zip/t.py", line 11, in <module>
  File "t.zip/t.py", line 8, in f
  File "t.zip/t.py", line 8, in f
  File "t.zip/t.py", line 8, in f
  [Previous line repeated 2 more times]
  File "t.zip/t.py", line 7, in f
ValueError

Note that entries from t.py don't have source code lines.

----------
components: Library (Lib)
files: t.zip
messages: 379408
nosy: eltoder
priority: normal
severity: normal
status: open
title: linecache cannot get source for the __main__ module with a custom loader
type: behavior
versions: Python 3.10
Added file: https://bugs.python.org/file49536/t.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42125>
_______________________________________

From report at bugs.python.org  Fri Oct 23 01:30:25 2020
From: report at bugs.python.org (Roundup Robot)
Date: Fri, 23 Oct 2020 05:30:25 +0000
Subject: [issue42125] linecache cannot get source for the __main__ module with
 a custom loader
In-Reply-To: <1603430813.16.0.973913314648.issue42125@roundup.psfhosted.org>
Message-ID: <1603431025.9.0.898353656318.issue42125@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 1.0 -> 2.0
pull_requests: +21839
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22908

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42125>
_______________________________________

From report at bugs.python.org  Fri Oct 23 01:36:15 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 23 Oct 2020 05:36:15 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1603431375.52.0.479940758218.issue41835@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
keywords: +patch
pull_requests: +21840
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22909

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Fri Oct 23 01:47:40 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 23 Oct 2020 05:47:40 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1603432060.5.0.950074438714.issue41835@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Ok. Performance improvement comes from:

a. Presizing
b. Bypassing some checks in PyDict_SetItem
c. Avoiding duplication check.

(b) is relatively small so I tried to focus on (a) and (b). See GH-22909.

In case of simple keyword arguments, it is 10% faster than GH-22346:

```
$ ./python -m pyperf timeit --compare-to ./python-speedup_kw "dict(ihinvdono='doononon', gowwondwon='nwog', bdjbodbob='nidnnpn', nwonwno='vndononon', dooodbob='iohiwipwgpw', doidonooq='ndwnnpnpnp', fndionqinqn='ndjboqoqjb', nonoeoqgoqb='bdboboqbgoqeb', jdnvonvoddo='nvdjnvndvonoq', njnvodnoo='hiehgieba', nvdnvwnnp='wghgihpa', nvfnwnnq='nvdknnnqkm', ndonvnipnq='fndjnaobobvob', fjafosboab='ndjnodvobvojb', nownwnojwjw='nvknnndnow', niownviwnwnwi='nownvwinvwnwnwj')"
python-speedup_kw: ..................... 357 ns +- 10 ns
python: ..................... 323 ns +- 4 ns

Mean +- std dev: [python-speedup_kw] 357 ns +- 10 ns -> [python] 323 ns +- 4 ns: 1.11x faster (-10%)
```

In case of `dict(d, key=val)` case, it is 8% slower than GH-22346, but still 8% faster than master.

```
$ ./python -m pyperf timeit --compare-to ./python-speedup_kw -s 'd={"foo":"bar"}' "dict(d, ihinvdono='doononon', gowwondwon='nwog', bdjbodbob='nidnnpn', nwonwno='vndononon', dooodbob='iohiwipwgpw', doidonooq='ndwnnpnpnp', fndionqinqn='ndjboqoqjb', nonoeoqgoqb='bdboboqbgoqeb', jdnvonvoddo='nvdjnvndvonoq', njnvodnoo='hiehgieba', nvdnvwnnp='wghgihpa', nvfnwnnq='nvdknnnqkm', ndonvnipnq='fndjnaobobvob', fjafosboab='ndjnodvobvojb', nownwnojwjw='nvknnndnow', niownviwnwnwi='nownvwinvwnwnwj')"
python-speedup_kw: ..................... 505 ns +- 15 ns
python: ..................... 546 ns +- 17 ns

Mean +- std dev: [python-speedup_kw] 505 ns +- 15 ns -> [python] 546 ns +- 17 ns: 1.08x slower (+8%)

$ ./python -m pyperf timeit --compare-to ./python-master -s 'd={"foo":"bar"}' "dict(d, ihinvdono='doononon', gowwondwon='nwog', bdjbodbob='nidnnpn', nwonwno='vndononon', dooodbob='iohiwipwgpw', doidonooq='ndwnnpnpnp', fndionqinqn='ndjboqoqjb', nonoeoqgoqb='bdboboqbgoqeb', jdnvonvoddo='nvdjnvndvonoq', njnvodnoo='hiehgieba', nvdnvwnnp='wghgihpa', nvfnwnnq='nvdknnnqkm', ndonvnipnq='fndjnaobobvob', fjafosboab='ndjnodvobvojb', nownwnojwjw='nvknnndnow', niownviwnwnwi='nownvwinvwnwnwj')"
python-master: ..................... 598 ns +- 10 ns
python: ..................... 549 ns +- 19 ns

Mean +- std dev: [python-master] 598 ns +- 10 ns -> [python] 549 ns +- 19 ns: 1.09x faster (-8%)
```

Additionally, I expect we can reuse this new code to optimize BUILD_CONST_KEY_MAP.

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Fri Oct 23 03:36:52 2020
From: report at bugs.python.org (Alex Roussel)
Date: Fri, 23 Oct 2020 07:36:52 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603438612.79.0.802406813386.issue42096@roundup.psfhosted.org>


Alex Roussel <alexandredrr14 at gmail.com> added the comment:

The impression I got from reading https://bugs.python.org/issue28494 was that this was fixed in python 3.7 ? Or perhaps as you say it's just a matter of stumbling across the rare files that generate false positives.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Fri Oct 23 04:10:16 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 08:10:16 +0000
Subject: [issue8084] pep-0370 on osx duplicates existing functionality
In-Reply-To: <1267964951.32.0.7992829434.issue8084@psf.upfronthosting.co.za>
Message-ID: <1603440616.53.0.55346136336.issue8084@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue8084>
_______________________________________

From report at bugs.python.org  Fri Oct 23 04:30:00 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 08:30:00 +0000
Subject: [issue38443] unavailable --with-universal-archs= macOS confgure
 options fail cryptically
In-Reply-To: <1570780434.84.0.507087684939.issue38443@roundup.psfhosted.org>
Message-ID: <1603441800.96.0.663588153782.issue38443@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
keywords: +patch
pull_requests: +21841
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22910

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38443>
_______________________________________

From report at bugs.python.org  Fri Oct 23 04:31:52 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 08:31:52 +0000
Subject: [issue38443] unavailable --with-universal-archs= macOS confgure
 options fail cryptically
In-Reply-To: <1570780434.84.0.507087684939.issue38443@roundup.psfhosted.org>
Message-ID: <1603441912.12.0.461117652739.issue38443@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I've added a PR with a variation of my earlier patch. This version will bail out when specifying "--enable-universalsdk" with a version of Xcode that does not support i386 (the previous patch did not).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38443>
_______________________________________

From report at bugs.python.org  Fri Oct 23 04:39:29 2020
From: report at bugs.python.org (Georges)
Date: Fri, 23 Oct 2020 08:39:29 +0000
Subject: [issue30681] email.utils.parsedate_to_datetime() should return None
 when date cannot be parsed
In-Reply-To: <1497568363.46.0.596536376967.issue30681@psf.upfronthosting.co.za>
Message-ID: <1603442369.41.0.131342118028.issue30681@roundup.psfhosted.org>


Georges <georges.toth at govcert.etat.lu> added the comment:

@barry Thank you for your input on the PR.

>From what I understood this PR was nearly ready and only missing a small addition to the documentation which I added. So it took me a bit to go through it all :-).

I actually don't see how *parsedate_to_datetime* would ever return None. It is *_parsedate_tz* which returns None on bogus input, in which case *parsedate_to_datetime* raises a TypeError.
This is also covered in the tests, so those should be fine.

In order to continue I suggest to fix the documentation on *parsedate_to_datetime*, remove the mention of it returning None and replacing it with it possibly returning TypeError in case of an invalid date input.

Does that make sense ?


Regarding the backporting, as a user of this I must admit that it would be much appreciated if this could be backported :-).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30681>
_______________________________________

From report at bugs.python.org  Fri Oct 23 04:40:03 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 23 Oct 2020 08:40:03 +0000
Subject: [issue34394] Descriptors HowTo doesn't mention __set_name__
In-Reply-To: <1534163786.32.0.56676864532.issue34394@psf.upfronthosting.co.za>
Message-ID: <1603442403.06.0.899352132852.issue34394@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

See https://github.com/python/cpython/pull/22906

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34394>
_______________________________________

From report at bugs.python.org  Fri Oct 23 04:43:42 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 08:43:42 +0000
Subject: [issue42122] macOS complains about how fonts are accessed
In-Reply-To: <1603409230.0.0.859933553088.issue42122@roundup.psfhosted.org>
Message-ID: <1603442622.62.0.972709506503.issue42122@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Raymond,

- What version of macOS are you on?
- How did you install python 3.10? Did you use the python.org installer?
- What version of Tk is used?
  (This can be found in the output of `python3.9 -m test.pythoninfo`)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42122>
_______________________________________

From report at bugs.python.org  Fri Oct 23 04:46:51 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 23 Oct 2020 08:46:51 +0000
Subject: [issue42126] Optimize BUILD_CONST_KEY_MAP for distinct keys
Message-ID: <1603442811.66.0.361695425892.issue42126@roundup.psfhosted.org>


New submission from Inada Naoki <songofacandy at gmail.com>:

BUILD_CONST_KEY_MAP can be optimized based on #41835 optimization.

1. compiler checks keys tuple is distinct.
2. Add distinct flag to BUILD_CONST_KEY_MAP oparg

To be considered:

* Should we use new opcode, instead of flag in oparg?
* Is this technique safe? Wrong co_consts can make invalid dict instance.

----------
assignee: methane
components: Interpreter Core
messages: 379415
nosy: methane
priority: normal
severity: normal
status: open
title: Optimize BUILD_CONST_KEY_MAP for distinct keys
type: performance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42126>
_______________________________________

From report at bugs.python.org  Fri Oct 23 04:54:41 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Fri, 23 Oct 2020 08:54:41 +0000
Subject: [issue42035] [C API] PyType_GetSlot cannot get tp_name
In-Reply-To: <1602683525.08.0.938781399322.issue42035@roundup.psfhosted.org>
Message-ID: <1603443281.42.0.875025328817.issue42035@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Yes, for some cases the ship has sailed. I don't think we can add unions now -- the stable ABI needs to be stable.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42035>
_______________________________________

From report at bugs.python.org  Fri Oct 23 04:54:42 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 08:54:42 +0000
Subject: [issue9405] Test fix for past crash when calling urllib.getproxies()
 under OSX with subprocess / particular memory usage
In-Reply-To: <1280352635.35.0.910645426575.issue9405@psf.upfronthosting.co.za>
Message-ID: <1603443282.48.0.294893587093.issue9405@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
resolution:  -> out of date
stage: test needed -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9405>
_______________________________________

From report at bugs.python.org  Fri Oct 23 05:02:34 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 09:02:34 +0000
Subject: [issue19733] Setting image parameter of a button crashes with Cocoa Tk
In-Reply-To: <1385212186.78.0.599244063108.issue19733@psf.upfronthosting.co.za>
Message-ID: <1603443754.22.0.621095755861.issue19733@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

It looks like the test can be reenabled.

System: macOS 10.15, with Python 3.9 from Python.org

``python3.9 -m tkinter.test.test_tkinter.test_widgets`` runs without problems (571 tests, no crash), even if I remove the skip for test_image.

Likewise for ``python3.9 -m unittest discover tkinter.test.test_tkinter`` (703 tests)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19733>
_______________________________________

From report at bugs.python.org  Fri Oct 23 05:05:06 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 23 Oct 2020 09:05:06 +0000
Subject: [issue42126] Optimize BUILD_CONST_KEY_MAP for distinct keys
In-Reply-To: <1603442811.66.0.361695425892.issue42126@roundup.psfhosted.org>
Message-ID: <1603443906.36.0.365530165204.issue42126@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
keywords: +patch
pull_requests: +21842
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22911

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42126>
_______________________________________

From report at bugs.python.org  Fri Oct 23 05:08:35 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 09:08:35 +0000
Subject: [issue28491] Remove bundled libffi for OSX
In-Reply-To: <1476988827.6.0.878520006506.issue28491@psf.upfronthosting.co.za>
Message-ID: <1603444115.81.0.210681643871.issue28491@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

added 41100 as a dependency because that switches to the system libffi (as a side effect of larger changes)

----------
dependencies: +Build failure on macOS 11 (beta)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28491>
_______________________________________

From report at bugs.python.org  Fri Oct 23 05:06:19 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 09:06:19 +0000
Subject: [issue23534] `test_longdouble` fails on Mac when using system libffi
 (version 3.1)
In-Reply-To: <1425020250.66.0.941803975171.issue23534@psf.upfronthosting.co.za>
Message-ID: <1603443979.59.0.889640950541.issue23534@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Closing as out of date:

- python 2 issue
- I don't get this error when using the system libffi (bpo-41100)

----------
resolution:  -> out of date
stage:  -> resolved

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23534>
_______________________________________

From report at bugs.python.org  Fri Oct 23 05:12:37 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 09:12:37 +0000
Subject: [issue33090] race condition between send and recv in _ssl with
 non-zero timeout
In-Reply-To: <1521229390.38.0.467229070634.issue33090@psf.upfronthosting.co.za>
Message-ID: <1603444357.76.0.911711668795.issue33090@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

The script still fails on macOS 10.15 with python 3.9 (installed from python.org).

Interestingly enough:
- First run of the script worked without any problems
- Subsequent runs failed with various errors:

$ python3.9 t.py
Got connection from ('127.0.0.1', 60640)
Exception in thread ReadThread:
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/threading.py", line 950, in _bootstrap_inner
    self.run()
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/threading.py", line 888, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/ronald/Projects/python/github/cpython-ronald/t.py", line 93, in read_thread
    csocket.recv()
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/ssl.py", line 1226, in recv
    return self.read(buflen)
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/ssl.py", line 1101, in read
    return self._sslobj.read(len)
BlockingIOError: [Errno 35] Resource temporarily unavailable


----

Got connection from ('127.0.0.1', 60651)
.Traceback (most recent call last):
  File "/Users/ronald/Projects/python/github/cpython-ronald/t.py", line 74, in server_thread
Exception in thread WriteThread:
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/threading.py", line 950, in _bootstrap_inner
Exception in thread ReadThread:
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/threading.py", line 950, in _bootstrap_inner
    deal_with_client(newsocket)
  File "/Users/ronald/Projects/python/github/cpython-ronald/t.py", line 68, in deal_with_client
    data = connstream.read()
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/ssl.py", line 1101, in read
    self.run()
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/threading.py", line 888, in run
    self.run()
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/threading.py", line 888, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/ronald/Projects/python/github/cpython-ronald/t.py", line 93, in read_thread
    self._target(*self._args, **self._kwargs)
  File "/Users/ronald/Projects/python/github/cpython-ronald/t.py", line 89, in write_thread
    return self._sslobj.read(len)
    csocket.recv()
ssl.SSLError: [SSL: DECRYPTION_FAILED_OR_BAD_RECORD_MAC] decryption failed or bad record mac (_ssl.c:2621)
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/ssl.py", line 1226, in recv
    csocket.send(b'blah')
Closed connection from ('127.0.0.1', 60651)
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/ssl.py", line 1173, in send
    return self.read(buflen)
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/ssl.py", line 1101, in read
    return self._sslobj.write(data)
ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:2471)
    return self._sslobj.read(len)
ssl.SSLError: [SSL: SSLV3_ALERT_BAD_RECORD_MAC] sslv3 alert bad record mac (_ssl.c:2621)

----

Got connection from ('127.0.0.1', 60636)
.Exception in thread ReadThread:
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/threading.py", line 950, in _bootstrap_inner
Traceback (most recent call last):
  File "/Users/ronald/Projects/python/github/cpython-ronald/t.py", line 74, in server_thread
    self.run()
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/threading.py", line 888, in run
    deal_with_client(newsocket)
  File "/Users/ronald/Projects/python/github/cpython-ronald/t.py", line 68, in deal_with_client
    self._target(*self._args, **self._kwargs)
  File "/Users/ronald/Projects/python/github/cpython-ronald/t.py", line 93, in read_thread
    csocket.recv()
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/ssl.py", line 1226, in recv
    data = connstream.read()
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/ssl.py", line 1101, in read
    return self.read(buflen)
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/ssl.py", line 1101, in read
    return self._sslobj.read(len)
    return self._sslobj.read(len)
ssl.SSLError: [SSL: DECRYPTION_FAILED_OR_BAD_RECORD_MAC] decryption failed or bad record mac (_ssl.c:2621)
Closed connection from ('127.0.0.1', 60636)
BlockingIOError: [Errno 35] Resource temporarily unavailable
Exception in thread WriteThread:
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/threading.py", line 950, in _bootstrap_inner

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33090>
_______________________________________

From report at bugs.python.org  Fri Oct 23 05:16:08 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 09:16:08 +0000
Subject: [issue31359] `configure` script incorrectly detects symbols as
 available on Mac w/ Xcode 8+
In-Reply-To: <1504665226.84.0.383465332946.issue31359@psf.upfronthosting.co.za>
Message-ID: <1603444568.71.0.880126857391.issue31359@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Added 41100 as a dependency because the active PR for that issue will fix this issue as well.

----------
dependencies: +Build failure on macOS 11 (beta)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31359>
_______________________________________

From report at bugs.python.org  Fri Oct 23 05:32:12 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Fri, 23 Oct 2020 09:32:12 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603445532.42.0.224876122073.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

This is the approach in the PR:

    # JUMP_BOTH
    while ...:
        if haystack[j + cut] != needle[cut]:
            # Sunday skip
            j += table[haystack[j + len(needle)]]
            continue
        j += rest_of_the_two_way_algorithm()

If I understand correctly, this is what you're suggesting:

    # JUMP_MAX
    while ...:
        shift = rest_of_the_two_way_algorithm()
        j += max(shift, table[haystack[j + len(needle)]])

I implemented this and on my Zipf benchmark, and JUMP_BOTH was faster on 410 cases (at most 1.86x faster), while JUMP_MAX was faster on 179 cases (at most 1.3x faster).

Some things to notice about the JUMP_BOTH approach:

* The if-statement is actually the first step of the rest_of_the_two_way_algorithm, so there's no extra comparison over the pure two-way algorithm.

* The if-block only executes in situations where the two-way algorithm would say to skip ahead by only 1. In all other situations, the two-way algorithm skips by at least 2.

The typical purpose of the Sunday skip (as far as I can tell) is that in Sunday's algorithm, we find a mismatch, then have no a priori idea of how far ahead to skip, other than knowing that it has to be at least 1, so we check the character 1 to the right of the window. Another way of thinking about this would be to increment the window by 1, look at the last character in the new window, and jump ahead to line it up.

However, with the hybrid method of the PR, we *do* have some a priori skip, bigger than 1, known before we check the table. So instead of doing the maximum of the two-way skip and the Sunday skip, why not do both? As in: do the two-way shift, then extend that with a Sunday shift in the next iteration.

I tried another version also with this in mind, something like:

    # JUMP_AFTER
    while ...:
        # Guaranteed to jump to a mismatched poisition
        j += rest_of_the_two_way_algorithm() - 1
        j += table[haystack[j + len(needle)]]

But this resulted in slightly-worse performance: JUMP_BOTH was faster in 344 cases (at most 1.9x faster), while JUMP_AFTER was faster in 265 cases (at most 1.32x faster). My guess for the explanation of this is that since most of the time is spent on Sunday shifts lining up the cut character, it's beneficial for the compiler to generate specialized code for that case.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Fri Oct 23 05:36:08 2020
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 23 Oct 2020 09:36:08 +0000
Subject: [issue33090] race condition between send and recv in _ssl with
 non-zero timeout
In-Reply-To: <1521229390.38.0.467229070634.issue33090@psf.upfronthosting.co.za>
Message-ID: <1603445768.74.0.81974951077.issue33090@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

The demo script uses the same connection socket in two threads. Neither OpenSSL nor Python guarantee that a single SSLSocket object can be used by multiple threads. https://www.openssl.org/blog/blog/2017/02/21/threads/ contains more information about thread safety.

tl;dr SSLObject and SSLSocket cannot be safely used by multiple threads at the same time. SSLContext can be shared across multiple threads. However it's not safe to reconfigure a context once it's attached to a connection. Only getters, wrap_*(), and load_verify_locations() are safe.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33090>
_______________________________________

From report at bugs.python.org  Fri Oct 23 05:37:06 2020
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 23 Oct 2020 09:37:06 +0000
Subject: [issue33090] race condition between send and recv in _ssl with
 non-zero timeout
In-Reply-To: <1521229390.38.0.467229070634.issue33090@psf.upfronthosting.co.za>
Message-ID: <1603445826.46.0.414682470162.issue33090@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

I'm turning this into a docs bug.

----------
assignee: christian.heimes -> docs at python
components: +Documentation -macOS
nosy: +docs at python
stage:  -> needs patch
type: crash -> enhancement
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.7, Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33090>
_______________________________________

From report at bugs.python.org  Fri Oct 23 06:01:34 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 23 Oct 2020 10:01:34 +0000
Subject: [issue42122] macOS complains about how fonts are accessed
In-Reply-To: <1603409230.0.0.859933553088.issue42122@roundup.psfhosted.org>
Message-ID: <1603447294.21.0.424481169133.issue42122@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

python.org 3.10 mac is still using 8.6.8.  It is on IDLE/Python => About

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42122>
_______________________________________

From report at bugs.python.org  Fri Oct 23 06:08:40 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 23 Oct 2020 10:08:40 +0000
Subject: [issue40592] `Shutil.which` incosistent with windows's `where`
In-Reply-To: <1589187015.71.0.593402074503.issue40592@roundup.psfhosted.org>
Message-ID: <1603447720.92.0.75447491824.issue40592@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 6.0 -> 7.0
pull_requests: +21843
pull_request: https://github.com/python/cpython/pull/22912

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40592>
_______________________________________

From report at bugs.python.org  Fri Oct 23 06:08:35 2020
From: report at bugs.python.org (Steve Dower)
Date: Fri, 23 Oct 2020 10:08:35 +0000
Subject: [issue40592] `Shutil.which` incosistent with windows's `where`
In-Reply-To: <1589187015.71.0.593402074503.issue40592@roundup.psfhosted.org>
Message-ID: <1603447715.31.0.507565706022.issue40592@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset da6f098188c9825f10ae60db8987056b3a54c2e8 by Christopher Marchfelder in branch 'master':
bpo-40592: shutil.which will not return None anymore if ; is the last char in PATHEXT (GH-20088)
https://github.com/python/cpython/commit/da6f098188c9825f10ae60db8987056b3a54c2e8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40592>
_______________________________________

From report at bugs.python.org  Fri Oct 23 06:08:49 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 23 Oct 2020 10:08:49 +0000
Subject: [issue40592] `Shutil.which` incosistent with windows's `where`
In-Reply-To: <1589187015.71.0.593402074503.issue40592@roundup.psfhosted.org>
Message-ID: <1603447729.43.0.399802228691.issue40592@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21844
pull_request: https://github.com/python/cpython/pull/22913

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40592>
_______________________________________

From report at bugs.python.org  Fri Oct 23 06:09:45 2020
From: report at bugs.python.org (Steve Dower)
Date: Fri, 23 Oct 2020 10:09:45 +0000
Subject: [issue40592] `Shutil.which` incosistent with windows's `where`
In-Reply-To: <1589187015.71.0.593402074503.issue40592@roundup.psfhosted.org>
Message-ID: <1603447785.93.0.988958008439.issue40592@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Thanks for the contribution! Looking forward to your next one :)

----------
nosy:  -miss-islington
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40592>
_______________________________________

From report at bugs.python.org  Fri Oct 23 06:33:16 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 10:33:16 +0000
Subject: [issue37586] macOS: posix_spawn(..., setsid=True)
In-Reply-To: <1563024457.33.0.250849204696.issue37586@roundup.psfhosted.org>
Message-ID: <1603449196.38.0.847469713187.issue37586@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I'm including a fix for this in the active PR on bpo-41100

----------
dependencies: +Build failure on macOS 11 (beta)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37586>
_______________________________________

From report at bugs.python.org  Fri Oct 23 07:10:04 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 23 Oct 2020 11:10:04 +0000
Subject: [issue23534] `test_longdouble` fails on Mac when using system libffi
 (version 3.1)
In-Reply-To: <1425020250.66.0.941803975171.issue23534@psf.upfronthosting.co.za>
Message-ID: <1603451404.16.0.883768989539.issue23534@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23534>
_______________________________________

From report at bugs.python.org  Fri Oct 23 07:16:57 2020
From: report at bugs.python.org (=?utf-8?q?Lum=C3=ADr_Balhar?=)
Date: Fri, 23 Oct 2020 11:16:57 +0000
Subject: [issue39825] EXT_SUFFIX inconsistent between sysconfig and
 distutils.sysconfig (Windows)
In-Reply-To: <1583156407.62.0.364374237882.issue39825@roundup.psfhosted.org>
Message-ID: <1603451817.93.0.860337863843.issue39825@roundup.psfhosted.org>


Change by Lum?r Balhar <frenzy.madness at gmail.com>:


----------
nosy: +frenzy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39825>
_______________________________________

From report at bugs.python.org  Fri Oct 23 07:18:29 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 11:18:29 +0000
Subject: [issue42122] macOS complains about how fonts are accessed
In-Reply-To: <1603409230.0.0.859933553088.issue42122@roundup.psfhosted.org>
Message-ID: <1603451909.68.0.424657764993.issue42122@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I know, but what I don't know is if Raymond uses the python.org installer. The initial message seems to indicate he's using a local build ("python.exe"). 

That will by default pick up the system version of Tk, which is ancient and is known to have problems.


And for completeness sake: I don't get these warnings, neither in IDLE nor when using your scriptlet (adjusted to try all fonts in "frames').

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42122>
_______________________________________

From report at bugs.python.org  Fri Oct 23 07:19:57 2020
From: report at bugs.python.org (=?utf-8?q?Lum=C3=ADr_Balhar?=)
Date: Fri, 23 Oct 2020 11:19:57 +0000
Subject: [issue24908] sysconfig.py and distutils.sysconfig.py disagree on
 directory spelling on Windows
In-Reply-To: <1440156019.56.0.0846148968613.issue24908@psf.upfronthosting.co.za>
Message-ID: <1603451997.35.0.752868945213.issue24908@roundup.psfhosted.org>


Change by Lum?r Balhar <frenzy.madness at gmail.com>:


----------
nosy: +frenzy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24908>
_______________________________________

From report at bugs.python.org  Fri Oct 23 07:46:06 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 23 Oct 2020 11:46:06 +0000
Subject: [issue42126] Optimize BUILD_CONST_KEY_MAP for distinct keys
In-Reply-To: <1603442811.66.0.361695425892.issue42126@roundup.psfhosted.org>
Message-ID: <1603453566.21.0.651521403492.issue42126@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

$ ./python -m pyperf timeit --compare-to ~/pyenv/versions/3.10-dev/bin/python '{}'
/home/inada-n/pyenv/versions/3.10-dev/bin/python: ..................... 23.5 ns +- 0.2 ns
/home/inada-n/work/python/cpython/python: ..................... 22.4 ns +- 0.1 ns

Mean +- std dev: [/home/inada-n/pyenv/versions/3.10-dev/bin/python] 23.5 ns +- 0.2 ns -> [/home/inada-n/work/python/cpython/python] 22.4 ns +- 0.1 ns: 1.05x f
aster (-5%)

$ ./python -m pyperf timeit --compare-to ~/pyenv/versions/3.10-dev/bin/python '{1:1,2:2}'
/home/inada-n/pyenv/versions/3.10-dev/bin/python: ..................... 83.5 ns +- 0.3 ns
/home/inada-n/work/python/cpython/python: ..................... 96.7 ns +- 0.2 ns

Mean +- std dev: [/home/inada-n/pyenv/versions/3.10-dev/bin/python] 83.5 ns +- 0.3 ns -> [/home/inada-n/work/python/cpython/python] 96.7 ns +- 0.2 ns: 1.16x s
lower (+16%)

$ ./python -m pyperf timeit --compare-to ~/pyenv/versions/3.10-dev/bin/python '{1:1,2:2,3:3}'
/home/inada-n/pyenv/versions/3.10-dev/bin/python: ..................... 108 ns +- 0 ns
/home/inada-n/work/python/cpython/python: ..................... 110 ns +- 1 ns

Mean +- std dev: [/home/inada-n/pyenv/versions/3.10-dev/bin/python] 108 ns +- 0 ns -> [/home/inada-n/work/python/cpython/python] 110 ns +- 1 ns: 1.01x slower
(+1%)

$ ./python -m pyperf timeit --compare-to ~/pyenv/versions/3.10-dev/bin/python '{1:1,2:2,3:3,4:4}'
/home/inada-n/pyenv/versions/3.10-dev/bin/python: ..................... 134 ns +- 1 ns
/home/inada-n/work/python/cpython/python: ..................... 122 ns +- 1 ns

Mean +- std dev: [/home/inada-n/pyenv/versions/3.10-dev/bin/python] 134 ns +- 1 ns -> [/home/inada-n/work/python/cpython/python] 122 ns +- 1 ns: 1.10x faster
(-9%)

$ ./python -m pyperf timeit --compare-to ~/pyenv/versions/3.10-dev/bin/python '{1:1,2:2,3:3,4:4,5:5}'
/home/inada-n/pyenv/versions/3.10-dev/bin/python: ..................... 168 ns +- 1 ns
/home/inada-n/work/python/cpython/python: ..................... 112 ns +- 1 ns

Mean +- std dev: [/home/inada-n/pyenv/versions/3.10-dev/bin/python] 168 ns +- 1 ns -> [/home/inada-n/work/python/cpython/python] 112 ns +- 1 ns: 1.50x faster
(-33%)

$ ./python -m pyperf timeit --compare-to ~/pyenv/versions/3.10-dev/bin/python '{1:1,2:2,3:3,4:4,5:5,6:6}'
/home/inada-n/pyenv/versions/3.10-dev/bin/python: ..................... 223 ns +- 1 ns
/home/inada-n/work/python/cpython/python: ..................... 150 ns +- 4 ns

Mean +- std dev: [/home/inada-n/pyenv/versions/3.10-dev/bin/python] 223 ns +- 1 ns -> [/home/inada-n/work/python/cpython/python] 150 ns +- 4 ns: 1.48x faster
(-33%)

$ ./python -m pyperf timeit --compare-to ~/pyenv/versions/3.10-dev/bin/python '{1:1,2:2,3:3,4:4,5:5,6:6,7:7,8:8}'
/home/inada-n/pyenv/versions/3.10-dev/bin/python: ..................... 273 ns +- 1 ns
/home/inada-n/work/python/cpython/python: ..................... 177 ns +- 1 ns

Mean +- std dev: [/home/inada-n/pyenv/versions/3.10-dev/bin/python] 273 ns +- 1 ns -> [/home/inada-n/work/python/cpython/python] 177 ns +- 1 ns: 1.54x faster
(-35%)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42126>
_______________________________________

From report at bugs.python.org  Fri Oct 23 08:20:41 2020
From: report at bugs.python.org (Mark Shannon)
Date: Fri, 23 Oct 2020 12:20:41 +0000
Subject: [issue42126] Optimize BUILD_CONST_KEY_MAP for distinct keys
In-Reply-To: <1603442811.66.0.361695425892.issue42126@roundup.psfhosted.org>
Message-ID: <1603455641.13.0.824469278437.issue42126@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Is this worthwhile?

Statically, BUILD_CONST_KEY_MAP represents 0.14% of all bytecode instructions in the standard library, but only 0.03% of the bytecode instructions in functions.
Which suggests that dynamically only 1 in 3000 instructions executed is BUILD_CONST_KEY_MAP. The implication is that making BUILD_CONST_KEY_MAP more complex is just as likely to slow things down as speed them up.

Do you have any evidence that this will make a measurable difference?

----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42126>
_______________________________________

From report at bugs.python.org  Fri Oct 23 08:31:29 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Fri, 23 Oct 2020 12:31:29 +0000
Subject: [issue26515] Update extending/embedding docs to new way to build
 modules in C
In-Reply-To: <1457491421.2.0.684118231911.issue26515@psf.upfronthosting.co.za>
Message-ID: <1603456289.93.0.686205733066.issue26515@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

There is now PEP 630. Still not done enough to move it out of draft status, but usable for converting simple modules.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26515>
_______________________________________

From report at bugs.python.org  Fri Oct 23 08:55:12 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Fri, 23 Oct 2020 12:55:12 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1603457712.15.0.872611751589.issue41490@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
pull_requests: +21845
pull_request: https://github.com/python/cpython/pull/22915

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Fri Oct 23 09:21:20 2020
From: report at bugs.python.org (Blaze Spinnaker)
Date: Fri, 23 Oct 2020 13:21:20 +0000
Subject: [issue42117] asyncio calls from sync/async, better docs or api support
In-Reply-To: <1603374436.81.0.314726165729.issue42117@roundup.psfhosted.org>
Message-ID: <1603459280.67.0.290864583317.issue42117@roundup.psfhosted.org>


Change by Blaze Spinnaker <blazespinnaker at gmail.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42117>
_______________________________________

From report at bugs.python.org  Fri Oct 23 09:21:12 2020
From: report at bugs.python.org (Blaze Spinnaker)
Date: Fri, 23 Oct 2020 13:21:12 +0000
Subject: [issue42117] asyncio calls from sync/async, better docs or api support
In-Reply-To: <1603374436.81.0.314726165729.issue42117@roundup.psfhosted.org>
Message-ID: <1603459272.97.0.526136930767.issue42117@roundup.psfhosted.org>


Blaze Spinnaker <blazespinnaker at gmail.com> added the comment:

Ah, thanks.  Looked around for something like that but couldn't find it.  Will close this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42117>
_______________________________________

From report at bugs.python.org  Fri Oct 23 09:53:46 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 23 Oct 2020 13:53:46 +0000
Subject: [issue42126] Optimize BUILD_CONST_KEY_MAP for distinct keys
In-Reply-To: <1603442811.66.0.361695425892.issue42126@roundup.psfhosted.org>
Message-ID: <1603461226.59.0.906425570192.issue42126@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

It is difficult to estimate. Real world applications has different code-style than stdlib. And pyperformance didn't include whole real world applications too.
Some application may use dict display in heavy loop. But it is difficult to say how much exactly.

One example from pyperformance. It uses inner function and function annotations heavily.
BUILD_CONST_KEY_MAP is used to build annotation dict, instead of dict display.
https://github.com/tornadoweb/tornado/blob/5eb7bb8efb4e1be8a2cec1744c857a8dadd43af9/tornado/gen.py

```
591          32 LOAD_CONST               1 ('Future')
             34 LOAD_CONST               2 ('None')
             36 LOAD_CONST               3 (('future', 'return'))
             38 BUILD_CONST_KEY_MAP      5
             40 LOAD_CLOSURE             3 (quiet_exceptions)
             42 BUILD_TUPLE              1
             44 LOAD_CONST               4 (<code object error_callback at 0x7fa7c64195b0, file "/home/inada-n/local/python-dev/lib/python3.10/site-packages/t
ornado/gen.py", line 591>)
             46 LOAD_CONST               5 ('with_timeout.<locals>.error_callback')
             48 MAKE_FUNCTION           12 (annotations, closure)
             50 STORE_DEREF              0 (error_callback)
```

I have not posted pyperformance result because this pull request is based on #41835 and I don't measure each performance.
But #41835 + this is 16% faster than master on bm_tornado_http.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42126>
_______________________________________

From report at bugs.python.org  Fri Oct 23 10:06:11 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 23 Oct 2020 14:06:11 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1603461971.69.0.101799638672.issue41835@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

@Marco Sulla Please take a look at GH-22909. It is simplified version of your PR. And I wrote another optimization based on it #42126.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Fri Oct 23 10:06:42 2020
From: report at bugs.python.org (Mark Shannon)
Date: Fri, 23 Oct 2020 14:06:42 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1603462002.77.0.498444190644.issue41835@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Could we get a pyperformance benchmark run on this please?

----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Fri Oct 23 10:08:29 2020
From: report at bugs.python.org (Mark Shannon)
Date: Fri, 23 Oct 2020 14:08:29 +0000
Subject: [issue42126] Optimize BUILD_CONST_KEY_MAP for distinct keys
In-Reply-To: <1603442811.66.0.361695425892.issue42126@roundup.psfhosted.org>
Message-ID: <1603462109.42.0.473480320981.issue42126@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

It sounds like the root cause is that annotations are repeatedly being computed. We should address the underlying issue, IMO.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42126>
_______________________________________

From report at bugs.python.org  Fri Oct 23 10:49:54 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 23 Oct 2020 14:49:54 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603464594.28.0.367783728488.issue41950@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

All this needs is a PR filed against latest master that updates Doc/whatsnew/3.9.rst and labeled with needs-backport-3.9.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 10:51:35 2020
From: report at bugs.python.org (Yonatan Goldschmidt)
Date: Fri, 23 Oct 2020 14:51:35 +0000
Subject: [issue42127] functools.cached_property possibly disables key-sharing
 instance dictionaries
Message-ID: <1603464695.3.0.183922542861.issue42127@roundup.psfhosted.org>


New submission from Yonatan Goldschmidt <yon.goldschmidt at gmail.com>:

Key-sharing dictionaries, defined by https://www.python.org/dev/peps/pep-0412/, require that any resizing of the shared dictionary keys will happen before a second instance of the class is created.

cached_property inserts its resolved result into the instance dict after it is called. This is likely to happen *after* a second instance has been created, and it is also likely to cause a resize of the dict, as demonstrated by this snippet:

    from functools import cached_property
    import sys

    def dict_size(o):
        return sys.getsizeof(o.__dict__)

    class X:
        def __init__(self):
            self.a = 1
            self.b = 2
            self.c = 3
            self.d = 4
            self.e = 5

        @cached_property
        def f(self):
            return id(self)

    x1 = X()
    x2 = X()

    print(dict_size(x1))
    print(dict_size(x2))

    x1.f

    print(dict_size(x1))
    print(dict_size(x2))

    x3 = X()
    print(dict_size(x3))

Essentially it means that types using cached_property are less likely to enjoy the benefits of shared keys. It may also incur a certain performance hit, because a resize + unshare will happen every time.

A simple way I've thought of to let cached_property play more nicely with shared keys, is to first create a single object of the class, and set the cached_property attribute to some value (so the key is added to the shared dict). In the snippet above, if you add "x0 = X(); x0.f = None" before creating x1 and x2, you'll see that the cached_property resolving does not unshare the dicts.

But I wonder if there's a way to do so without requiring user code changes.

----------
components: Library (Lib)
messages: 379439
nosy: Yonatan Goldschmidt
priority: normal
severity: normal
status: open
title: functools.cached_property possibly disables key-sharing instance dictionaries
type: performance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42127>
_______________________________________

From report at bugs.python.org  Fri Oct 23 11:06:35 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 15:06:35 +0000
Subject: [issue40060] socket.TCP_NOTSENT_LOWAT is missing in official macOS
 builds
In-Reply-To: <1585120826.63.0.863724436073.issue40060@roundup.psfhosted.org>
Message-ID: <1603465595.33.0.671714004035.issue40060@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

The active PR on bpo-41100 will make it possible to build the installer on the latest version of macOS (which will be needed to be able to provide support for "Apple Silicon").

IMHO it is not necessary to remove unavailable constants, on some platforms (in particular Linux) some of the constants might not work because the relevant kernel module is not loaded. That's something you can only find by actively probing, which is too expensive and error prone. 

I propose closing this issue: the installers are what they are for a reason, and a better solution than proposed in this issue is on its way.

----------
dependencies: +Build failure on macOS 11 (beta)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40060>
_______________________________________

From report at bugs.python.org  Fri Oct 23 11:18:57 2020
From: report at bugs.python.org (Atsuo Ishimoto)
Date: Fri, 23 Oct 2020 15:18:57 +0000
Subject: [issue35943] PyImport_GetModule() can return partially-initialized
 module
In-Reply-To: <1549646017.22.0.395154635441.issue35943@roundup.psfhosted.org>
Message-ID: <1603466337.55.0.0575139448546.issue35943@roundup.psfhosted.org>


Atsuo Ishimoto <ishimoto at python.jp> added the comment:

After this fix, some functions like multiprocessing.Pool cannot be used in threaded code(https://bugs.python.org/issue41567).

importerror-sample.tgz contains simplified code to reproduce the same error without multiprocessing module. Is this an expected behaviour of this change?

Tested with Python 3.9.0/macOS 10.15.5.

----------
nosy: +ishimoto
Added file: https://bugs.python.org/file49537/importerror-sample.tgz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35943>
_______________________________________

From report at bugs.python.org  Fri Oct 23 11:22:20 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Fri, 23 Oct 2020 15:22:20 +0000
Subject: [issue42128] Structural Pattern Matching (PEP 634)
Message-ID: <1603466540.96.0.7677855399.issue42128@roundup.psfhosted.org>


New submission from Brandt Bucher <brandtbucher at gmail.com>:

PEP 634 has not yet been accepted, but we'd like to hit the ground running and get this into alphas as soon as it (hopefully) is.

Several people have volunteered to review the implementation, since it's so huge. Other reviews are very welcome, if anybody has a bit of time to pitch in. This touches tons of stuff: the parser, the compiler, the VM, the builtins, the stdlib, the tests... I'd like as many eyeballs as possible!

I'll have a draft PR up against master in a few minutes. Let's try to keep all of the review comments there.

----------
assignee: brandtbucher
components: Interpreter Core
messages: 379442
nosy: BTaskaya, brandtbucher, gvanrossum, lys.nikolaou, pablogsal
priority: normal
severity: normal
stage: patch review
status: open
title: Structural Pattern Matching (PEP 634)
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42128>
_______________________________________

From report at bugs.python.org  Fri Oct 23 11:27:28 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Fri, 23 Oct 2020 15:27:28 +0000
Subject: [issue42128] Structural Pattern Matching (PEP 634)
In-Reply-To: <1603466540.96.0.7677855399.issue42128@roundup.psfhosted.org>
Message-ID: <1603466848.54.0.716064643404.issue42128@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

Sorry, just resolving some changes with master. Are you parser people finished breaking my grammar yet? Sheesh. ;)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42128>
_______________________________________

From report at bugs.python.org  Fri Oct 23 11:28:28 2020
From: report at bugs.python.org (Weiliang Li)
Date: Fri, 23 Oct 2020 15:28:28 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603466908.12.0.379845937149.issue41950@roundup.psfhosted.org>


Weiliang Li <to.be.impressive at gmail.com> added the comment:

Well, it looks like there is no CONTAINS_OP part under the subtitle "CPython bytecode changes" in master's Doc/whatsnew/3.9.rst

Maybe it's some discrepancy?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 11:39:38 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Fri, 23 Oct 2020 15:39:38 +0000
Subject: [issue42128] Structural Pattern Matching (PEP 634)
In-Reply-To: <1603466540.96.0.7677855399.issue42128@roundup.psfhosted.org>
Message-ID: <1603467578.41.0.120437542334.issue42128@roundup.psfhosted.org>


Change by Brandt Bucher <brandtbucher at gmail.com>:


----------
keywords: +patch
pull_requests: +21846
pull_request: https://github.com/python/cpython/pull/22917

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42128>
_______________________________________

From report at bugs.python.org  Fri Oct 23 11:46:10 2020
From: report at bugs.python.org (Mark Roseman)
Date: Fri, 23 Oct 2020 15:46:10 +0000
Subject: [issue34976] IDLE: Replace the search dialog with a search bar
In-Reply-To: <1539464539.46.0.788709270274.issue34976@psf.upfronthosting.co.za>
Message-ID: <1603467970.48.0.862805345052.issue34976@roundup.psfhosted.org>


Mark Roseman <mark at markroseman.com> added the comment:

Tal, I gave it a try, I think this is great. For "simple" searches (i.e. what people do most of the time), a search bar is a lot less klunky than bringing up a dialog.  

Patch seems to work well, would just need a cosmetic update (ttk widgets etc.).

Things may get a bit complex for users if too many things are stuck in there, and you run out of space real quick when you have a fairly narrow window. 

My suggestion would be to keep it to just a simple search without options, and keep the rest (search with options, replace) in a separate unified dialog that merges the current "Search Dialog" and "Replace Dialog". A button ("...") in the search bar to open that dialog would make for a nice transition between the search bar and the dialog.

----------
nosy: +markroseman

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34976>
_______________________________________

From report at bugs.python.org  Fri Oct 23 11:48:39 2020
From: report at bugs.python.org (Mark Roseman)
Date: Fri, 23 Oct 2020 15:48:39 +0000
Subject: [issue33051] IDLE: Create new tab for editor options in configdialog
In-Reply-To: <1520796379.91.0.467229070634.issue33051@psf.upfronthosting.co.za>
Message-ID: <1603468119.11.0.273577354381.issue33051@roundup.psfhosted.org>


Change by Mark Roseman <mark at markroseman.com>:


----------
nosy: +markroseman

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33051>
_______________________________________

From report at bugs.python.org  Fri Oct 23 11:51:40 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 23 Oct 2020 15:51:40 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603468300.39.0.900088111924.issue41950@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Honestly I don't see it in the 3.9 branch either. It seems the whole section mentioned in the closed PR doesn't exist anywhere. Maybe it was reverted for some reason. Let's close this issue.

----------
resolution:  -> out of date
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 11:52:36 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 23 Oct 2020 15:52:36 +0000
Subject: [issue13139] multiprocessing.map skips finally blocks
In-Reply-To: <1318125947.15.0.13973515193.issue13139@psf.upfronthosting.co.za>
Message-ID: <1603468356.45.0.106502430036.issue13139@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
stage:  -> needs patch
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.7, Python 3.2, Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13139>
_______________________________________

From report at bugs.python.org  Fri Oct 23 11:56:08 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 23 Oct 2020 15:56:08 +0000
Subject: [issue42122] macOS complains about how fonts are accessed
In-Reply-To: <1603409230.0.0.859933553088.issue42122@roundup.psfhosted.org>
Message-ID: <1603468568.46.0.365827584343.issue42122@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I'm only Catalina 10.15.7 and am using a local build constructed with:

   ./configure --with-openssl=$(brew --prefix openssl) && make

Perhaps that is using the system Tk and we don't need to worry about this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42122>
_______________________________________

From report at bugs.python.org  Fri Oct 23 11:59:54 2020
From: report at bugs.python.org (Mark Roseman)
Date: Fri, 23 Oct 2020 15:59:54 +0000
Subject: [issue41434] IDLE: Option to warn user on "Run Module" if file is not
 Python source
In-Reply-To: <1596005697.8.0.893586453742.issue41434@roundup.psfhosted.org>
Message-ID: <1603468794.68.0.872465654439.issue41434@roundup.psfhosted.org>


Mark Roseman <mark at markroseman.com> added the comment:

I like Terry's idea of providing a better error message than just "invalid syntax" when we run something that likely isn't a Python file. There doesn't seem to be any great danger in trying to run any file that would justify a warning beforehand.

----------
nosy: +markroseman

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41434>
_______________________________________

From report at bugs.python.org  Fri Oct 23 12:01:12 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 16:01:12 +0000
Subject: [issue42122] macOS complains about how fonts are accessed
In-Reply-To: <1603409230.0.0.859933553088.issue42122@roundup.psfhosted.org>
Message-ID: <1603468872.55.0.396602603415.issue42122@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Could you check "/tmp/py310/bin/python3 -m test.pythoninfo | grep -i tk". If that says your using Tk 8.5 you're almost certainly using the system version.

You could also check _tkinter itself:

otool -vL /tmp/py310/lib/python3.10/lib-dynload/_tkinter.cpython-310-darwin.so
/tmp/py310/lib/python3.10/lib-dynload/_tkinter.cpython-310-darwin.so:
	/System/Library/Frameworks/Tcl.framework/Versions/8.5/Tcl (compatibility version 8.5.0, current version 8.5.9)
	/System/Library/Frameworks/Tk.framework/Versions/8.5/Tk (compatibility version 8.5.0, current version 8.5.9)
	/usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1292.0.0)

I propose closing this issue if you are indeed using the system copy of Tk.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42122>
_______________________________________

From report at bugs.python.org  Fri Oct 23 12:01:03 2020
From: report at bugs.python.org (Weiliang Li)
Date: Fri, 23 Oct 2020 16:01:03 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603468863.12.0.853060173051.issue41950@roundup.psfhosted.org>


Weiliang Li <to.be.impressive at gmail.com> added the comment:

It's here https://github.com/python/cpython/blob/3.9/Doc/whatsnew/3.9.rst#cpython-bytecode-changes

Just several pixels below

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 12:03:26 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Fri, 23 Oct 2020 16:03:26 +0000
Subject: [issue42129] Support resources in namespace packages
Message-ID: <1603469006.87.0.128715336786.issue42129@roundup.psfhosted.org>


New submission from Jason R. Coombs <jaraco at jaraco.com>:

In [importlib_resources#68](https://github.com/python/importlib_resources/issues/68), the project identified a deficiency with respect to pkg_resources for resources in namespace packages.

The project has since merged support for these packages, slated to go out with the importlib_resources 3.2 release.

This issue is to track the incorporation of those changes into importlib.resources.

----------
assignee: jaraco
messages: 379451
nosy: jaraco
priority: normal
severity: normal
status: open
title: Support resources in namespace packages
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42129>
_______________________________________

From report at bugs.python.org  Fri Oct 23 12:05:49 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 16:05:49 +0000
Subject: [issue25509] PyImport_ImportModule inaccurately described
In-Reply-To: <1446120404.56.0.248022316134.issue25509@psf.upfronthosting.co.za>
Message-ID: <1603469149.16.0.47662520889.issue25509@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

The docs for PyImport_ImportModule() is https://docs.python.org/3/c-api/import.html?highlight=pyimport_importmodule#c.PyImport_ImportModule and https://github.com/python/cpython/blob/master/Doc/c-api/import.rst.

----------
keywords: +easy (C) -easy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25509>
_______________________________________

From report at bugs.python.org  Fri Oct 23 12:07:20 2020
From: report at bugs.python.org (Weiliang Li)
Date: Fri, 23 Oct 2020 16:07:20 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603469240.75.0.364625848904.issue41950@roundup.psfhosted.org>


Weiliang Li <to.be.impressive at gmail.com> added the comment:

And the "What?s New In Python 3.9" page (updated today): 

https://docs.python.org/3/whatsnew/3.9.html#cpython-bytecode-changes

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 12:10:29 2020
From: report at bugs.python.org (Taras Voinarovskyi)
Date: Fri, 23 Oct 2020 16:10:29 +0000
Subject: [issue42130] AsyncIO's wait_for can hide cancellation in a rare race
 condition
Message-ID: <1603469429.01.0.760360212477.issue42130@roundup.psfhosted.org>


New submission from Taras Voinarovskyi <voyn1991 at gmail.com>:

Hi, during migration to Python 3.8.6 we encountered a behavior change from previous versions: wait_for ignored the request to cancellation and returned instead. After investigation, it seems to be related to the update in bpo-32751 and is only reproduced if the waited task is finished when cancellation of wait_for happens (code mistakes external CancelledError for a timeout).

The following example can reproduce the behavior on both 3.8.6 and 3.9.0 for me:

```

import asyncio


async def inner():
    return

async def with_for_coro():
    await asyncio.wait_for(inner(), timeout=100)
    await asyncio.sleep(1)
    print('End of with_for_coro. Should not be reached!')

async def main():
    task = asyncio.create_task(with_for_coro())
    await asyncio.sleep(0)
    assert not task.done()
    task.cancel()
    print('Called task.cancel()')
    await task  # -> You would expect a CancelledError to be raised.


asyncio.run(main())
```

Changing the wait time before cancellation slightly will return the correct behavior and CancelledError will be raised.

----------
components: asyncio
messages: 379454
nosy: asvetlov, tvoinarovskyi, yselivanov
priority: normal
severity: normal
status: open
title: AsyncIO's wait_for can hide cancellation in a rare race condition
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42130>
_______________________________________

From report at bugs.python.org  Fri Oct 23 12:10:25 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Fri, 23 Oct 2020 16:10:25 +0000
Subject: [issue42129] Support resources in namespace packages
In-Reply-To: <1603469006.87.0.128715336786.issue42129@roundup.psfhosted.org>
Message-ID: <1603469425.16.0.0412376931223.issue42129@roundup.psfhosted.org>


Change by Filipe La?ns <lains at riseup.net>:


----------
nosy: +FFY00

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42129>
_______________________________________

From report at bugs.python.org  Fri Oct 23 12:10:45 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 23 Oct 2020 16:10:45 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603469445.51.0.131411685816.issue41950@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Hm, I guess my repo is out of date. Sorry. So it is in master? Let's fix it there then.

----------
resolution: out of date -> 
stage: resolved -> needs patch
status: closed -> open
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 12:31:12 2020
From: report at bugs.python.org (Weiliang Li)
Date: Fri, 23 Oct 2020 16:31:12 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603470672.94.0.262497143988.issue41950@roundup.psfhosted.org>


Weiliang Li <to.be.impressive at gmail.com> added the comment:

The whole CONTAINS_OP stuff is gone in master, but it's still there in 3.9 branch.

I don't know why.

Any plan to resolve the discrepancy?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 13:00:43 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 23 Oct 2020 17:00:43 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603472443.9.0.0829845037424.issue41950@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

There really shouldn't be any differences between that doc in the 3.9 and master branch (with rare exceptions). Can you post a diff here between the two so we can sort it out?

Also can you find the commit where it was added to the 3.9 branch?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 13:09:06 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Fri, 23 Oct 2020 17:09:06 +0000
Subject: [issue42129] Support resources in namespace packages
In-Reply-To: <1603469006.87.0.128715336786.issue42129@roundup.psfhosted.org>
Message-ID: <1603472946.33.0.374700862976.issue42129@roundup.psfhosted.org>


Change by Barry A. Warsaw <barry at python.org>:


----------
nosy: +barry

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42129>
_______________________________________

From report at bugs.python.org  Fri Oct 23 13:22:27 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 17:22:27 +0000
Subject: [issue26131] Raise ImportWarning when loader.load_module() is used
In-Reply-To: <1452894244.92.0.478987355259.issue26131@psf.upfronthosting.co.za>
Message-ID: <1603473747.92.0.501290187503.issue26131@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
stage: test needed -> commit review

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26131>
_______________________________________

From report at bugs.python.org  Fri Oct 23 13:42:50 2020
From: report at bugs.python.org (Marco Sulla)
Date: Fri, 23 Oct 2020 17:42:50 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1603474970.75.0.548613887971.issue41835@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

@methane: well, to be honest, I don't see much difference between the two pulls. The major difference is that you merged insertdict_init in dict_merge_init.

But I kept insertdict_init separate on purpose, because this function can be used in other future dedicated function on creation time only. Furthermore it's more simple to maintain, since it's quite identical to insertdict.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Fri Oct 23 13:58:47 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 23 Oct 2020 17:58:47 +0000
Subject: [issue42122] macOS complains about how fonts are accessed
In-Reply-To: <1603409230.0.0.859933553088.issue42122@roundup.psfhosted.org>
Message-ID: <1603475927.44.0.937826982054.issue42122@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I'm going to mark this as closed, not a bug.  If you're not seeing the same result, it is almost certainly an issue with my local build.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42122>
_______________________________________

From report at bugs.python.org  Fri Oct 23 14:01:21 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 23 Oct 2020 18:01:21 +0000
Subject: [issue16094] Tuple extraction in a lambda isn't supported by 2to3
In-Reply-To: <1349003232.56.0.742514252911.issue16094@psf.upfronthosting.co.za>
Message-ID: <1603476081.83.0.856029867723.issue16094@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na92 at gmail.com>:


----------
resolution:  -> wont fix
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16094>
_______________________________________

From report at bugs.python.org  Fri Oct 23 14:10:33 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 23 Oct 2020 18:10:33 +0000
Subject: [issue40841] Provide mimetypes.sniff API as stdlib
In-Reply-To: <1591080165.24.0.514984320107.issue40841@roundup.psfhosted.org>
Message-ID: <1603476633.25.0.386766693026.issue40841@roundup.psfhosted.org>


Dong-hee Na <donghee.na92 at gmail.com> added the comment:

I close this issue as rejected!

During the sprint, I could hear a lot of opinions from core devs including Guido, Tal, and Christian.

The overall conclusion for me is not to add this time.
if the mimetypes module is extracted from stdlib to pypi package, we can discuss to add this feature at that time!

Thank you everyone for the discussion!

----------
nosy: +christian.heimes, taleinat
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40841>
_______________________________________

From report at bugs.python.org  Fri Oct 23 14:11:42 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 23 Oct 2020 18:11:42 +0000
Subject: [issue614557] LookupError etc. need API to get the key
Message-ID: <1603476702.55.0.191992093857.issue614557@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions:  -Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue614557>
_______________________________________

From report at bugs.python.org  Fri Oct 23 14:15:00 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 23 Oct 2020 18:15:00 +0000
Subject: [issue40841] Provide mimetypes.sniff API as stdlib
In-Reply-To: <1603476633.25.0.386766693026.issue40841@roundup.psfhosted.org>
Message-ID: <CAP7+vJLvWUAqdWFO=3gV1QkrJ2adW9mBTNO1fbaJFCYTJzv-dA@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

Dong-hee, I recommend that you turn this into a 3rd party package on PyPI
yourself. That way your effort and code will live on!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40841>
_______________________________________

From report at bugs.python.org  Fri Oct 23 14:21:36 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Fri, 23 Oct 2020 18:21:36 +0000
Subject: [issue38870] Expose ast.unparse in the ast module
In-Reply-To: <1574289269.61.0.90605518345.issue38870@roundup.psfhosted.org>
Message-ID: <1603477296.08.0.484748088206.issue38870@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

Well, I'm happy to say that 3.9.0 is finally released with the ast.unparse interface. After tens of PRs, I think it is time for us to move on. For all future bugs, please create a new issue and nosy me. Thanks everyone who has participated this journey!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38870>
_______________________________________

From report at bugs.python.org  Fri Oct 23 14:24:39 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Fri, 23 Oct 2020 18:24:39 +0000
Subject: [issue38870] Expose ast.unparse in the ast module
In-Reply-To: <1574289269.61.0.90605518345.issue38870@roundup.psfhosted.org>
Message-ID: <1603477479.32.0.546172863204.issue38870@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38870>
_______________________________________

From report at bugs.python.org  Fri Oct 23 14:27:24 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Fri, 23 Oct 2020 18:27:24 +0000
Subject: [issue3760] PEP 3121 --- PyType_Copy is missing
In-Reply-To: <1220383344.44.0.399854586534.issue3760@psf.upfronthosting.co.za>
Message-ID: <1603477644.38.0.837951963135.issue3760@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

The need is covered by PEP 384's PyType_FromSpec (and later additions, the latest being PyType_FromModuleAndSpec).

Thanks for closing!

----------
nosy: +petr.viktorin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3760>
_______________________________________

From report at bugs.python.org  Fri Oct 23 14:42:32 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Fri, 23 Oct 2020 18:42:32 +0000
Subject: [issue30681] email.utils.parsedate_to_datetime() should return None
 when date cannot be parsed
In-Reply-To: <1497568363.46.0.596536376967.issue30681@psf.upfronthosting.co.za>
Message-ID: <1603478552.95.0.152896329609.issue30681@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

Aside: I noticed that on _parseaddr.py:68, there's a bare `return`.  That should really be `return None` (EIBTI).  Can you fix that in your PR?

I think it's confusing to raise both TypeError and ValueError.  I suggest we check the `None` return from _parsedate_tz() and raise ValueError explicitly in that case, avoiding the implicit TypeError on the failing tuple unpack.

+1 on removing the mention of returning None from the documentation.  Then with the above, it would document raising ValueError on invalid date input.

As for backporting, I'm nosing Ned and ?ukasz to weigh in.  Given that the patch is adding a new defect class (which it should), this won't break existing code, but it does mean that existing code would have different semantics depending on the patch version release of 3.9, 3.8, and 3.7.  I'm not completely comfortable with that, but let's see what the RMs say.  I guess I'm currently -0 on backporting.

----------
nosy: +lukasz.langa, ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30681>
_______________________________________

From report at bugs.python.org  Fri Oct 23 14:50:31 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 23 Oct 2020 18:50:31 +0000
Subject: [issue42058] Process not running with args
In-Reply-To: <1602902723.88.0.655306807418.issue42058@roundup.psfhosted.org>
Message-ID: <1603479031.88.0.0508971533303.issue42058@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

bpo is the issue tracker for patching the python cpython repository.  We support running python from system command line terminals and icons that we install, as specified in the CPython docs.  Ask questions about running python otherwise on other forums.

----------
nosy: +terry.reedy
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42058>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:09:49 2020
From: report at bugs.python.org (Felipe Rodrigues)
Date: Fri, 23 Oct 2020 19:09:49 +0000
Subject: [issue21032] Socket leak if HTTPConnection.getresponse() fails
In-Reply-To: <1395547547.76.0.268263591219.issue21032@psf.upfronthosting.co.za>
Message-ID: <1603480189.47.0.790956583073.issue21032@roundup.psfhosted.org>


Change by Felipe Rodrigues <felipe at felipevr.com>:


----------
nosy: +fbidu
nosy_count: 3.0 -> 4.0
pull_requests: +21848
pull_request: https://github.com/python/cpython/pull/22737

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21032>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:09:49 2020
From: report at bugs.python.org (Felipe Rodrigues)
Date: Fri, 23 Oct 2020 19:09:49 +0000
Subject: [issue13464] HTTPResponse is missing an implementation of readinto
In-Reply-To: <1322072062.06.0.738377139897.issue13464@psf.upfronthosting.co.za>
Message-ID: <1603480189.24.0.263813047794.issue13464@roundup.psfhosted.org>


Change by Felipe Rodrigues <felipe at felipevr.com>:


----------
nosy: +fbidu
nosy_count: 5.0 -> 6.0
pull_requests: +21847
pull_request: https://github.com/python/cpython/pull/22737

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13464>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:30:48 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 23 Oct 2020 19:30:48 +0000
Subject: [issue42070] Revisit IsoCalendarDate being private from pickle
 perspective
In-Reply-To: <1603046695.09.0.570659045382.issue42070@roundup.psfhosted.org>
Message-ID: <1603481448.2.0.465258648335.issue42070@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

If the current situation is not a bug, a mismatch between behavior and doc, a change would be an enhancement limited to the next release.

----------
nosy: +terry.reedy
title: I think the rationale to keep IsoCalendarDate private from the pickle perspective should get revisited -> Revisit IsoCalendarDate being private from pickle perspective
type: behavior -> enhancement
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42070>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:33:57 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 19:33:57 +0000
Subject: [issue23797] Mac OS X locale setup in thread happens sometime after
 run() is called
In-Reply-To: <1427539675.57.0.610869974475.issue23797@psf.upfronthosting.co.za>
Message-ID: <1603481637.87.0.454049736086.issue23797@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I've been using the scriptlet below to try to attempt to reproduce the problem. I'm not sure if this matches the way the program of the OP is set up.

The scriptlet below works for me without problems (macOS 10.15, Python 3.4 - 3.9).

This either means the problem has been fixed in the meantime (if it was an OS bug), or my script doesn't reproduce the problematic setup.

The traceback in the first message is due to LC_CTYPE=UTF-8 in the default shell environment on macOS, which wasn't recognised by locale.py for a long time. That issue has been fixed though.


# ----
import locale
import threading

def thread():
    print("thread locale:", locale.getlocale())

locale.setlocale(locale.LC_ALL, "en_US.UTF-8")
#locale.getlocale()

t = threading.Thread(target=thread)
t.start()
t.join()

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23797>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:34:57 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 19:34:57 +0000
Subject: [issue23797] Mac OS X locale setup in thread happens sometime after
 run() is called
In-Reply-To: <1427539675.57.0.610869974475.issue23797@psf.upfronthosting.co.za>
Message-ID: <1603481697.2.0.230711000324.issue23797@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I'm closing this issue as "works for me". Please re-open if there is more information on how to reproduce the problem.

----------
resolution:  -> works for me
stage:  -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23797>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:45:22 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 23 Oct 2020 19:45:22 +0000
Subject: [issue42074] setup error on windows
In-Reply-To: <1603057749.44.0.277772505127.issue42074@roundup.psfhosted.org>
Message-ID: <1603482322.59.0.645121221176.issue42074@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Thank you for attaching the log instead of including it inline.  But when you reply by email, please delete the message you are responding too, as it duplicates the original already on the web page.

The first error in the log is a failure to make a restore point.  Then the fatal error reported:
ESOMEUSERor 0x80070002: Failed to install MSI package.
ESOMEUSERor 0x80070002: Failed to configure per-user MSI package.
Applied execute package: core_JustForMe, result: 0x80070002, restart: None
ESOMEUSERor 0x80070002: Failed to execute MSI package.

I added the Windows component so a Windows expert can try to interpret this.  Since it was installing just for you, in AppData, I don't think permissions should have been a problem.  I presume that 1703 is recent enough that the installer should work.

----------
components: +Windows
nosy: +paul.moore, steve.dower, terry.reedy, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42074>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:48:42 2020
From: report at bugs.python.org (Tal Einat)
Date: Fri, 23 Oct 2020 19:48:42 +0000
Subject: [issue40841] Provide mimetypes.sniff API as stdlib
In-Reply-To: <1591080165.24.0.514984320107.issue40841@roundup.psfhosted.org>
Message-ID: <1603482522.89.0.951827644503.issue40841@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

> Dong-hee, I recommend that you turn this into a 3rd party package on PyPI yourself.

+1

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40841>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:50:48 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 19:50:48 +0000
Subject: [issue41101] Support "arm64" in Mac/Tools/pythonw
In-Reply-To: <1593000988.46.0.0606602806921.issue41101@roundup.psfhosted.org>
Message-ID: <1603482648.37.0.399503464889.issue41101@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

This change is part of the active PR in #41100. Therefore closing this issue.

----------
resolution:  -> out of date
stage: patch review -> resolved
status: open -> closed
superseder:  -> Build failure on macOS 11 (beta)
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41101>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:49:59 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 23 Oct 2020 19:49:59 +0000
Subject: [issue41100] Build failure on macOS 11 (beta)
In-Reply-To: <1592999467.1.0.372512113251.issue41100@roundup.psfhosted.org>
Message-ID: <1603482599.05.0.684813640793.issue41100@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
pull_requests: +21849
pull_request: https://github.com/python/cpython/pull/21114

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41100>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:52:53 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 23 Oct 2020 19:52:53 +0000
Subject: [issue42075] Verbose/confusing default format on warnings
In-Reply-To: <1603059340.5.0.993614197366.issue42075@roundup.psfhosted.org>
Message-ID: <1603482773.3.0.101093387493.issue42075@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

An application *can* change warnings.  See lib/idlelib/run for an example.  Library code should not make changes as they will be global or overwritten.  A project that is both can restrict the changes to when run as main module.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42075>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:55:26 2020
From: report at bugs.python.org (Tal Einat)
Date: Fri, 23 Oct 2020 19:55:26 +0000
Subject: [issue34976] IDLE: Replace the search dialog with a search bar
In-Reply-To: <1539464539.46.0.788709270274.issue34976@psf.upfronthosting.co.za>
Message-ID: <1603482926.04.0.922567990274.issue34976@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

Thanks Mark, your feedback is greatly appreciated!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34976>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:57:20 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 23 Oct 2020 19:57:20 +0000
Subject: [issue34394] Descriptors HowTo doesn't mention __set_name__
In-Reply-To: <1534163786.32.0.56676864532.issue34394@psf.upfronthosting.co.za>
Message-ID: <1603483040.23.0.21183549721.issue34394@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed
versions: +Python 3.10, Python 3.9 -Python 3.4, Python 3.5, Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34394>
_______________________________________

From report at bugs.python.org  Fri Oct 23 15:58:06 2020
From: report at bugs.python.org (Tal Einat)
Date: Fri, 23 Oct 2020 19:58:06 +0000
Subject: [issue34976] IDLE: Replace the search dialog with a search bar
In-Reply-To: <1539464539.46.0.788709270274.issue34976@psf.upfronthosting.co.za>
Message-ID: <1603483086.94.0.899281868983.issue34976@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

> Why would having all 'a's on a page light up when I type 'a' be a plus?

The auto-highlighting could be disabled for 1-2 character search queries, or delayed for a bit to allow typing to continue.

I find auto-highlighting very useful when I'm looking for "where is this variable used?", I just Ctrl-f, start typing its name, and get the answer very quickly, even if I haven't typed the whole name.

Also, this PR supports Alt+/ completion in the search bar, which makes the above even more effective.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34976>
_______________________________________

From report at bugs.python.org  Fri Oct 23 16:06:17 2020
From: report at bugs.python.org (Marco Sulla)
Date: Fri, 23 Oct 2020 20:06:17 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1603483577.79.0.567290019155.issue41835@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

@Mark.Shannon I tried to run pyperformance, but wheel does not work for Python 3.10. I get the error:

AssertionError: would build wheel with unsupported tag ('cp310', 'cp310', 'linux_x86_64')

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Fri Oct 23 17:13:18 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 23 Oct 2020 21:13:18 +0000
Subject: [issue42064] Convert sqlite3 to multi-phase initialisation (PEP 489)
In-Reply-To: <1602963425.44.0.576962569847.issue42064@roundup.psfhosted.org>
Message-ID: <1603487598.31.0.962508917557.issue42064@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

I've narrowed down the traverse problems to Py_VISIT(state->CacheType). Suspecting this has to do with the cyclic references in cache/connection. Preliminary tests with GC tracking `cache->factory` look promising, but this is a part of the C API that's _completely_ unknown to me (yet), so I'm on thin ice here.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42064>
_______________________________________

From report at bugs.python.org  Fri Oct 23 17:38:07 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 23 Oct 2020 21:38:07 +0000
Subject: [issue40592] `Shutil.which` incosistent with windows's `where`
In-Reply-To: <1589187015.71.0.593402074503.issue40592@roundup.psfhosted.org>
Message-ID: <1603489087.69.0.730121335737.issue40592@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8b4842b7a830299870067bba59f53529b13647a2 by Miss Skeleton (bot) in branch '3.8':
[3.8] bpo-40592: shutil.which will not return None anymore if ; is the last char in PATHEXT (GH-20088) (GH-22913)
https://github.com/python/cpython/commit/8b4842b7a830299870067bba59f53529b13647a2


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40592>
_______________________________________

From report at bugs.python.org  Fri Oct 23 17:38:08 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 23 Oct 2020 21:38:08 +0000
Subject: [issue40592] `Shutil.which` incosistent with windows's `where`
In-Reply-To: <1589187015.71.0.593402074503.issue40592@roundup.psfhosted.org>
Message-ID: <1603489088.97.0.360342449731.issue40592@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c437fe39cf5318f27f3381a983fbf320f65064bc by Miss Skeleton (bot) in branch '3.9':
[3.9] bpo-40592: shutil.which will not return None anymore if ; is the last char in PATHEXT (GH-20088) (GH-22912)
https://github.com/python/cpython/commit/c437fe39cf5318f27f3381a983fbf320f65064bc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40592>
_______________________________________

From report at bugs.python.org  Fri Oct 23 17:41:48 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 23 Oct 2020 21:41:48 +0000
Subject: [issue42127] functools.cached_property possibly disables key-sharing
 instance dictionaries
In-Reply-To: <1603464695.3.0.183922542861.issue42127@roundup.psfhosted.org>
Message-ID: <1603489308.52.0.995877475391.issue42127@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> Essentially it means that types using cached_property are less
> likely to enjoy the benefits of shared keys.

I don't think anything can be done about it.  @cached_property and key-sharing dicts are intrinsically at odds with one another.  Likewise, @cached_property doesn't work with classes that define __slots__.

FWIW, there is an alternative that works with both key-sharing dicts and __slots__.  You can stack property() on top of functools.cache():

    class A:
        def __init__(self, x):
                self.x = x

        @property
        @cache
        def square(self):
                print('Called!')
                return self.x ** 2

            
    >>> a = A(10)
    >>> a.square
    Called!
    100
    >>> b = A(11)
    >>> b.square
    Called
    121
    >>> a.square
    100
    >>> b.square
    121

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42127>
_______________________________________

From report at bugs.python.org  Fri Oct 23 17:47:55 2020
From: report at bugs.python.org (Paul Ganssle)
Date: Fri, 23 Oct 2020 21:47:55 +0000
Subject: [issue42070] Revisit IsoCalendarDate being private from pickle
 perspective
In-Reply-To: <1603046695.09.0.570659045382.issue42070@roundup.psfhosted.org>
Message-ID: <1603489675.54.0.437375907866.issue42070@roundup.psfhosted.org>


Paul Ganssle <p.ganssle at gmail.com> added the comment:

Even if it were accidental (and it wasn't ? it was actually somewhat difficult to achieve), I'd still argue for not changing it in 3.9, because it would mean that pickles created in 3.9.(n+1) would not be readable in 3.9.n.

Still, I don't think I'd be convinced without some real-life use cases. The SO question is asking about the reasoning for this in the abstract ? the poster noticed that we designed it this way and saw a possible objection to this, but it was one that we had considered and decided to make the trade-off a different way.

I informally asked many people about this, since it was by far the weirdest design decision made in that issue (I say that in the passive tense not to deflect from the fact that I made the decision, but to own the fact that it was weirder than any of the design decisions made by anyone else, either ?), and generally they could not give me any concrete reasons it would break (but they also all counseled not to try to get too clever with pickling logic).

I think I'm happy with the decision if we remain in the realm of the abstract, but I recognize how weird it is, and I think if someone came up with a compelling workflow that this breaks, we could change it (in a feature release). This was specifically proposed to avoid backwards-compatibility problems, so it wouldn't be any more of a breakage to change it in future feature releases than it would have been to do it in 3.9.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42070>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:05:33 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 22:05:33 +0000
Subject: [issue42131] [zipimport] Update zipimport to use specs
Message-ID: <1603490733.54.0.490063164948.issue42131@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

zipimport only supports old PEP 302 APIs and not PEP 451 module specs (i.e. it uses load_module() instead of create_module()/exec_module(), find_mdoule() instead of find_spec()).

Uses of both load_module() and find_module() are documented as deprecated for the import system and are slated to eventually go away.

----------
components: Library (Lib)
messages: 379481
nosy: brett.cannon, twouters
priority: normal
severity: normal
status: open
title: [zipimport] Update zipimport to use specs
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42131>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:06:17 2020
From: report at bugs.python.org (Paul Ganssle)
Date: Fri, 23 Oct 2020 22:06:17 +0000
Subject: [issue42070] Revisit IsoCalendarDate being private from pickle
 perspective
In-Reply-To: <1603046695.09.0.570659045382.issue42070@roundup.psfhosted.org>
Message-ID: <1603490777.49.0.615324539215.issue42070@roundup.psfhosted.org>


Paul Ganssle <p.ganssle at gmail.com> added the comment:

I'm glad that Terry brought up documentation, though, because I realized that this is not a documented behavior: https://docs.python.org/3/library/datetime.html#datetime.date.isocalendar

We should maybe document it? Though if we document it it might be considered more of a breaking change to change the behavior than if it's an undocumented feature.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42070>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:16:01 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 22:16:01 +0000
Subject: [issue42132] Use specs instead of just __loader__ in C code
Message-ID: <1603491361.46.0.996069640716.issue42132@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

_warnings.c, pylifecycle.c, and pythonrun.c all either use or set `__loader__` but without also falling back on `__spec__`.

----------
components: Interpreter Core
messages: 379483
nosy: brett.cannon
priority: normal
severity: normal
status: open
title: Use specs instead of just __loader__ in C code
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42132>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:31:18 2020
From: report at bugs.python.org (Weiliang Li)
Date: Fri, 23 Oct 2020 22:31:18 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603492278.31.0.517655369224.issue41950@roundup.psfhosted.org>


Weiliang Li <to.be.impressive at gmail.com> added the comment:

The diff is here:

https://gist.github.com/kigawas/c0c3900e5f56552f13160c7989612c28

Looks like it is not trivial.

And the commit at branch 3.9 is:

https://github.com/python/cpython/commit/9cf6752276e6fcfd0c23fdb064ad27f448aaaf75#diff-ec874d66bbcf13046b9928aa3716d14a93632f568b914eba32baf46ff4c9eb36R1180

Hope this would help.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:36:59 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 23 Oct 2020 22:36:59 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603492619.07.0.744337275391.issue41950@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Oh, I see. ?ukasz (@ambv) prepared the 3.9.0 release and didn't merge his changes into master yet.

I'll contact him.

----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:40:07 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 23 Oct 2020 22:40:07 +0000
Subject: [issue39108] random needs doc for "gauss" versus "normalvariate"
In-Reply-To: <1576842313.59.0.109867222427.issue39108@roundup.psfhosted.org>
Message-ID: <1603492807.44.0.0627861855535.issue39108@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
keywords: +patch
pull_requests: +21850
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22928

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39108>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:46:40 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 22:46:40 +0000
Subject: [issue42133] Update the stdlib to fall back to __spec__.parent if
 __loader__ isn't defined
Message-ID: <1603493200.29.0.0849833372282.issue42133@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

By making sure the stdlib can handle the case where __loader__ isn't defined but __spec__.parent is, eventually the former could be dropped for the latter.

----------
components: Library (Lib)
messages: 379486
nosy: brett.cannon
priority: normal
severity: normal
status: open
title: Update the stdlib to fall back to __spec__.parent if __loader__ isn't defined
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42133>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:49:03 2020
From: report at bugs.python.org (Senthil Kumaran)
Date: Fri, 23 Oct 2020 22:49:03 +0000
Subject: [issue38976] Add support for HTTP Only flag in MozillaCookieJar
In-Reply-To: <1575522823.75.0.720870581486.issue38976@roundup.psfhosted.org>
Message-ID: <1603493343.82.0.0858547577765.issue38976@roundup.psfhosted.org>


Senthil Kumaran <senthil at uthcode.com> added the comment:


New changeset 16ee68da6e12bb2d79751b32cc37523fe4f4bb48 by Jacob Neil Taylor in branch 'master':
bpo-38976: Add support for HTTP Only flag in MozillaCookieJar (#17471)
https://github.com/python/cpython/commit/16ee68da6e12bb2d79751b32cc37523fe4f4bb48


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38976>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:49:45 2020
From: report at bugs.python.org (Senthil Kumaran)
Date: Fri, 23 Oct 2020 22:49:45 +0000
Subject: [issue38976] Add support for HTTP Only flag in MozillaCookieJar
In-Reply-To: <1575522823.75.0.720870581486.issue38976@roundup.psfhosted.org>
Message-ID: <1603493385.98.0.480153039701.issue38976@roundup.psfhosted.org>


Change by Senthil Kumaran <senthil at uthcode.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38976>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:50:55 2020
From: report at bugs.python.org (Weiliang Li)
Date: Fri, 23 Oct 2020 22:50:55 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603493455.88.0.941005192592.issue41950@roundup.psfhosted.org>


Weiliang Li <to.be.impressive at gmail.com> added the comment:

No wonder there is discrepancy...

So our tactic would be to patch in 3.9 branch and bring it back to master?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:54:46 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 22:54:46 +0000
Subject: [issue42133] Update the stdlib to fall back to __spec__.parent if
 __loader__ isn't defined
In-Reply-To: <1603493200.29.0.0849833372282.issue42133@roundup.psfhosted.org>
Message-ID: <1603493686.62.0.971394002416.issue42133@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
keywords: +patch
pull_requests: +21851
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22929

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42133>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:55:03 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 23 Oct 2020 22:55:03 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603493703.3.0.731945035484.issue41950@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Yeah, I'll see if I can reopen your PR and we can apply it to the 3.9 branch, we'll then forward port it (if and when that's done).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 18:59:22 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 22:59:22 +0000
Subject: [issue21762] update the import machinery to only use __spec__
In-Reply-To: <1402781631.86.0.838758150876.issue21762@psf.upfronthosting.co.za>
Message-ID: <1603493962.64.0.736203051392.issue21762@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

It turns out that the import system itself doesn't use `__loader__` (it does set it), but various parts of the stdlib do use `__loader__`. bpo-42133 updates a bunch of stdlib modules to use `__spec__.loader` as a fallback. bpo-42132 tracks the fact that there's C code which isn't setting or using `__spec__` (let alone `__spec__.loader`).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21762>
_______________________________________

From report at bugs.python.org  Fri Oct 23 19:02:07 2020
From: report at bugs.python.org (Steve Dower)
Date: Fri, 23 Oct 2020 23:02:07 +0000
Subject: [issue42074] setup error on windows
In-Reply-To: <1603057749.44.0.277772505127.issue42074@roundup.psfhosted.org>
Message-ID: <1603494127.39.0.0547775805293.issue42074@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Thanks for finding the error code, Terry.

CaptainMitsumoto, firstly sorry for the frustration. We try to make it work reliably everywhere, but there are so many variables when it comes to installation that weird things always come up.

As an alternative, you might want to try opening the Microsoft Store app and searching for one of the Python releases we publish there (probably Python 3.8 right now, or 3.9 if you want to try it out and aren't planning to install other packages). Those use a different kind of installer that is normally much more reliable.

If we're going to keep looking into the other installer that failed for you, I'm going to need the other log files that were in %TEMP%. The one that ends in "core_JustForMe" has the actual source of this error. 

However, I can tell you that the most common reason for this error code is that your virus scanner is interfering. You might have to disable it while installing.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42074>
_______________________________________

From report at bugs.python.org  Fri Oct 23 19:10:10 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 23:10:10 +0000
Subject: [issue42134] Raise ImportWarning when falling back to find_module()
Message-ID: <1603494610.04.0.950789467246.issue42134@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

find_spec() has superseded find_module() since Python 3.4.

----------
components: Interpreter Core
messages: 379492
nosy: brett.cannon
priority: normal
severity: normal
status: open
title: Raise ImportWarning when falling back to find_module()
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42134>
_______________________________________

From report at bugs.python.org  Fri Oct 23 19:11:44 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 23 Oct 2020 23:11:44 +0000
Subject: [issue42127] functools.cached_property possibly disables key-sharing
 instance dictionaries
In-Reply-To: <1603464695.3.0.183922542861.issue42127@roundup.psfhosted.org>
Message-ID: <1603494704.07.0.622170055524.issue42127@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
keywords: +patch
pull_requests: +21852
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22930

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42127>
_______________________________________

From report at bugs.python.org  Fri Oct 23 19:11:35 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 23:11:35 +0000
Subject: [issue42135] [importlib] Deprecate find_module() implementations
Message-ID: <1603494695.54.0.8376376438.issue42135@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

find_spec() supersedes find_module() at this point.

----------
components: Library (Lib)
messages: 379493
nosy: brett.cannon
priority: normal
severity: normal
status: open
title: [importlib] Deprecate find_module() implementations
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42135>
_______________________________________

From report at bugs.python.org  Fri Oct 23 19:11:40 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 23:11:40 +0000
Subject: [issue42135] [importlib] Deprecate find_module() implementations
In-Reply-To: <1603494695.54.0.8376376438.issue42135@roundup.psfhosted.org>
Message-ID: <1603494700.55.0.478921378565.issue42135@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
dependencies: +Raise ImportWarning when falling back to find_module()

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42135>
_______________________________________

From report at bugs.python.org  Fri Oct 23 19:12:21 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 23 Oct 2020 23:12:21 +0000
Subject: [issue42127] functools.cached_property possibly disables key-sharing
 instance dictionaries
In-Reply-To: <1603464695.3.0.183922542861.issue42127@roundup.psfhosted.org>
Message-ID: <1603494741.28.0.494391876152.issue42127@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee:  -> docs at python
components: +Documentation -Library (Lib)
nosy: +docs at python

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42127>
_______________________________________

From report at bugs.python.org  Fri Oct 23 19:14:13 2020
From: report at bugs.python.org (Dennis Sweeney)
Date: Fri, 23 Oct 2020 23:14:13 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603494853.14.0.842614805417.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

Here are those zipf-distributed benchmarks for PR 22904: https://pastebin.com/raw/qBaMi2dm

Ignoring differences of <5%, there are 33 cases that get slower, but 477 cases that got faster.

Here's a stringbench.py run for PR 22904: https://pastebin.com/raw/ABm32bA0

It looks like the stringbench times get a bit worse on a few cases, but I would attribute that to the benchmarks having many "difficult" cases with a unique character at the end of the needle, such as:

    s="ABC"*33; ((s+"D")*500+s+"E").find(s+"E"),

which the status quo already handles as well as possible, whereas the PR best handles the case where some middle "cut" character is unique. Who knows how common these cases are.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Fri Oct 23 19:18:48 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 23:18:48 +0000
Subject: [issue42136] [importlib] deprecate module_repr() methods
Message-ID: <1603495128.4.0.940710955069.issue42136@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

The import system handles what `module_repr()` was meant for.

----------
components: Library (Lib)
messages: 379495
nosy: brett.cannon
priority: normal
severity: normal
status: open
title: [importlib] deprecate module_repr() methods
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42136>
_______________________________________

From report at bugs.python.org  Fri Oct 23 19:21:03 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 23:21:03 +0000
Subject: [issue42137] Raise an ImportWarning for calling module_repr() on
 loaders
In-Reply-To: <1603495255.51.0.316157271396.issue42137@roundup.psfhosted.org>
Message-ID: <1603495263.16.0.702880492022.issue42137@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
dependencies: +[importlib] deprecate module_repr() methods

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42137>
_______________________________________

From report at bugs.python.org  Fri Oct 23 19:20:55 2020
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 23 Oct 2020 23:20:55 +0000
Subject: [issue42137] Raise an ImportWarning for calling module_repr() on
 loaders
Message-ID: <1603495255.51.0.316157271396.issue42137@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

Once all traces of module_repr() are gone, raise an `ImportWarning` when using `module_repr()`.

Once this is implemented and has been out in the wild for a sufficient amount of time, it should be switching to a DeprecationWarning and then the fallback eventually removed.

----------
components: Interpreter Core
messages: 379496
nosy: brett.cannon
priority: normal
severity: normal
status: open
title: Raise an ImportWarning for calling module_repr() on loaders
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42137>
_______________________________________

From report at bugs.python.org  Fri Oct 23 19:40:05 2020
From: report at bugs.python.org (Weiliang Li)
Date: Fri, 23 Oct 2020 23:40:05 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603496405.93.0.850869523748.issue41950@roundup.psfhosted.org>


Weiliang Li <to.be.impressive at gmail.com> added the comment:

Thank you, our hardworking BDFL!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 20:10:58 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 00:10:58 +0000
Subject: [issue38953] Untokenize and retokenize does not round-trip
In-Reply-To: <1575284774.35.0.371169137429.issue38953@roundup.psfhosted.org>
Message-ID: <1603498258.13.0.0906149498197.issue38953@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Zac, thank you for Hypothesmith.  I am thinking about how to maybe use it to test certain IDLE functions.  But your 2nd example, as posted, does not compile, even with 3.8.  Typo?

Thank you also for the two failure examples.  I worked on untokenize in 2013 and an not surprised that there are still bugs.  The test assert matches the doc claim that the untokenize return "is guaranteed to tokenize back to match the input" of untokenize as far as type and string.  To get output that could be used to fix the bugs, I converted to unittest (and ran with 3.10).

from io import StringIO as SIO
import tokenize
import unittest

class RoundtripTest(unittest.TestCase):
    def test_examples(self):
        examples = ("#", "\n\\\n", "#\n\x0cpass#\n",)
        for code in examples:
            with self.subTest(code=code):
                tokens = list(tokenize.generate_tokens(SIO(code).readline))
                print(tokens)
                outstring = tokenize.untokenize(tokens)  # may change whitespace from source
                print(outstring)
                output = tokenize.generate_tokens(SIO(outstring).readline)
                self.assertEqual([(t.type, t.string) for t in tokens],
                                 [(t.type, t.string) for t in output])

unittest.main()

"#" compiles: untokenize calls add_whitespace, which failed on line 173 with
 ValueError: start (1,1) precedes previous end (2,0)
tokens = [
TokenInfo(type=60 (COMMENT), string='#', start=(1, 0), end=(1, 1), line='#'),
TokenInfo(type=61 (NL), string='', start=(1, 1), end=(1, 1), line='#'),
TokenInfo(type=4 (NEWLINE), string='', start=(1, 1), end=(1, 2), line=''),
TokenInfo(type=0 (ENDMARKER), string='', start=(2, 0), end=(2, 0), line='')]

The doc for NL, a tokenize-only token, says "Token value used to indicate a non-terminating newline. The NEWLINE token indicates the end of a logical line of Python code; NL tokens are generated when a logical line of code is continued over multiple physical lines."  The NL token seems to be a mistake here.

Calling add_whitespace also seems like a mistake.  In any case, raising on a valid token stream is obviously bad.


"\n\\\n" does not compile in 3.8 or 3.10.
>>> compile("\n\\\n", '', 'exec')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "", line 2
    \
     ^
SyntaxError: unexpected EOF while parsing

generate_tokens calls _tokenize, which failed on line 521, as it should, with
tokenize.TokenError: ('EOF in multi-line statement', (3, 0))
Nothing to fix here.


"#\n\x0cpass#\n": outstring is '#\n pass#\n', which fails compile with IndentationError.
[(60, '#'),(61, '\n'),         (1, 'pass'),(60, '#'),(4, '\n'),        (0, '')] != 
[(60, '#'),(61, '\n'),(5, ' '),(1, 'pass'),(60, '#'),(4, '\n'),(6, ''),(0, '')]

test_tokenize tests the roundtrip with various modules and test strings, but perhaps none with formfeed.  I think the bug is tokenizing 'pass' as starting in column 1 instead of column 0.
TokenInfo(type=1 (NAME), string='pass', start=(2, 1), end=(2, 5), line='\x0cpass#\n')

Formfeed = '\f' = '\x0c' is legal here precisely because it is non-space 'whitespace' that does not advance the column counter.  In _tokenize, \f sets the column counter for indentation to 0.  Otherwise, there would be an IndentationError, as there is with the outstring.  But the string position ignores the indentation counter.  Either the string position must be adjusted, so \f is replaced with nothing, or a token for \f must be emitted so it is not replaced.

Tokens 5 and 6 are INDENT and DEDENT, so the latter will go away with the former.

What is a bit silly about untokenize is that it ignores the physical line of 5-tuples even when present.  Another issue, along with the dreadful API.


A note could be added to https://docs.python.org/3/reference/lexical_analysis.html#whitespace-between-tokens when _tokenize is patched.
---

BPO is aimed at facilitating patches.  Other discussions are best done elsewhere.  But I have a quick question and comment.

Can hypothesis be integrated as is with unittest?  Does it work to decorate test_xyz and get a sensible report of multiple failures?  Is there now or possibly in the future an iterator interface, so one could write "for testcase in testcases:   with subTest...."

About properties: your blog post https://github.com/Zac-HD/stdlib-property-tests pointed me to metamorphic testing https://www.hillelwayne.com/post/metamorphic-testing/ which lead me to the PDF version of "?Metamorphic Testing: A Review of Challenges and Opportunities?.  Most properties I have seen correspond to metamorphic relations.  The 'metamorphic' is broader than may be immediately obvious.  I would like to discuss this more on a better channel.

----------
stage:  -> test needed
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38953>
_______________________________________

From report at bugs.python.org  Fri Oct 23 20:11:14 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 24 Oct 2020 00:11:14 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603498274.21.0.368722864641.issue41950@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset dc33f798139016961fba33b37c792c690399b2b6 by Weiliang Li in branch '3.9':
bpo-41950: Typo in Python 3.9 what's new page (GH-22573)
https://github.com/python/cpython/commit/dc33f798139016961fba33b37c792c690399b2b6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 20:12:13 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 24 Oct 2020 00:12:13 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603498333.57.0.994669164467.issue41950@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Thanks, merged, so closing.

I'll open a separate issue regarding the forward-porting of the 3.9 whatsnew.

----------
resolution:  -> fixed
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 20:15:56 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 24 Oct 2020 00:15:56 +0000
Subject: [issue42138] Forward port Doc/whatsnew/3.9.rst to master
Message-ID: <1603498556.27.0.77301023463.issue42138@roundup.psfhosted.org>


New submission from Guido van Rossum <guido at python.org>:

We discovered in issue41950 that the whatsnew/3.9.rst files differ quite a bit between 3.9 and master. IIUC this is (mostly) because Lukasz made a big pass updating it on occasion of the 3.9.0 release, and he did that in the 3.9 branch:
https://github.com/python/cpython/commit/9cf6752276e6fcfd0c23fdb064ad27f448aaaf75#diff-ec874d66bbcf13046b9928aa3716d14a93632f568b914eba32baf46ff4c9eb36R1180

Historically we've kept these docs in sync.

For someone with a bit of git knowledge this should be a simple thing (probably just cp that thing into master).

----------
messages: 379501
nosy: gvanrossum, lukasz.langa
priority: normal
severity: normal
status: open
title: Forward port Doc/whatsnew/3.9.rst to master
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42138>
_______________________________________

From report at bugs.python.org  Fri Oct 23 20:21:18 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 00:21:18 +0000
Subject: [issue42111] Make the xxlimited module an example of best extension
 module practices
In-Reply-To: <1603310336.9.0.27411366123.issue42111@roundup.psfhosted.org>
Message-ID: <1603498878.42.0.758237824262.issue42111@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I would interpret the limited pydev response (1 person, whose concern you incorporated into your post) to indicate absence of opposition.  Given that 384 was written by someone inactive for years, I say go ahead and submit a PR for review by any interested active maintainers.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42111>
_______________________________________

From report at bugs.python.org  Fri Oct 23 20:23:44 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 24 Oct 2020 00:23:44 +0000
Subject: [issue42138] Forward port Doc/whatsnew/3.9.rst to master
In-Reply-To: <1603498556.27.0.77301023463.issue42138@roundup.psfhosted.org>
Message-ID: <1603499024.98.0.246465293252.issue42138@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
keywords: +patch
pull_requests: +21853
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22933

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42138>
_______________________________________

From report at bugs.python.org  Fri Oct 23 20:26:43 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 00:26:43 +0000
Subject: [issue42116] Inspect library ignore comments at the end of a function
 (inspect.getsource)
In-Reply-To: <1603363723.99.0.873580527867.issue42116@roundup.psfhosted.org>
Message-ID: <1603499203.34.0.379798641734.issue42116@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
nosy: +yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42116>
_______________________________________

From report at bugs.python.org  Fri Oct 23 20:47:09 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 24 Oct 2020 00:47:09 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603500429.13.0.00703128882519.issue35823@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset 976da903a746a5455998e9ca45fbc4d3ad3479d8 by Alexey Izbyshev in branch 'master':
bpo-35823: subprocess: Use vfork() instead of fork() on Linux when safe (GH-11671)
https://github.com/python/cpython/commit/976da903a746a5455998e9ca45fbc4d3ad3479d8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Fri Oct 23 20:54:32 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 24 Oct 2020 00:54:32 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603500872.95.0.421928754342.issue35823@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

now waiting to see how happy all of the buildbots are...

We currently have a `__linux__` check in the code deciding VFORK_USABLE.

>From what I can tell, vfork probably also works on macOS (darwin).

Lets let this run for a bit on Linux and it can be a separate issue to open vfork usage up to other platforms.

----------
stage: patch review -> commit review

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Fri Oct 23 20:55:39 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 00:55:39 +0000
Subject: [issue42121] unable to input certain Unicode characters in Text widget
In-Reply-To: <1603400094.16.0.618856195633.issue42121@roundup.psfhosted.org>
Message-ID: <1603500939.96.0.0468277053876.issue42121@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I am closing this because I am rather sure that your problem is with your input method and its interaction with your OS and the tcl/tk GUI framework.  Tkinter has essentially nothing to do with key and mouse input.

A better place to ask for debugging help is https://mail.python.org/mailman/listinfo/python-list.  If you post there, include your OS.

For testing tkinter, you should input with keys, using the unicode escaped codes: '\u####' for BMP chars, and '\U000#####' for non-BMP chars, where each # is a hexadecimal character.

For using tkinter, you should use a recent release, within the last year, as tkinter's handling of non-ASCII chars are improved a year ago.   The fix may be in the 3.7.9 release.

If your browser supports unicode as well as, say, Firefox does, (which is better than Tkinter) your input method should work with it.

BPO is for developing patches to fix and enhance the Python docs and the CPython implementation.  You have not yet given evidence that there is bug in *current* CPython.  If you do, we can reopen.

----------
nosy: +terry.reedy
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42121>
_______________________________________

From report at bugs.python.org  Fri Oct 23 20:58:47 2020
From: report at bugs.python.org (Zac Hatfield-Dodds)
Date: Sat, 24 Oct 2020 00:58:47 +0000
Subject: [issue38953] Untokenize and retokenize does not round-trip
In-Reply-To: <1575284774.35.0.371169137429.issue38953@roundup.psfhosted.org>
Message-ID: <1603501127.27.0.692198969027.issue38953@roundup.psfhosted.org>


Zac Hatfield-Dodds <zac.hatfield.dodds at gmail.com> added the comment:

Thanks for your comments Terry - I'm delighted that it's useful.  It's been a while since I wrote that, and entirely possible that it's just a typo.

Hypothesis does indeed support unittest, including for multiple-failure reporting and so on. 
 You can see my unittest implementation of the tokenise tests at https://github.com/Zac-HD/stdlib-property-tests/blob/b5ef97f9e7fd1b0e7a028823e436f78f374cf0dc/tests/test_source_code.py#L87-L133

Subtests are a little tricky, because the default interaction is to store the subtests for *all* test cases generated by Hypothesis.  We therefore monkeypatch it to a no-op, but more sophisticated handling is almost certainly possible.  More generally, when using Hypothesis I would usually ask @given for single inputs and call the test method; which replaces the usual loop over a list of inputs with subTest.

An iterator interface is not available because in general (see e.g. `hypothesis.strategies.data()` or stateful testing) it is not possible to separate data generation from test execution, and also because Hypothesis uses feedback from previous inputs in deciding what to generate.  Instead of "for testcase in testcases: with subTest: ...", I'd write "@given(testcase=...) def test_foo(self, testcase): ...".


I've sent you an email for the other conversation.  (anyone else interested is invited to get in touch via zhd.dev :-))

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38953>
_______________________________________

From report at bugs.python.org  Fri Oct 23 20:59:17 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 24 Oct 2020 00:59:17 +0000
Subject: [issue19072] classmethod doesn't honour descriptor protocol of
 wrapped callable
In-Reply-To: <1379856164.11.0.6368818134.issue19072@psf.upfronthosting.co.za>
Message-ID: <1603501157.0.0.466192120126.issue19072@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
pull_requests: +21854
pull_request: https://github.com/python/cpython/pull/22934

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19072>
_______________________________________

From report at bugs.python.org  Fri Oct 23 21:15:11 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 24 Oct 2020 01:15:11 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603502111.71.0.325432718183.issue35823@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

> * To avoid repeating long parameter lists in several functions, we can move them to a struct. The downside is that we'd need to convert child_exec() to use that struct all over the place. I don't have a strong preference here.

Agreed that the long parameter lists are annoying.  I don't like shoving that much on the stack and by adding an additional call with so many params we've increase stack usage.  I consider this refactoring work that can be done on its own outside of this issue though.

> * Are any documentation changes needed? We don't change any interfaces, so I'm not sure.

I don't think so.  I looked things over and I think all that is needed is the existing Misc/NEWS entry.

> Potential future directions:
> 
> * If desired, a vfork() opt-out may be implemented. But it'd need to disable posix_spawn() on Linux as well, since it might be implemented via vfork(), and we have no good way to check that.

We have such an opt-out capabilty for posix_spawn via `subprocess._USE_POSIX_SPAWN` https://github.com/python/cpython/blob/master/Lib/subprocess.py#L651
along with code in there that determines the default value based on the detected runtime environment.

I'm not sure we'll need that for vfork() as it seems to pretty much be a low level raw system call wrapper rather than something to be implemented via libc that can have its own bugs.  If we do wind up wanting one, I'd structure it the same way.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Fri Oct 23 21:17:28 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 01:17:28 +0000
Subject: [issue42123] Run parser twice;
 enable invalid_* rules only on the second run
In-Reply-To: <1603409743.28.0.787265357056.issue42123@roundup.psfhosted.org>
Message-ID: <1603502248.93.0.632585468069.issue42123@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Since I do a lot of interactive compiling, I appreciate faster feedback.  How much will the slowdown be on errors?

----------
nosy: +terry.reedy
title: Run the two times, only enable invalid_* rules on the second run -> Run parser twice; enable invalid_* rules only on the second run

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42123>
_______________________________________

From report at bugs.python.org  Fri Oct 23 21:37:32 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 24 Oct 2020 01:37:32 +0000
Subject: [issue19072] classmethod doesn't honour descriptor protocol of
 wrapped callable
In-Reply-To: <1379856164.11.0.6368818134.issue19072@psf.upfronthosting.co.za>
Message-ID: <1603503452.9.0.632292538919.issue19072@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 8e5b0fdce337ef0a1f4f38b31a8c6b66c56b16d2 by Raymond Hettinger in branch 'master':
bpo-19072: Update descriptor howto for decorator chaining (GH-22934)
https://github.com/python/cpython/commit/8e5b0fdce337ef0a1f4f38b31a8c6b66c56b16d2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19072>
_______________________________________

From report at bugs.python.org  Fri Oct 23 21:37:43 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 24 Oct 2020 01:37:43 +0000
Subject: [issue19072] classmethod doesn't honour descriptor protocol of
 wrapped callable
In-Reply-To: <1379856164.11.0.6368818134.issue19072@psf.upfronthosting.co.za>
Message-ID: <1603503463.15.0.160311410758.issue19072@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 9.0 -> 10.0
pull_requests: +21855
pull_request: https://github.com/python/cpython/pull/22935

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19072>
_______________________________________

From report at bugs.python.org  Fri Oct 23 22:01:42 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 24 Oct 2020 02:01:42 +0000
Subject: [issue19072] classmethod doesn't honour descriptor protocol of
 wrapped callable
In-Reply-To: <1379856164.11.0.6368818134.issue19072@psf.upfronthosting.co.za>
Message-ID: <1603504902.42.0.789655606387.issue19072@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset c17f63fae57dc02e78bd6931b8fb6c6c2f9d4d81 by Miss Skeleton (bot) in branch '3.9':
bpo-19072: Update descriptor howto for decorator chaining (GH-22934) (GH-22935)
https://github.com/python/cpython/commit/c17f63fae57dc02e78bd6931b8fb6c6c2f9d4d81


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19072>
_______________________________________

From report at bugs.python.org  Fri Oct 23 22:20:26 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 24 Oct 2020 02:20:26 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603506026.84.0.321991808084.issue35823@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Thank you for taking this on!  I'm calling it fixed for now as the buildbots are looking happy with it.  If issues with it arise we can address them.

----------
resolution:  -> fixed
stage: commit review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Fri Oct 23 23:04:47 2020
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sat, 24 Oct 2020 03:04:47 +0000
Subject: [issue35181] Doc: Namespace Packages: Inconsistent documentation of
 __loader__ being None
In-Reply-To: <1541543349.68.0.788709270274.issue35181@psf.upfronthosting.co.za>
Message-ID: <1603508687.84.0.907193020719.issue35181@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

Thanks @barry for reviewing and merging PR 15190

> I haven't merged PR 10016, but I left some additional comments.  Are you still interested in shepherding this PR?

Also thanks for helping me with @ericsnowcurrently advancing this last PR. Yes I am still interested, I have reviewed all the comments and updated the whole thing, doing my best to keep the two descriptions of the module attributes and spec attributes consistent since this PEP updates both descriptions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35181>
_______________________________________

From report at bugs.python.org  Fri Oct 23 23:25:45 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 03:25:45 +0000
Subject: [issue42139] Synchronize What's New in 3.9 master and 3.9
Message-ID: <1603509945.65.0.000359045856286.issue42139@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

Continuation of #41808, #41950, 9cf6752276e6fcfd0c23fdb064ad27f448aaaf75 (Langa, no diff).

Attached is a current diff (about 1/2 hour ago).  It appears to be all or almost all Langa's release edits in 9cf6752276e6fcfd0c23fdb064ad27f448aaaf75.  The important point is that all the +s are for the 3.9 version.  So the files can be synchronized easily by copying the 3.9 copy to master (each with separate workspaces).  I will re-update first to make sure to catch the changes in #41950.

----------
files: whatnew39-master-to-39.diff
keywords: patch
messages: 379513
nosy: gvanrossum, lukasz.langa, terry.reedy
priority: normal
severity: normal
stage: needs patch
status: open
title: Synchronize What's New in 3.9 master and 3.9
versions: Python 3.10
Added file: https://bugs.python.org/file49538/whatnew39-master-to-39.diff

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42139>
_______________________________________

From report at bugs.python.org  Fri Oct 23 23:26:44 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 03:26:44 +0000
Subject: [issue41950] Typo in Python 3.9 what's new page
In-Reply-To: <1601952138.4.0.0931015825602.issue41950@roundup.psfhosted.org>
Message-ID: <1603510004.38.0.436364695712.issue41950@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

See #42139

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41950>
_______________________________________

From report at bugs.python.org  Fri Oct 23 23:31:28 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 03:31:28 +0000
Subject: [issue42139] Synchronize What's New in 3.9 master and 3.9
In-Reply-To: <1603509945.65.0.000359045856286.issue42139@roundup.psfhosted.org>
Message-ID: <1603510288.72.0.89598951605.issue42139@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
pull_requests: +21856
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/22936

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42139>
_______________________________________

From report at bugs.python.org  Fri Oct 23 23:46:18 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 03:46:18 +0000
Subject: [issue42070] Revisit IsoCalendarDate being private from pickle
 perspective
In-Reply-To: <1603046695.09.0.570659045382.issue42070@roundup.psfhosted.org>
Message-ID: <1603511178.24.0.901345214939.issue42070@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

If this point I suggest asking on pydev, maybe after you think more about how you want it to be for the next decade.

If the behavior is intentional and the doc says nothing, one might consider the behavior the 'document'.  Hence deprecation might be needed.  Too bad the API was not labelled 'provisional'.

If not being documented is what lead to the SO question, then it probably should be documented.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42070>
_______________________________________

From report at bugs.python.org  Fri Oct 23 23:59:41 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 24 Oct 2020 03:59:41 +0000
Subject: [issue42139] Synchronize What's New in 3.9 master and 3.9
In-Reply-To: <1603509945.65.0.000359045856286.issue42139@roundup.psfhosted.org>
Message-ID: <1603511981.78.0.482544567294.issue42139@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 805ef73ad0ac4a77f3764dd17dfc959d562ce627 by Terry Jan Reedy in branch 'master':
bpo-42139: Update What's New 3.9 for master (#22936)
https://github.com/python/cpython/commit/805ef73ad0ac4a77f3764dd17dfc959d562ce627


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42139>
_______________________________________

From report at bugs.python.org  Sat Oct 24 00:01:26 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 24 Oct 2020 04:01:26 +0000
Subject: [issue42138] Forward port Doc/whatsnew/3.9.rst to master
In-Reply-To: <1603498556.27.0.77301023463.issue42138@roundup.psfhosted.org>
Message-ID: <1603512086.58.0.570206677722.issue42138@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Terry did the same thing in https://bugs.python.org/issue42139.

----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42138>
_______________________________________

From report at bugs.python.org  Sat Oct 24 00:07:17 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 24 Oct 2020 04:07:17 +0000
Subject: [issue42139] Synchronize What's New in 3.9 master and 3.9
In-Reply-To: <1603509945.65.0.000359045856286.issue42139@roundup.psfhosted.org>
Message-ID: <1603512437.77.0.187572324053.issue42139@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

You also need to forward-port https://bugs.python.org/issue41950.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42139>
_______________________________________

From report at bugs.python.org  Sat Oct 24 00:08:53 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 24 Oct 2020 04:08:53 +0000
Subject: [issue42139] Synchronize What's New in 3.9 master and 3.9
In-Reply-To: <1603509945.65.0.000359045856286.issue42139@roundup.psfhosted.org>
Message-ID: <1603512533.13.0.0407675754089.issue42139@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Never mind, I read the diff backwards. You're all good and you can close this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42139>
_______________________________________

From report at bugs.python.org  Sat Oct 24 00:12:14 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 04:12:14 +0000
Subject: [issue42139] Synchronize What's New in 3.9 master and 3.9
In-Reply-To: <1603509945.65.0.000359045856286.issue42139@roundup.psfhosted.org>
Message-ID: <1603512734.85.0.71182235872.issue42139@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42139>
_______________________________________

From report at bugs.python.org  Sat Oct 24 00:22:53 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Sat, 24 Oct 2020 04:22:53 +0000
Subject: [issue38523] ignore_dangling_symlinks in shutil.copytree does not
 apply recursively
In-Reply-To: <1571437755.03.0.462874003253.issue38523@roundup.psfhosted.org>
Message-ID: <1603513373.01.0.212405806411.issue38523@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
nosy: +ZackerySpytz
nosy_count: 1.0 -> 2.0
pull_requests: +21857
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22937

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38523>
_______________________________________

From report at bugs.python.org  Sat Oct 24 01:29:15 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 24 Oct 2020 05:29:15 +0000
Subject: [issue40841] Provide mimetypes.sniff API as stdlib
In-Reply-To: <1591080165.24.0.514984320107.issue40841@roundup.psfhosted.org>
Message-ID: <1603517355.74.0.177544866954.issue40841@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

@gvanrossum, @taleinat

I've already provided the mimesniffing through PyPI ;)
https://pypi.org/project/mimesniff/

The interface is similar to imghdr.what :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40841>
_______________________________________

From report at bugs.python.org  Sat Oct 24 02:39:38 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 24 Oct 2020 06:39:38 +0000
Subject: [issue24165] Free list for single-digits ints
In-Reply-To: <1431352769.3.0.375640200007.issue24165@psf.upfronthosting.co.za>
Message-ID: <1603521578.23.0.862172082305.issue24165@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I close this issue for now. Please reopen or create a new issue if you came up with better idea.

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24165>
_______________________________________

From report at bugs.python.org  Sat Oct 24 02:51:22 2020
From: report at bugs.python.org (Diogo Dutra)
Date: Sat, 24 Oct 2020 06:51:22 +0000
Subject: [issue42140] asyncio.wait function creates futures set two times
Message-ID: <1603522282.48.0.50359686965.issue42140@roundup.psfhosted.org>


New submission from Diogo Dutra <diogodutradamata at gmail.com>:

The python3.9 code creates the futures set two times.
We can create this set before, avoiding the second creation.

This python3.9 behaviour breaks the aiokafka library, because it gives an iterator to that function, so the second iteration become empty.

----------
components: asyncio
messages: 379522
nosy: asvetlov, dutradda, yselivanov
priority: normal
pull_requests: 21858
severity: normal
status: open
title: asyncio.wait function creates futures set two times
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42140>
_______________________________________

From report at bugs.python.org  Sat Oct 24 03:08:49 2020
From: report at bugs.python.org (Denis S. Otkidach)
Date: Sat, 24 Oct 2020 07:08:49 +0000
Subject: [issue42140] asyncio.wait function creates futures set two times
In-Reply-To: <1603522282.48.0.50359686965.issue42140@roundup.psfhosted.org>
Message-ID: <1603523329.78.0.243162555302.issue42140@roundup.psfhosted.org>


Change by Denis S. Otkidach <denis.otkidach at gmail.com>:


----------
nosy: +ods

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42140>
_______________________________________

From report at bugs.python.org  Sat Oct 24 03:22:00 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 24 Oct 2020 07:22:00 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1603524120.05.0.858294918906.issue41835@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

@Mark.Shannon I had seen some speedup on tornado benchmark when I didn't use PGO+LTO. but it was noise.

Now I use PGO+LTO. master vs PR-22909:

$ ./python -m pyperf compare_to master-opt.json speedup_kw-opt.json -G --min-speed=1
Slower (11):
- spectral_norm: 147 ms +- 1 ms -> 153 ms +- 2 ms: 1.04x slower (+4%)
- pickle_dict: 28.6 us +- 0.1 us -> 29.5 us +- 0.6 us: 1.03x slower (+3%)
- regex_compile: 199 ms +- 1 ms -> 204 ms +- 4 ms: 1.03x slower (+3%)
- chameleon: 9.75 ms +- 0.10 ms -> 9.99 ms +- 0.09 ms: 1.02x slower (+2%)
- logging_format: 10.9 us +- 0.2 us -> 11.1 us +- 0.2 us: 1.02x slower (+2%)
- sqlite_synth: 3.29 us +- 0.05 us -> 3.36 us +- 0.05 us: 1.02x slower (+2%)
- regex_v8: 26.1 ms +- 0.1 ms -> 26.5 ms +- 0.3 ms: 1.02x slower (+2%)
- json_dumps: 14.6 ms +- 0.1 ms -> 14.8 ms +- 0.1 ms: 1.02x slower (+2%)
- logging_simple: 9.88 us +- 0.18 us -> 10.0 us +- 0.2 us: 1.02x slower (+2%)
- nqueens: 105 ms +- 1 ms -> 107 ms +- 2 ms: 1.01x slower (+1%)
- raytrace: 511 ms +- 5 ms -> 517 ms +- 6 ms: 1.01x slower (+1%)

Faster (10):
- regex_dna: 233 ms +- 1 ms -> 229 ms +- 1 ms: 1.02x faster (-2%)
- unpickle: 14.7 us +- 0.1 us -> 14.5 us +- 0.2 us: 1.02x faster (-1%)
- deltablue: 8.17 ms +- 0.29 ms -> 8.06 ms +- 0.17 ms: 1.01x faster (-1%)
- mako: 16.8 ms +- 0.2 ms -> 16.6 ms +- 0.1 ms: 1.01x faster (-1%)
- xml_etree_iterparse: 117 ms +- 1 ms -> 116 ms +- 1 ms: 1.01x faster (-1%)
- scimark_monte_carlo: 117 ms +- 2 ms -> 115 ms +- 1 ms: 1.01x faster (-1%)
- xml_etree_parse: 164 ms +- 3 ms -> 162 ms +- 1 ms: 1.01x faster (-1%)
- unpack_sequence: 62.7 ns +- 0.7 ns -> 62.0 ns +- 0.7 ns: 1.01x faster (-1%)
- regex_effbot: 3.43 ms +- 0.01 ms -> 3.39 ms +- 0.02 ms: 1.01x faster (-1%)
- scimark_fft: 405 ms +- 4 ms -> 401 ms +- 1 ms: 1.01x faster (-1%)

Benchmark hidden because not significant (39)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Sat Oct 24 03:36:55 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 24 Oct 2020 07:36:55 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1603525015.72.0.152647903074.issue41835@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

@Marco Sulla

> @methane: well, to be honest, I don't see much difference between the two pulls. The major difference is that you merged insertdict_init in dict_merge_init.

Not only it but also some simplification which make 10% faster than GH-22346.

> But I kept insertdict_init separate on purpose, because this function can be used in other future dedicated function on creation time only.

Where do you expect to use it? Would you implement some more optimization based on your PR to demonstrate your idea?

I confirmed that GH-22909 can be used to optimize BUILD_CONST_KEY_MAP (GH-22911). That's why I merged two functions.

> AssertionError: would build wheel with unsupported tag ('cp310', 'cp310', 'linux_x86_64')

Try `pip install pyperformance==1.0.0`.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Sat Oct 24 03:53:05 2020
From: report at bugs.python.org (Chris Jerdonek)
Date: Sat, 24 Oct 2020 07:53:05 +0000
Subject: [issue42130] AsyncIO's wait_for can hide cancellation in a rare race
 condition
In-Reply-To: <1603469429.01.0.760360212477.issue42130@roundup.psfhosted.org>
Message-ID: <1603525985.98.0.568600260657.issue42130@roundup.psfhosted.org>


Change by Chris Jerdonek <chris.jerdonek at gmail.com>:


----------
nosy: +chris.jerdonek

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42130>
_______________________________________

From report at bugs.python.org  Sat Oct 24 05:10:19 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 24 Oct 2020 09:10:19 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1603530619.28.0.922788679827.issue41835@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I confirmed _PyDict_FromItems() can be used to optimize _PyStack_AsDict() too.
See https://github.com/methane/cpython/pull/25

But I can not confirm significant performance gain from it too.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Sat Oct 24 05:26:39 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 24 Oct 2020 09:26:39 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603531599.44.0.978700404784.issue42096@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
nosy: +gregory.p.smith, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Sat Oct 24 05:42:11 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 24 Oct 2020 09:42:11 +0000
Subject: [issue24165] Free list for single-digits ints
In-Reply-To: <1431352769.3.0.375640200007.issue24165@psf.upfronthosting.co.za>
Message-ID: <1603532531.12.0.932404913714.issue24165@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I agree that it is not worth to add this optimization.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24165>
_______________________________________

From report at bugs.python.org  Sat Oct 24 05:47:57 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sat, 24 Oct 2020 09:47:57 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603532877.32.0.394496248014.issue35823@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

> From what I can tell, vfork probably also works on macOS (darwin).
> 
> Lets let this run for a bit on Linux and it can be a separate issue to 
> open vfork usage up to other platforms.

I'd prefer to not use vfork on macOS. For one I don't particularly trust that vfork would work reliably when using higher level APIs, but more importantly posix_spawn on macOS has some options that are hard to achieve otherwise and might be useful to expose in subprocess. An example of this is selecting the CPU architecture to use for the launched process when using fat binaries and a system that supports CPU emulation, such as the intel emulation on the upcoming Apple Silicon systems.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Sat Oct 24 08:47:25 2020
From: report at bugs.python.org (Marco Sulla)
Date: Sat, 24 Oct 2020 12:47:25 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1603543645.04.0.60323887513.issue41835@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

I commented out sqlalchemy in the requirements.txt in the pyperformance source code, and it worked. I had also to skip tornado:

pyperformance run -r -b,-sqlalchemy_declarative,-sqlalchemy_imperative,-tornado_http -o ../perf_master.json

This is my result:

pyperformance compare perf_master.json perf_dict_init.json -O table | grep Significant
| 2to3                    | 356 ms           | 348 ms              | 1.02x faster | Significant (t=7.28)   |
| fannkuch                | 485 ms           | 468 ms              | 1.04x faster | Significant (t=9.68)   |
| pathlib                 | 22.5 ms          | 22.1 ms             | 1.02x faster | Significant (t=13.02)  |
| pickle_dict             | 29.0 us          | 30.3 us             | 1.05x slower | Significant (t=-92.36) |
| pickle_list             | 4.55 us          | 4.64 us             | 1.02x slower | Significant (t=-10.87) |
| pyflate                 | 735 ms           | 702 ms              | 1.05x faster | Significant (t=6.67)   |
| regex_compile           | 197 ms           | 193 ms              | 1.02x faster | Significant (t=2.81)   |
| regex_v8                | 24.5 ms          | 23.9 ms             | 1.02x faster | Significant (t=17.63)  |
| scimark_fft             | 376 ms           | 386 ms              | 1.03x slower | Significant (t=-15.07) |
| scimark_lu              | 154 ms           | 158 ms              | 1.03x slower | Significant (t=-12.94) |
| sqlite_synth            | 3.35 us          | 3.21 us             | 1.04x faster | Significant (t=17.65)  |
| telco                   | 6.54 ms          | 7.14 ms             | 1.09x slower | Significant (t=-8.51)  |
| unpack_sequence         | 58.8 ns          | 61.5 ns             | 1.04x slower | Significant (t=-19.66) |

It's strange that some benchmarks are slower, since the patch only do two additional checks to dict_vectorcall. Maybe they use many little dicts?

@methane:
> Would you implement some more optimization based on your PR to demonstrate your idea?

I already done them, I'll do a PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Sat Oct 24 11:05:05 2020
From: report at bugs.python.org (Mark Roseman)
Date: Sat, 24 Oct 2020 15:05:05 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603551905.11.0.975357812327.issue33987@roundup.psfhosted.org>


Change by Mark Roseman <mark at markroseman.com>:


----------
pull_requests: +21859
pull_request: https://github.com/python/cpython/pull/22941

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 11:49:17 2020
From: report at bugs.python.org (Mark Roseman)
Date: Sat, 24 Oct 2020 15:49:17 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603554557.48.0.773938546611.issue33987@roundup.psfhosted.org>


Change by Mark Roseman <mark at markroseman.com>:


----------
pull_requests: +21860
pull_request: https://github.com/python/cpython/pull/22942

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 12:09:36 2020
From: report at bugs.python.org (Mark Roseman)
Date: Sat, 24 Oct 2020 16:09:36 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603555776.72.0.38276483546.issue33987@roundup.psfhosted.org>


Change by Mark Roseman <mark at markroseman.com>:


----------
pull_requests: +21861
pull_request: https://github.com/python/cpython/pull/22943

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 12:28:23 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 24 Oct 2020 16:28:23 +0000
Subject: [issue42132] Use specs instead of just __loader__ in C code
In-Reply-To: <1603491361.46.0.996069640716.issue42132@roundup.psfhosted.org>
Message-ID: <1603556903.71.0.696568343695.issue42132@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42132>
_______________________________________

From report at bugs.python.org  Sat Oct 24 13:13:06 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Sat, 24 Oct 2020 17:13:06 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603559586.31.0.0413408050787.issue35823@roundup.psfhosted.org>


Change by Alexey Izbyshev <izbyshev at ispras.ru>:


----------
pull_requests: +21862
pull_request: https://github.com/python/cpython/pull/22944

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Sat Oct 24 13:29:41 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Sat, 24 Oct 2020 17:29:41 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603560581.04.0.591683874199.issue35823@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

> Thank you for taking this on!  I'm calling it fixed for now as the buildbots are looking happy with it.  If issues with it arise we can address them.

Thank you for reviewing and merging!

Using POSIX_CALL for pthread_sigmask() is incorrect, however, since it *returns* the error instead of setting errno. I've opened a PR with a fix and additional handling of the first pthread_sigmask() call in the parent (which can be done easily).

I've also noticed a memory leak why doing the above: cwd_obj2 is not released on the error path. It probably slipped with patches adding user/groups support. I'll file a separate issue.

Would you also clarify why you disallowed vfork() in case setsid() is needed? Have you discovered any potential issues with setsid()? Note that setsid() doesn't suffer from thread sync issues like setuid()/setgid()/etc.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Sat Oct 24 13:47:44 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 24 Oct 2020 17:47:44 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603561664.75.0.154308360287.issue35823@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset 473db47747bb8bc986d88ad81799bcbd88153ac5 by Alexey Izbyshev in branch 'master':
bpo-35823: subprocess: Fix handling of pthread_sigmask() errors (GH-22944)
https://github.com/python/cpython/commit/473db47747bb8bc986d88ad81799bcbd88153ac5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Sat Oct 24 14:12:19 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 24 Oct 2020 18:12:19 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603563139.5.0.0769019211016.issue35823@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

regarding excluding the setsid() case: I was being conservative as I couldn't find a reference of what was and wasn't allowed after vfork.

I found one thing suggesting that on macOS setsid() was not safe after vfork().  But that appeared to be a Darwin-ism.  I expect that is not true on Linux as it should just be a syscall updating a couple of fields in the process info.  Confirming, in glibc is appears to be a shim for the setsid syscall (based on not finding any code implementing anything special for it) and in uclibc (*much* easier to read) it is clearly just a setsid syscall shim.

I'll make a PR to undo the setsid restriction given we're Linux only.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Sat Oct 24 14:12:13 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 24 Oct 2020 18:12:13 +0000
Subject: [issue31484] Cache single-character strings outside of the Latin1
 range
In-Reply-To: <1505482179.61.0.572534667387.issue31484@psf.upfronthosting.co.za>
Message-ID: <1603563133.97.0.11296481095.issue31484@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31484>
_______________________________________

From report at bugs.python.org  Sat Oct 24 14:14:26 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 24 Oct 2020 18:14:26 +0000
Subject: [issue41052] Opt out serialization/deserialization for heap type
In-Reply-To: <1592659049.98.0.596314769567.issue41052@roundup.psfhosted.org>
Message-ID: <1603563266.45.0.585030491217.issue41052@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 8cd1dbae32d9303caac3a473d3332f17bc98c921 by Serhiy Storchaka in branch 'master':
bpo-41052: Fix pickling heap types implemented in C with protocols 0 and 1 (GH-22870)
https://github.com/python/cpython/commit/8cd1dbae32d9303caac3a473d3332f17bc98c921


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41052>
_______________________________________

From report at bugs.python.org  Sat Oct 24 14:16:22 2020
From: report at bugs.python.org (Aviram)
Date: Sat, 24 Oct 2020 18:16:22 +0000
Subject: [issue40001] ignore errors in SimpleCookie
In-Reply-To: <1584533209.73.0.816552573912.issue40001@roundup.psfhosted.org>
Message-ID: <1603563382.99.0.413653348499.issue40001@roundup.psfhosted.org>


Aviram <aviramyhassan at gmail.com> added the comment:

Hi all,
still waiting for review.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40001>
_______________________________________

From report at bugs.python.org  Sat Oct 24 14:34:49 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 24 Oct 2020 18:34:49 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603564489.11.0.306290329005.issue35823@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
pull_requests: +21863
pull_request: https://github.com/python/cpython/pull/22945

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Sat Oct 24 15:05:16 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 24 Oct 2020 19:05:16 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603566316.55.0.803768614836.issue42096@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

for what it's worth: false positives are always going to be possible in any such "magic" check as is_zipfile is.

we don't check the start of the file because zip files are defined by their end of file central directory which contains length information to determine where within the file the zip archive actually starts.

The issue28494 tests are a demonstration of this; It is somewhat common practice to append a zipfile to an executable of various forms for use as application specific data.

If you need more more reliable determination of file type not tied to a specific Python release, you might look at what the various file type sniffing magic libraries do for you, some examples include:
 https://pypi.org/project/filetype/
 https://pypi.org/project/puremagic/
 https://pypi.org/project/python-magic/

I _can_ reproduce this issue with the testdata @bckohan provided.

But I can't promise there is anything to fix here.  Even if we make the test slightly more robust by looking at another byte or two, it is always possible for files to appear to be a bunch of things at once based on small data signatures.

If nothing else we should reinforce in the documentation that is_zipfile is at best a guess.  False means it is not as far as the zipfile module is concerned.  True cannot guarantee that it is.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Sat Oct 24 15:07:43 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 24 Oct 2020 19:07:43 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603566463.84.0.944567731143.issue35823@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset be3c3a0e468237430ad7d19a33c60d306199a7f2 by Gregory P. Smith in branch 'master':
bpo-35823: Allow setsid() after vfork() on Linux. (GH-22945)
https://github.com/python/cpython/commit/be3c3a0e468237430ad7d19a33c60d306199a7f2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Sat Oct 24 15:12:42 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Sat, 24 Oct 2020 19:12:42 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603566762.74.0.687553303716.issue35823@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

> regarding excluding the setsid() case: I was being conservative as I couldn't find a reference of what was and wasn't allowed after vfork.

Yes, there is no list of functions allowed after vfork(), except for the conservative POSIX.1 list consisting only of _exit() and execve(), so we can only take async-signal-safe functions as a first approximation and work from there. Thankfully, on Linux, C libraries don't do anything fancy in most cases. But, for example, it appears that on FreeBSD we wouldn't be able to use sigprocmask()/sigaction()[1]. BTW, commit[2] and the linked review are an interesting reading for anybody who would like to support posix_spawn() and/or vfork() in subprocess on FreeBSD.

> Confirming, in glibc is appears to be a shim for the setsid syscall (based on not finding any code implementing anything special for it) and in uclibc (*much* easier to read) it is clearly just a setsid syscall shim.

I also recommend musl[3] when simplicity (and correctness) is required :)

[1] https://svnweb.freebsd.org/base/head/lib/libc/gen/posix_spawn.c?view=markup&pathrev=362111#l126
[2] https://svnweb.freebsd.org/base?view=revision&revision=352712
[3] https://git.musl-libc.org/cgit/musl/tree/src/unistd/setsid.c?id=a5aff1972c9e3981566414b09a28e331ccd2be5d

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Sat Oct 24 15:22:50 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Sat, 24 Oct 2020 19:22:50 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603567370.15.0.532047176076.issue35823@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

@ronaldoussoren

> I'd prefer to not use vfork on macOS. For one I don't particularly trust that vfork would work reliably when using higher level APIs, but more importantly posix_spawn on macOS has some options that are hard to achieve otherwise and might be useful to expose in subprocess.

I can't comment on vfork() usability on macOS myself, but given the number of issues/considerations described here, I expect that significant research would be needed to check that.

Regarding your second point about extra posix_spawn() options, I actually don't see why it would be an argument against vfork(). Even on Linux, subprocess prefers posix_spawn() to vfork()/fork() when possible, so vfork() support doesn't hinder posix_spawn().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Sat Oct 24 15:30:59 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 24 Oct 2020 19:30:59 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603567859.3.0.185371602735.issue35823@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Nice links.  LOL, yes, musl source was going to be my next stop if the larger libc sources proved impossible for a mere mortal to reason about. :)

regarding macOS, agreed. If someone needs vfork() to work there, I believe it could be made to.

Options like selecting the architecture of the child process could be higher level options to the subprocess API.  Hiding the platform specific details of how that happens and deciding which underlying approach to use based on the flags.

multi-arch systems are a thing.  It is conceivable that we may even see non-esoteric multi-arch hardware at some point.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Sat Oct 24 16:42:04 2020
From: report at bugs.python.org (Mark Roseman)
Date: Sat, 24 Oct 2020 20:42:04 +0000
Subject: [issue17942] IDLE Debugger: Improve GUI
In-Reply-To: <1368076818.55.0.00268388045116.issue17942@psf.upfronthosting.co.za>
Message-ID: <1603572124.15.0.235391763181.issue17942@roundup.psfhosted.org>


Change by Mark Roseman <mark at markroseman.com>:


----------
pull_requests: +21864
pull_request: https://github.com/python/cpython/pull/22947

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17942>
_______________________________________

From report at bugs.python.org  Sat Oct 24 16:49:44 2020
From: report at bugs.python.org (Mark Roseman)
Date: Sat, 24 Oct 2020 20:49:44 +0000
Subject: [issue17942] IDLE Debugger: Improve GUI
In-Reply-To: <1368076818.55.0.00268388045116.issue17942@psf.upfronthosting.co.za>
Message-ID: <1603572583.99.0.378767572173.issue17942@roundup.psfhosted.org>


Mark Roseman <mark at markroseman.com> added the comment:

have updated/cleaned up the previous patch, and there's a new PR. i realize this is unfortunately a somewhat monolithic change which might make reviewing it a bit tough...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17942>
_______________________________________

From report at bugs.python.org  Sat Oct 24 16:50:01 2020
From: report at bugs.python.org (Mark Roseman)
Date: Sat, 24 Oct 2020 20:50:01 +0000
Subject: [issue17942] IDLE Debugger: Improve GUI
In-Reply-To: <1368076818.55.0.00268388045116.issue17942@psf.upfronthosting.co.za>
Message-ID: <1603572601.23.0.292314723529.issue17942@roundup.psfhosted.org>


Change by Mark Roseman <mark at markroseman.com>:


----------
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17942>
_______________________________________

From report at bugs.python.org  Sat Oct 24 17:17:49 2020
From: report at bugs.python.org (Marco Sulla)
Date: Sat, 24 Oct 2020 21:17:49 +0000
Subject: [issue42141] Speedup various dict inits
Message-ID: <1603574269.77.0.908879318121.issue42141@roundup.psfhosted.org>


New submission from Marco Sulla <launchpad.net at marco.sulla.e4ward.com>:

The PR #22948 is an augmented version of #22346. It speeds up also the creation of:

1. dicts from other dicts that are not "perfect" (combined and without holes)
2. fromkeys
3. copies of dicts with many holes
4. dict from keywords, as in #22346

A sample bench:

python -m pyperf timeit --rigorous "dict(o)" -s """
from uuid import uuid4

def getUuid():
    return str(uuid4())

o = {getUuid():getUuid() for i in range(1000)}
delkey = getUuid()
o[delkey] = getUuid()
del o[delkey]
"""
.........................................

Before #22948:
Mean +- std dev: 35.9 us +- 0.6 us

After:
Mean +- std dev: 26.4 us +- 0.4 us

----------
messages: 379540
nosy: Marco Sulla
priority: normal
pull_requests: 21865
severity: normal
status: open
title: Speedup various dict inits

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42141>
_______________________________________

From report at bugs.python.org  Sat Oct 24 17:18:28 2020
From: report at bugs.python.org (Chris Jerdonek)
Date: Sat, 24 Oct 2020 21:18:28 +0000
Subject: [issue42130] AsyncIO's wait_for can hide cancellation in a rare race
 condition
In-Reply-To: <1603469429.01.0.760360212477.issue42130@roundup.psfhosted.org>
Message-ID: <1603574308.47.0.238593531242.issue42130@roundup.psfhosted.org>


Chris Jerdonek <chris.jerdonek at gmail.com> added the comment:

It looks like issue 37658 might be the relevant change rather.

Here is the new logic it introduced: https://github.com/python/cpython/blob/db455296be5f792b8c12b7cd7f3962b52e4f44ee/Lib/asyncio/tasks.py#L483-L488

(via https://github.com/python/cpython/pull/21894 )

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42130>
_______________________________________

From report at bugs.python.org  Sat Oct 24 17:22:53 2020
From: report at bugs.python.org (Chris Jerdonek)
Date: Sat, 24 Oct 2020 21:22:53 +0000
Subject: [issue37658] In some cases asyncio.wait_for can lead to socket leak.
In-Reply-To: <1563884177.4.0.19779936427.issue37658@roundup.psfhosted.org>
Message-ID: <1603574573.47.0.739355139737.issue37658@roundup.psfhosted.org>


Chris Jerdonek <chris.jerdonek at gmail.com> added the comment:

Issue #42130 that was recently filed appears related to this change.

----------
nosy: +chris.jerdonek

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37658>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:07:52 2020
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sat, 24 Oct 2020 23:07:52 +0000
Subject: [issue37203] Correct classmethod emulation in Descriptor HowTo Guide
In-Reply-To: <1559994687.73.0.550711459072.issue37203@roundup.psfhosted.org>
Message-ID: <1603580872.15.0.61039800253.issue37203@roundup.psfhosted.org>


Change by G?ry <gery.ogam at gmail.com>:


----------
pull_requests: +21866
pull_request: https://github.com/python/cpython/pull/22934

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37203>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:08:29 2020
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sat, 24 Oct 2020 23:08:29 +0000
Subject: [issue37203] Correct classmethod emulation in Descriptor HowTo Guide
In-Reply-To: <1559994687.73.0.550711459072.issue37203@roundup.psfhosted.org>
Message-ID: <1603580909.4.0.179032692318.issue37203@roundup.psfhosted.org>


Change by G?ry <gery.ogam at gmail.com>:


----------
resolution: not a bug -> fixed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37203>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:08:42 2020
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sat, 24 Oct 2020 23:08:42 +0000
Subject: [issue37203] Correct classmethod emulation in Descriptor HowTo Guide
In-Reply-To: <1559994687.73.0.550711459072.issue37203@roundup.psfhosted.org>
Message-ID: <1603580922.62.0.434554818355.issue37203@roundup.psfhosted.org>


Change by G?ry <gery.ogam at gmail.com>:


----------
versions: +Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37203>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:29:20 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 23:29:20 +0000
Subject: [issue42142] FAIL tkinter ttk LabeledScale test_resize
Message-ID: <1603582160.73.0.386671878138.issue42142@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

This appears to have timed out as there was no other error indication.
Azure Pipelines, retested gave 2nd failure.  Passed on another PR.

test_resize (tkinter.test.test_ttk.test_extensions.LabeledScaleTest) ... Timeout (0:20:00)!
Thread 0x00007f787182e080 (most recent call first):
  File "/home/vsts/work/1/s/Lib/tkinter/__init__.py", line 696 in wait_visibility
  File "/home/vsts/work/1/s/Lib/tkinter/test/test_ttk/test_extensions.py", line 190 in test_resize
...

----------
messages: 379543
nosy: serhiy.storchaka, terry.reedy
priority: normal
severity: normal
status: open
title: FAIL tkinter ttk LabeledScale test_resize
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42142>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:32:42 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 23:32:42 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603582362.24.0.800732862672.issue33987@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset e53e54425d9b7b9b7b082817da104d60bb25e3a2 by Mark Roseman in branch 'master':
bpo-33987: Use ttk Label on IDLE statusbar (GH-22941)
https://github.com/python/cpython/commit/e53e54425d9b7b9b7b082817da104d60bb25e3a2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:32:59 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 24 Oct 2020 23:32:59 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603582379.93.0.680090550227.issue33987@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21867
pull_request: https://github.com/python/cpython/pull/22949

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:33:07 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 24 Oct 2020 23:33:07 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603582387.03.0.219374567199.issue33987@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21868
pull_request: https://github.com/python/cpython/pull/22950

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:45:13 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 24 Oct 2020 23:45:13 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603583113.21.0.419580066089.issue33987@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21869
pull_request: https://github.com/python/cpython/pull/22951

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:45:20 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 24 Oct 2020 23:45:20 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603583120.0.0.280445956516.issue33987@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21870
pull_request: https://github.com/python/cpython/pull/22952

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:45:07 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 24 Oct 2020 23:45:07 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603583107.83.0.213095722217.issue33987@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset c579ad14d3b5bb9a45d7b9cc708eaf0bf4884c50 by Mark Roseman in branch 'master':
bpo-33987: Use master ttk Frame for IDLE config dialog (GH-22943)
https://github.com/python/cpython/commit/c579ad14d3b5bb9a45d7b9cc708eaf0bf4884c50


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:49:05 2020
From: report at bugs.python.org (Yonatan Goldschmidt)
Date: Sat, 24 Oct 2020 23:49:05 +0000
Subject: [issue42143] Corruptions in func_dealloc() with partially-created
 function object
Message-ID: <1603583345.9.0.605339724776.issue42143@roundup.psfhosted.org>


New submission from Yonatan Goldschmidt <yon.goldschmidt at gmail.com>:

While reading funcobject.c, I noticed that PyFunction_NewWithQualName() may exit early if it fails retrieving __name__ from the globals dict.
It will destroy the partially-created PyFunction object. However, this is done before ever initializing ->func_qualname. Since the object is allocated with PyObject_GC_New() (which does *not* provide zero-initialized memory), we are using Py_CLEAR() on uninitialized memory.

I wrote a simple snippet to produce this bug, expecting to see a crash due to the Py_DECREF() call on garbage memory:

    from types import FunctionType
    import random

    class BadEq:
        def __hash__(self):
            print("hash called")
            return hash("__name__")
        def __eq__(self, other):
            print("eq called")
            raise Exception()

    # run until we hit a 0x61616161.. pointer for PyFunctionObject->func_qualname, and crash
    while True:
        s = int(random.random() * 1000) * "a"
        try:
            FunctionType(BadEq.__hash__.__code__, {BadEq(): 1})
        except Exception:
            pass

However, I got *another* crash immediately: func_dealloc() calls _PyObject_GC_UNTRACK() which crashes if _PyObject_GC_TRACK() was not called beforehand. When running with "--with-pydebug", you get this nice assert:

    Objects/funcobject.c:595: _PyObject_GC_UNTRACK: Assertion "(((PyGC_Head *)(op)-1)->_gc_next != 0)" failed: object not tracked by the garbage collector

I replaced "_PyObject_GC_UNTRACK(op);" in func_dealloc() with:

    if (PyObject_GC_IsTracked(op)) {
        _PyObject_GC_UNTRACK(op);
    }

And ran my snippet again, this time it crashes after some loops with the error I was expecting to receive
(here I print _py_tmp, the temporary variable inside Py_CLEAR()):

    Program received signal SIGSEGV, Segmentation fault.
    func_clear (op=op at entry=0x7f9c8a25faf0) at Objects/funcobject.c:587
    587     Py_CLEAR(op->func_qualname);
    (gdb) p _py_tmp
    $1 = (PyObject *) 0x6161616161616161

This issue exists since https://github.com/python/cpython/pull/11112, which fixed tons of call sites to use PyDict_GetItemWithError(), I guess that this specific flow was not tested.

As a fix, I think we should run the part that can result in errors *before* creating the PyFunction, so we can no longer get an error while we have a partial object. This fixes both of the problems I've described. Thus we can move the dict lookup part to the top of
PyFunction_NewWithQualName().

I see no reason not to make such a change in the function's flow. If we'd rather keep the flow as-is, we can make sure to initialize ->func_qualname to NULL, and wrap _PyObject_GC_UNTRACK() with _PyObject_GC_IS_TRACKED() in func_dealloc(). I like this solution less because it adds this unnecessary "if" statement in func_dealloc().

I'll post a PR in GitHub soon.

----------
components: Interpreter Core
messages: 379546
nosy: Yonatan Goldschmidt
priority: normal
severity: normal
status: open
title: Corruptions in func_dealloc() with partially-created function object
type: crash
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42143>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:51:07 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 24 Oct 2020 23:51:07 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603583467.13.0.404740719681.issue33987@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c1b620eecc2ca0f9ae9d5ee2d973e823db295ad2 by Miss Skeleton (bot) in branch '3.8':
bpo-33987: Use ttk Label on IDLE statusbar (GH-22941)
https://github.com/python/cpython/commit/c1b620eecc2ca0f9ae9d5ee2d973e823db295ad2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:53:37 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 24 Oct 2020 23:53:37 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603583617.4.0.875194233706.issue33987@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 4efd2defb899c5c45334814234c842f8f513879e by Miss Skeleton (bot) in branch '3.9':
bpo-33987: Use ttk Label on IDLE statusbar (GH-22941)
https://github.com/python/cpython/commit/4efd2defb899c5c45334814234c842f8f513879e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 19:58:15 2020
From: report at bugs.python.org (Yonatan Goldschmidt)
Date: Sat, 24 Oct 2020 23:58:15 +0000
Subject: [issue42143] Corruptions in func_dealloc() with partially-created
 function object
In-Reply-To: <1603583345.9.0.605339724776.issue42143@roundup.psfhosted.org>
Message-ID: <1603583895.2.0.86342899852.issue42143@roundup.psfhosted.org>


Change by Yonatan Goldschmidt <yon.goldschmidt at gmail.com>:


----------
keywords: +patch
pull_requests: +21871
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22953

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42143>
_______________________________________

From report at bugs.python.org  Sat Oct 24 20:03:40 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 00:03:40 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603584220.81.0.361842840723.issue33987@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 253c8eb40ec5a87aa539f913fcd83d1759069981 by Miss Skeleton (bot) in branch '3.8':
bpo-33987: Use master ttk Frame for IDLE config dialog (GH-22943)
https://github.com/python/cpython/commit/253c8eb40ec5a87aa539f913fcd83d1759069981


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 20:38:56 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sun, 25 Oct 2020 00:38:56 +0000
Subject: [issue42141] Speedup various dict inits
In-Reply-To: <1603574269.77.0.908879318121.issue42141@roundup.psfhosted.org>
Message-ID: <1603586336.71.0.953214135137.issue42141@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> 1. dicts from other dicts that are not "perfect" (combined and without holes)
> 3. copies of dicts with many holes

Note that I have optimized and rejected it by myself already.
See https://github.com/python/cpython/pull/21669
and https://bugs.python.org/issue41431#msg374556

Code duplication is too huge compared to performance gain.

----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42141>
_______________________________________

From report at bugs.python.org  Sat Oct 24 21:04:21 2020
From: report at bugs.python.org (Mark Roseman)
Date: Sun, 25 Oct 2020 01:04:21 +0000
Subject: [issue33962] IDLE: use ttk.spinbox with configdialog
In-Reply-To: <1529983748.27.0.56676864532.issue33962@psf.upfronthosting.co.za>
Message-ID: <1603587861.56.0.219945896347.issue33962@roundup.psfhosted.org>


Change by Mark Roseman <mark at markroseman.com>:


----------
keywords: +patch
pull_requests: +21872
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/22954

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33962>
_______________________________________

From report at bugs.python.org  Sat Oct 24 21:08:25 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 01:08:25 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603588105.42.0.358038306861.issue33987@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 2d493893c7aa9af633c4ebeb56ecce42e3a82e9f by Miss Skeleton (bot) in branch '3.9':
bpo-33987: Use master ttk Frame for IDLE config dialog (GH-22943)
https://github.com/python/cpython/commit/2d493893c7aa9af633c4ebeb56ecce42e3a82e9f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 21:17:25 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 25 Oct 2020 01:17:25 +0000
Subject: [issue42127] functools.cached_property possibly disables key-sharing
 instance dictionaries
In-Reply-To: <1603464695.3.0.183922542861.issue42127@roundup.psfhosted.org>
Message-ID: <1603588645.24.0.140876283053.issue42127@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 48be6b1ef7a6201e13c87a317361cdb60bd5faa8 by Raymond Hettinger in branch 'master':
bpo-42127:  Document effect of cached_property on key-sharing dictionaries (GH-22930)
https://github.com/python/cpython/commit/48be6b1ef7a6201e13c87a317361cdb60bd5faa8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42127>
_______________________________________

From report at bugs.python.org  Sat Oct 24 21:17:30 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 01:17:30 +0000
Subject: [issue42127] functools.cached_property possibly disables key-sharing
 instance dictionaries
In-Reply-To: <1603464695.3.0.183922542861.issue42127@roundup.psfhosted.org>
Message-ID: <1603588650.85.0.465595381578.issue42127@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21873
pull_request: https://github.com/python/cpython/pull/22955

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42127>
_______________________________________

From report at bugs.python.org  Sat Oct 24 21:18:19 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 25 Oct 2020 01:18:19 +0000
Subject: [issue42127] functools.cached_property possibly disables key-sharing
 instance dictionaries
In-Reply-To: <1603464695.3.0.183922542861.issue42127@roundup.psfhosted.org>
Message-ID: <1603588699.97.0.0198563018498.issue42127@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42127>
_______________________________________

From report at bugs.python.org  Sat Oct 24 22:00:22 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 25 Oct 2020 02:00:22 +0000
Subject: [issue42127] functools.cached_property possibly disables key-sharing
 instance dictionaries
In-Reply-To: <1603464695.3.0.183922542861.issue42127@roundup.psfhosted.org>
Message-ID: <1603591222.83.0.799895360832.issue42127@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 427cb0aa78813b89a3f100073bf7d70a53510f57 by Miss Skeleton (bot) in branch '3.9':
bpo-42127:  Document effect of cached_property on key-sharing dictionaries (GH-22930) (GH-22955)
https://github.com/python/cpython/commit/427cb0aa78813b89a3f100073bf7d70a53510f57


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42127>
_______________________________________

From report at bugs.python.org  Sat Oct 24 22:53:24 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 02:53:24 +0000
Subject: [issue29981] Update Index for set, dict,
 and generator 'comprehensions'
In-Reply-To: <1491328871.52.0.864348862414.issue29981@psf.upfronthosting.co.za>
Message-ID: <1603594404.33.0.626790271557.issue29981@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 60bef61f717dde915058b03159b2c2e97d765858 by Miss Skeleton (bot) in branch '3.8':
bpo-29981: Add examples and update index for set, dict, and generator comprehensions'(GH-20272)
https://github.com/python/cpython/commit/60bef61f717dde915058b03159b2c2e97d765858


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29981>
_______________________________________

From report at bugs.python.org  Sat Oct 24 22:53:44 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 02:53:44 +0000
Subject: [issue29981] Update Index for set, dict,
 and generator 'comprehensions'
In-Reply-To: <1491328871.52.0.864348862414.issue29981@psf.upfronthosting.co.za>
Message-ID: <1603594424.65.0.875389973932.issue29981@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 2cccc29eaf20694006c03af0f4740abdf8ae5579 by Miss Skeleton (bot) in branch '3.9':
bpo-29981: Add examples and update index for set, dict, and generator comprehensions'(GH-20272)
https://github.com/python/cpython/commit/2cccc29eaf20694006c03af0f4740abdf8ae5579


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29981>
_______________________________________

From report at bugs.python.org  Sat Oct 24 22:57:18 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sun, 25 Oct 2020 02:57:18 +0000
Subject: [issue29981] Update Index for set, dict,
 and generator 'comprehensions'
In-Reply-To: <1491328871.52.0.864348862414.issue29981@psf.upfronthosting.co.za>
Message-ID: <1603594638.92.0.077628452741.issue29981@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29981>
_______________________________________

From report at bugs.python.org  Sat Oct 24 23:09:28 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 25 Oct 2020 03:09:28 +0000
Subject: [issue42142] FAIL tkinter ttk LabeledScale test_resize, and more
In-Reply-To: <1603582160.73.0.386671878138.issue42142@roundup.psfhosted.org>
Message-ID: <1603595368.77.0.983459241639.issue42142@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Azure Pipelines Ubuntu, as before, but Combobox test_virtual_event.

test_virtual_event (tkinter.test.test_ttk.test_widgets.ComboboxTest) ... Timeout (0:20:00)!
Thread 0x00007fb09e3f3080 (most recent call first):
  File "/home/vsts/work/1/s/Lib/tkinter/__init__.py", line 696 in wait_visibility
  File "/home/vsts/work/1/s/Lib/tkinter/test/test_ttk/test_widgets.py", line 452 in test_virtual_event

----------
components: +Tests, Tkinter
title: FAIL tkinter ttk LabeledScale test_resize -> FAIL tkinter ttk LabeledScale test_resize, and more

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42142>
_______________________________________

From report at bugs.python.org  Sat Oct 24 23:14:05 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 25 Oct 2020 03:14:05 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603595645.98.0.358611662813.issue33987@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 5df6c99cb450fe2f30be681dbf68cd1d34d3bbe4 by Mark Roseman in branch 'master':
bpo-33987: Add master ttk Frame to IDLE search dialogs (GH-22942)
https://github.com/python/cpython/commit/5df6c99cb450fe2f30be681dbf68cd1d34d3bbe4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 23:14:27 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 03:14:27 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603595667.28.0.820031320711.issue33987@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21874
pull_request: https://github.com/python/cpython/pull/22956

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 23:14:34 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 03:14:34 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603595674.36.0.941283434796.issue33987@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21875
pull_request: https://github.com/python/cpython/pull/22957

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 23:36:58 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 03:36:58 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603597018.91.0.518822048881.issue33987@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 9cf26b00e42787bc668c62f1b5dde814f8307259 by Miss Skeleton (bot) in branch '3.9':
bpo-33987: Add master ttk Frame to IDLE search dialogs (GH-22942)
https://github.com/python/cpython/commit/9cf26b00e42787bc668c62f1b5dde814f8307259


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 23:41:29 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 03:41:29 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603597289.3.0.624399069229.issue33987@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8485d3b911c3cb73ed6217a47c7720f9277efc01 by Miss Skeleton (bot) in branch '3.8':
bpo-33987: Add master ttk Frame to IDLE search dialogs (GH-22942)
https://github.com/python/cpython/commit/8485d3b911c3cb73ed6217a47c7720f9277efc01


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sat Oct 24 23:53:27 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 25 Oct 2020 03:53:27 +0000
Subject: [issue33962] IDLE: use ttk.spinbox with configdialog
In-Reply-To: <1529983748.27.0.56676864532.issue33962@psf.upfronthosting.co.za>
Message-ID: <1603598007.41.0.904364700353.issue33962@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

#27755 was about replacing uses of our custom DynOptionMenu with ttk.Combobox, which I believe we can do now, wherever we don't replace it with something else.   One use is for font size choice; Spinbox was suggested as an alternative replacement.

Spinbox was also proposed somewhere else to remplace the indent size Label scale.  But I/we had decided, somewhere,  to use a simple entry box, like those for entering counts on the General tab, with validation limits of 1 and 16, and move the choice to the General tab.  (If we don't have validate(min, max) function, should make one.)  SO

The transfer cannot be done until the General tab is split into 2, as it is now too long (does not fix on Macbook Air -- cannot see buttons).  I think General windows preferences (where indent should go) + help resources for 1, Specific Editor only or Shell only for other.  Not sure of names.

This all said, I tried out the patch.  The spinbox appears to be an Entry with added arrows.  If it worked right, it could be used for some other int entries instead of plain Entry.  But in some ways, it seems partly worse than Entry.
0. No doc in Shipman (written before 8.5.9); must use tk doc.
1. Expands to space available; is Entry char width really disabled?
2. Deleting digit to replace it generates 2 TclErrors*.
3. Clicking arrow 'selects' entry.  Patch used text selection, but my dark theme select looks awful for single digit.  We can fix this with different config.

* ...
  File "f:\dev\3x\lib\tkinter\__init__.py", line 536, in get
    return self._tk.getint(value)
_tkinter.TclError: expected integer but got ""
During handling of the above exception, another exception occurred:
...
  File "f:\dev\3x\lib\tkinter\__init__.py", line 538, in get
    return int(self._tk.getdouble(value))
_tkinter.TclError: expected floating-point number but got ""

I will look more later.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33962>
_______________________________________

From report at bugs.python.org  Sat Oct 24 23:58:21 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 25 Oct 2020 03:58:21 +0000
Subject: [issue33987] IDLE: use ttk.Frame for ttk widgets
In-Reply-To: <1530158550.76.0.56676864532.issue33987@psf.upfronthosting.co.za>
Message-ID: <1603598301.03.0.828152591511.issue33987@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Thanks for hopefully finishing this issue.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33987>
_______________________________________

From report at bugs.python.org  Sun Oct 25 00:51:47 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 25 Oct 2020 04:51:47 +0000
Subject: [issue42144] A missing "goto" in the _ssl module!
Message-ID: <1603601507.64.0.594640776307.issue42144@roundup.psfhosted.org>


New submission from Zackery Spytz <zspytz at gmail.com>:

In the _ssl_configure_hostname() function, there's a missing "goto error;" if
SSL_set_tlsext_host_name() fails.

----------
assignee: christian.heimes
components: Extension Modules, SSL
messages: 379562
nosy: ZackerySpytz, christian.heimes
priority: normal
severity: normal
status: open
title: A missing "goto" in the _ssl module!
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42144>
_______________________________________

From report at bugs.python.org  Sun Oct 25 00:53:36 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 25 Oct 2020 04:53:36 +0000
Subject: [issue42144] A missing "goto" in the _ssl module!
In-Reply-To: <1603601507.64.0.594640776307.issue42144@roundup.psfhosted.org>
Message-ID: <1603601616.0.0.101915869652.issue42144@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +21876
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22959

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42144>
_______________________________________

From report at bugs.python.org  Sun Oct 25 00:59:38 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 25 Oct 2020 04:59:38 +0000
Subject: [issue14556] telnetlib Telnet.expect fails with timeout=0
In-Reply-To: <1334193617.55.0.736160184516.issue14556@psf.upfronthosting.co.za>
Message-ID: <1603601978.08.0.902792190219.issue14556@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

Python 2.7 is no longer supported, so I think this issue should be closed.

----------
nosy: +ZackerySpytz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14556>
_______________________________________

From report at bugs.python.org  Sun Oct 25 01:51:18 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 05:51:18 +0000
Subject: [issue42145] test_io is leaking references
Message-ID: <1603605078.18.0.00514890587111.issue42145@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

? ./python -m test test_io -m test.test_io.CTextIOWrapperTest.test_read_one_by_one -R :
0:00:00 load avg: 1.59 Run tests sequentially
0:00:00 load avg: 1.59 [1/1] test_io
beginning 9 repetitions
123456789
.........
test_io leaked [3, 3, 3, 3] references, sum=12
test_io leaked [1, 1, 1, 1] memory blocks, sum=4
test_io failed

== Tests result: FAILURE ==

1 test failed:
    test_io

Total duration: 398 ms
Tests result: FAILURE

----------
components: Tests
messages: 379564
nosy: pablogsal
priority: normal
severity: normal
status: open
title: test_io is leaking references
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42145>
_______________________________________

From report at bugs.python.org  Sun Oct 25 02:01:58 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 06:01:58 +0000
Subject: [issue41919] Modify test_codecs to use the new codecs.unregister()
 function
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1603605718.24.0.992178838709.issue41919@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Commit c9f696cb96d1c362d5cad871f61da520572d9b08 introduced a reference leak in the test suite. See https://bugs.python.org/issue42145:

c9f696cb96d1c362d5cad871f61da520572d9b08 is the first bad commit
commit c9f696cb96d1c362d5cad871f61da520572d9b08
Author: Hai Shi <shihai1992 at gmail.com>
Date:   Fri Oct 16 16:34:15 2020 +0800

    bpo-41919, test_codecs: Move codecs.register calls to setUp() (GH-22513)

Reverting the commit eliminates the problem:

rences, sum=12
test_io leaked [1, 1, 1, 1] memory blocks, sum=4
test_io failed

== Tests result: FAILURE ==

1 test failed:
    test_io

Total duration: 397 ms
Tests result: FAILURE
g
~/github/python/master master|bisect*
? git revert c9f696cb96d1c362d5cad871f61da520572d9b08
Auto-merging Lib/test/test_codecs.py
[master f3de7c00b4] Revert "bpo-41919, test_codecs: Move codecs.register calls to setUp() (GH-22513)"
 7 files changed, 112 insertions(+), 16 deletions(-)

~/github/python/master master|bisect* ?
? make -j -s
 CC='gcc -pthread' LDSHARED='gcc -pthread -shared    ' OPT='-g -Og -Wall'       _TCLTK_INCLUDES='' _TCLTK_LIBS=''       ./python -E ./setup.py -q build

The following modules found by detect_modules() in setup.py, have been
built by the Makefile instead, as configured by the Setup files:
_abc                  atexit                pwd
time


~/github/python/master master|bisect* ?
? ./python -m test test_io -m test.test_io.CTextIOWrapperTest.test_read_one_by_one -R :
0:00:00 load avg: 2.57 Run tests sequentially
0:00:00 load avg: 2.57 [1/1] test_io
beginning 9 repetitions
123456789
.........

== Tests result: SUCCESS ==

1 test OK.

Total duration: 455 ms
Tests result: SUCCESS

    * Move the codecs' (un)register operation to testcases.
    * Remove _codecs._forget_codec() and _PyCodec_Forget()

 Lib/test/test_charmapcodec.py    |  7 +++++--
 Lib/test/test_codecs.py          | 25 +++----------------------
 Lib/test/test_io.py              |  7 +++----
 Lib/test/test_unicode.py         |  5 ++++-
 Modules/_codecsmodule.c          | 20 --------------------
 Modules/clinic/_codecsmodule.c.h | 39 +--------------------------------------
 Python/codecs.c                  | 25 -------------------------
 7 files changed, 16 insertions(+), 112 deletions(-)

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Sun Oct 25 02:03:02 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 06:03:02 +0000
Subject: [issue42145] test_io is leaking references
In-Reply-To: <1603605078.18.0.00514890587111.issue42145@roundup.psfhosted.org>
Message-ID: <1603605782.54.0.661204192077.issue42145@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Commit c9f696cb96d1c362d5cad871f61da520572d9b08 introduced a reference leak in the test suite. See https://bugs.python.org/issue42145:

c9f696cb96d1c362d5cad871f61da520572d9b08 is the first bad commit
commit c9f696cb96d1c362d5cad871f61da520572d9b08
Author: Hai Shi <shihai1992 at gmail.com>
Date:   Fri Oct 16 16:34:15 2020 +0800

    bpo-41919, test_codecs: Move codecs.register calls to setUp() (GH-22513)

Reverting the commit eliminates the problem:

rences, sum=12
test_io leaked [1, 1, 1, 1] memory blocks, sum=4
test_io failed

== Tests result: FAILURE ==

1 test failed:
    test_io

Total duration: 397 ms
Tests result: FAILURE
g
~/github/python/master master|bisect*
? git revert c9f696cb96d1c362d5cad871f61da520572d9b08
Auto-merging Lib/test/test_codecs.py
[master f3de7c00b4] Revert "bpo-41919, test_codecs: Move codecs.register calls to setUp() (GH-22513)"
 7 files changed, 112 insertions(+), 16 deletions(-)

~/github/python/master master|bisect* ?
? make -j -s
 CC='gcc -pthread' LDSHARED='gcc -pthread -shared    ' OPT='-g -Og -Wall'       _TCLTK_INCLUDES='' _TCLTK_LIBS=''       ./python -E ./setup.py -q build

The following modules found by detect_modules() in setup.py, have been
built by the Makefile instead, as configured by the Setup files:
_abc                  atexit                pwd
time


~/github/python/master master|bisect* ?
? ./python -m test test_io -m test.test_io.CTextIOWrapperTest.test_read_one_by_one -R :
0:00:00 load avg: 2.57 Run tests sequentially
0:00:00 load avg: 2.57 [1/1] test_io
beginning 9 repetitions
123456789
.........

== Tests result: SUCCESS ==

1 test OK.

Total duration: 455 ms
Tests result: SUCCESS

    * Move the codecs' (un)register operation to testcases.
    * Remove _codecs._forget_codec() and _PyCodec_Forget()

 Lib/test/test_charmapcodec.py    |  7 +++++--
 Lib/test/test_codecs.py          | 25 +++----------------------
 Lib/test/test_io.py              |  7 +++----
 Lib/test/test_unicode.py         |  5 ++++-
 Modules/_codecsmodule.c          | 20 --------------------
 Modules/clinic/_codecsmodule.c.h | 39 +--------------------------------------
 Python/codecs.c                  | 25 -------------------------
 7 files changed, 16 insertions(+), 112 deletions(-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42145>
_______________________________________

From report at bugs.python.org  Sun Oct 25 02:03:55 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 06:03:55 +0000
Subject: [issue41919] Modify test_codecs to use the new codecs.unregister()
 function
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1603605835.44.0.210549289349.issue41919@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Sun Oct 25 02:03:51 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 06:03:51 +0000
Subject: [issue41919] Modify test_codecs to use the new codecs.unregister()
 function
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1603605831.75.0.992906912221.issue41919@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

AS this is masking other issues in the build bots, we need to revert the commit unless is fixed in 24 hours per the buildbot workflow

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Sun Oct 25 02:06:26 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 06:06:26 +0000
Subject: [issue41919] Modify test_codecs to use the new codecs.unregister()
 function
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1603605986.5.0.933007949896.issue41919@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +21877
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/22961

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Sun Oct 25 02:38:16 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 25 Oct 2020 06:38:16 +0000
Subject: [issue35823] Use vfork() in subprocess on Linux
In-Reply-To: <1548381806.02.0.709569222975.issue35823@roundup.psfhosted.org>
Message-ID: <1603607896.72.0.37134453627.issue35823@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Performance improvement measured on a 1.4Ghz quad aarch64 A57 (nvidia jetson nano):

#define VFORK_USABLE 1
 test_subprocess: 36.5 seconds

#undef VFORK_USABLE
 test_subprocess: 45 seconds

Nice.  I really didn't expect a 20% speedup on its testsuite alone!

Lets dive into that with a microbenchmark:

$ ./build-novfork/python ten_seconds_of_truth.py
Launching /bin/true for 10 seconds in a loop.
Launched 2713 subprocesses in 10.00194378796732 seconds.
271.247275281014 subprocesses/second.
Increased our mapped pages by 778240KiB.
Launching /bin/true for 10 seconds in a loop.
Launched 212 subprocesses in 10.006392606999725 seconds.
21.186456331095847 subprocesses/second.

$ ./build/python ten_seconds_of_truth.py
Launching /bin/true for 10 seconds in a loop.
Launched 3310 subprocesses in 10.001623224001378 seconds.
330.94628000551285 subprocesses/second.
Increased our mapped pages by 778240KiB.
Launching /bin/true for 10 seconds in a loop.
Launched 3312 subprocesses in 10.001519071985967 seconds.
331.1496959773679 subprocesses/second.

Demonstrating perfectly the benefit of vfork().  The more mapped pages, the slower regular fork() becomes.  With vfork() the size of the process's memory map does not matter.

ten_seconds_of_truth.py:

```python
from time import monotonic as now
import subprocess

def benchmark_for_ten():
    print('Launching /bin/true for 10 seconds in a loop.')

    count = 0
    start = now()
    while now() - start < 10.:
        subprocess.run(['/bin/true'])
        count += 1
    end = now()
    duration = end-start

    print(f'Launched {count} subprocesses in {duration} seconds.')
    print(f'{count/duration} subprocesses/second.')

benchmark_for_ten()

map_a_bunch_of_pages = '4agkahglahaa^#\0ag3\3'*1024*1024*40

print(f'Increased our mapped pages by {len(map_a_bunch_of_pages)//1024}KiB.')

benchmark_for_ten()
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35823>
_______________________________________

From report at bugs.python.org  Sun Oct 25 02:47:23 2020
From: report at bugs.python.org (Soumendra Ganguly)
Date: Sun, 25 Oct 2020 06:47:23 +0000
Subject: [issue26228] pty.spawn hangs on FreeBSD 9.3, 10.x, 12.1
In-Reply-To: <1453953861.58.0.104331734212.issue26228@psf.upfronthosting.co.za>
Message-ID: <1603608443.25.0.409755631358.issue26228@roundup.psfhosted.org>


Change by Soumendra Ganguly <soumendra at tamu.edu>:


----------
pull_requests: +21879
pull_request: https://github.com/python/cpython/pull/22962

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26228>
_______________________________________

From report at bugs.python.org  Sun Oct 25 02:47:22 2020
From: report at bugs.python.org (Soumendra Ganguly)
Date: Sun, 25 Oct 2020 06:47:22 +0000
Subject: [issue41818] Lib/pty.py major revision
In-Reply-To: <1600557574.22.0.272934906824.issue41818@roundup.psfhosted.org>
Message-ID: <1603608442.32.0.0761684019531.issue41818@roundup.psfhosted.org>


Change by Soumendra Ganguly <soumendra at tamu.edu>:


----------
keywords: +patch
pull_requests: +21878
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22962

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41818>
_______________________________________

From report at bugs.python.org  Sun Oct 25 04:10:59 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 25 Oct 2020 08:10:59 +0000
Subject: [issue41052] Opt out serialization/deserialization for heap type
In-Reply-To: <1592659049.98.0.596314769567.issue41052@roundup.psfhosted.org>
Message-ID: <1603613459.55.0.133296628367.issue41052@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +21880
pull_request: https://github.com/python/cpython/pull/22963

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41052>
_______________________________________

From report at bugs.python.org  Sun Oct 25 04:16:20 2020
From: report at bugs.python.org (LE GARREC Vincent)
Date: Sun, 25 Oct 2020 08:16:20 +0000
Subject: [issue41214] -O0: Segmentation fault in _PyArg_UnpackStack
In-Reply-To: <1593946467.6.0.0689011340862.issue41214@roundup.psfhosted.org>
Message-ID: <1603613780.91.0.0554818244985.issue41214@roundup.psfhosted.org>


LE GARREC Vincent <github at le-garrec.fr> added the comment:

I still have the problem with python 3.7.9 but not with python 3.8.6.

Since I migrated my system to python 3.8, it's not a problem anymore. I still have python 3.7 installed so if you want, I still can do some tests.

----------
nosy: +bansan85

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41214>
_______________________________________

From report at bugs.python.org  Sun Oct 25 04:24:05 2020
From: report at bugs.python.org (Artur Tamborski)
Date: Sun, 25 Oct 2020 08:24:05 +0000
Subject: [issue41607] pdb - Clickable path to breakpoints
In-Reply-To: <1597999770.47.0.222044983618.issue41607@roundup.psfhosted.org>
Message-ID: <1603614245.75.0.352030539732.issue41607@roundup.psfhosted.org>


Change by Artur Tamborski <tamborskiartur at gmail.com>:


----------
keywords: +patch
nosy: +arturtamborski
nosy_count: 2.0 -> 3.0
pull_requests: +21881
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22964

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41607>
_______________________________________

From report at bugs.python.org  Sun Oct 25 06:12:48 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sun, 25 Oct 2020 10:12:48 +0000
Subject: [issue42120] Depreciated MACRO of copysign for MSVC
In-Reply-To: <1603393730.66.0.233789813553.issue42120@roundup.psfhosted.org>
Message-ID: <1603620768.16.0.906775320065.issue42120@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

The standard is for copysign to work on doubles, with copysignf as the same functionality for floats.


https://en.cppreference.com/w/c/numeric/math/copysign

----------
nosy: +ronaldoussoren

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42120>
_______________________________________

From report at bugs.python.org  Sun Oct 25 06:34:13 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sun, 25 Oct 2020 10:34:13 +0000
Subject: [issue38233] datetime.datetime.fromtimestamp have different behaviour
 on windows and mac
In-Reply-To: <1568991316.62.0.929906860007.issue38233@roundup.psfhosted.org>
Message-ID: <1603622053.95.0.538200083366.issue38233@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Can this issue be closed? Fixing #36439 would also fix this issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38233>
_______________________________________

From report at bugs.python.org  Sun Oct 25 07:23:18 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sun, 25 Oct 2020 11:23:18 +0000
Subject: [issue34597] Python needs to check existence of functions at runtime
 for targeting older macOS platforms
In-Reply-To: <1536245948.33.0.56676864532.issue34597@psf.upfronthosting.co.za>
Message-ID: <1603624998.97.0.603664720092.issue34597@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

The active PR in bpo-41100 will fix this issue as well.

----------
dependencies: +Build failure on macOS 11 (beta)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34597>
_______________________________________

From report at bugs.python.org  Sun Oct 25 07:39:25 2020
From: report at bugs.python.org (Marco Sulla)
Date: Sun, 25 Oct 2020 11:39:25 +0000
Subject: [issue42141] Speedup various dict inits
In-Reply-To: <1603574269.77.0.908879318121.issue42141@roundup.psfhosted.org>
Message-ID: <1603625965.86.0.773984337775.issue42141@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

I'm quite sure I not invented the wheel :) but I think it's a good improvement:

| pathlib                 | 35.8 ms          | 35.1 ms            | 1.02x faster | Significant (t=13.21) |
| scimark_monte_carlo     | 176 ms           | 172 ms             | 1.02x faster | Significant (t=9.48)  |
| scimark_sor             | 332 ms           | 325 ms             | 1.02x faster | Significant (t=11.96) |
| telco                   | 11.0 ms          | 10.8 ms            | 1.03x faster | Significant (t=8.52)  |
| unpickle_pure_python    | 525 us           | 514 us             | 1.02x faster | Significant (t=19.97) |
| xml_etree_process       | 132 ms           | 129 ms             | 1.02x faster | Significant (t=17.59) |

----------
components: +Interpreter Core
type:  -> performance
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42141>
_______________________________________

From report at bugs.python.org  Sun Oct 25 07:43:23 2020
From: report at bugs.python.org (Marco Sulla)
Date: Sun, 25 Oct 2020 11:43:23 +0000
Subject: [issue42141] Speedup various dict inits
In-Reply-To: <1603574269.77.0.908879318121.issue42141@roundup.psfhosted.org>
Message-ID: <1603626203.32.0.311155535885.issue42141@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

Note that this time I've no slowdown in the macro bench, since I used normal builds, not optimized ones. I suppose an optimized build will show slowdown because the new functions are not in the test battery.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42141>
_______________________________________

From report at bugs.python.org  Sun Oct 25 08:30:55 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Sun, 25 Oct 2020 12:30:55 +0000
Subject: [issue42146] subprocess.Popen() leaks cwd in case of uid/gid overflow
Message-ID: <1603629055.61.0.677699237141.issue42146@roundup.psfhosted.org>


New submission from Alexey Izbyshev <izbyshev at ispras.ru>:

The following test demonstrates the leak:

```
import subprocess

cwd = 'x' * 10**6
for __ in range(100):
    try:
        subprocess.call(['/xxx'], cwd=cwd, user=2**64)
    except OverflowError:
        pass

from resource import *
print(getrusage(RUSAGE_SELF).ru_maxrss)
```

The leak was introduced by bpo-36046. Previously, `cleanup:` label was not reachable after `cwd_obj2` was initialized at https://github.com/python/cpython/blob/492d513ccbebeec40a8ba85cbd894a027ca5b2b3/Modules/_posixsubprocess.c#L892

I'll submit a PR with a simple fix suitable for backporting to 3.9.

Also, I think it might make sense to unify the two almost-identical cleanup paths we have now. I'll follow up with another PR.

----------
assignee: izbyshev
components: Extension Modules
keywords: 3.9regression
messages: 379575
nosy: gregory.p.smith, izbyshev, patrick.mclean
priority: normal
severity: normal
status: open
title: subprocess.Popen() leaks cwd in case of uid/gid overflow
type: behavior
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42146>
_______________________________________

From report at bugs.python.org  Sun Oct 25 08:34:55 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Sun, 25 Oct 2020 12:34:55 +0000
Subject: [issue42146] subprocess.Popen() leaks cwd in case of uid/gid overflow
In-Reply-To: <1603629055.61.0.677699237141.issue42146@roundup.psfhosted.org>
Message-ID: <1603629295.04.0.664126379918.issue42146@roundup.psfhosted.org>


Change by Alexey Izbyshev <izbyshev at ispras.ru>:


----------
keywords: +patch
pull_requests: +21882
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22966

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42146>
_______________________________________

From report at bugs.python.org  Sun Oct 25 08:37:07 2020
From: report at bugs.python.org (daniel hahler)
Date: Sun, 25 Oct 2020 12:37:07 +0000
Subject: [issue15872] shutil.rmtree(...,
 ignore_errors=True) doesn't ignore all errors
In-Reply-To: <1346962035.48.0.664042204164.issue15872@psf.upfronthosting.co.za>
Message-ID: <1603629427.29.0.983842439846.issue15872@roundup.psfhosted.org>


Change by daniel hahler <python-bugs at thequod.de>:


----------
nosy: +blueyed
nosy_count: 11.0 -> 12.0
pull_requests: +21883
pull_request: https://github.com/python/cpython/pull/22967

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15872>
_______________________________________

From report at bugs.python.org  Sun Oct 25 08:59:14 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sun, 25 Oct 2020 12:59:14 +0000
Subject: [issue42141] Speedup various dict inits
In-Reply-To: <1603574269.77.0.908879318121.issue42141@roundup.psfhosted.org>
Message-ID: <1603630754.2.0.936963218515.issue42141@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I run pyperformance=1.0.0 for your speedup_dictinit branch (7df3b9c) and master branch, with PGO+LTO build.

```
$ ./python -m pyperf compare_to master-opt.json dictinit.json -G --min-speed=1
Slower (22):
- unpack_sequence: 62.7 ns +- 0.7 ns -> 70.3 ns +- 0.5 ns: 1.12x slower (+12%)
- pickle_dict: 28.6 us +- 0.1 us -> 30.7 us +- 0.1 us: 1.07x slower (+7%)
- regex_dna: 233 ms +- 1 ms -> 245 ms +- 0 ms: 1.05x slower (+5%)
- unpickle_list: 5.22 us +- 0.22 us -> 5.46 us +- 0.10 us: 1.05x slower (+5%)
- sqlite_synth: 3.29 us +- 0.05 us -> 3.43 us +- 0.05 us: 1.04x slower (+4%)
- regex_v8: 26.1 ms +- 0.1 ms -> 27.1 ms +- 0.4 ms: 1.04x slower (+4%)
- spectral_norm: 147 ms +- 1 ms -> 153 ms +- 2 ms: 1.04x slower (+4%)
- scimark_sparse_mat_mult: 5.28 ms +- 0.03 ms -> 5.48 ms +- 0.01 ms: 1.04x slower (+4%)
- unpickle_pure_python: 326 us +- 4 us -> 338 us +- 3 us: 1.04x slower (+4%)
- nbody: 143 ms +- 3 ms -> 148 ms +- 2 ms: 1.03x slower (+3%)
- regex_effbot: 3.43 ms +- 0.01 ms -> 3.53 ms +- 0.02 ms: 1.03x slower (+3%)
- django_template: 52.7 ms +- 0.7 ms -> 54.1 ms +- 0.9 ms: 1.03x slower (+3%)
- scimark_fft: 405 ms +- 4 ms -> 415 ms +- 9 ms: 1.03x slower (+3%)
- fannkuch: 523 ms +- 2 ms -> 535 ms +- 2 ms: 1.02x slower (+2%)
- xml_etree_process: 80.2 ms +- 0.8 ms -> 82.0 ms +- 0.8 ms: 1.02x slower (+2%)
- json_dumps: 14.6 ms +- 0.1 ms -> 14.9 ms +- 0.1 ms: 1.02x slower (+2%)
- scimark_sor: 209 ms +- 2 ms -> 213 ms +- 2 ms: 1.02x slower (+2%)
- genshi_text: 32.1 ms +- 0.5 ms -> 32.7 ms +- 0.4 ms: 1.02x slower (+2%)
- logging_format: 10.9 us +- 0.2 us -> 11.0 us +- 0.2 us: 1.02x slower (+2%)
- pyflate: 734 ms +- 6 ms -> 745 ms +- 8 ms: 1.01x slower (+1%)
- float: 134 ms +- 1 ms -> 135 ms +- 2 ms: 1.01x slower (+1%)
- raytrace: 511 ms +- 5 ms -> 517 ms +- 5 ms: 1.01x slower (+1%)

Faster (2):
- logging_silent: 209 ns +- 5 ns -> 205 ns +- 6 ns: 1.02x faster (-2%)
- pickle_list: 5.04 us +- 0.03 us -> 4.96 us +- 0.04 us: 1.02x faster (-2%)

Benchmark hidden because not significant (36):
```

I suppose all delta are noise. But there is a possibility small performance down caused by fatter binary.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42141>
_______________________________________

From report at bugs.python.org  Sun Oct 25 09:07:28 2020
From: report at bugs.python.org (Taras Voinarovskyi)
Date: Sun, 25 Oct 2020 13:07:28 +0000
Subject: [issue42130] AsyncIO's wait_for can hide cancellation in a rare race
 condition
In-Reply-To: <1603469429.01.0.760360212477.issue42130@roundup.psfhosted.org>
Message-ID: <1603631248.14.0.702358589968.issue42130@roundup.psfhosted.org>


Taras Voinarovskyi <voyn1991 at gmail.com> added the comment:

Hi Chris,
Yes, I do believe that is the respectful change, if we look the CancelledError is not checked to be external or originate from the timer. 
Best regards, 
Taras Voinarovskyi

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42130>
_______________________________________

From report at bugs.python.org  Sun Oct 25 09:33:48 2020
From: report at bugs.python.org (daniel hahler)
Date: Sun, 25 Oct 2020 13:33:48 +0000
Subject: [issue4489] shutil.rmtree is vulnerable to a symlink attack
In-Reply-To: <1228232522.58.0.0992151848245.issue4489@psf.upfronthosting.co.za>
Message-ID: <1603632828.11.0.676587868434.issue4489@roundup.psfhosted.org>


Change by daniel hahler <python-bugs at thequod.de>:


----------
nosy: +blueyed
nosy_count: 18.0 -> 19.0
pull_requests: +21884
pull_request: https://github.com/python/cpython/pull/22968

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4489>
_______________________________________

From report at bugs.python.org  Sun Oct 25 10:16:16 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Sun, 25 Oct 2020 14:16:16 +0000
Subject: [issue42146] subprocess.Popen() leaks cwd in case of uid/gid overflow
In-Reply-To: <1603629055.61.0.677699237141.issue42146@roundup.psfhosted.org>
Message-ID: <1603635376.85.0.946286835826.issue42146@roundup.psfhosted.org>


Change by Alexey Izbyshev <izbyshev at ispras.ru>:


----------
pull_requests: +21885
pull_request: https://github.com/python/cpython/pull/22970

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42146>
_______________________________________

From report at bugs.python.org  Sun Oct 25 10:25:05 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sun, 25 Oct 2020 14:25:05 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
Message-ID: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>


New submission from Dong-hee Na <donghee.na at python.org>:

This is a similar case with https://bugs.python.org/issue41902
A quite possible usecase when the user use range with big number

./python -m pyperf compare_to longrange_master.json longrange_opt.json
Mean +- std dev: [longrange_master] 6.45 us +- 0.09 us -> [longrange_opt] 5.72 us +- 0.07 us: 1.13x faster (-11%)

----------
assignee: corona10
components: Interpreter Core
files: bench_longrange.py
messages: 379578
nosy: corona10, methane, vstinner
priority: normal
severity: normal
status: open
title: Micro optimization for longrange iteration if step is 1
type: performance
versions: Python 3.10
Added file: https://bugs.python.org/file49539/bench_longrange.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 10:25:42 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Sun, 25 Oct 2020 14:25:42 +0000
Subject: [issue42146] subprocess.Popen() leaks cwd in case of uid/gid overflow
In-Reply-To: <1603629055.61.0.677699237141.issue42146@roundup.psfhosted.org>
Message-ID: <1603635942.52.0.483321084786.issue42146@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

I've submitted both PRs.

Regarding PR 22970:

* I made it a draft since we'd probably want to fix the leak first, but then it will have to be rebased. 

* It fixes a bug with _enable_gc(): if it failed after fork(), we'd raise OSError instead. Additionally, if fork() succeeded(), the errno inside OSError would be zero, and we'd leak the child process.

----------
keywords:  -patch
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42146>
_______________________________________

From report at bugs.python.org  Sun Oct 25 10:26:02 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 25 Oct 2020 14:26:02 +0000
Subject: [issue24427] subclass of multiprocessing Connection segfault upon
 attribute acces
In-Reply-To: <1433964415.99.0.226244144163.issue24427@psf.upfronthosting.co.za>
Message-ID: <1603635962.23.0.64926305142.issue24427@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> out of date
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24427>
_______________________________________

From report at bugs.python.org  Sun Oct 25 10:28:19 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sun, 25 Oct 2020 14:28:19 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603636099.66.0.155295434398.issue42147@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
keywords: +patch
pull_requests: +21886
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22971

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 10:28:32 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Sun, 25 Oct 2020 14:28:32 +0000
Subject: [issue42146] subprocess.Popen() leaks cwd in case of uid/gid overflow
In-Reply-To: <1603629055.61.0.677699237141.issue42146@roundup.psfhosted.org>
Message-ID: <1603636112.32.0.381478281681.issue42146@roundup.psfhosted.org>


Change by Alexey Izbyshev <izbyshev at ispras.ru>:


----------
keywords: +patch
stage:  -> patch review

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42146>
_______________________________________

From report at bugs.python.org  Sun Oct 25 10:33:39 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Sun, 25 Oct 2020 14:33:39 +0000
Subject: [issue42146] subprocess.Popen() leaks cwd in case of uid/gid overflow
In-Reply-To: <1603629055.61.0.677699237141.issue42146@roundup.psfhosted.org>
Message-ID: <1603636419.91.0.493358257366.issue42146@roundup.psfhosted.org>


Change by Alexey Izbyshev <izbyshev at ispras.ru>:


----------
type: behavior -> resource usage

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42146>
_______________________________________

From report at bugs.python.org  Sun Oct 25 10:59:09 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 25 Oct 2020 14:59:09 +0000
Subject: [issue39108] random needs doc for "gauss" versus "normalvariate"
In-Reply-To: <1576842313.59.0.109867222427.issue39108@roundup.psfhosted.org>
Message-ID: <1603637949.55.0.464292340682.issue39108@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 3cde3788b68bce7deee1e6d31e265bbfce337731 by Raymond Hettinger in branch 'master':
bpo-39108: Document threading issues for random.gauss() (GH-22928)
https://github.com/python/cpython/commit/3cde3788b68bce7deee1e6d31e265bbfce337731


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39108>
_______________________________________

From report at bugs.python.org  Sun Oct 25 10:59:23 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 14:59:23 +0000
Subject: [issue39108] random needs doc for "gauss" versus "normalvariate"
In-Reply-To: <1576842313.59.0.109867222427.issue39108@roundup.psfhosted.org>
Message-ID: <1603637963.73.0.877628958084.issue39108@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21887
pull_request: https://github.com/python/cpython/pull/22972

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39108>
_______________________________________

From report at bugs.python.org  Sun Oct 25 11:02:55 2020
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 25 Oct 2020 15:02:55 +0000
Subject: [issue38233] datetime.datetime.fromtimestamp have different behaviour
 on windows and mac
In-Reply-To: <1568991316.62.0.929906860007.issue38233@roundup.psfhosted.org>
Message-ID: <1603638175.67.0.243363999756.issue38233@roundup.psfhosted.org>


Change by Eryk Sun <eryksun at gmail.com>:


----------
resolution:  -> duplicate
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38233>
_______________________________________

From report at bugs.python.org  Sun Oct 25 11:14:57 2020
From: report at bugs.python.org (Marco Sulla)
Date: Sun, 25 Oct 2020 15:14:57 +0000
Subject: [issue42141] Speedup various dict inits
In-Reply-To: <1603574269.77.0.908879318121.issue42141@roundup.psfhosted.org>
Message-ID: <1603638897.17.0.136354526159.issue42141@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

The fact is that, IMHO, PGO will "false" the results, since it's quite improbable that in the test battery there's a test of creation of a dict from another dict with an hole. It seems to me that the comparison between the normal builds are more significant.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42141>
_______________________________________

From report at bugs.python.org  Sun Oct 25 11:46:58 2020
From: report at bugs.python.org (Mark Roseman)
Date: Sun, 25 Oct 2020 15:46:58 +0000
Subject: [issue33962] IDLE: use ttk.spinbox with configdialog
In-Reply-To: <1529983748.27.0.56676864532.issue33962@psf.upfronthosting.co.za>
Message-ID: <1603640818.12.0.951339563146.issue33962@roundup.psfhosted.org>


Mark Roseman <mark at markroseman.com> added the comment:

Whoops, sorry... there's a "readonly" state flag that disables direct editing of the entry (like with combobox) and just allows manipulation of the arrows. I've updated the PR to set that. I've also changed it so that the contents of the entry part isn't selected whenever the arrows are used (agreed, it looks ugly). Please give it a try and let me know.

p.s. I just checked, the entry's width configuration option works. You just have to remove the "fill=X" when the widget is packed. FWIW, I kept the previous layout to keep the patch as minimal as possible, under the assumption that other layout changes (here, on in general) were planned.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33962>
_______________________________________

From report at bugs.python.org  Sun Oct 25 11:48:41 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 25 Oct 2020 15:48:41 +0000
Subject: [issue39108] random needs doc for "gauss" versus "normalvariate"
In-Reply-To: <1576842313.59.0.109867222427.issue39108@roundup.psfhosted.org>
Message-ID: <1603640921.4.0.10870696459.issue39108@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset af891a962b62268d76ace0d4768ab0e1934a2cd1 by Miss Skeleton (bot) in branch '3.9':
bpo-39108: Document threading issues for random.gauss() (GH-22928) (GH-22972)
https://github.com/python/cpython/commit/af891a962b62268d76ace0d4768ab0e1934a2cd1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39108>
_______________________________________

From report at bugs.python.org  Sun Oct 25 11:49:05 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 25 Oct 2020 15:49:05 +0000
Subject: [issue39108] random needs doc for "gauss" versus "normalvariate"
In-Reply-To: <1576842313.59.0.109867222427.issue39108@roundup.psfhosted.org>
Message-ID: <1603640945.35.0.542529908098.issue39108@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39108>
_______________________________________

From report at bugs.python.org  Sun Oct 25 11:49:06 2020
From: report at bugs.python.org (hai shi)
Date: Sun, 25 Oct 2020 15:49:06 +0000
Subject: [issue41919] Modify test_codecs to use the new codecs.unregister()
 function
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1603640946.19.0.419052911655.issue41919@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
pull_requests: +21888
pull_request: https://github.com/python/cpython/pull/22973

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Sun Oct 25 11:50:45 2020
From: report at bugs.python.org (hai shi)
Date: Sun, 25 Oct 2020 15:50:45 +0000
Subject: [issue41919] Modify test_codecs to use the new codecs.unregister()
 function
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1603641045.09.0.713860275663.issue41919@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

> AS this is masking other issues in the build bots, we need to revert the commit unless is fixed in 24 hours per the buildbot workflow

Thanks, Pablo. I checked that only test_io.py have resource leak.
I create PR-22973, pls take a look if you have free time, thanks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Sun Oct 25 11:55:15 2020
From: report at bugs.python.org (Lewis Gaul)
Date: Sun, 25 Oct 2020 15:55:15 +0000
Subject: [issue37776] [subinterpreters] Test Py_Finalize() from a
 subinterpreter
In-Reply-To: <1565113410.42.0.547052767114.issue37776@roundup.psfhosted.org>
Message-ID: <1603641315.16.0.215633713387.issue37776@roundup.psfhosted.org>


Change by Lewis Gaul <lewis.gaul at gmail.com>:


----------
keywords: +patch
pull_requests: +21890
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/17575

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37776>
_______________________________________

From report at bugs.python.org  Sun Oct 25 11:56:27 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 25 Oct 2020 15:56:27 +0000
Subject: [issue41052] Opt out serialization/deserialization for heap type
In-Reply-To: <1592659049.98.0.596314769567.issue41052@roundup.psfhosted.org>
Message-ID: <1603641387.46.0.122614810272.issue41052@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 0aaecb30483e98fc29c1f4253967d05da092f0c5 by Serhiy Storchaka in branch '3.9':
[3.9] bpo-41052: Fix pickling heap types implemented in C with protocols 0 and 1 (GH-22870). (GH-22963)
https://github.com/python/cpython/commit/0aaecb30483e98fc29c1f4253967d05da092f0c5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41052>
_______________________________________

From report at bugs.python.org  Sun Oct 25 11:55:14 2020
From: report at bugs.python.org (Lewis Gaul)
Date: Sun, 25 Oct 2020 15:55:14 +0000
Subject: [issue38865] [subinterpreters] Can Py_Finalize() be called if the
 current interpreter is not the main interpreter?
In-Reply-To: <1574264524.01.0.330569638863.issue38865@roundup.psfhosted.org>
Message-ID: <1603641314.86.0.10607377281.issue38865@roundup.psfhosted.org>


Change by Lewis Gaul <lewis.gaul at gmail.com>:


----------
pull_requests: +21889
pull_request: https://github.com/python/cpython/pull/17575

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38865>
_______________________________________

From report at bugs.python.org  Sun Oct 25 12:03:17 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 25 Oct 2020 16:03:17 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603641797.98.0.338760307527.issue42147@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Sorry, but I do not think it is worth. If there are any issues with multiplying by 1, it may be worth to optimize multiplication of integers in general. But iterating range(1 << 1000, (1 << 1000) + 100) looks a pretty artificial example.

----------
nosy: +mark.dickinson, rhettinger, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 12:09:30 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 25 Oct 2020 16:09:30 +0000
Subject: [issue41052] Opt out serialization/deserialization for heap type
In-Reply-To: <1592659049.98.0.596314769567.issue41052@roundup.psfhosted.org>
Message-ID: <1603642170.7.0.886750734769.issue41052@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41052>
_______________________________________

From report at bugs.python.org  Sun Oct 25 12:10:30 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sun, 25 Oct 2020 16:10:30 +0000
Subject: [issue7175] Define a standard location and API for configuration files
In-Reply-To: <1256037677.34.0.670034749287.issue7175@psf.upfronthosting.co.za>
Message-ID: <1603642230.14.0.443966693198.issue7175@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
nosy:  -ronaldoussoren

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7175>
_______________________________________

From report at bugs.python.org  Sun Oct 25 12:18:41 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sun, 25 Oct 2020 16:18:41 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603642721.71.0.0871480222651.issue42147@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

At bpo-41092, we decide not to optimize mulitply operation itself.

I approach as same case that step=1 is quite a lot usecase until user designate step value.

If range with longobject is not that much use case, I can agree with your opinion

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 12:27:51 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sun, 25 Oct 2020 16:27:51 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603643271.01.0.0912606360591.issue42147@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

s/
I approach as same case that step=1 is quite a lot usecase until user designate step value.
/My assumtion is that step=1 is quite often usecase until user designate step value.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 12:49:56 2020
From: report at bugs.python.org (Andrea Tuccia)
Date: Sun, 25 Oct 2020 16:49:56 +0000
Subject: [issue42148] floating point representation issues
Message-ID: <1603644596.05.0.306482715682.issue42148@roundup.psfhosted.org>


New submission from Andrea Tuccia <andrea at tuccia.it>:

I'm noticing some floating point representation precision issues that occurs on all versions and platforms:

>>> 277*0.1
27.700000000000003
>>> 1.2-1.0
0.19999999999999996
>>> import numpy as np
>>> np.double(277*0.1)
27.700000000000003
>>> np.double(1.2-1.0)
0.19999999999999996
>>> np.longdouble(277*0.1)
27.700000000000002842
>>> np.longdouble(1.2-1.0)
0.19999999999999995559

Verified with python 2.7 to 3.8. On x86 (i386 and amd64) and ARM (32 and 64 bits). It does not occur in C, LUA, Perl, ...

----------
components: Interpreter Core, Library (Lib)
messages: 379589
nosy: atuccia
priority: normal
severity: normal
status: open
title: floating point representation issues
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42148>
_______________________________________

From report at bugs.python.org  Sun Oct 25 12:53:28 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sun, 25 Oct 2020 16:53:28 +0000
Subject: [issue42145] test_io is leaking references
In-Reply-To: <1603605078.18.0.00514890587111.issue42145@roundup.psfhosted.org>
Message-ID: <1603644808.51.0.0575916587805.issue42145@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42145>
_______________________________________

From report at bugs.python.org  Sun Oct 25 12:57:23 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sun, 25 Oct 2020 16:57:23 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603645043.5.0.0618861364882.issue42147@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

if somebody try to sum very large value with range.
sum(range(1 << 1000, (1 << 1000) + 100))
it can be affected by this patch.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 13:13:20 2020
From: report at bugs.python.org (hai shi)
Date: Sun, 25 Oct 2020 17:13:20 +0000
Subject: [issue42145] test_io is leaking references
In-Reply-To: <1603605078.18.0.00514890587111.issue42145@roundup.psfhosted.org>
Message-ID: <1603646000.77.0.655788074144.issue42145@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

I created a possible fix PR: PR-22973

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42145>
_______________________________________

From report at bugs.python.org  Sun Oct 25 13:28:49 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Sun, 25 Oct 2020 17:28:49 +0000
Subject: [issue42148] floating point representation issues
In-Reply-To: <1603644596.05.0.306482715682.issue42148@roundup.psfhosted.org>
Message-ID: <1603646929.17.0.817707854672.issue42148@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

This isn't a bug. It's due to the base 2 representation of floating point numbers. See for example: See https://docs.python.org/3/tutorial/floatingpoint.html

It's possible, depending on your use case, you might want to use the decimal module. But that has it's own issues that you should be aware of. For example, 1/7 is not exactly representable in either floats or Decimals.

----------
nosy: +eric.smith
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42148>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:02:53 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 18:02:53 +0000
Subject: [issue42144] A missing "goto" in the _ssl module!
In-Reply-To: <1603601507.64.0.594640776307.issue42144@roundup.psfhosted.org>
Message-ID: <1603648973.7.0.248635335783.issue42144@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21892
pull_request: https://github.com/python/cpython/pull/22975

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42144>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:02:46 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 18:02:46 +0000
Subject: [issue42144] A missing "goto" in the _ssl module!
In-Reply-To: <1603601507.64.0.594640776307.issue42144@roundup.psfhosted.org>
Message-ID: <1603648966.58.0.0559591024009.issue42144@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21891
pull_request: https://github.com/python/cpython/pull/22974

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42144>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:02:38 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 18:02:38 +0000
Subject: [issue42144] A missing "goto" in the _ssl module!
In-Reply-To: <1603601507.64.0.594640776307.issue42144@roundup.psfhosted.org>
Message-ID: <1603648958.35.0.663606128274.issue42144@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c32f2976b8f4034724c3270397aa16f38daf470f by Zackery Spytz in branch 'master':
bpo-42144: Add a missing "goto error;" in the _ssl module (GH-22959)
https://github.com/python/cpython/commit/c32f2976b8f4034724c3270397aa16f38daf470f


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42144>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:21:53 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Sun, 25 Oct 2020 18:21:53 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1603650113.98.0.832743658459.issue41490@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:


New changeset df8d4c83a6e1727e766191896aeabde886979587 by Jason R. Coombs in branch 'master':
bpo-41490: ``path`` and ``contents`` to aggressively close handles (#22915)
https://github.com/python/cpython/commit/df8d4c83a6e1727e766191896aeabde886979587


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:21:43 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 18:21:43 +0000
Subject: [issue42144] A missing "goto" in the _ssl module!
In-Reply-To: <1603601507.64.0.594640776307.issue42144@roundup.psfhosted.org>
Message-ID: <1603650103.53.0.980872385037.issue42144@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8e980ecfb7b42063ed41d665288aff69f0ed7fdc by Miss Skeleton (bot) in branch '3.8':
bpo-42144: Add a missing "goto error;" in the _ssl module (GH-22959)
https://github.com/python/cpython/commit/8e980ecfb7b42063ed41d665288aff69f0ed7fdc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42144>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:23:16 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 18:23:16 +0000
Subject: [issue42144] A missing "goto" in the _ssl module!
In-Reply-To: <1603601507.64.0.594640776307.issue42144@roundup.psfhosted.org>
Message-ID: <1603650196.84.0.366755472685.issue42144@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 83c86cf54b36a7325f615f5adf22b28e48f0e72d by Miss Skeleton (bot) in branch '3.9':
bpo-42144: Add a missing "goto error;" in the _ssl module (GH-22959)
https://github.com/python/cpython/commit/83c86cf54b36a7325f615f5adf22b28e48f0e72d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42144>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:38:37 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 18:38:37 +0000
Subject: [issue41919] Modify test_codecs to use the new codecs.unregister()
 function
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1603651117.34.0.883049816865.issue41919@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 14cdc215aa952d280c18626005d3aff967901d92 by Hai Shi in branch 'master':
bpo-41919: Avoid resource leak in test_io (GH-22973)
https://github.com/python/cpython/commit/14cdc215aa952d280c18626005d3aff967901d92


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:38:56 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 18:38:56 +0000
Subject: [issue41919] Modify test_codecs to use the new codecs.unregister()
 function
In-Reply-To: <1601717827.7.0.637294336769.issue41919@roundup.psfhosted.org>
Message-ID: <1603651136.61.0.916922652748.issue41919@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41919>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:37:08 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Sun, 25 Oct 2020 18:37:08 +0000
Subject: [issue42090] zipfile.Path.joinpath API inconsistent with
 pathlib.Path.joinpath
In-Reply-To: <1603141108.13.0.969027124293.issue42090@roundup.psfhosted.org>
Message-ID: <1603651028.6.0.727292471064.issue42090@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

This issue is fixed in zipp 3.4.0.

----------
assignee:  -> jaraco
stage:  -> backport needed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42090>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:39:32 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 18:39:32 +0000
Subject: [issue42145] test_io is leaking references
In-Reply-To: <1603605078.18.0.00514890587111.issue42145@roundup.psfhosted.org>
Message-ID: <1603651172.97.0.977835031465.issue42145@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Fixed by https://github.com/python/cpython/pull/22973

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42145>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:39:50 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 18:39:50 +0000
Subject: [issue42145] test_io is leaking references
In-Reply-To: <1603605078.18.0.00514890587111.issue42145@roundup.psfhosted.org>
Message-ID: <1603651190.6.0.68328369969.issue42145@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thanks for the quick fix, hai shi

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42145>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:45:12 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Sun, 25 Oct 2020 18:45:12 +0000
Subject: [issue42043] zipfile.Path should support inheritance
In-Reply-To: <1602763408.56.0.61735130641.issue42043@roundup.psfhosted.org>
Message-ID: <1603651512.08.0.439187141411.issue42043@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:


New changeset d1a0a960ee493262fb95a0f5b795b5b6d75cecb8 by Jason R. Coombs in branch 'master':
bpo-42043: Add support for zipfile.Path subclasses (#22716)
https://github.com/python/cpython/commit/d1a0a960ee493262fb95a0f5b795b5b6d75cecb8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42043>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:50:01 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Sun, 25 Oct 2020 18:50:01 +0000
Subject: [issue42090] zipfile.Path.joinpath API inconsistent with
 pathlib.Path.joinpath
In-Reply-To: <1603141108.13.0.969027124293.issue42090@roundup.psfhosted.org>
Message-ID: <1603651801.92.0.408744760267.issue42090@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
keywords: +patch
pull_requests: +21893
stage: backport needed -> patch review
pull_request: https://github.com/python/cpython/pull/22976

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42090>
_______________________________________

From report at bugs.python.org  Sun Oct 25 14:53:16 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Sun, 25 Oct 2020 18:53:16 +0000
Subject: [issue42090] zipfile.Path.joinpath API inconsistent with
 pathlib.Path.joinpath
In-Reply-To: <1603141108.13.0.969027124293.issue42090@roundup.psfhosted.org>
Message-ID: <1603651996.3.0.925548622884.issue42090@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
stage: patch review -> commit review

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42090>
_______________________________________

From report at bugs.python.org  Sun Oct 25 15:38:59 2020
From: report at bugs.python.org (Dustin Spicuzza)
Date: Sun, 25 Oct 2020 19:38:59 +0000
Subject: [issue41916] cxx pthread check is not overrideable
In-Reply-To: <1601709628.96.0.95457003563.issue41916@roundup.psfhosted.org>
Message-ID: <1603654739.83.0.382857542178.issue41916@roundup.psfhosted.org>


Dustin Spicuzza <dustin at virtualroadside.com> added the comment:

FWIW, I've been using the patch in my PR and it seems to work.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41916>
_______________________________________

From report at bugs.python.org  Sun Oct 25 15:40:07 2020
From: report at bugs.python.org (Kostiantyn Mashukov)
Date: Sun, 25 Oct 2020 19:40:07 +0000
Subject: [issue42149] Python 'make test' failed inside ssh+tmux
Message-ID: <1603654807.77.0.904276076107.issue42149@roundup.psfhosted.org>


New submission from Kostiantyn Mashukov <mail at highrox.com>:

Short version:
When building python from source code on linux (Debian10 amd64) inside ssh+tmux session 'make test' ends up with some tests failed.
  
Long version:
Build environment - freshly installed Debian10-amd64 os. Added build dependency packages: libreadline-dev libbz2-dev libffi-dev liblzma-dev libssl-dev libsqlite3-dev libgdbm-dev libncursesw5-dev tk-dev libgdbm-compat-dev

If you ssh to this machine, start tmux and initiate build like this:
./configure && make && make test
the whole testing phase will fail due to some failed tests.
----------------------------------------
7 tests failed:                                                                                                                                                                               
   test_generators test_multiprocessing_fork                                                                                                                                                 
   test_multiprocessing_forkserver test_multiprocessing_spawn                                                                                                                                   
   test_pdb test_regrtest test_threading                                                                                                                                                     
                                                                                                                                                                                              
14 tests skipped:                                                                                                                                                                             
   test_devpoll test_gdb test_ioctl test_kqueue test_msilib                                                                                                                           
   test_ossaudiodev test_startfile test_tix test_tk test_ttk_guionly                                                                                                                         
    test_winconsoleio test_winreg test_winsound test_zipfile64                                                                                                                                
                                                                                                                                                                                              
7 re-run tests:                                                                                                                                                                               
    test_generators test_multiprocessing_fork                                                                                                                                                 
    test_multiprocessing_forkserver test_multiprocessing_spawn                                                                                                                                
    test_pdb test_regrtest test_threading                                                                                                                                                     
                                                                                                                                                                                              
Total duration: 10 min 34 sec                                                                                                                                                                 
Tests result: FAILURE then FAILURE
-----------------------------------------
Running the same build process on the same machine ends up fine, if running: locally inside xterm, locally inside xterm+tmux, remotely inside ssh only (without tmux).

----------
components: Build
messages: 379603
nosy: kmash
priority: normal
severity: normal
status: open
title: Python 'make test' failed inside ssh+tmux
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42149>
_______________________________________

From report at bugs.python.org  Sun Oct 25 15:44:37 2020
From: report at bugs.python.org (Kostiantyn Mashukov)
Date: Sun, 25 Oct 2020 19:44:37 +0000
Subject: [issue42149] Python 'make test' failed inside ssh+tmux
In-Reply-To: <1603654807.77.0.904276076107.issue42149@roundup.psfhosted.org>
Message-ID: <1603655077.48.0.281026661373.issue42149@roundup.psfhosted.org>


Kostiantyn Mashukov <mail at highrox.com> added the comment:

Does it mean that running python script inside ssh+tmux session could fail if it uses functionality that fails those tests?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42149>
_______________________________________

From report at bugs.python.org  Sun Oct 25 16:05:08 2020
From: report at bugs.python.org (Ben Bonenfant)
Date: Sun, 25 Oct 2020 20:05:08 +0000
Subject: [issue27495] Pretty printing sorting for set and frozenset instances
In-Reply-To: <1468323029.69.0.352634397545.issue27495@psf.upfronthosting.co.za>
Message-ID: <1603656308.76.0.500918277022.issue27495@roundup.psfhosted.org>


Change by Ben Bonenfant <bonenfan5ben at gmail.com>:


----------
nosy: +bbonenfant
nosy_count: 6.0 -> 7.0
pull_requests: +21894
pull_request: https://github.com/python/cpython/pull/22977

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27495>
_______________________________________

From report at bugs.python.org  Sun Oct 25 16:34:59 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 20:34:59 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603658099.64.0.13814447401.issue42147@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I concur with Serhiy

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 16:38:29 2020
From: report at bugs.python.org (Christian Heimes)
Date: Sun, 25 Oct 2020 20:38:29 +0000
Subject: [issue42144] A missing "goto" in the _ssl module!
In-Reply-To: <1603601507.64.0.594640776307.issue42144@roundup.psfhosted.org>
Message-ID: <1603658309.46.0.81318710529.issue42144@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Thanks, excellent finding.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42144>
_______________________________________

From report at bugs.python.org  Sun Oct 25 17:11:23 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 21:11:23 +0000
Subject: [issue42150] Buffer overflow in bad_single_statement (Parser/pegen.c)
Message-ID: <1603660283.41.0.765507012241.issue42150@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

Building Python with the address sanitizer and executing ./python -m test test_repl -v shows this:

===========================================================
==26216==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x60200003990f at pc 0x5625406527b2 bp 0x7ffe8d621910 sp 0x7ffe8d621900
READ of size 1 at 0x60200003990f thread T0
    #0 0x5625406527b1 in bad_single_statement Parser/pegen.c:993
    #1 0x5625406527b1 in _PyPegen_run_parser Parser/pegen.c:1136
    #2 0x5625406529b8 in _PyPegen_run_parser_from_file_pointer Parser/pegen.c:1179
    #3 0x5625403f1945 in PyRun_InteractiveOneObjectEx Python/pythonrun.c:208
    #4 0x5625403f3cd9 in PyRun_InteractiveLoopFlags Python/pythonrun.c:115
    #5 0x5625403f4e3f in PyRun_AnyFileExFlags Python/pythonrun.c:74
    #6 0x562540181792 in pymain_run_stdin Modules/main.c:512
    #7 0x562540181792 in pymain_run_python Modules/main.c:601
    #8 0x562540182904 in Py_RunMain Modules/main.c:677
    #9 0x562540182904 in pymain_main Modules/main.c:707
    #10 0x562540182904 in Py_BytesMain Modules/main.c:731
    #11 0x7f25297aa151 in __libc_start_main (/usr/lib/libc.so.6+0x28151)
    #12 0x56254017f0bd in _start (/home/pablogsal/github/python/master/python+0x1640bd)

0x60200003990f is located 1 bytes to the left of 2-byte region [0x602000039910,0x602000039912)
allocated by thread T0 here:
    #0 0x7f2529b70459 in __interceptor_malloc /build/gcc/src/gcc/libsanitizer/asan/asan_malloc_linux.cpp:145
    #1 0x562540553416 in tok_nextc Parser/tokenizer.c:872
    #2 0x562540554eb7 in tok_get Parser/tokenizer.c:1190
    #3 0x562540559590 in PyTokenizer_Get Parser/tokenizer.c:1839
    #4 0x56254064f6dd in _PyPegen_fill_token Parser/pegen.c:584
    #5 0x5625406934a7 in statement_newline_rule Parser/parser.c:1296
    #6 0x5625406934a7 in interactive_rule Parser/parser.c:769
    #7 0x5625406934a7 in _PyPegen_parse Parser/parser.c:24823
    #8 0x562540652382 in _PyPegen_run_parser Parser/pegen.c:1111
    #9 0x5625406529b8 in _PyPegen_run_parser_from_file_pointer Parser/pegen.c:1179
    #10 0x5625403f1945 in PyRun_InteractiveOneObjectEx Python/pythonrun.c:208
    #11 0x5625403f3cd9 in PyRun_InteractiveLoopFlags Python/pythonrun.c:115
    #12 0x5625403f4e3f in PyRun_AnyFileExFlags Python/pythonrun.c:74
    #13 0x562540181792 in pymain_run_stdin Modules/main.c:512
    #14 0x562540181792 in pymain_run_python Modules/main.c:601
    #15 0x562540182904 in Py_RunMain Modules/main.c:677
    #16 0x562540182904 in pymain_main Modules/main.c:707
    #17 0x562540182904 in Py_BytesMain Modules/main.c:731
    #18 0x7f25297aa151 in __libc_start_main (/usr/lib/libc.so.6+0x28151)

SUMMARY: AddressSanitizer: heap-buffer-overflow Parser/pegen.c:993 in bad_single_statement
Shadow bytes around the buggy address:
  0x0c047ffff2d0: fa fa 00 04 fa fa 00 01 fa fa 00 04 fa fa 00 04
  0x0c047ffff2e0: fa fa 00 04 fa fa 00 04 fa fa 00 04 fa fa 00 04
  0x0c047ffff2f0: fa fa 00 04 fa fa 00 04 fa fa 00 04 fa fa 00 07
  0x0c047ffff300: fa fa 00 04 fa fa 00 04 fa fa 06 fa fa fa 00 fa
  0x0c047ffff310: fa fa fd fa fa fa fd fa fa fa fd fa fa fa fd fa
=>0x0c047ffff320: fa[fa]02 fa fa fa fd fa fa fa fd fa fa fa fd fa
  0x0c047ffff330: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c047ffff340: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c047ffff350: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c047ffff360: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c047ffff370: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
Shadow byte legend (one shadow byte represents 8 application bytes):
  Addressable:           00
  Partially addressable: 01 02 03 04 05 06 07
  Heap left redzone:       fa
  Freed heap region:       fd
  Stack left redzone:      f1
  Stack mid redzone:       f2
  Stack right redzone:     f3
  Stack after return:      f5
  Stack use after scope:   f8
  Global redzone:          f9
  Global init order:       f6
  Poisoned by user:        f7
  Container overflow:      fc
  Array cookie:            ac
  Intra object redzone:    bb
  ASan internal:           fe
  Left alloca redzone:     ca
  Right alloca redzone:    cb
  Shadow gap:              cc
==26216==ABORTING

----------
components: Interpreter Core
messages: 379607
nosy: lys.nikolaou, pablogsal
priority: normal
severity: normal
status: open
title: Buffer overflow in bad_single_statement (Parser/pegen.c)
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42150>
_______________________________________

From report at bugs.python.org  Sun Oct 25 17:12:48 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 21:12:48 +0000
Subject: [issue42150] Buffer overflow in bad_single_statement (Parser/pegen.c)
In-Reply-To: <1603660283.41.0.765507012241.issue42150@roundup.psfhosted.org>
Message-ID: <1603660368.68.0.229518198294.issue42150@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

The problem seems to be that when we do

const char *cur = strchr(p->tok->buf, '\n');
...

*(cur - 1) == '\\'

we don't check if "cur" is before at p->tok->buf (and therefore we cannot check the previous char)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42150>
_______________________________________

From report at bugs.python.org  Sun Oct 25 17:13:40 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 21:13:40 +0000
Subject: [issue42150] Buffer overflow in bad_single_statement (Parser/pegen.c)
In-Reply-To: <1603660283.41.0.765507012241.issue42150@roundup.psfhosted.org>
Message-ID: <1603660420.16.0.116520808081.issue42150@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +21895
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22978

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42150>
_______________________________________

From report at bugs.python.org  Sun Oct 25 17:15:12 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 21:15:12 +0000
Subject: [issue42150] Buffer overflow in bad_single_statement (Parser/pegen.c)
In-Reply-To: <1603660283.41.0.765507012241.issue42150@roundup.psfhosted.org>
Message-ID: <1603660512.28.0.914195819073.issue42150@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Check the errors in this new builder I have prepared:

https://buildbot.python.org/all/#/builders/582/builds/200/steps/5/logs/stdio

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42150>
_______________________________________

From report at bugs.python.org  Sun Oct 25 17:23:38 2020
From: report at bugs.python.org (Marco Sulla)
Date: Sun, 25 Oct 2020 21:23:38 +0000
Subject: [issue42141] Speedup various dict inits
In-Reply-To: <1603574269.77.0.908879318121.issue42141@roundup.psfhosted.org>
Message-ID: <1603661018.97.0.174306530898.issue42141@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

Well, after a second thought I think you're right, there's no significant advantage and too much duplicated code.

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42141>
_______________________________________

From report at bugs.python.org  Sun Oct 25 17:30:56 2020
From: report at bugs.python.org (Mark Roseman)
Date: Sun, 25 Oct 2020 21:30:56 +0000
Subject: [issue33962] IDLE: use ttk.spinbox with configdialog
In-Reply-To: <1529983748.27.0.56676864532.issue33962@psf.upfronthosting.co.za>
Message-ID: <1603661456.35.0.659058578395.issue33962@roundup.psfhosted.org>


Mark Roseman <mark at markroseman.com> added the comment:

Just as a side note for Terry and anyone else testing on macOS... the recent updates in Tk have smoothed out many of the appearance issues for the classic widgets. See the attached screen shot tkversions.png comparing 8.6.9 with the current trunk of the Tk repo. Notice things like the background color around the optionmenu aren't as jarring on the newer Tk versions.

Having said that, I'll likely stick with the older ones for development purposes, just because the blemishes with the classic widgets and other things are so much more noticeable! 

Incidentally, if you've got several versions of Tcl/Tk on your system, you can use /usr/bin/install_name_tool to point the Tkinter shared library at the one you want to use. Use like "install_name_tool -change OLD NEW file", e.g.:
    install_name_tool -change /Library/Frameworks/Tk.framework/Versions/8.6/Tk /Users/roseman/tmp/tcl86core/Library/Frameworks/Tk.framework/Versions/8.6/Tk build/lib.macosx-10.15-x86_64-3.10/_tkinter.cpython-310-darwin.so

----------
Added file: https://bugs.python.org/file49540/tkversions.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33962>
_______________________________________

From report at bugs.python.org  Sun Oct 25 17:47:01 2020
From: report at bugs.python.org (Chris Jerdonek)
Date: Sun, 25 Oct 2020 21:47:01 +0000
Subject: [issue30181] Correct the parsing of a test case docstring.
In-Reply-To: <1493261074.73.0.807341942876.issue30181@psf.upfronthosting.co.za>
Message-ID: <1603662421.74.0.338841097135.issue30181@roundup.psfhosted.org>


Chris Jerdonek <chris.jerdonek at gmail.com> added the comment:

I'm closing this as a duplicate of issue 39450, which has been resolved.

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> unittest TestCase shortDescription does not strip whitespace

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30181>
_______________________________________

From report at bugs.python.org  Sun Oct 25 17:57:48 2020
From: report at bugs.python.org (Chris Jerdonek)
Date: Sun, 25 Oct 2020 21:57:48 +0000
Subject: [issue42140] asyncio.wait function creates futures set two times
In-Reply-To: <1603522282.48.0.50359686965.issue42140@roundup.psfhosted.org>
Message-ID: <1603663068.93.0.570983446226.issue42140@roundup.psfhosted.org>


Chris Jerdonek <chris.jerdonek at gmail.com> added the comment:

Are you suggesting this is a bug, or is it just a suggested code cleanup? I ask because the docs suggest that a set should be passed:
https://docs.python.org/3/library/asyncio-task.html#asyncio.wait

And the docstring says it should be a sequence:
https://github.com/python/cpython/blob/d1a0a960ee493262fb95a0f5b795b5b6d75cecb8/Lib/asyncio/tasks.py#L373-L376

So while code cleanup is okay, I'm not sure support for general iterator arguments can / should be guaranteed.

----------
nosy: +chris.jerdonek

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42140>
_______________________________________

From report at bugs.python.org  Sun Oct 25 18:43:06 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 25 Oct 2020 22:43:06 +0000
Subject: [issue12737] str.title() is overzealous by upcasing combining
 marks	inappropriately
In-Reply-To: <1313102254.23.0.17412568785.issue12737@psf.upfronthosting.co.za>
Message-ID: <1603665786.79.0.770363557568.issue12737@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Of the examples given two seem ok now, but the Istanbul one is still wrong:

>>> "d?me un caf?".title()
'D?me Un Caf?'
>>> "? ??? ??????".title()
'?? ??? ??????'
>>>

>>> "i?stanbul".title()
'I?Stanbul'

----------
nosy: +iritkatriel
versions: +Python 3.10, Python 3.9 -Python 3.2, Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12737>
_______________________________________

From report at bugs.python.org  Sun Oct 25 18:49:48 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 25 Oct 2020 22:49:48 +0000
Subject: [issue5149] syntactic sugar: type coercion on pointer assignment
In-Reply-To: <1233710403.4.0.267443476473.issue5149@psf.upfronthosting.co.za>
Message-ID: <1603666188.01.0.201752411319.issue5149@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10 -Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5149>
_______________________________________

From report at bugs.python.org  Sun Oct 25 18:53:29 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 25 Oct 2020 22:53:29 +0000
Subject: [issue4246] doc: execution model - clear and complete example in
 documentation
In-Reply-To: <1225551571.75.0.81232740458.issue4246@psf.upfronthosting.co.za>
Message-ID: <1603666409.73.0.908629995045.issue4246@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
title: execution model - clear and complete example in documentation -> doc: execution model - clear and complete example in documentation
versions: +Python 3.10, Python 3.9 -Python 2.7, Python 3.2, Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4246>
_______________________________________

From report at bugs.python.org  Sun Oct 25 18:55:38 2020
From: report at bugs.python.org (Nicolas)
Date: Sun, 25 Oct 2020 22:55:38 +0000
Subject: [issue36207] robotsparser deny all with some rules
In-Reply-To: <1551865321.24.0.407834320039.issue36207@roundup.psfhosted.org>
Message-ID: <1603666538.7.0.192714008877.issue36207@roundup.psfhosted.org>


Nicolas <toulouse at meridigital.com> added the comment:

Seems like we have the same issue with http://meridigital.com/robots.txt

----------
nosy: +nico702 -matthieuhemea

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36207>
_______________________________________

From report at bugs.python.org  Sun Oct 25 18:58:27 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 25 Oct 2020 22:58:27 +0000
Subject: [issue12832] The documentation for the print function should
 explain/point to how to control the sys.stdout encoding
In-Reply-To: <1314191894.1.0.666645625262.issue12832@psf.upfronthosting.co.za>
Message-ID: <1603666707.72.0.20647595179.issue12832@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
type:  -> enhancement
versions: +Python 3.10, Python 3.9 -Python 2.7, Python 3.2, Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12832>
_______________________________________

From report at bugs.python.org  Sun Oct 25 19:01:14 2020
From: report at bugs.python.org (Nicolas)
Date: Sun, 25 Oct 2020 23:01:14 +0000
Subject: [issue36207] robotsparser deny all with some rules
In-Reply-To: <1551865321.24.0.407834320039.issue36207@roundup.psfhosted.org>
Message-ID: <1603666874.95.0.545437634272.issue36207@roundup.psfhosted.org>


Nicolas <toulouse at meridigital.com> added the comment:

Sorry, I meant https://www.meridigital.com

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36207>
_______________________________________

From report at bugs.python.org  Sun Oct 25 19:03:46 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 23:03:46 +0000
Subject: [issue42150] Buffer overflow in bad_single_statement (Parser/pegen.c)
In-Reply-To: <1603660283.41.0.765507012241.issue42150@roundup.psfhosted.org>
Message-ID: <1603667026.07.0.0316897236741.issue42150@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset e68c67805e6a4c4ec80bea64be0e8373cc02d322 by Pablo Galindo in branch 'master':
bpo-42150: Avoid buffer overflow in the new parser (GH-22978)
https://github.com/python/cpython/commit/e68c67805e6a4c4ec80bea64be0e8373cc02d322


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42150>
_______________________________________

From report at bugs.python.org  Sun Oct 25 19:04:02 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 23:04:02 +0000
Subject: [issue42150] Buffer overflow in bad_single_statement (Parser/pegen.c)
In-Reply-To: <1603660283.41.0.765507012241.issue42150@roundup.psfhosted.org>
Message-ID: <1603667042.89.0.849770377455.issue42150@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +21896
pull_request: https://github.com/python/cpython/pull/22979

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42150>
_______________________________________

From report at bugs.python.org  Sun Oct 25 19:03:53 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 25 Oct 2020 23:03:53 +0000
Subject: [issue42150] Buffer overflow in bad_single_statement (Parser/pegen.c)
In-Reply-To: <1603660283.41.0.765507012241.issue42150@roundup.psfhosted.org>
Message-ID: <1603667033.53.0.579590491586.issue42150@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42150>
_______________________________________

From report at bugs.python.org  Sun Oct 25 19:08:32 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 25 Oct 2020 23:08:32 +0000
Subject: [issue12930] reindent.py inserts spaces in multiline literals
In-Reply-To: <1315405777.71.0.767109553281.issue12930@psf.upfronthosting.co.za>
Message-ID: <1603667312.37.0.38841287831.issue12930@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.7, Python 3.2, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12930>
_______________________________________

From report at bugs.python.org  Sun Oct 25 19:21:10 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 25 Oct 2020 23:21:10 +0000
Subject: [issue1490929] urllib.retrieve's reporthook called with non-helpful
 value
Message-ID: <1603668070.49.0.589808328713.issue1490929@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

The code in urllib is different now but I see that a test very similar to the one in the patch exists, so was this fixed?

https://github.com/python/cpython/blob/e68c67805e6a4c4ec80bea64be0e8373cc02d322/Lib/test/test_urllib.py#L813

----------
nosy: +iritkatriel
status: open -> pending

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1490929>
_______________________________________

From report at bugs.python.org  Sun Oct 25 19:24:50 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 25 Oct 2020 23:24:50 +0000
Subject: [issue2679] email.feedparser regex duplicate
In-Reply-To: <1209045140.34.0.682842030487.issue2679@psf.upfronthosting.co.za>
Message-ID: <1603668290.15.0.67554962355.issue2679@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
type: behavior -> 
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.6, Python 2.7, Python 3.1, Python 3.2, Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2679>
_______________________________________

From report at bugs.python.org  Sun Oct 25 19:25:04 2020
From: report at bugs.python.org (miss-islington)
Date: Sun, 25 Oct 2020 23:25:04 +0000
Subject: [issue42150] Buffer overflow in bad_single_statement (Parser/pegen.c)
In-Reply-To: <1603660283.41.0.765507012241.issue42150@roundup.psfhosted.org>
Message-ID: <1603668304.62.0.281151324614.issue42150@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0b290dd2171e745d94f48298cafb2327eb2de17c by Miss Skeleton (bot) in branch '3.9':
bpo-42150: Avoid buffer overflow in the new parser (GH-22978)
https://github.com/python/cpython/commit/0b290dd2171e745d94f48298cafb2327eb2de17c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42150>
_______________________________________

From report at bugs.python.org  Sun Oct 25 19:55:13 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 25 Oct 2020 23:55:13 +0000
Subject: [issue42148] floating point representation issues
In-Reply-To: <1603644596.05.0.306482715682.issue42148@roundup.psfhosted.org>
Message-ID: <1603670113.47.0.983064826631.issue42148@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Eric I would normally agree with you but the only thing which gives me pause is the statement that this doesn't occur with C, Lua and Perl.

That alone doesn't mean much. Different interpreters can use different algorithms for printing floats, Python changed its algorithm in 3.1 and backported it to 2.7:

https://docs.python.org/3.1/whatsnew/3.1.html#other-language-changes

and now uses Gay's algorithm which will often give different, shorter, results than other algorithms. Other languages do other things, for example R is notorious for just terminating the float output after a few decimal places, so you have numbers which look identical but are unequal.

Andrea, do you still think this is a bug? Can you demonstrate some code in another language that shows the output you expect? (Preferably an interpreter rather than C.)

Most importantly, can you demonstrate that the other language's output is correct and Python's is wrong? In particular, are you sure that the output in those other languages is not just rounding the result to a certain number of decimal places?

If you can satisfy those, please re-open the ticket, otherwise I expect that Eric is correct.

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42148>
_______________________________________

From report at bugs.python.org  Sun Oct 25 20:05:12 2020
From: report at bugs.python.org (Dima Tisnek)
Date: Mon, 26 Oct 2020 00:05:12 +0000
Subject: [issue12930] reindent.py inserts spaces in multiline literals
In-Reply-To: <1315405777.71.0.767109553281.issue12930@psf.upfronthosting.co.za>
Message-ID: <1603670712.93.0.282922862374.issue12930@roundup.psfhosted.org>


Dima Tisnek <dimaqq at gmail.com> added the comment:

Given the trajectory of this bug, would it be easier to remove `reindent.py` from cpython code base entirely?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12930>
_______________________________________

From report at bugs.python.org  Sun Oct 25 20:07:27 2020
From: report at bugs.python.org (Dima Tisnek)
Date: Mon, 26 Oct 2020 00:07:27 +0000
Subject: [issue40060] socket.TCP_NOTSENT_LOWAT is missing in official macOS
 builds
In-Reply-To: <1585120826.63.0.863724436073.issue40060@roundup.psfhosted.org>
Message-ID: <1603670847.46.0.136388738188.issue40060@roundup.psfhosted.org>


Dima Tisnek <dimaqq at gmail.com> added the comment:

Indeed, this issue can be closed, when the mac build update is confirmed to be included in a specific upcoming Python version.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40060>
_______________________________________

From report at bugs.python.org  Sun Oct 25 20:09:47 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 26 Oct 2020 00:09:47 +0000
Subject: [issue42146] subprocess.Popen() leaks cwd in case of uid/gid overflow
In-Reply-To: <1603629055.61.0.677699237141.issue42146@roundup.psfhosted.org>
Message-ID: <1603670987.36.0.174304513905.issue42146@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21897
pull_request: https://github.com/python/cpython/pull/22980

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42146>
_______________________________________

From report at bugs.python.org  Sun Oct 25 20:09:40 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 26 Oct 2020 00:09:40 +0000
Subject: [issue42146] subprocess.Popen() leaks cwd in case of uid/gid overflow
In-Reply-To: <1603629055.61.0.677699237141.issue42146@roundup.psfhosted.org>
Message-ID: <1603670980.7.0.601516310483.issue42146@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset c0590c0033e86f98cdf5f2ca6898656f98ab4053 by Alexey Izbyshev in branch 'master':
bpo-42146: Fix memory leak in subprocess.Popen() in case of uid/gid overflow (GH-22966)
https://github.com/python/cpython/commit/c0590c0033e86f98cdf5f2ca6898656f98ab4053


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42146>
_______________________________________

From report at bugs.python.org  Sun Oct 25 20:14:06 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 26 Oct 2020 00:14:06 +0000
Subject: [issue42148] floating point representation issues
In-Reply-To: <1603644596.05.0.306482715682.issue42148@roundup.psfhosted.org>
Message-ID: <1603671246.35.0.775206939076.issue42148@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

It looks like Python is correct and the other languages may be just truncating the output.


In the Lua interpreter:

> =277*0.1
27.7
> = 277*0.1 == 27.7
false


Perl:

$ perl -e "use feature qw(say); say 277*0.1"
27.7
$ perl -e "use feature qw(say); if (277*0.1 != 27.7) {say 'unequal'}"
unequal

In Ruby:

irb(main):001:0> 277*0.1
=> 27.7
irb(main):002:0> 277*0.1 == 27.7
=> false


Julia agrees with Python:

julia> 277*0.1
27.700000000000003

So does the Rhino javascript interpreter:

js> 277*0.1
27.700000000000003

I think Eric's instinct was correct.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42148>
_______________________________________

From report at bugs.python.org  Sun Oct 25 20:18:06 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 26 Oct 2020 00:18:06 +0000
Subject: [issue42148] floating point representation issues
In-Reply-To: <1603644596.05.0.306482715682.issue42148@roundup.psfhosted.org>
Message-ID: <1603671486.79.0.0848775205677.issue42148@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Thanks for double-checking the other languages, Steven.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42148>
_______________________________________

From report at bugs.python.org  Sun Oct 25 20:34:36 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 26 Oct 2020 00:34:36 +0000
Subject: [issue42146] subprocess.Popen() leaks cwd in case of uid/gid overflow
In-Reply-To: <1603629055.61.0.677699237141.issue42146@roundup.psfhosted.org>
Message-ID: <1603672476.73.0.976666404165.issue42146@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c12afa92b0db6f017e479b41f95d75bac7b59850 by Miss Skeleton (bot) in branch '3.9':
[3.9] bpo-42146: Fix memory leak in subprocess.Popen() in case of uid/gid overflow (GH-22966) (GH-22980)
https://github.com/python/cpython/commit/c12afa92b0db6f017e479b41f95d75bac7b59850


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42146>
_______________________________________

From report at bugs.python.org  Sun Oct 25 21:30:20 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 26 Oct 2020 01:30:20 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603675820.87.0.675980578052.issue42147@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I agree that 1<<1000 is artificial example. But isn't this patch affects more regular patterns like [[] for _ in range(10000)]?

If we reject this, shouldn't we revert GH-22479 too?
I believe iterating range object is much more common use  case than range.index.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 21:50:19 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 26 Oct 2020 01:50:19 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603677019.61.0.0661487296047.issue42147@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

My particular opinion is that I would advise against having more branching, especially for code that is rare: it augments the possibilities of branch mispredictions, the changes of untested code paths, and the possibilities of unknown interactions. In this case, I agree that the code is simple enough, but I still feel that the cost may not be worth the extra maintenance needs of those branches.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 22:08:51 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 26 Oct 2020 02:08:51 +0000
Subject: [issue12737] str.title() is overzealous by upcasing combining
 marks	inappropriately
In-Reply-To: <1313102254.23.0.17412568785.issue12737@psf.upfronthosting.co.za>
Message-ID: <1603678131.26.0.128316718643.issue12737@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Are you sure? Running Ezio's titletest.py, I get this output (note that the UCD major version is in the double digits so the test for that misfires :-).

titletest.py: Please set your PYTHONIOENCODING envariable to utf8
WARNING: Your old UCD is out of date, expected 6.0.0 but got 13.0.0
titlecase of  'de?me un cafe?'  should be  'De?me Un Cafe?'  not  'De?Me Un Cafe?'
titlecase of  'i?stanbul'  should be  'I?stanbul'  not  'I?Stanbul'
titlecase of  '??? ??? ???????'  should be  '??? ??? ???????'  not  '??? ??? ???????'
failed 3 out of 6 tests

Note that the test program specifically uses combining marks, which are alternate ways to spell some characters. It seems what's failing is the second deme un cafe, the first istanbul, and the (only) greek phrase.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12737>
_______________________________________

From report at bugs.python.org  Sun Oct 25 22:38:38 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 26 Oct 2020 02:38:38 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603679918.12.0.38985485263.issue42147@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I had not noticed that there are rangeobject and longrangeobject. It doesn't affect to range(10000) definitely.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 22:41:23 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Mon, 26 Oct 2020 02:41:23 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603680083.9.0.376254223021.issue42147@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

@methane

To be more precise, [[] for _ in range(10000)] will not effort this patch because range(10000) does not create longrangeiter object.
This patch will affect to if the number is veeery large.

On the other hand, GH-22479 is affect to all index API() whether the number is large or small.

p.s by the way, Naoki is the last name or first name? ;)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 22:42:03 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Mon, 26 Oct 2020 02:42:03 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603680123.73.0.624081024469.issue42147@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

s / will not effort / will not be affected

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 22:55:43 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Mon, 26 Oct 2020 02:55:43 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603680943.15.0.756484315002.issue42147@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

@pablogsal, @serhiy.storchaka

> I would advise against having more branching, especially for code that is rare:

About bpo-41902, I believe those patches affect all range objects which is created with step is one .

I believe the usage of creation of range object with range(start), range(start, stop) is more than range(start, stop, step) unless there is significant proof that users prefer to create with range(start, stop, step)

So I think that those patches are worth to do it.

but PR 22971 is only affecting to longrange iteration.
it means if there no worth to optimize range(start), range(start, stop) when the start and stop is big number, this issue could be rejected.

And if the patch is rejected, I would like to suggest write a comment on the codeline for the future contributors why we decided to not optimizing this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 22:55:54 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 26 Oct 2020 02:55:54 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603680954.09.0.798348876947.issue42147@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> On the other hand, GH-22479 is affect to all index API() whether the number is large or small.

Then, no need to revert GH-22479 for consistency. Thanks.

> p.s by the way, Naoki is the last name or first name? ;)

It is difficult to say what is first name. Inada is surname and Naoki is given name. Surname comes first in Japanese.

Traditionally, we used reversed name order when write name in English to follow English-world manner. But China and Korea don't reverse name. And Japan is stopping reversed name order too. Japanese junior high schools teach surname-given name since about 2000.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 23:03:22 2020
From: report at bugs.python.org (Alfred Perlstein)
Date: Mon, 26 Oct 2020 03:03:22 +0000
Subject: [issue35753] Importing call from unittest.mock directly causes
 ValueError
In-Reply-To: <1547669844.88.0.953853980523.issue35753@roundup.psfhosted.org>
Message-ID: <1603681402.57.0.46673311318.issue35753@roundup.psfhosted.org>


Change by Alfred Perlstein <alfred at freebsd.org>:


----------
pull_requests: +21898
pull_request: https://github.com/python/cpython/pull/22981

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35753>
_______________________________________

From report at bugs.python.org  Sun Oct 25 23:15:25 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Mon, 26 Oct 2020 03:15:25 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603682125.52.0.836731476215.issue42147@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

Sorry for the offtopic

@methane

Looks like Inada san is the right expression. ;)

> But China and Korea don't reverse name.

This is a very intereting fact, the national system of Korea are using surname-given name order or printing with a distinc section.

A good example is the passport,
surname: Na
givenname: Dong-hee


But the education of Korea teaches to use given-surname order when going abroad ;)
So I always use the given-surname order when I have to write my name in English.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 23:20:37 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 26 Oct 2020 03:20:37 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603682437.86.0.583441354509.issue42147@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Oh, I didn't know that. Thank you.

I thought Chinese and Korean use surname-given name order because of "X? J?np?ng", "Moon Jae-in", and "Kim Jong-un". Japanese previous P.M. used "Shinzo Abe" English notation, but changed it to "Abe Shinzo" recently.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Sun Oct 25 23:51:30 2020
From: report at bugs.python.org (Felix C. Stegerman)
Date: Mon, 26 Oct 2020 03:51:30 +0000
Subject: [issue42151] Pure Python xml.etree.ElementTree is missing default
 attribute values
Message-ID: <1603684290.04.0.0149631860455.issue42151@roundup.psfhosted.org>


New submission from Felix C. Stegerman <flx at obfusk.net>:

I originally reported this as a bug in PyPy, but it turns out that CPython's C implementation (_elementtree) behaves differently than the pure Python version (b/c it sets specified_attributes = 1).

PyPy issue with example code: https://foss.heptapod.net/pypy/pypy/-/issues/3333

----------
components: Library (Lib)
messages: 379637
nosy: obfusk
priority: normal
severity: normal
status: open
title: Pure Python xml.etree.ElementTree is missing default attribute values
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42151>
_______________________________________

From report at bugs.python.org  Sun Oct 25 23:58:18 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 26 Oct 2020 03:58:18 +0000
Subject: [issue42151] Pure Python xml.etree.ElementTree is missing default
 attribute values
In-Reply-To: <1603684290.04.0.0149631860455.issue42151@roundup.psfhosted.org>
Message-ID: <1603684698.39.0.383937180425.issue42151@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +eli.bendersky, scoder, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42151>
_______________________________________

From report at bugs.python.org  Mon Oct 26 00:11:25 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 26 Oct 2020 04:11:25 +0000
Subject: [issue32122] Improve -x option documentation
In-Reply-To: <1511504808.14.0.213398074469.issue32122@psf.upfronthosting.co.za>
Message-ID: <1603685485.0.0.0919456808857.issue32122@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
keywords: +newcomer friendly
versions: +Python 3.10 -Python 2.7, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32122>
_______________________________________

From report at bugs.python.org  Mon Oct 26 00:32:54 2020
From: report at bugs.python.org (Denis S. Otkidach)
Date: Mon, 26 Oct 2020 04:32:54 +0000
Subject: [issue42140] asyncio.wait function creates futures set two times
In-Reply-To: <1603522282.48.0.50359686965.issue42140@roundup.psfhosted.org>
Message-ID: <1603686774.67.0.453034622727.issue42140@roundup.psfhosted.org>


Denis S. Otkidach <denis.otkidach at gmail.com> added the comment:

The current error message is way too cryptic anyway.  And restricting it to the set type only, as in docs, will certainly break a lot of code (passing a list is quite common).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42140>
_______________________________________

From report at bugs.python.org  Mon Oct 26 00:45:41 2020
From: report at bugs.python.org (Ned Deily)
Date: Mon, 26 Oct 2020 04:45:41 +0000
Subject: [issue30681] email.utils.parsedate_to_datetime() should return None
 when date cannot be parsed
In-Reply-To: <1497568363.46.0.596536376967.issue30681@psf.upfronthosting.co.za>
Message-ID: <1603687541.9.0.663327020442.issue30681@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
nosy:  -ned.deily
versions:  -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30681>
_______________________________________

From report at bugs.python.org  Mon Oct 26 00:52:42 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 26 Oct 2020 04:52:42 +0000
Subject: [issue33557] Windows multiprocessing doesn't propagate tabcheck to
 children
In-Reply-To: <1526571487.53.0.682650639539.issue33557@psf.upfronthosting.co.za>
Message-ID: <1603687962.11.0.731621778099.issue33557@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Python 2.7 became EOL.

----------
nosy: +methane
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33557>
_______________________________________

From report at bugs.python.org  Mon Oct 26 01:11:48 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Mon, 26 Oct 2020 05:11:48 +0000
Subject: [issue42151] Pure Python xml.etree.ElementTree is missing default
 attribute values
In-Reply-To: <1603684290.04.0.0149631860455.issue42151@roundup.psfhosted.org>
Message-ID: <1603689108.03.0.796542419129.issue42151@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42151>
_______________________________________

From report at bugs.python.org  Mon Oct 26 01:37:20 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 26 Oct 2020 05:37:20 +0000
Subject: [issue39871] math.copysign raises SystemError with non-float x and
 custom y
In-Reply-To: <1583463541.57.0.123228500554.issue39871@roundup.psfhosted.org>
Message-ID: <1603690640.04.0.892561983373.issue39871@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset f6255a2ccb55a63194caf698f471c803c08be359 by Zackery Spytz in branch '3.8':
bpo-39871: Fix an error in a news entry (GH-21749)
https://github.com/python/cpython/commit/f6255a2ccb55a63194caf698f471c803c08be359


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39871>
_______________________________________

From report at bugs.python.org  Mon Oct 26 01:46:15 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 26 Oct 2020 05:46:15 +0000
Subject: [issue41662] Bugs in binding parameters in sqlite3
In-Reply-To: <1598706308.83.0.197807583291.issue41662@roundup.psfhosted.org>
Message-ID: <1603691175.76.0.0462422284342.issue41662@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset a053a7ecfef006b834a9957468fa461dafb332db by Miss Skeleton (bot) in branch '3.8':
bpo-41662: Fix bugs in binding parameters in sqlite3 (GH-21998)
https://github.com/python/cpython/commit/a053a7ecfef006b834a9957468fa461dafb332db


----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41662>
_______________________________________

From report at bugs.python.org  Mon Oct 26 01:57:07 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 26 Oct 2020 05:57:07 +0000
Subject: [issue41100] Build failure on macOS 11 (beta)
In-Reply-To: <1592999467.1.0.372512113251.issue41100@roundup.psfhosted.org>
Message-ID: <1603691827.12.0.673562287537.issue41100@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
pull_requests: +21899
pull_request: https://github.com/python/cpython/pull/21115

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41100>
_______________________________________

From report at bugs.python.org  Mon Oct 26 02:11:31 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 26 Oct 2020 06:11:31 +0000
Subject: [issue39189] Use io.DEFAULT_BUFFER_SIZE for filecmp BUFSIZE variable
In-Reply-To: <1577962528.13.0.543315983881.issue39189@roundup.psfhosted.org>
Message-ID: <1603692691.07.0.0640779651868.issue39189@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I concur with Benjamin.

Although two variables are similar, they are used in the different layer.

----------
nosy: +methane
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39189>
_______________________________________

From report at bugs.python.org  Mon Oct 26 02:43:48 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 26 Oct 2020 06:43:48 +0000
Subject: [issue42006] Stop using PyDict_GetItem,
 PyDict_GetItemString and _PyDict_GetItemId
In-Reply-To: <1602427000.44.0.391654139767.issue42006@roundup.psfhosted.org>
Message-ID: <1603694628.99.0.965307324986.issue42006@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset fb5db7ec58624cab0797b4050735be865d380823 by Serhiy Storchaka in branch 'master':
bpo-42006: Stop using PyDict_GetItem, PyDict_GetItemString and _PyDict_GetItemId. (GH-22648)
https://github.com/python/cpython/commit/fb5db7ec58624cab0797b4050735be865d380823


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42006>
_______________________________________

From report at bugs.python.org  Mon Oct 26 02:48:46 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 26 Oct 2020 06:48:46 +0000
Subject: [issue40255] Fixing Copy on Writes from reference counting
In-Reply-To: <1586619621.82.0.553262088399.issue40255@roundup.psfhosted.org>
Message-ID: <1603694926.16.0.790801102814.issue40255@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I'm big -1 too. But I am interested in Instagram usage.

* How % of heap are CoW-ed with gc.freeze()?
* When CoW happen? in execution time, or shutdown?
* Which type cause CoW?

I have two ideas to reduce CoW:

* Fast shutdown option
  Currently Python try to free object as possible in finalization. It will cause much CoW. It will very bad for applications using multiprocessing.Pool for parallel processing of large data.

* Use "legacy" Unicode representation for large strings.
  Unicode is cold, immutable. But refcount is not immutable. Currentlly, most unicode object is "compact": object header and data is in one memory block. We may be able to use "legacy" representation and put cold data into another page.

For long term, multi process friendly `pyc` format can share more memory inter processes, even though they are not created by prefork.

----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40255>
_______________________________________

From report at bugs.python.org  Mon Oct 26 02:49:04 2020
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 26 Oct 2020 06:49:04 +0000
Subject: [issue40255] Fixing Copy on Writes from reference counting
In-Reply-To: <1586619621.82.0.553262088399.issue40255@roundup.psfhosted.org>
Message-ID: <1603694944.6.0.606146417159.issue40255@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40255>
_______________________________________

From report at bugs.python.org  Mon Oct 26 02:52:58 2020
From: report at bugs.python.org (Denis S. Otkidach)
Date: Mon, 26 Oct 2020 06:52:58 +0000
Subject: [issue42130] AsyncIO's wait_for can hide cancellation in a rare race
 condition
In-Reply-To: <1603469429.01.0.760360212477.issue42130@roundup.psfhosted.org>
Message-ID: <1603695178.12.0.441377414943.issue42130@roundup.psfhosted.org>


Change by Denis S. Otkidach <denis.otkidach at gmail.com>:


----------
nosy: +ods

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42130>
_______________________________________

From report at bugs.python.org  Mon Oct 26 03:15:19 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 26 Oct 2020 07:15:19 +0000
Subject: [issue42006] Stop using PyDict_GetItem,
 PyDict_GetItemString and _PyDict_GetItemId
In-Reply-To: <1602427000.44.0.391654139767.issue42006@roundup.psfhosted.org>
Message-ID: <1603696519.5.0.953690832641.issue42006@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

My plan is to deprecate PyDict_GetItem() and functions with same design flaw and finally remove them (in 4.0?).

We cannot start to ignore exceptions in PyDict_GetItem(). It would not fix the original flaw when the user code does not check an exception after using PyDict_GetItem(), and only make it worse. It can cause crashes in the code which asserts that the exception is not set (for example when function returns value and sets exception). And in worst case it will lead to incorrect results when PyErr_Occurred() is used after calling other C API function.

Emitting a DeprecationWarning only when PyDict_GetItem() is called with an exception raised does not make much sense, because the problem with PyDict_GetItem() is not only in this case. Also, there is a trick in using warnings here, you should use PyErr_WriteUnraisable(), so warnings always will be printed and cannot be turned into exceptions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42006>
_______________________________________

From report at bugs.python.org  Mon Oct 26 03:16:24 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 26 Oct 2020 07:16:24 +0000
Subject: [issue42152] Use PyDict_Contains() and PyDict_SetDefault() instead of
 PyDict_GetItemIdWithError
Message-ID: <1603696584.2.0.298207751497.issue42152@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: serhiy.storchaka
priority: normal
severity: normal
status: open
title: Use PyDict_Contains() and PyDict_SetDefault() instead of PyDict_GetItemIdWithError

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42152>
_______________________________________

From report at bugs.python.org  Mon Oct 26 03:28:19 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Mon, 26 Oct 2020 07:28:19 +0000
Subject: [issue42146] subprocess.Popen() leaks cwd in case of uid/gid overflow
In-Reply-To: <1603629055.61.0.677699237141.issue42146@roundup.psfhosted.org>
Message-ID: <1603697299.16.0.798587231663.issue42146@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

Thanks for merging! I've rebased PR 22970.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42146>
_______________________________________

From report at bugs.python.org  Mon Oct 26 03:39:38 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 26 Oct 2020 07:39:38 +0000
Subject: [issue42152] Use PyDict_Contains() and PyDict_SetDefault() instead of
 PyDict_GetItemWithError()
Message-ID: <1603697978.15.0.873588402489.issue42152@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

It was common to use the code PyDict_GetItem(dict, key) == NULL to check whether the key is in the dict. PyDict_GetItem() returns borrowed reference, so no clean up is needed. And if we need to check only existence of the key, we do not need to store a value.

But PyDict_GetItem() which suppresses all internal exceptions is considered not safe, so PyDict_GetItemWithError() should be used. The code looks like:

    if (PyDict_GetItemWithError(dict, key) == NULL) {
        if (PyErr_Occurred()) {
            goto error;
        }
        // does not have the key
    }
    else {
        // has the key
    }

It can be written with using PyDict_Contains():

    int r = PyDict_Contains(dict, key);
    if (r < 0) {
        goto error;
    }
    if (r == 0) {
        // does not have the key
    }
    else {
        // has the key
    }

Advantages:

* It is more clear expression of what we do.
* It is more simple and efficient in PyPy, because it has to keep borrowed references and track their lifetime.
* It may be more efficient in CPython, because calling PyErr_Occurred() has small but non-zero cost.
* PyErr_Occurred() would not be fooled by exception raised before. So you can use this code even if an exception is set.

Disadvantages:

* You need to use an int variable.

In some cases, when this check is used in combinations with PyDict_SetItem(), the code can be replaced with PyDict_SetDefault(), which is bot more terse and efficient. And when it is used in combinations with PyDict_DelItem(), the code can be replaced with _PyDict_Pop().

The proposed patch makes the code using PyDict_Contains() and PyDict_SetDefault() if appropriate. All use cases for _PyDict_Pop() were already covered by previous changes.

----------
components: +Interpreter Core
nosy: +methane, vstinner
title: Use PyDict_Contains() and PyDict_SetDefault() instead of PyDict_GetItemIdWithError -> Use PyDict_Contains() and PyDict_SetDefault() instead of PyDict_GetItemWithError()
type:  -> enhancement
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42152>
_______________________________________

From report at bugs.python.org  Mon Oct 26 03:41:35 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 26 Oct 2020 07:41:35 +0000
Subject: [issue42152] Use PyDict_Contains() and PyDict_SetDefault() instead of
 PyDict_GetItemWithError()
In-Reply-To: <1603697978.15.0.873588402489.issue42152@roundup.psfhosted.org>
Message-ID: <1603698095.94.0.479961228659.issue42152@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +21900
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22986

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42152>
_______________________________________

From report at bugs.python.org  Mon Oct 26 03:50:36 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 26 Oct 2020 07:50:36 +0000
Subject: [issue42152] Use PyDict_Contains() and PyDict_SetDefault() instead of
 PyDict_GetItemWithError()
In-Reply-To: <1603697978.15.0.873588402489.issue42152@roundup.psfhosted.org>
Message-ID: <1603698636.3.0.983008769395.issue42152@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

The code uses also _PyDict_ContainsId() added in issue42006 instead of _PyDict_GetItemIdWithError().

Few uses of _PyDict_GetItemStringWithError() are left as is. I do not think it is worth to introduce _PyDict_ContainsString(). They could be rewritten using _PyDict_ContainsId() if we find it worth.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42152>
_______________________________________

From report at bugs.python.org  Mon Oct 26 03:58:27 2020
From: report at bugs.python.org (Senthil Kumaran)
Date: Mon, 26 Oct 2020 07:58:27 +0000
Subject: [issue1490929] urllib.retrieve's reporthook called with non-helpful
 value
Message-ID: <1603699107.51.0.031071820087.issue1490929@roundup.psfhosted.org>


Senthil Kumaran <senthil at uthcode.com> added the comment:

> so was this fixed?

Irit, not really. This is adding another hook called "progress hook" in addition to the "report hook". We need to evaluate if this is really required.

----------
status: pending -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1490929>
_______________________________________

From report at bugs.python.org  Mon Oct 26 03:59:35 2020
From: report at bugs.python.org (Chris Xiao)
Date: Mon, 26 Oct 2020 07:59:35 +0000
Subject: [issue42153] doc: library imaplib a url not available
Message-ID: <1603699175.52.0.848588068568.issue42153@roundup.psfhosted.org>


New submission from Chris Xiao <c.cx at foxmail.com>:

jump to https://docs.python.org/3/library/imaplib.html#imap4-objects,

in the "See also" text, the url(https://www.washington.edu/imap/) of the University of Washington?s IMAP Information Center is not available.

----------
assignee: docs at python
components: Documentation
messages: 379650
nosy: chrisxiao, docs at python
priority: normal
severity: normal
status: open
title: doc: library imaplib a url not available
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42153>
_______________________________________

From report at bugs.python.org  Mon Oct 26 04:00:19 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 26 Oct 2020 08:00:19 +0000
Subject: [issue1490929] urllib.retrieve's reporthook called with non-helpful
 value
Message-ID: <1603699219.4.0.801567866153.issue1490929@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
stage: test needed -> 
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1490929>
_______________________________________

From report at bugs.python.org  Mon Oct 26 04:12:26 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 26 Oct 2020 08:12:26 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603699946.69.0.176013680324.issue42147@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I think that In sum(range(1 << 1000, (1 << 1000) + 100)) it is dwarfed by repeated addition of long integers in sum(). I expect the the effect of this optimization is even less that 13% in this case. In any case, for sum(range(a, b)) it is better to use formula (b-a)*(a+b-1)//2 if it is performance critical to you.

Iterating range object is pretty rare in Python (in most cases you iterate a sequence itself or enumerate object), and iterating range object for large integer is especially rare. Also, in real code you do not just iterate for the sake of iterating, you execute some code in every iteration. And it will make the effect of the optimization of this case much smaller, closer to 1% or 0.1% that to 13%.

Last week Inada-san played with my old optimization patch for using free lists for integers and decided to close the issue. He, and I, and other core developers agreed that it is not worth. Besides that optimization would help in much more cases and had good effect in microbenchmarks. And I closed also my other optimization patch few days ago. And did it many times in past. It is fanny to microoptimize the code, add special cases here and there, but it makes code larger and less maintenable, and a lot of such microoptimizations can have negative cumulative effect on the performance of general code. Sometimes the work of the core developer is to say "No" to his own code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Mon Oct 26 04:20:24 2020
From: report at bugs.python.org (Alex Roussel)
Date: Mon, 26 Oct 2020 08:20:24 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603700424.79.0.724251833949.issue42096@roundup.psfhosted.org>


Alex Roussel <alexandredrr14 at gmail.com> added the comment:

OK understood. Thanks for the explanation, I wasn't aware of those and will take a look.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Mon Oct 26 04:25:24 2020
From: report at bugs.python.org (Hitansh K Doshi)
Date: Mon, 26 Oct 2020 08:25:24 +0000
Subject: [issue42153] doc: library imaplib a url not available
In-Reply-To: <1603699175.52.0.848588068568.issue42153@roundup.psfhosted.org>
Message-ID: <1603700724.96.0.485446807212.issue42153@roundup.psfhosted.org>


Hitansh K Doshi <hkd159 at gmail.com> added the comment:

hello,
I am new to python repo,
I would like to contribute here.

I checked the page to told and it is showing that https://www.washington.edu/imap/ is not found.
I tried to find the url to their documentation but I couldn't found one. can you please guide me here

----------
nosy: +hitansh159

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42153>
_______________________________________

From report at bugs.python.org  Mon Oct 26 04:48:42 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Mon, 26 Oct 2020 08:48:42 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603702122.8.0.0840715902611.issue42147@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

> Sometimes the work of the core developer is to say "No" to his own code.

Thank you for the careful sentence.
For clear the air, I never think that my patch should be accepted.
This is why I always get reviews from other core devs and I always accept the review result.
(You may know my a lot of rejected PR ;))

but for the future record, we always record why someone tried this and why rejected(e.g why not worthed to do it)
so this is the reason why I talked about why I tried this optimization.

In the future, if someone submits a similar patch we can give this issue to them.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Mon Oct 26 04:50:41 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Mon, 26 Oct 2020 08:50:41 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603702241.46.0.523722727448.issue42147@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

I will close this issue by tomorrow with rejected ;)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Mon Oct 26 05:04:48 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 26 Oct 2020 09:04:48 +0000
Subject: [issue12737] str.title() is overzealous by upcasing combining
 marks	inappropriately
In-Reply-To: <1313102254.23.0.17412568785.issue12737@psf.upfronthosting.co.za>
Message-ID: <1603703088.05.0.640861772514.issue12737@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

You're right, I see that too when I don't tamper with the test.

----------
components: +Library (Lib)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12737>
_______________________________________

From report at bugs.python.org  Mon Oct 26 05:17:38 2020
From: report at bugs.python.org (john ryan)
Date: Mon, 26 Oct 2020 09:17:38 +0000
Subject: [issue42154] Bad proxy returned immediately after BaseManager server
 restarted
Message-ID: <1603703858.08.0.528057325979.issue42154@roundup.psfhosted.org>


New submission from john ryan <jryan at tactiq.co.uk>:

I am building an application that is made up of several separate processes, where each process is a python program. They are all started by the supervisord utility and execute within a venv running Python 3.8.5 (default, Aug 13 2020, 15:42:06) [GCC 7.5.0] on linux, under Ubuntu 18.04.

I am using a multiprocessing BaseManager to implement a repository of queues. Each process asks for a queue by name then uses put/get on that queue.

The application needs to be resilient so it must be possible to restart the respository process and have the various client processes re-connect to the queues hosted by it.

The problem I am getting is that the first call to `get_queue()` after restarting the BaseManager server process does not return a queue.

The sequence below shows some testing by hand. (My test environment runs Ubuntu in a virtualbox hosted on Windows 8.1)

Here I started the server in a different terminal then started python as below (both pythons in the same venv).

This works as expected with the first call to get_queue returning a queue.
```
(hydra_env) john at u1804-VirtualBox:~/sw/code/hydra$ python
Python 3.8.5 (default, Aug 13 2020, 15:42:06) 
[GCC 7.5.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from multiprocessing.managers import BaseManager
>>> class QueueManager(BaseManager): pass
... 
>>> QueueManager.register('get_queue')
>>> mgr = QueueManager(address=('localhost', 50000), authkey=b'abracadabra' )
>>> mgr.connect()
>>> q = mgr.get_queue('name', 'src'); print(str(q))
<multiprocessing.queues.Queue object at 0x7f98403c1820>
>>> q = mgr.get_queue('name', 'src'); print(str(q))
<multiprocessing.queues.Queue object at 0x7f98403c1820>
```

Stop and restart the server to see the problem. The first call to get_queue seems to succeed but in fact it has failed as shown by the print(str...). The second call to get_queue succeeds.
```
>>> mgr.connect()
>>> q = mgr.get_queue('name', 'src'); print(str(q))
<AutoProxy[get_queue] object, typeid 'get_queue' at 0x7f280afdc160; '__str__()' failed>
>>> q = mgr.get_queue('name', 'src'); print(str(q))
<multiprocessing.queues.Queue object at 0x7ff5f1b46820>
```

The server logs show it sent queues on all 4 calls
```
^C(hydra_env) john at u1804-VirtualBox:~/sw/code/hydra$ python ../../trials/test_mgr.py 
starting
serving <multiprocessing.queues.Queue object at 0x7f98403c1820>
serving <multiprocessing.queues.Queue object at 0x7f98403c1820>
^C(hydra_env) john at u1804-VirtualBox:~/sw/code/hydra$ python ../../trials/test_mgr.py 
starting
serving <multiprocessing.queues.Queue object at 0x7ff5f1b46820>
serving <multiprocessing.queues.Queue object at 0x7ff5f1b46820>
```

I get the same behaviour if I re-instantiate the local manager object

```
>>> mgr = QueueManager(address=('localhost', 50000), authkey=b'abracadabra' )
>>> mgr.connect()
>>> q = mgr.get_queue('name', 'src'); print(str(q))
<AutoProxy[get_queue] object, typeid 'get_queue' at 0x7f280afdc2b0; '__str__()' failed>
>>> q = mgr.get_queue('name', 'src'); print(str(q))
<multiprocessing.queues.Queue object at 0x7ff8dabd7820>
>>>
```

I even get the same behaviour if I just call `get_queue()` after restarting the server (ie without explicitly reconnecting).

I would have expected the first call to `get_queue()` to return a valid queue since neither it nor the call to `connect()` raised any kind of error.

It seems to me that there is some kind of state held that is the underlying cause of the issue. I did some investigating in  but I was not able to work out what was happening.

I found that it was possible to get into a state where a valid queue was never returned by `get_queue()` if an error had been raised by `get_nowait()` first.

Stop the server

```
>>> q.get_nowait()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "<string>", line 2, in get_nowait
  File "/home/john/.pyenv/versions/3.8.5/lib/python3.8/multiprocessing/managers.py", line 835, in _callmethod
    kind, result = conn.recv()
  File "/home/john/.pyenv/versions/3.8.5/lib/python3.8/multiprocessing/connection.py", line 250, in recv
    buf = self._recv_bytes()
  File "/home/john/.pyenv/versions/3.8.5/lib/python3.8/multiprocessing/connection.py", line 414, in _recv_bytes
    buf = self._recv(4)
  File "/home/john/.pyenv/versions/3.8.5/lib/python3.8/multiprocessing/connection.py", line 383, in _recv
    raise EOFError
EOFError
```

Restart the server but do not call `get_queue()`

```
>>> q.get_nowait()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "<string>", line 2, in get_nowait
  File "/home/john/.pyenv/versions/3.8.5/lib/python3.8/multiprocessing/managers.py", line 834, in _callmethod
    conn.send((self._id, methodname, args, kwds))
  File "/home/john/.pyenv/versions/3.8.5/lib/python3.8/multiprocessing/connection.py", line 206, in send
    self._send_bytes(_ForkingPickler.dumps(obj))
  File "/home/john/.pyenv/versions/3.8.5/lib/python3.8/multiprocessing/connection.py", line 411, in _send_bytes
    self._send(header + buf)
  File "/home/john/.pyenv/versions/3.8.5/lib/python3.8/multiprocessing/connection.py", line 368, in _send
    n = write(self._handle, buf)
BrokenPipeError: [Errno 32] Broken pipe
>>> q = mgr.get_queue('name', 'src'); print(str(q))
<AutoProxy[get_queue] object, typeid 'get_queue' at 0x7f1e21f63070; '__str__()' failed>
>>> q = mgr.get_queue('name', 'src'); print(str(q))
<AutoProxy[get_queue] object, typeid 'get_queue' at 0x7f1e21f63130; '__str__()' failed>
>>> q = mgr.get_queue('name', 'src'); print(str(q))
<AutoProxy[get_queue] object, typeid 'get_queue' at 0x7f1e21f63220; '__str__()' failed>
>>> q = mgr.get_queue('name', 'src'); print(str(q))
<AutoProxy[get_queue] object, typeid 'get_queue' at 0x7f1e21f631f0; '__str__()' failed>
```

This continued while I was testing, but returned a queue some time later so was perhaps stuck on a timeout.


Python 3.9.0 - I did a limited amount of testing on Python 3.9.0 and the results appeared to be the same.


The code for the test server is here

```
from multiprocessing.managers import BaseManager
from multiprocessing import Queue

class QueueManager(BaseManager):

    def __init__(self, *args, **kwargs):
        super().__init__(*args, **kwargs)
        self.__queues = {} # dict of instances keyed on qname

    def get_queue(self, qname: str, src: str) -> Queue:
        if qname not in self.__queues:
            self.__queues[qname] = Queue()
        the_q = self.__queues[qname]
        print(f'serving {the_q}')
        return the_q


def main() -> None:
    """main for a process serving queues forever"""
    mgr = QueueManager(address=('localhost', 50000), authkey=b'abracadabra' )
    QueueManager.register('get_queue', callable=mgr.get_queue)
    server_object = mgr.get_server()
    print('starting')
    server_object.serve_forever()


if __name__ == '__main__':
    main()

```

----------
components: Library (Lib)
messages: 379657
nosy: jryan
priority: normal
severity: normal
status: open
title: Bad proxy returned immediately after BaseManager server restarted
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42154>
_______________________________________

From report at bugs.python.org  Mon Oct 26 06:15:40 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 26 Oct 2020 10:15:40 +0000
Subject: [issue4297] Add error_log attribute to optparse.OptionParser
In-Reply-To: <1226413379.99.0.188665223227.issue4297@psf.upfronthosting.co.za>
Message-ID: <1603707340.94.0.414706085002.issue4297@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Following issue9938, argparse now offers a convenient way to handle errors. I propose to close this issue as out of date.

----------
nosy: +iritkatriel
status: open -> pending

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4297>
_______________________________________

From report at bugs.python.org  Mon Oct 26 06:48:11 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 26 Oct 2020 10:48:11 +0000
Subject: [issue42152] Use PyDict_Contains() and PyDict_SetDefault() instead of
 PyDict_GetItemWithError()
In-Reply-To: <1603697978.15.0.873588402489.issue42152@roundup.psfhosted.org>
Message-ID: <1603709291.01.0.667766553074.issue42152@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset b510e101f8b5b31276bf97b921ca9247162881d2 by Serhiy Storchaka in branch 'master':
bpo-42152: Use PyDict_Contains and PyDict_SetDefault if appropriate. (GH-22986)
https://github.com/python/cpython/commit/b510e101f8b5b31276bf97b921ca9247162881d2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42152>
_______________________________________

From report at bugs.python.org  Mon Oct 26 07:23:10 2020
From: report at bugs.python.org (Andrew de Quincey)
Date: Mon, 26 Oct 2020 11:23:10 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
In-Reply-To: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>
Message-ID: <1603711390.51.0.500490137167.issue42097@roundup.psfhosted.org>


Andrew de Quincey <Adq at tvsquared.com> added the comment:

Hi, sorry, I was ill on Friday, apologies for the delayed reply.

We're not using os.fork() directly, and I'm afraid the multiprocessing thing I mentioned was a bit of a red herring.

We're using a capped pool of threads to spawn subprocesses (using subprocess.*) and wait for them to complete.. so we'll do something like spawn max 6 threads, each of which will kick off a subprocess and stuff them in a list. Then in the main loop, we wait for one of the threads to complete and start a new one when it has done so. I don't _believe_ this should trigger the os.fork()/logging bug?

This all worked fine in 2.* and in 3.5. Its only in 3.7 that we have started to have this hanging problem.

Unfortunately the (production) environment that has the problem is currently running 3.7. We do have plans to upgrade to 3.8, but I can't just switch it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Mon Oct 26 07:41:51 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 26 Oct 2020 11:41:51 +0000
Subject: [issue42155] email.utils.parsedate_to_datetime() should return None
 when date cannot be parsed
Message-ID: <1603712511.56.0.0108062453896.issue42155@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

Documentation says that parsedate_to_datetime() performs the same function as parsedata(), but on success returns a datetime.

parsedata() returns None when date cannot be parsed, but parsedate_to_datetime() raises TypeError.

>>> email.utils.parsedate("0")
>>> email.utils.parsedate_to_datetime("0")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/serhiy/py/cpython/Lib/email/utils.py", line 198, in parsedate_to_datetime
    *dtuple, tz = _parsedate_tz(data)
TypeError: cannot unpack non-iterable NoneType object

The other use case is passing None as arguments. Although it is not documented, but I seen the following code in wild:

    parsedate(header.get('Date'))

parsedate() and parsedate_tz() accept None, but parsedate_to_datetime() does not.

----------
components: Library (Lib), email
messages: 379661
nosy: barry, maxking, r.david.murray, serhiy.storchaka
priority: normal
severity: normal
status: open
title: email.utils.parsedate_to_datetime() should return None when date cannot be parsed
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42155>
_______________________________________

From report at bugs.python.org  Mon Oct 26 07:46:35 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 26 Oct 2020 11:46:35 +0000
Subject: [issue21510] fma documentation should provide better example.
In-Reply-To: <1400131145.93.0.338142878224.issue21510@psf.upfronthosting.co.za>
Message-ID: <1603712795.91.0.672331393102.issue21510@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.9 -Python 2.7, Python 3.1, Python 3.2, Python 3.3, Python 3.4, Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21510>
_______________________________________

From report at bugs.python.org  Mon Oct 26 07:48:57 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 26 Oct 2020 11:48:57 +0000
Subject: [issue15339] document the threading "facts of life" in Python
In-Reply-To: <1342130435.62.0.0784000861923.issue15339@psf.upfronthosting.co.za>
Message-ID: <1603712937.62.0.0105219937131.issue15339@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
priority: low -> normal
stage:  -> needs patch
type:  -> behavior
versions: +Python 3.10, Python 3.9 -Python 2.7, Python 3.2, Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15339>
_______________________________________

From report at bugs.python.org  Mon Oct 26 07:57:04 2020
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 26 Oct 2020 11:57:04 +0000
Subject: [issue26954] Add Guido's rejection notice to the "with" FAQ
In-Reply-To: <1462378082.17.0.472643239372.issue26954@psf.upfronthosting.co.za>
Message-ID: <1603713424.15.0.182439804385.issue26954@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.9 -Python 2.7, Python 3.2, Python 3.3, Python 3.4, Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26954>
_______________________________________

From report at bugs.python.org  Mon Oct 26 09:33:05 2020
From: report at bugs.python.org (=?utf-8?q?Stefan_V=C3=B6lkl?=)
Date: Mon, 26 Oct 2020 13:33:05 +0000
Subject: [issue42156] Currency not correct for all locales
Message-ID: <1603719185.4.0.390571957235.issue42156@roundup.psfhosted.org>


New submission from Stefan V?lkl <stefan.voelkl at fotozupple.de>:

I found that the currency formatting does not work correctly for all locales. For example:

{{{
import locale

amount = 24.99
locale.setlocale(locale.LC_ALL, 'it_IT.UTF-8')

price = locale.currency(amount)

print(price)
}}}

returns "? 24,99".
It should return "24,99 ?", just like noted at http://publications.europa.eu/code/it/it-370303.htm
under "Posizione del simbolo (?) negli importi in cifre".

----------
components: Library (Lib)
messages: 379662
nosy: GiftZwergrapper, lemburg
priority: normal
severity: normal
status: open
title: Currency not correct for all locales
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42156>
_______________________________________

From report at bugs.python.org  Mon Oct 26 09:35:50 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Mon, 26 Oct 2020 13:35:50 +0000
Subject: [issue42147] Micro optimization for longrange iteration if step is 1
In-Reply-To: <1603635905.37.0.86802982801.issue42147@roundup.psfhosted.org>
Message-ID: <1603719350.51.0.238190367662.issue42147@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

I close this issue with rejected status.
Thank you serhiy, pablogsal and Inada-san for discussion ;)

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42147>
_______________________________________

From report at bugs.python.org  Mon Oct 26 09:48:49 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 26 Oct 2020 13:48:49 +0000
Subject: [issue42156] Currency not correct for all locales
In-Reply-To: <1603719185.4.0.390571957235.issue42156@roundup.psfhosted.org>
Message-ID: <1603720129.75.0.174531498259.issue42156@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

What does locale.localeconv() return?

>>> locale.localeconv()
{'int_curr_symbol': '', 'currency_symbol': '', 'mon_decimal_point': '', 'mon_thousands_sep': '', 'mon_grouping': [], 'positive_sign': '', 'negative_sign': '', 'int_frac_digits': 127, 'frac_digits': 127, 'p_cs_precedes': 127, 'p_sep_by_space': 127, 'n_cs_precedes': 127, 'n_sep_by_space': 127, 'p_sign_posn': 127, 'n_sign_posn': 127, 'decimal_point': '.', 'thousands_sep': '', 'grouping': []}
>>>

In particular, the values of p_cs_precedes and n_cs_precedes.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42156>
_______________________________________

From report at bugs.python.org  Mon Oct 26 09:58:51 2020
From: report at bugs.python.org (=?utf-8?q?Stefan_V=C3=B6lkl?=)
Date: Mon, 26 Oct 2020 13:58:51 +0000
Subject: [issue42156] Currency not correct for all locales
In-Reply-To: <1603719185.4.0.390571957235.issue42156@roundup.psfhosted.org>
Message-ID: <1603720731.87.0.748115787184.issue42156@roundup.psfhosted.org>


Stefan V?lkl <stefan.voelkl at fotozupple.de> added the comment:

>>> locale.localeconv()
{'int_curr_symbol': 'EUR ', 'currency_symbol': '?', 'mon_decimal_point': ',', 'mon_thousands_sep': '.', 'mon_grouping': [3, 3, 0], 'positive_sign': '', 'negative_sign': '-', 'int_frac_digits': 2, 'frac_digits': 2, 'p_cs_precedes': 1, 'p_sep_by_space': 1, 'n_cs_precedes': 1, 'n_sep_by_space': 1, 'p_sign_posn': 1, 'n_sign_posn': 1, 'decimal_point': ',', 'thousands_sep': '.', 'grouping': [3, 3, 0]}

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42156>
_______________________________________

From report at bugs.python.org  Mon Oct 26 10:07:05 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 26 Oct 2020 14:07:05 +0000
Subject: [issue42156] Currency not correct for all locales
In-Reply-To: <1603719185.4.0.390571957235.issue42156@roundup.psfhosted.org>
Message-ID: <1603721225.56.0.700685253237.issue42156@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

p_cs_precedes == 1 means "the currency_symbol or int_curr_symbol strings should precede the value of a monetary amount", per https://www.gnu.org/software/libc/manual/html_node/Currency-Symbol.html (I couldn't find a more authoritative source, but I think this is okay).

So it looks like Python is following the rules correctly. I don't know how you'd adjust the locale values.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42156>
_______________________________________

From report at bugs.python.org  Mon Oct 26 11:43:55 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 15:43:55 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1603727035.36.0.779133493247.issue1635741@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 47e1afd2a1793b5818a16c41307a4ce976331649 by Victor Stinner in branch 'master':
bpo-1635741: _PyUnicode_Name_CAPI moves to internal C API (GH-22713)
https://github.com/python/cpython/commit/47e1afd2a1793b5818a16c41307a4ce976331649


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Mon Oct 26 11:47:16 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Mon, 26 Oct 2020 15:47:16 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
In-Reply-To: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>
Message-ID: <1603727236.41.0.0497531783048.issue42097@roundup.psfhosted.org>


Change by Alexey Izbyshev <izbyshev at ispras.ru>:


Added file: https://bugs.python.org/file49531/test.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Mon Oct 26 11:49:38 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Mon, 26 Oct 2020 15:49:38 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
In-Reply-To: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>
Message-ID: <1603727378.89.0.48417480234.issue42097@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

(Restored test.py attachment)

The issue happens due to an incorrect usage of `multiprocessing.Pool`.

```
    # Set up multiprocessing pool, initialising logging in each subprocess
    with multiprocessing.Pool(initializer=process_setup, initargs=(get_queue(),)) as pl:
        # 100 seems to work fine, 500 fails most of the time.
        # If you're having trouble reproducing the error, try bumping this number up to 1000
        pl.map(do_work, range(10000))

    if _globalListener is not None:
        # Stop the listener and join the thread it runs on.
        # If we don't do this, we may lose log messages when we exit.
        _globalListener.stop()
```

Leaving `with` statement causes `pl.terminate()` [1, 2]
Since multiprocessing simply sends SIGTERM to all workers, a worker might be killed while it holds the cross-process lock guarding `_globalQueue`. In this case, `_globalListener.stop()` blocks forever trying to acquire that lock (to add a sentinel to `_globalQueue` to make a background thread stop monitoring it).

Consider using `Pool.close()` and `Pool.join()` to properly wait for task completion.

[1] https://docs.python.org/3.9/library/multiprocessing.html#multiprocessing.pool.Pool.terminate
[2] https://docs.python.org/3.9/library/multiprocessing.html#programming-guidelines

----------
nosy: +izbyshev
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Mon Oct 26 11:58:44 2020
From: report at bugs.python.org (Alexey Izbyshev)
Date: Mon, 26 Oct 2020 15:58:44 +0000
Subject: [issue42097] Python 3.7.9 logging/threading/fork hang
In-Reply-To: <1603204591.66.0.845365232565.issue42097@roundup.psfhosted.org>
Message-ID: <1603727924.65.0.730861506446.issue42097@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

By the way, I don't see a direct relation between `test.py` (which doesn't use `subprocess` directly) and your comment describing `subprocess` usage with threads. So if you think that the bug in `test.py` is unrelated to the problem you face, feel free to reopen.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42097>
_______________________________________

From report at bugs.python.org  Mon Oct 26 12:01:16 2020
From: report at bugs.python.org (Felix C. Stegerman)
Date: Mon, 26 Oct 2020 16:01:16 +0000
Subject: [issue42151] Pure Python xml.etree.ElementTree is missing default
 attribute values
In-Reply-To: <1603684290.04.0.0149631860455.issue42151@roundup.psfhosted.org>
Message-ID: <1603728076.26.0.0202748134027.issue42151@roundup.psfhosted.org>


Change by Felix C. Stegerman <flx at obfusk.net>:


----------
keywords: +patch
pull_requests: +21901
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22987

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42151>
_______________________________________

From report at bugs.python.org  Mon Oct 26 12:25:36 2020
From: report at bugs.python.org (Lisa Roach)
Date: Mon, 26 Oct 2020 16:25:36 +0000
Subject: [issue39706] unittest.IsolatedAsyncioTestCase hangs on
 asyncio.CancelledError
In-Reply-To: <1582279968.65.0.00583544355873.issue39706@roundup.psfhosted.org>
Message-ID: <1603729536.14.0.863739829307.issue39706@roundup.psfhosted.org>


Change by Lisa Roach <lisaroach14 at gmail.com>:


----------
keywords: +patch
nosy: +lisroach
nosy_count: 3.0 -> 4.0
pull_requests: +21902
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22654

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39706>
_______________________________________

From report at bugs.python.org  Mon Oct 26 12:28:33 2020
From: report at bugs.python.org (Lisa Roach)
Date: Mon, 26 Oct 2020 16:28:33 +0000
Subject: [issue39101] IsolatedAsyncioTestCase freezes when exception is raised
In-Reply-To: <1576784699.03.0.850711294275.issue39101@roundup.psfhosted.org>
Message-ID: <1603729713.41.0.954827500729.issue39101@roundup.psfhosted.org>


Lisa Roach <lisaroach14 at gmail.com> added the comment:


New changeset 8374d2ee1589791be8892b00f4bbf8121dde24bd by Lisa Roach in branch 'master':
bpo-39101: Fixes BaseException hang in IsolatedAsyncioTestCase. (GH-22654)
https://github.com/python/cpython/commit/8374d2ee1589791be8892b00f4bbf8121dde24bd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39101>
_______________________________________

From report at bugs.python.org  Mon Oct 26 12:28:47 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 26 Oct 2020 16:28:47 +0000
Subject: [issue39101] IsolatedAsyncioTestCase freezes when exception is raised
In-Reply-To: <1576784699.03.0.850711294275.issue39101@roundup.psfhosted.org>
Message-ID: <1603729727.3.0.00755949392689.issue39101@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21904
pull_request: https://github.com/python/cpython/pull/22989

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39101>
_______________________________________

From report at bugs.python.org  Mon Oct 26 12:28:39 2020
From: report at bugs.python.org (miss-islington)
Date: Mon, 26 Oct 2020 16:28:39 +0000
Subject: [issue39101] IsolatedAsyncioTestCase freezes when exception is raised
In-Reply-To: <1576784699.03.0.850711294275.issue39101@roundup.psfhosted.org>
Message-ID: <1603729719.03.0.840632870139.issue39101@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +21903
pull_request: https://github.com/python/cpython/pull/22988

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39101>
_______________________________________

From report at bugs.python.org  Mon Oct 26 12:28:53 2020
From: report at bugs.python.org (Lisa Roach)
Date: Mon, 26 Oct 2020 16:28:53 +0000
Subject: [issue39706] unittest.IsolatedAsyncioTestCase hangs on
 asyncio.CancelledError
In-Reply-To: <1582279968.65.0.00583544355873.issue39706@roundup.psfhosted.org>
Message-ID: <1603729733.56.0.0507503621372.issue39706@roundup.psfhosted.org>


Change by Lisa Roach <lisaroach14 at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39706>
_______________________________________

From report at bugs.python.org  Mon Oct 26 12:29:40 2020
From: report at bugs.python.org (Lisa Roach)
Date: Mon, 26 Oct 2020 16:29:40 +0000
Subject: [issue39101] IsolatedAsyncioTestCase freezes when exception is raised
In-Reply-To: <1576784699.03.0.850711294275.issue39101@roundup.psfhosted.org>
Message-ID: <1603729780.34.0.943347165939.issue39101@roundup.psfhosted.org>


Change by Lisa Roach <lisaroach14 at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39101>
_______________________________________

From report at bugs.python.org  Mon Oct 26 12:32:29 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 26 Oct 2020 16:32:29 +0000
Subject: [issue42155] email.utils.parsedate_to_datetime() should return None
 when date cannot be parsed
In-Reply-To: <1603712511.56.0.0108062453896.issue42155@roundup.psfhosted.org>
Message-ID: <1603729949.57.0.337722409068.issue42155@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:

Hi Serhiy.  I believe this is a duplicate of bpo-30681 which is active and has a good PR IMHO.  The only hold up is whether to backport that PR to 3.9 and 3.8.  See the bug and PR for details.

----------
resolution:  -> duplicate
superseder:  -> email.utils.parsedate_to_datetime() should return None when date cannot be parsed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42155>
_______________________________________

From report at bugs.python.org  Mon Oct 26 12:32:45 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Mon, 26 Oct 2020 16:32:45 +0000
Subject: [issue42151] Pure Python xml.etree.ElementTree is missing default
 attribute values
In-Reply-To: <1603684290.04.0.0149631860455.issue42151@roundup.psfhosted.org>
Message-ID: <1603729965.16.0.391261791093.issue42151@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

The patch looks right. I'm not sure if this can still be changed in Py3.8, though, since that has been around for quite a while now.

Admittedly, few people will disable the C accelerator module and thus whitness this issue, but for them, this is a breaking change, and some code might rely on the current behaviour. I have no way to tell how much, and whether it intentionally relies on it.

I'd definitely change this for 3.9 and later. Maybe for 3.8, but it's at least a bit of a risk, given that there will only be very few more minor releases for it, and given that this is how things have been working for years. So, rather not, unless there is a convincing argument for backporting the change.

----------
components: +XML -Library (Lib)
versions:  -Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42151>
_______________________________________

From report at bugs.python.org  Mon Oct 26 12:32:43 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Mon, 26 Oct 2020 16:32:43 +0000
Subject: [issue42155] email.utils.parsedate_to_datetime() should return None
 when date cannot be parsed
In-Reply-To: <1603712511.56.0.0108062453896.issue42155@roundup.psfhosted.org>
Message-ID: <1603729963.68.0.815528235607.issue42155@roundup.psfhosted.org>


Change by Barry A. Warsaw <barry at python.org>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42155>
_______________________________________

From report at bugs.python.org  Mon Oct 26 12:37:37 2020
From: report at bugs.python.org (hai shi)
Date: Mon, 26 Oct 2020 16:37:37 +0000
Subject: [issue38865] [subinterpreters] Can Py_Finalize() be called if the
 current interpreter is not the main interpreter?
In-Reply-To: <1574264524.01.0.330569638863.issue38865@roundup.psfhosted.org>
Message-ID: <1603730257.21.0.431064734843.issue38865@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38865>
_______________________________________

From report at bugs.python.org  Mon Oct 26 13:05:20 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 17:05:20 +0000
Subject: [issue42157] Cleanup the unicodedata module
Message-ID: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

Mohamed Koubaa and me are trying to convert the unicodedata module to the multi-phase initialization API (PEP 489) and to convert the UCD static type to a heap type in bpo-1635741.

The unicodedata extension module has some special cases:

* It has a C API exposes in Python as the "unicodedata.ucnhash_CAPI" PyCapsule object.
* In C, the unicodedata_functions array is used to define module functions *AND* unicodedata.UCD methods. It is unused to do that and makes the conversion more tricky.
* Most C functions have a "self" parameter which is used to choose between the current version of the Unicode database and the version 3.2.0 ("unicodedata.ucd_3_2_0").

There is also a unicodedata.UCD type which cannot be instanciated in Python. It is only used to create the unicodedata.ucd_3_2_0 instance.

In the commit 47e1afd2a1793b5818a16c41307a4ce976331649, I moved the private _PyUnicode_Name_CAPI structure to internal C API.

In the commit ddc0dd001a4224274ba6f83568b45a1dd88c6fc6, Mohammed added a ucd_type parameter to the UCD_Check() macro. I asked him to do that.

In the commit e6b8c5263a7fcf5b95d0fd4c900e5949eeb6630d, I added a "global module state" and a "state" parameter to most functions. This change prepares the code base to pass a UCD type instance to functions, to be able to have more than once UCD type when it will be converted to a heap type, one type per module instance.

The technical problem is that unicodedata_functions is used for module functions and UCD methods. Duplicating unicodedata_functions requires to duplicate a lot of code and comments.

Sadly, it does not seem easily possible to retrieve the "module state" ("state" variable) in functions since unicodedata_functions is reused for module functioins and UCD methods. Using "defining_class" in Argument Clinic would require to duplicate all unicodedata_functions functions, one flavor for module functions, one flavor for UCD type. It would also require to duplicate all docstrings, which means to increase the maintenance burden and introduce a risk of having inconsistencies.

Maybe we could introduce a new UCD instance which would be mapped to the current Unicode Character Database version, and module functions which be bounded methods of this type. But it sounds overkill to me.

By the way, Unicode 3.2 was released in 2002: 18 years ago. I don't think that it's still relevant in 2020 to keep backward compatibility with Unicode 3.2. I propose to deprecate unicodedata.ucd_3_2_0 and deprecate the unicodedate.UCD type. In Python 3.12, we will be able to remove a lot of code, and simplify the code a lot.

For now, we can convert unicodedata to the multi-phase initilization API (PEP 489) and convert UCD static type to a heap type by avoiding references to the UCD type. Rather than checking if self is an instance of UCD_Type, we can check if it is not a module (PyModule_Check). This is exactly what Mohammed proposed in the first place, but I misunderstood the whole issue and gave him bad advices.

----------
components: Library (Lib)
messages: 379673
nosy: vstinner
priority: normal
severity: normal
status: open
title: Cleanup the unicodedata module
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42157>
_______________________________________

From mal at egenix.com  Mon Oct 26 13:39:01 2020
From: mal at egenix.com (M.-A. Lemburg)
Date: Mon, 26 Oct 2020 18:39:01 +0100
Subject: [issue42157] Cleanup the unicodedata module
In-Reply-To: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>
References: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>
Message-ID: <690392bf-ed6a-9ed5-b737-9867d54ff28d@egenix.com>

On 26.10.2020 18:05, STINNER Victor wrote:
> 
> By the way, Unicode 3.2 was released in 2002: 18 years ago. I don't think that it's still relevant in 2020 to keep backward compatibility with Unicode 3.2. I propose to deprecate unicodedata.ucd_3_2_0 and deprecate the unicodedate.UCD type. In Python 3.12, we will be able to remove a lot of code, and simplify the code a lot.

The version 3.2.0 is needed for IDNA compatibility:

IDNA 2003: https://tools.ietf.org/html/rfc3490
requires Unicode 3.2 mappings

IDNA 2008: https://tools.ietf.org/html/rfc5890 et al.
requires Unicode 5.2+ mappings

Python only supports IDNA 2003 AFAIK and the ucs_3_2_0 tag was added
by Martin von L?wis to support it even after moving forward to more
recent Unicode versions.

IDNA 2008 seems to have mechanisms to also work for Unicode versions
later than 5.2, but I don't know the details. See this TR for details
on how IDNA compatibility is handled:

http://www.unicode.org/reports/tr46/

All that said, it may actually be better to deprecate IDNA 2003 support
first and direct people to:

https://pypi.org/project/idna/

or incorporate this into the stdlib instead of IDNA 2003. The special
tag can then be dropped.

-- 
Marc-Andre Lemburg
eGenix.com

Professional Python Services directly from the Experts (#1, Oct 26 2020)
>>> Python Projects, Coaching and Support ...    https://www.egenix.com/
>>> Python Product Development ...        https://consulting.egenix.com/
________________________________________________________________________

::: We implement business ideas - efficiently in both time and costs :::

   eGenix.com Software, Skills and Services GmbH  Pastor-Loeh-Str.48
    D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg
           Registered at Amtsgericht Duesseldorf: HRB 46611
               https://www.egenix.com/company/contact/
                     https://www.malemburg.com/


From report at bugs.python.org  Mon Oct 26 13:39:07 2020
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Mon, 26 Oct 2020 17:39:07 +0000
Subject: [issue42157] Cleanup the unicodedata module
In-Reply-To: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>
Message-ID: <690392bf-ed6a-9ed5-b737-9867d54ff28d@egenix.com>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

On 26.10.2020 18:05, STINNER Victor wrote:
> 
> By the way, Unicode 3.2 was released in 2002: 18 years ago. I don't think that it's still relevant in 2020 to keep backward compatibility with Unicode 3.2. I propose to deprecate unicodedata.ucd_3_2_0 and deprecate the unicodedate.UCD type. In Python 3.12, we will be able to remove a lot of code, and simplify the code a lot.

The version 3.2.0 is needed for IDNA compatibility:

IDNA 2003: https://tools.ietf.org/html/rfc3490
requires Unicode 3.2 mappings

IDNA 2008: https://tools.ietf.org/html/rfc5890 et al.
requires Unicode 5.2+ mappings

Python only supports IDNA 2003 AFAIK and the ucs_3_2_0 tag was added
by Martin von L?wis to support it even after moving forward to more
recent Unicode versions.

IDNA 2008 seems to have mechanisms to also work for Unicode versions
later than 5.2, but I don't know the details. See this TR for details
on how IDNA compatibility is handled:

http://www.unicode.org/reports/tr46/

All that said, it may actually be better to deprecate IDNA 2003 support
first and direct people to:

https://pypi.org/project/idna/

or incorporate this into the stdlib instead of IDNA 2003. The special
tag can then be dropped.

-- 
Marc-Andre Lemburg
eGenix.com

Professional Python Services directly from the Experts (#1, Oct 26 2020)
>>> Python Projects, Coaching and Support ...    https://www.egenix.com/
>>> Python Product Development ...        https://consulting.egenix.com/
________________________________________________________________________

::: We implement business ideas - efficiently in both time and costs :::

   eGenix.com Software, Skills and Services GmbH  Pastor-Loeh-Str.48
    D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg
           Registered at Amtsgericht Duesseldorf: HRB 46611
               https://www.egenix.com/company/contact/
                     https://www.malemburg.com/

----------
nosy: +lemburg

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42157>
_______________________________________

From report at bugs.python.org  Mon Oct 26 13:45:02 2020
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Mon, 26 Oct 2020 17:45:02 +0000
Subject: [issue39573] [C API] Make PyObject an opaque structure in the limited
 C API
In-Reply-To: <1581030432.16.0.48160379721.issue39573@roundup.psfhosted.org>
Message-ID: <1603734302.32.0.594356267442.issue39573@roundup.psfhosted.org>


Miro Hron?ok <miro at hroncok.cz> added the comment:

This also breaks pycurl:

https://github.com/pycurl/pycurl/pull/660

And breezy:

https://bugzilla.redhat.com/show_bug.cgi?id=1890880 (not yet reported upstream)


I don't understand the rationale for this change in depth, but does the benefit outweigh (yet another) backwards incompatibility?

----------
nosy: +hroncok

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39573>
_______________________________________

From report at bugs.python.org  Mon Oct 26 13:56:56 2020
From: report at bugs.python.org (Dylan Van Assche)
Date: Mon, 26 Oct 2020 17:56:56 +0000
Subject: [issue42158] guess_format() MIME type doesn't guess n-quads, n-triples,
 notation3 and TriG
Message-ID: <1603735016.36.0.247111341461.issue42158@roundup.psfhosted.org>


New submission from Dylan Van Assche <me at dylanvanassche.be>:

guess_format() from lib/mimetypes.py doesn't guess correctly the following MIME types:

- .nq: application/n-quads (specification: https://www.w3.org/TR/n-quads/)
- .nt: application/n-triples (specification: https://www.w3.org/TR/n-triples/)
- .n3: text/n3 (specification: https://www.w3.org/TeamSubmission/n3/)
- .trig: application/trig (specification: https://www.w3.org/TR/trig/)

In these cases the default MIME type is returned: application/octet-stream

----------
components: Library (Lib)
messages: 379676
nosy: DylanVanAssche
priority: normal
severity: normal
status: open
title: guess_format() MIME type doesn't guess n-quads, n-triples, notation3 and TriG
type: enhancement
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42158>
_______________________________________

From report at bugs.python.org  Mon Oct 26 13:57:16 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 17:57:16 +0000
Subject: [issue42157] Cleanup the unicodedata module
In-Reply-To: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>
Message-ID: <1603735036.92.0.815715489838.issue42157@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +21905
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22990

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42157>
_______________________________________

From report at bugs.python.org  Mon Oct 26 14:02:39 2020
From: report at bugs.python.org (Dylan Van Assche)
Date: Mon, 26 Oct 2020 18:02:39 +0000
Subject: [issue42158] http.server MIME type doesn't guess n-quads, n-triples, 
 notation3 and TriG MIME types
In-Reply-To: <1603735016.36.0.247111341461.issue42158@roundup.psfhosted.org>
Message-ID: <1603735359.03.0.325764178203.issue42158@roundup.psfhosted.org>


Change by Dylan Van Assche <me at dylanvanassche.be>:


----------
title: guess_format() MIME type doesn't guess n-quads, n-triples, notation3 and TriG -> http.server MIME type doesn't guess n-quads, n-triples, notation3 and TriG MIME types

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42158>
_______________________________________

From report at bugs.python.org  Mon Oct 26 14:03:00 2020
From: report at bugs.python.org (Dylan Van Assche)
Date: Mon, 26 Oct 2020 18:03:00 +0000
Subject: [issue42158] http.server doesn't guess n-quads, n-triples,
 notation3 and TriG MIME types
In-Reply-To: <1603735016.36.0.247111341461.issue42158@roundup.psfhosted.org>
Message-ID: <1603735380.79.0.338512912859.issue42158@roundup.psfhosted.org>


Change by Dylan Van Assche <me at dylanvanassche.be>:


----------
title: http.server MIME type doesn't guess n-quads, n-triples, notation3 and TriG MIME types -> http.server doesn't guess n-quads, n-triples, notation3 and TriG MIME types

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42158>
_______________________________________

From report at bugs.python.org  Mon Oct 26 14:11:11 2020
From: report at bugs.python.org (Dylan Van Assche)
Date: Mon, 26 Oct 2020 18:11:11 +0000
Subject: [issue42158] http.server doesn't guess n-quads, n-triples,
 notation3 and TriG MIME types
In-Reply-To: <1603735016.36.0.247111341461.issue42158@roundup.psfhosted.org>
Message-ID: <1603735871.34.0.914959363805.issue42158@roundup.psfhosted.org>


Dylan Van Assche <me at dylanvanassche.be> added the comment:

Adding the MIME types to /etc/mime.types fixes this issue, but I'm not sure if that's the right 'fix'

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42158>
_______________________________________

From report at bugs.python.org  Mon Oct 26 14:19:48 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 18:19:48 +0000
Subject: [issue42157] Cleanup the unicodedata module
In-Reply-To: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>
Message-ID: <1603736388.98.0.853903752667.issue42157@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 920cb647ba23feab7987d0dac1bd63bfc2ffc4c0 by Victor Stinner in branch 'master':
bpo-42157: unicodedata avoids references to UCD_Type (GH-22990)
https://github.com/python/cpython/commit/920cb647ba23feab7987d0dac1bd63bfc2ffc4c0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42157>
_______________________________________

From report at bugs.python.org  Mon Oct 26 14:21:34 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 18:21:34 +0000
Subject: [issue42157] Cleanup the unicodedata module
In-Reply-To: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>
Message-ID: <1603736494.51.0.514615013373.issue42157@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21906
pull_request: https://github.com/python/cpython/pull/22991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42157>
_______________________________________

From report at bugs.python.org  Mon Oct 26 14:27:40 2020
From: report at bugs.python.org (Neil Schemenauer)
Date: Mon, 26 Oct 2020 18:27:40 +0000
Subject: [issue39573] [C API] Make PyObject an opaque structure in the limited
 C API
In-Reply-To: <1581030432.16.0.48160379721.issue39573@roundup.psfhosted.org>
Message-ID: <1603736860.06.0.247363033077.issue39573@roundup.psfhosted.org>


Neil Schemenauer <nas-python at arctrix.com> added the comment:

> I don't understand the rationale for this change in depth, but
> does the benefit outweigh (yet another) backwards incompatibility?

I think you can have it both ways.  Do you want a C API that is
stable over a long period of CPython releases or do you want to
continue to be able to look deep (i.e. non opaque PyObject*) into
CPython implementation internals?

During the sprint last week, we talked about how to provide a
compatible API, similar to what Pypy cpyext does.  It would be
possible to provide a (nearly) fully compatible API with the
approach.  It could get quite painful for CPython to maintain such a
thing however.  E.g. cpyext has proxy objects (to maintain CPython
compatible structure layouts) but keeping those proxies in sync with
the internal VM object structures is expensive and tricky.

Certainly making PyObject opaque is going to break some 3rd party
code.  Making it opaque for the non-limited API is not an option
IMHO because it breaks too much 3rd party code.   Is making it
opaque for the limited C API going to break too much code?  Maybe, I
don't know.  Thanks for pointing out pycurl and breezy.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39573>
_______________________________________

From report at bugs.python.org  Mon Oct 26 14:28:26 2020
From: report at bugs.python.org (Neil Schemenauer)
Date: Mon, 26 Oct 2020 18:28:26 +0000
Subject: [issue39573] [C API] Make PyObject an opaque structure in the limited
 C API
In-Reply-To: <1581030432.16.0.48160379721.issue39573@roundup.psfhosted.org>
Message-ID: <1603736906.78.0.394520564072.issue39573@roundup.psfhosted.org>


Neil Schemenauer <nas-python at arctrix.com> added the comment:

Correction: I think you *cannot* have it both ways.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39573>
_______________________________________

From report at bugs.python.org  Mon Oct 26 14:58:45 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 26 Oct 2020 18:58:45 +0000
Subject: [issue42156] Currency not correct for all locales
In-Reply-To: <1603719185.4.0.390571957235.issue42156@roundup.psfhosted.org>
Message-ID: <1603738725.22.0.24586376652.issue42156@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

And just to show that python is doing the right thing, if the locale is set up correctly, I'll show the following hack:

>>> import locale
>>> locale.setlocale(locale.LC_ALL, 'en_US')
'en_US'
>>> locale.currency(24.99)
'$24.99'
>>> locale._override_localeconv["p_cs_precedes"] = 0
>>> locale.currency(24.99)
'24.99$'

Notice the change from '$24.99' to '24.99$' when I change p_cs_precedes to 0.

WARNING: you really, really shouldn't use _override_localeconv. It looks like it exists just for testing, but I'm using it here to show that currency formatting does respect p_cs_precedes.

On the other hand, I've often wanted to build up a locale programmatically and then use it, so maybe we should support that use case.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42156>
_______________________________________

From report at bugs.python.org  Mon Oct 26 15:11:27 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 19:11:27 +0000
Subject: [issue41486] Add _BlocksOutputBuffer for bz2/lzma/zlib module
In-Reply-To: <1596621344.28.0.22443935276.issue41486@roundup.psfhosted.org>
Message-ID: <1603739487.76.0.769003529573.issue41486@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Ma Lin proposed this approach (PR 21740) for _PyBytesWriter/_PyUnicodeWriter on python-dev:
https://mail.python.org/archives/list/python-dev at python.org/message/UMB52BEZCX424K5K2ZNPWV7ZTQAGYL53/

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41486>
_______________________________________

From report at bugs.python.org  Mon Oct 26 15:13:07 2020
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 26 Oct 2020 19:13:07 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1603739587.48.0.326844969839.issue41490@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
nosy:  -brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Mon Oct 26 15:45:11 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 19:45:11 +0000
Subject: [issue41486] Add _BlocksOutputBuffer for bz2/lzma/zlib module
In-Reply-To: <1596621344.28.0.22443935276.issue41486@roundup.psfhosted.org>
Message-ID: <1603741511.47.0.484424324829.issue41486@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

It would be interested to see if using _PyBytesWriter in bz2, lzma, zlib and _io.FileIO.readall() would speed up the code. I would prefer to centralize the buffer allocation logic in _PyBytesWriter rather than having custom code in each file. _PyBytesWriter is designed to reduce the number of realloc() by using overallocation, it uses a different overallocation ratio on Windows, and it uses a small buffer allocated on the stack for strings up to 512 bytes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41486>
_______________________________________

From report at bugs.python.org  Mon Oct 26 16:05:33 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 26 Oct 2020 20:05:33 +0000
Subject: [issue21510] fma documentation should provide better example.
In-Reply-To: <1400131145.93.0.338142878224.issue21510@psf.upfronthosting.co.za>
Message-ID: <1603742733.29.0.799242439893.issue21510@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I suggest using the text and example from the spec:
http://speleotrove.com/decimal/daops.html#reffma

=====================================================

fused-multiply-add takes three operands; the first two are multiplied together, using multiply, with sufficient precision and exponent range that the result is exact and unrounded.[4]  No flags are set by the multiplication unless one of the first two operands is a signaling NaN or one is a zero and the other is an infinity.
Unless the multiplication failed, the third operand is then added to the result of that multiplication, using add, under the current context.

In other words, fused-multiply-add(x, y, z) delivers a result which is (x ? y) + z with only the one, final, rounding.

Examples:

  fused-multiply-add(?3?, ?5?, ?7?)               ==>  ?22?
  fused-multiply-add(?3?, ?-5?, ?7?)              ==>  ?-8?
  fused-multiply-add(?888565290?, ?1557.96930?,
                                  ?-86087.7578?)  ==>  ?1.38435736E+12?
Note that the last example would have given the result ?1.38435735E+12? if the operation had been carried out as a separate multiply followed by an add.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21510>
_______________________________________

From report at bugs.python.org  Mon Oct 26 16:28:26 2020
From: report at bugs.python.org (Diogo Dutra)
Date: Mon, 26 Oct 2020 20:28:26 +0000
Subject: [issue42140] asyncio.wait function creates futures set two times
In-Reply-To: <1603663068.93.0.570983446226.issue42140@roundup.psfhosted.org>
Message-ID: <CAMJwLaH-36aco-V3i-H8m77A9nZNZambUPPzRa_kLaomRwVopg@mail.gmail.com>


Diogo Dutra <diogodutradamata at gmail.com> added the comment:

> Are you suggesting this is a bug, or is it just a suggested code cleanup?

It is a suggested code cleanup.

My point is that the code creates two sets based on the Sequence `fs`.
I think it is better if the code creates the set just one time, instead of
two times.

Em dom., 25 de out. de 2020 ?s 18:57, Chris Jerdonek <report at bugs.python.org>
escreveu:

>
> Chris Jerdonek <chris.jerdonek at gmail.com> added the comment:
>
> Are you suggesting this is a bug, or is it just a suggested code cleanup?
> I ask because the docs suggest that a set should be passed:
> https://docs.python.org/3/library/asyncio-task.html#asyncio.wait
>
> And the docstring says it should be a sequence:
>
> https://github.com/python/cpython/blob/d1a0a960ee493262fb95a0f5b795b5b6d75cecb8/Lib/asyncio/tasks.py#L373-L376
>
> So while code cleanup is okay, I'm not sure support for general iterator
> arguments can / should be guaranteed.
>
> ----------
> nosy: +chris.jerdonek
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue42140>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42140>
_______________________________________

From report at bugs.python.org  Mon Oct 26 16:47:24 2020
From: report at bugs.python.org (E. Paine)
Date: Mon, 26 Oct 2020 20:47:24 +0000
Subject: [issue42142] FAIL tkinter ttk LabeledScale test_resize, and more
In-Reply-To: <1603582160.73.0.386671878138.issue42142@roundup.psfhosted.org>
Message-ID: <1603745244.19.0.620542345309.issue42142@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

This is strange as these only seem to have started occurring recently (though there hasn't been a change to the tests themselves in a long time). There must be something different about how Azure runs the GUI tests because it was on Azure that the tests on PR-22682 failed (noting that it was only on Azure they failed and all the Azure bots failed - suspicious). Is there someone we can nosy who would know better how Azure works (and hence why the possible difference)?

I am looking into both Azure and the tests themselves but am not really sure how to check if they pass without a messy commit history.

----------
nosy: +epaine

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42142>
_______________________________________

From report at bugs.python.org  Mon Oct 26 17:05:24 2020
From: report at bugs.python.org (Lisa Roach)
Date: Mon, 26 Oct 2020 21:05:24 +0000
Subject: [issue42159] AsyncMock restores stopped patch if same object stopped
 multiple times
Message-ID: <1603746324.52.0.94475530038.issue42159@roundup.psfhosted.org>


New submission from Lisa Roach <lisaroach14 at gmail.com>:

Hard to explain in the title, easier to see via a test case:

     async def async_func():
         raise Exception

    def test_simultaneous_mocks(self):
        class Test(IsolatedAsyncioTestCase):
            async def test_test(self):
                patcher1 = patch(f"{__name__}.async_func")
                patcher2 = patch(f"{__name__}.async_func")
                patcher1.start()
                await async_func()
                patcher2.start()
                await async_func()
                patcher1.stop()
                with self.assertRaises(Exception):
                    await async_func()
                patcher2.stop()
                with self.assertRaises(Exception): # Fails, mock is restored!
                    await async_func()

        test = Test("test_test")
        output = test.run()
        self.assertTrue(output.wasSuccessful()) # Fail


Calling stop() on the second patch actually restores the mock and causes the test to fail.

----------
assignee: lisroach
messages: 379687
nosy: lisroach
priority: normal
severity: normal
status: open
title: AsyncMock restores stopped patch if same object stopped multiple times
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42159>
_______________________________________

From report at bugs.python.org  Mon Oct 26 17:07:04 2020
From: report at bugs.python.org (Eric Wolf)
Date: Mon, 26 Oct 2020 21:07:04 +0000
Subject: [issue42160] unnecessary overhead in tempfile
Message-ID: <1603746424.31.0.446714198691.issue42160@roundup.psfhosted.org>


Change by Eric Wolf <robo-eric at gmx.de>:


----------
components: Library (Lib)
nosy: Deric-W
priority: normal
severity: normal
status: open
title: unnecessary overhead in tempfile
type: enhancement
versions: Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Mon Oct 26 17:19:24 2020
From: report at bugs.python.org (Eric Wolf)
Date: Mon, 26 Oct 2020 21:19:24 +0000
Subject: [issue42160] unnecessary overhead in tempfile
Message-ID: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>


New submission from Eric Wolf <robo-eric at gmx.de>:

The tempfile module contains the class _RandomNameSequence, which has the rng property.
This property checks os.getpid() every time and re-initializes a random number generator when it has changed.
However, this is only necessary on systems which allow the process to be cloned and should be solved on such systems with os.register_at_fork (see the random module).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Mon Oct 26 17:30:35 2020
From: report at bugs.python.org (Justin Arthur)
Date: Mon, 26 Oct 2020 21:30:35 +0000
Subject: [issue42140] asyncio.wait function creates futures set two times
In-Reply-To: <1603522282.48.0.50359686965.issue42140@roundup.psfhosted.org>
Message-ID: <1603747835.88.0.554893229124.issue42140@roundup.psfhosted.org>


Justin Arthur <justinarthur at gmail.com> added the comment:

Your change makes perfect sense to me. It would be a backport-only change as the 2nd set creation is actually getting removed for the development version (3.10) to finalize the deprecation of wait's coroutine scheduling.

----------
nosy: +JustinTArthur

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42140>
_______________________________________

From report at bugs.python.org  Mon Oct 26 17:47:58 2020
From: report at bugs.python.org (Pascal Chambon)
Date: Mon, 26 Oct 2020 21:47:58 +0000
Subject: [issue5906] Risk of confusion in multiprocessing module - daemonic
 processes
In-Reply-To: <1241281680.28.0.426890622653.issue5906@psf.upfronthosting.co.za>
Message-ID: <1603748878.51.0.923156668971.issue5906@roundup.psfhosted.org>


Pascal Chambon <chambon.pascal at gmail.com> added the comment:

The latest doc has a quick mention about the fact that daemon is not used in the Unix sens, so it seems fine now  B-)

https://docs.python.org/3/library/multiprocessing.html?#multiprocessing.Process.daemon

"""Additionally, these are not Unix daemons or services, they are normal processes that will be terminated (and not joined) if non-daemonic processes have exited."""

My paragraph was just my one attempt at distinguishing concepts, it was never part of the official docs

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5906>
_______________________________________

From report at bugs.python.org  Mon Oct 26 17:59:37 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 21:59:37 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
Message-ID: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

In bpo-38858, I made the small integer singletons per interpreter: commit 630c8df5cf126594f8c1c4579c1888ca80a29d59. _PyLong_Zero and _PyLong_One variables are still shared by all interpreters, whereas subinterpreters must not share Python objects: see bpo-40533.

I propose to add new _PyLong_GetZero() and _PyLong_GetOne() functions to replace _PyLong_Zero and _PyLong_One variables. These functions will retrieve the singletons from tstate->interp->small_ints.

----------
components: Interpreter Core
messages: 379691
nosy: vstinner
priority: normal
severity: normal
status: open
title: Remove private _PyLong_Zero and _PyLong_One variables
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:14:23 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 22:14:23 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603750463.41.0.456353295832.issue42161@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +21907
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22993

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:17:00 2020
From: report at bugs.python.org (MaT1g3R)
Date: Mon, 26 Oct 2020 22:17:00 +0000
Subject: [issue42162] The license page for Python 3.0 is messed up
Message-ID: <1603750620.18.0.975456176895.issue42162@roundup.psfhosted.org>


New submission from MaT1g3R <peijun.ma at protonmail.com>:

Page in question: https://docs.python.org/3.0/license.html

The page still shows up in web searches (this is how I found the error)

I tracked down the error to this commit, but I couldn't find a relevant branch to fix it: 4ca04b67f00edabe86072446f059adcb70eafcdd

----------
assignee: docs at python
components: Documentation
messages: 379692
nosy: MaT1g3R, docs at python
priority: normal
severity: normal
status: open
title: The license page for Python 3.0 is messed up
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42162>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:19:31 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 22:19:31 +0000
Subject: [issue42157] Cleanup the unicodedata module
In-Reply-To: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>
Message-ID: <1603750771.48.0.425811430285.issue42157@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset c8c4200b65b2159bbb13cee10d67dfb3676fef26 by Victor Stinner in branch 'master':
bpo-42157: Convert unicodedata.UCD to heap type (GH-22991)
https://github.com/python/cpython/commit/c8c4200b65b2159bbb13cee10d67dfb3676fef26


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42157>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:21:52 2020
From: report at bugs.python.org (Chandan Singh)
Date: Mon, 26 Oct 2020 22:21:52 +0000
Subject: [issue42163] _replace() no longer works on platform.uname_result
 objects
Message-ID: <1603750912.81.0.950571190169.issue42163@roundup.psfhosted.org>


New submission from Chandan Singh <chandan at chandansingh.net>:

Starting from Python 3.9, it seems like the `_replace()` method no longer  works on `platform.uname_result` objects, that are returned by
`platform.uname()`. A simple example can be seen below, which works on Python 3.8, but not on Python 3.9.

```
>>> import platform
>>> result = platform.uname()
>>> result._replace(machine="x86_64")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.9/collections/__init__.py", line 448, in _replace
    result = self._make(_map(kwds.pop, field_names, self))
  File "/usr/local/lib/python3.9/collections/__init__.py", line 441, in _make
    raise TypeError(f'Expected {num_fields} arguments, got {len(result)}')
TypeError: Expected 5 arguments, got 6
```

I'm not sure if this is an intended change or an uninteded side-effect. The `_replace` method does work on simple namedtuple objects, and `uname_result` claims to be:

> largely compatible with a simple namedtumple` object except that 'platform' is resolved late and cached to avoid calling "uname" except when needed`

This late resolution is what's new in Python 3.9 and also the source of the issue  as far as I can tell. I suppose the answer may depend on how braod our definition of  "largely compatible" is.

For some context, we use `_replace` in the tests of our BuildStream project, which is why we ran into this. The fix is reasonably simple on our end by changing how we mock some bits. But I wanted to check here if it's considered a bug or not. For reference, this is the patch we neded on our end: https://gitlab.com/BuildStream/buildstream/-/merge_requests/2092.

----------
components: Library (Lib)
messages: 379694
nosy: cs-shadow
priority: normal
severity: normal
status: open
title: _replace() no longer works on platform.uname_result objects
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42163>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:29:17 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 26 Oct 2020 22:29:17 +0000
Subject: [issue42142] FAIL tkinter ttk LabeledScale test_resize, and more
In-Reply-To: <1603582160.73.0.386671878138.issue42142@roundup.psfhosted.org>
Message-ID: <1603751357.98.0.790111359559.issue42142@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Steve, we have a new Pipelines-specific intermittent tkinter test failure.  Are you familiar with Pipelines, or do you know who is?

----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42142>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:30:53 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 22:30:53 +0000
Subject: [issue42157] Cleanup the unicodedata module
In-Reply-To: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>
Message-ID: <1603751453.92.0.921930473885.issue42157@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21908
pull_request: https://github.com/python/cpython/pull/22994

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42157>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:34:48 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 26 Oct 2020 22:34:48 +0000
Subject: [issue42164] Python fails to compile in the Fedora Stable LTO
 buildbots
Message-ID: <1603751687.99.0.243163164232.issue42164@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

I have been trying to diagnose this failure:

https://buildbot.python.org/all/#/builders/271/builds/710/steps/3/logs/stdio

it happens on these buildbots:

x86_64 fedora stable
ppc64le fedora stable (so 32 now)

It seems that CPython cannot be compiled with --with-lto regardless of the version:

https://buildbot.python.org/all/#/builders/336/builds/2145
https://buildbot.python.org/all/#/builders/426/builds/641
https://buildbot.python.org/all/#/builders/294/builds/986

This seems to indicate that something has changed in these buildbots somehow. Maybe the gcc installation is broken?

In my investigation, it seems that Python/compile.o is miscompiled.For example

FEDORA BUILDBOT with LTO:

[buildbot at python-builder2-rawhide cpython]$ nm Python/compile.o  | grep _Py_Mangle
In function ?assemble_lnotab?,
    inlined from ?assemble_emit? at Python/compile.c:5696:25,
    inlined from ?assemble? at Python/compile.c:6038:18:
Python/compile.c:5650:19: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=]
 5650 |         *lnotab++ = k;
      |                   ^
         U _Py_Mangle


MY ARCH LINUX SYSTEM:

? nm Python/compile.o  | grep _Py_Mangle
00000000 T _Py_Mangle

It seems that the _Py_Mangle is not included in the object file. Is this a gcc bug? I have not been able to diagnose exactly where does this problem. It seems that the gcc version is "10.2.1" but I can correctly build CPython with LTO in my arch Linux machine with gcc 10.2.0.

Given that these are stable buildbots, could you investigate what is going on or report this to the gcc folks ar RedHat/Fedora? 

----

More interesting data:

Compiling with -O0 does not have a problem, but doing it with -O3 does.

With -O0:

[buildbot at python-builder2-rawhide cpython]$ nm Python/compile.o  | grep _Py_Mangle
00000000 T _Py_Mangle

With -O3:

[buildbot at python-builder2-rawhide cpython]$ nm Python/compile.o  | grep _Py_Mangle
         U _Py_Mangle

----------
components: Build
messages: 379696
nosy: cstratak, hroncok, pablogsal, petr.viktorin, vstinner
priority: normal
severity: normal
stage: needs patch
status: open
title: Python fails to compile in the Fedora Stable LTO buildbots
type: compile error
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42164>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:41:15 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 26 Oct 2020 22:41:15 +0000
Subject: [issue42123] Run parser twice;
 enable invalid_* rules only on the second run
In-Reply-To: <1603409743.28.0.787265357056.issue42123@roundup.psfhosted.org>
Message-ID: <1603752075.12.0.383021373508.issue42123@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

We do not have a big corpus of SyntaxErrors to test against, but some manual testing of running a file with a SyntaxError after a long complex line 1000 times shows no slowdown.

We keep the token stream for the second run, so we don't need to run the tokenizer all over again and the parsing is done much more quickly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42123>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:42:10 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 26 Oct 2020 22:42:10 +0000
Subject: [issue42123] Run parser twice;
 enable invalid_* rules only on the second run
In-Reply-To: <1603409743.28.0.787265357056.issue42123@roundup.psfhosted.org>
Message-ID: <1603752130.7.0.919569438476.issue42123@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:


New changeset bca701403253379409dece03053dbd739c0bd059 by Lysandros Nikolaou in branch 'master':
bpo-42123: Run the parser two times and only enable invalid rules on the second run (GH-22111)
https://github.com/python/cpython/commit/bca701403253379409dece03053dbd739c0bd059


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42123>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:42:38 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 26 Oct 2020 22:42:38 +0000
Subject: [issue42123] Run parser twice;
 enable invalid_* rules only on the second run
In-Reply-To: <1603409743.28.0.787265357056.issue42123@roundup.psfhosted.org>
Message-ID: <1603752158.49.0.635525741199.issue42123@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42123>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:45:41 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 26 Oct 2020 22:45:41 +0000
Subject: [issue5906] Risk of confusion in multiprocessing module - daemonic
 processes
In-Reply-To: <1241281680.28.0.426890622653.issue5906@psf.upfronthosting.co.za>
Message-ID: <1603752341.02.0.714615825623.issue5906@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5906>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:46:06 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 26 Oct 2020 22:46:06 +0000
Subject: [issue41659] PEG discrepancy on 'if {x} {a}: pass'
In-Reply-To: <1598650995.75.0.684602655166.issue41659@roundup.psfhosted.org>
Message-ID: <1603752366.46.0.978130477319.issue41659@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
pull_requests:  -21195

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41659>
_______________________________________

From report at bugs.python.org  Mon Oct 26 18:51:06 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 22:51:06 +0000
Subject: [issue42157] Cleanup the unicodedata module
In-Reply-To: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>
Message-ID: <1603752666.9.0.284160833062.issue42157@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> By the way, Unicode 3.2 was released in 2002: 18 years ago. I don't think that it's still relevant in 2020 to keep backward compatibility with Unicode 3.2. I propose to deprecate unicodedata.ucd_3_2_0 and deprecate the unicodedate.UCD type. In Python 3.12, we will be able to remove a lot of code, and simplify the code a lot.

Oh, it is used by the IDNA encoding (encodings.idna module) and the stringprep module (which is used by the encodings.idna module.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42157>
_______________________________________

From report at bugs.python.org  Mon Oct 26 19:00:10 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 23:00:10 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603753210.37.0.728351213061.issue42161@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 8e3b9f92835654943bb59d9658bb52e1b0f40a22 by Victor Stinner in branch 'master':
bpo-42161: Add _PyLong_GetZero() and _PyLong_GetOne() (GH-22993)
https://github.com/python/cpython/commit/8e3b9f92835654943bb59d9658bb52e1b0f40a22


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Mon Oct 26 19:33:25 2020
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 26 Oct 2020 23:33:25 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603755205.34.0.608875770427.issue42161@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21909
pull_request: https://github.com/python/cpython/pull/22995

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Mon Oct 26 19:35:29 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 26 Oct 2020 23:35:29 +0000
Subject: [issue41659] PEG discrepancy on 'if {x} {a}: pass'
In-Reply-To: <1598650995.75.0.684602655166.issue41659@roundup.psfhosted.org>
Message-ID: <1603755329.44.0.496330821651.issue41659@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
pull_requests: +21910
pull_request: https://github.com/python/cpython/pull/22996

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41659>
_______________________________________

From report at bugs.python.org  Mon Oct 26 19:39:34 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Mon, 26 Oct 2020 23:39:34 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603755574.83.0.137956343391.issue42161@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Mon Oct 26 20:02:37 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 00:02:37 +0000
Subject: [issue42164] Python fails to compile in the Fedora Stable LTO
 buildbots
In-Reply-To: <1603751687.99.0.243163164232.issue42164@roundup.psfhosted.org>
Message-ID: <1603756957.03.0.380908980556.issue42164@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> I have been trying to diagnose this failure:
> https://buildbot.python.org/all/#/builders/271/builds/710/steps/3/logs/stdio

This is the "AMD64 Fedora Stable LTO 3.x" worker. The latest successful build was build 684, finished 6 days ago. test.pythoninfo of build 684:

CC.version: gcc (GCC) 10.2.1 20200723 (Red Hat 10.2.1-1)
platform.libc_ver: glibc 2.31
platform.platform: Linux-5.8.14-200.fc32.x86_64-x86_64-with-glibc2.31
sys.version: 3.10.0a1+ (heads/master:c0f22fb8b3, Oct 21 2020, 00:02:36)  [GCC 10.2.1 20200723 (Red Hat 10.2.1-1)]
sysconfig[CCSHARED]: -fPIC
sysconfig[CC]: gcc -pthread
sysconfig[CFLAGS]: -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall
sysconfig[OPT]: -DNDEBUG -g -fwrapv -O3 -Wall
sysconfig[PY_CFLAGS]: -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall
sysconfig[PY_CFLAGS_NODIST]: -flto -fuse-linker-plugin -ffat-lto-objects -flto-partition=none -g -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Werror=implicit-function-declaration -fvisibility=hidden -I./Include/internal
sysconfig[PY_CORE_LDFLAGS]: -flto -fuse-linker-plugin -ffat-lto-objects -flto-partition=none -g
sysconfig[PY_LDFLAGS_NODIST]: -flto -fuse-linker-plugin -ffat-lto-objects -flto-partition=none -g
sysconfig[PY_STDMODULE_CFLAGS]: -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -flto -fuse-linker-plugin -ffat-lto-objects -flto-partition=none -g -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Werror=implicit-function-declaration -fvisibility=hidden -I./Include/internal -I. -I./Include


It started to fail at October 21 (build 685). At 2020-10-21, GCC package was upgraded from version 10.2.1-1 to 10.2.1-5 to gcc-10.2.1-5 according to /var/log/dnf.log:

2020-10-21T06:58:01-0400 SUBDEBUG drpm: spawned 2243855: /usr/bin/applydeltarpm -a x86_64 /var/cache/dnf/updates-b3cb4614b6495970/packages/gcc-10.2.1-1.fc32_10.2.1-5.fc32.x86_64.drpm /var/cache/dnf/updates-b3cb4614b6495970/packages/gcc-10.2.1-5.fc32.x86_64.rpm

Package changelog between 10.2.1-1 and 10.2.1-5:
---
* Mon Oct 05 2020 Jakub Jelinek <jakub at redhat.com> 10.2.1-5
- update from releases/gcc-10 branch
  - PRs bootstrap/97163, bootstrap/97183, c++/96994, c++/97145, c++/97195,
	fortran/93423, fortran/95614, fortran/96041, gcov-profile/64636,
	gcov-profile/96913, gcov-profile/97069, gcov-profile/97193,
	libstdc++/94160, libstdc++/94681, libstdc++/96803, libstdc++/97101,
	libstdc++/97167, middle-end/95464, middle-end/97054, middle-end/97073,
	preprocessor/96935, target/71233, target/96683, target/96795,
	target/96827, target/97166, target/97184, target/97231, target/97247,
	tree-optimization/96979, tree-optimization/97053

* Wed Sep 16 2020 Jakub Jelinek <jakub at redhat.com> 10.2.1-4
- update from releases/gcc-10 branch
  - PRs bootstrap/96203, c++/95164, c++/96862, c++/96901, d/96157, d/96924,
	debug/93865, debug/94235, debug/96729, fortran/94690, fortran/95109,
	fortran/95398, fortran/95882, fortran/96859, libstdc++/71960,
	libstdc++/92978, libstdc++/96766, libstdc++/96851, lto/94311,
	middle-end/87256, middle-end/96369, target/85830, target/94538,
	target/96357, target/96551, target/96574, target/96744, target/96808,
	target/97028, tree-optimization/88240, tree-optimization/96349,
	tree-optimization/96370, tree-optimization/96514,
	tree-optimization/96522, tree-optimization/96579,
	tree-optimization/96597, tree-optimization/96820,
	tree-optimization/96854, tree-optimization/97043
- fix up ARM target attribute/pragma handling (#1875814, PR target/96939)
- don't ICE on sp clobbers with -mincoming-stack-boundary=2 on ia32
  (#1862029, PR target/97032)

* Wed Aug 26 2020 Jakub Jelinek <jakub at redhat.com> 10.2.1-3
- update from releases/gcc-10 branch
  - PRs c++/95428, c++/96082, c++/96106, c++/96164, c++/96199, c++/96497,
	c/96545, c/96549, c/96571, d/96250, d/96254, d/96301, debug/96354,
	fortran/93553, fortran/96312, fortran/96486, ipa/95320, ipa/96291,
	ipa/96482, libstdc++/89760, libstdc++/95749, libstdc++/96303,
	libstdc++/96484, libstdc++/96718, lto/95362, lto/95548,
	middle-end/96426, middle-end/96459, target/93897, target/95450,
	target/96191, target/96243, target/96446, target/96493, target/96506,
	target/96525, target/96530, target/96536, target/96562, target/96682,
	tree-optimization/96483, tree-optimization/96535,
	tree-optimization/96722, tree-optimization/96730,
	tree-optimization/96758
- mangle some further symbols needed for debug info during early dwarf
  (#1862029, PR debug/96690)
- during %check perform tests whether annobin is usable with the newly built
  compiler or whether it might need to be rebuilt
- disable graphite for ELN

* Tue Aug 04 2020 Jakub Jelinek <jakub at redhat.com> 10.2.1-2
- update from releases/gcc-10 branch
  - PRs c++/95591, c++/95599, c++/95823, c++/95824, c++/95895, c/96377,
	d/96140, fortran/89574, fortran/93567, fortran/93592, fortran/95585,
	fortran/95612, fortran/95980, fortran/96018, fortran/96086,
	fortran/96220, fortran/96319, lto/45375, middle-end/96335,
	target/95435, target/96190, target/96236, target/96260, target/96402,
	tree-optimization/96058
- emit debug info for C/C++ external function declarations used in the TU
  (PR debug/96383)
- discard SHN_UNDEF global symbols from LTO debuginfo (PR lto/96385)
- strip also -flto=auto from optflags
---

Copied from: https://koji.fedoraproject.org/koji/buildinfo?buildID=1626341


Currently, the buildbot worker uses gcc-10.2.1-6.fc32.x86_64.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42164>
_______________________________________

From report at bugs.python.org  Mon Oct 26 20:15:35 2020
From: report at bugs.python.org (Steve Dower)
Date: Tue, 27 Oct 2020 00:15:35 +0000
Subject: [issue42142] FAIL tkinter ttk LabeledScale test_resize, and more
In-Reply-To: <1603582160.73.0.386671878138.issue42142@roundup.psfhosted.org>
Message-ID: <1603757735.84.0.888145282498.issue42142@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I'm as familiar as anyone else that I'll be able to find, but I've really got no way to explain why the window isn't becoming visible.

Is it possible that it's trying to default to the process's nShowCmd value instead of a constant "normal" window size? That would seem most likely - nearly every issue we've had along these lines in the past have been some form of inherited process-wide setting.

The other possibility is if the screen size is so small that the window is being put outside of the bounds, and then the visibility test being used is one that checks whether its bounds are within the current monitor. That may also get a false negative in some non-interactive cases.

(I'm assuming, based on two examples, that they're all timing out at the "wait_visibility" call.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42142>
_______________________________________

From report at bugs.python.org  Mon Oct 26 20:16:04 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 00:16:04 +0000
Subject: [issue42164] Python fails to compile in the Fedora Stable LTO
 buildbots
In-Reply-To: <1603751687.99.0.243163164232.issue42164@roundup.psfhosted.org>
Message-ID: <1603757764.28.0.506895660826.issue42164@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I reproduced the bug on Fedora 32 with gcc-10.2.1-6.fc32.x86_64 (new) but I failed to reproduce with gcc-10.2.1-1.fc32.x86_64 (old, before I upgraded GCC). So it's a regression of gcc-10.2.1-6.fc32.x86_64 package.

The package contains multiple downstream patches:

   https://src.fedoraproject.org/rpms/gcc/tree/f32

Commands used to reproduce the issue:

   export MAKEFLAGS=-j10
   ./configure --with-lto 
   make

Extract of my Makefile:

OPT=		-DNDEBUG -g -fwrapv -O3 -Wall
BASECFLAGS=	 -Wno-unused-result -Wsign-compare
CONFIGURE_CFLAGS_NODIST= -flto -fuse-linker-plugin -ffat-lto-objects -flto-partition=none -g -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Werror=implicit-function-declaration -fvisibility=hidden
CONFIGURE_LDFLAGS_NODIST= -flto -fuse-linker-plugin -ffat-lto-objects -flto-partition=none -g

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42164>
_______________________________________

From report at bugs.python.org  Mon Oct 26 20:27:04 2020
From: report at bugs.python.org (Eric Wolf)
Date: Tue, 27 Oct 2020 00:27:04 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1603758424.61.0.834956846801.issue42160@roundup.psfhosted.org>


Change by Eric Wolf <robo-eric at gmx.de>:


----------
keywords: +patch
pull_requests: +21911
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22997

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Mon Oct 26 20:28:09 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 00:28:09 +0000
Subject: [issue42164] Python fails to compile in the Fedora Stable LTO
 buildbots
In-Reply-To: <1603751687.99.0.243163164232.issue42164@roundup.psfhosted.org>
Message-ID: <1603758489.02.0.75717665693.issue42164@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

With LTO, compile.o requires an undefined _Py_Mangle symbol:

$ gcc -pthread -c -DNDEBUG -fwrapv -O3 -std=c99 -fvisibility=hidden -flto -I./Include/internal  -I. -I./Include -DPy_BUILD_CORE -o Python/compile.o Python/compile.c; nm Python/compile.o | grep _Py_Mangle

         U _Py_Mangle


Without LTO, compile.o defines _Py_Mangle symbol:

$ gcc -pthread -c -DNDEBUG -fwrapv -O3 -std=c99 -fvisibility=hidden -I./Include/internal  -I. -I./Include -DPy_BUILD_CORE -o Python/compile.o Python/compile.c; nm Python/compile.o | grep _Py_Mangle

0000000000003c20 T _Py_Mangle

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42164>
_______________________________________

From report at bugs.python.org  Mon Oct 26 20:29:47 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 27 Oct 2020 00:29:47 +0000
Subject: [issue42164] Python fails to compile in the Fedora Stable LTO
 buildbots
In-Reply-To: <1603751687.99.0.243163164232.issue42164@roundup.psfhosted.org>
Message-ID: <1603758587.25.0.79971342199.issue42164@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> With LTO, compile.o requires an undefined _Py_Mangle symbol:


Yeah, now try to compile with LTO and CFLAGS='-O0'

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42164>
_______________________________________

From report at bugs.python.org  Mon Oct 26 20:31:14 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 27 Oct 2020 00:31:14 +0000
Subject: [issue30681] email.utils.parsedate_to_datetime() should return None
 when date cannot be parsed
In-Reply-To: <1497568363.46.0.596536376967.issue30681@psf.upfronthosting.co.za>
Message-ID: <1603758674.5.0.747932119073.issue30681@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 303aac8c56609290e122eecc14c038e9b1e4174a by Georges Toth in branch 'master':
bpo-30681: Support invalid date format or value in email Date header (GH-22090)
https://github.com/python/cpython/commit/303aac8c56609290e122eecc14c038e9b1e4174a


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30681>
_______________________________________

From report at bugs.python.org  Mon Oct 26 20:31:37 2020
From: report at bugs.python.org (Barry A. Warsaw)
Date: Tue, 27 Oct 2020 00:31:37 +0000
Subject: [issue30681] email.utils.parsedate_to_datetime() should return None
 when date cannot be parsed
In-Reply-To: <1497568363.46.0.596536376967.issue30681@psf.upfronthosting.co.za>
Message-ID: <1603758697.63.0.87460598659.issue30681@roundup.psfhosted.org>


Change by Barry A. Warsaw <barry at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30681>
_______________________________________

From report at bugs.python.org  Mon Oct 26 21:00:46 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 01:00:46 +0000
Subject: [issue42164] Python fails to compile in the Fedora Stable LTO
 buildbots
In-Reply-To: <1603751687.99.0.243163164232.issue42164@roundup.psfhosted.org>
Message-ID: <1603760446.12.0.225112944747.issue42164@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Yeah, now try to compile with LTO and CFLAGS='-O0'

Using LTO:

* "-O1 -finline-functions -finline-small-functions -fpartial-inlining" reproduces the issue.
* "-O1" does not reproduce the issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42164>
_______________________________________

From report at bugs.python.org  Mon Oct 26 21:09:01 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 01:09:01 +0000
Subject: [issue42164] Python fails to compile in the Fedora Stable LTO
 buildbots
In-Reply-To: <1603751687.99.0.243163164232.issue42164@roundup.psfhosted.org>
Message-ID: <1603760941.34.0.647595201975.issue42164@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I reported the issue to Fedora: https://bugzilla.redhat.com/show_bug.cgi?id=1891657

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42164>
_______________________________________

From report at bugs.python.org  Mon Oct 26 21:24:58 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 01:24:58 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603761898.78.0.409958897506.issue42161@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset c9bc290dd6e3994a4ead2a224178bcba86f0c0e4 by Victor Stinner in branch 'master':
bpo-42161: Use _PyLong_GetZero() and _PyLong_GetOne() (GH-22995)
https://github.com/python/cpython/commit/c9bc290dd6e3994a4ead2a224178bcba86f0c0e4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Mon Oct 26 21:39:03 2020
From: report at bugs.python.org (Benjamin Peterson)
Date: Tue, 27 Oct 2020 01:39:03 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1603762743.32.0.842680963019.issue42160@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:

Wouldn't it be simpler to use random.SystemRandom instead?

----------
nosy: +benjamin.peterson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Mon Oct 26 21:41:28 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 01:41:28 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603762888.67.0.0643720834214.issue42161@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21913
pull_request: https://github.com/python/cpython/pull/22998

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Mon Oct 26 21:54:47 2020
From: report at bugs.python.org (Yongkwan Kim)
Date: Tue, 27 Oct 2020 01:54:47 +0000
Subject: [issue35061] Specify libffi.so soname for ctypes
In-Reply-To: <1540433070.81.0.788709270274.issue35061@psf.upfronthosting.co.za>
Message-ID: <1603763687.27.0.196289218295.issue35061@roundup.psfhosted.org>


Yongkwan Kim <tturbs at hotmail.com> added the comment:

My solution is creating link of libffi.so.6 as .5 This is for anyone who has same issue with me.
But thanks for your kind reply though.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35061>
_______________________________________

From report at bugs.python.org  Mon Oct 26 22:07:22 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 02:07:22 +0000
Subject: [issue38980] Compile libpython with -fno-semantic-interposition
In-Reply-To: <1575561631.45.0.417730594345.issue38980@roundup.psfhosted.org>
Message-ID: <1603764442.64.0.00696087338581.issue38980@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Since Fedora and RHEL build Python with -fno-semantic-interposition, we did not get any user bug report about the LD_PRELOAD use case. IMO we can safely consider that no user rely on LD_PRELOAD to override libpython symbols.

Thanks for implementing the feature Pablo and Petr!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38980>
_______________________________________

From report at bugs.python.org  Mon Oct 26 22:15:58 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 02:15:58 +0000
Subject: [issue41474] Missing dependency on Include/cpython/frameobject.h
In-Reply-To: <1596551033.65.0.706475501997.issue41474@roundup.psfhosted.org>
Message-ID: <1603764958.73.0.732598792577.issue41474@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21914
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/22999

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41474>
_______________________________________

From report at bugs.python.org  Mon Oct 26 22:25:42 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 02:25:42 +0000
Subject: [issue41944] [security] Python testsuite calls eval() on content
 received via HTTP
In-Reply-To: <1601908852.29.0.0266876682235.issue41944@roundup.psfhosted.org>
Message-ID: <1603765542.84.0.134817328843.issue41944@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks for the fix Serhiy and thanks Florian Bruhin for the bug report!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41944>
_______________________________________

From report at bugs.python.org  Mon Oct 26 22:29:32 2020
From: report at bugs.python.org (Chris Jerdonek)
Date: Tue, 27 Oct 2020 02:29:32 +0000
Subject: [issue42140] asyncio.wait function creates futures set two times
In-Reply-To: <1603522282.48.0.50359686965.issue42140@roundup.psfhosted.org>
Message-ID: <1603765772.18.0.262124879843.issue42140@roundup.psfhosted.org>


Chris Jerdonek <chris.jerdonek at gmail.com> added the comment:

If it's just a code cleanup and not a bugfix though, it shouldn't be backported. But yes, as a cleanup it's fine. And even if it's expected to go away later, it's okay to do now.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42140>
_______________________________________

From report at bugs.python.org  Mon Oct 26 22:31:34 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 02:31:34 +0000
Subject: [issue42051] [security] Avoid plistlib XML vulnerabilities by
 rejecting entity directives
In-Reply-To: <1602837130.12.0.103266772697.issue42051@roundup.psfhosted.org>
Message-ID: <1603765894.58.0.648022210147.issue42051@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks Ronald Oussoren for the fix. It's better to fix a vulnerability (denial of service in this case) rather than documenting it :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42051>
_______________________________________

From report at bugs.python.org  Mon Oct 26 22:32:31 2020
From: report at bugs.python.org (Eric Wolf)
Date: Tue, 27 Oct 2020 02:32:31 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1603765951.09.0.583466418917.issue42160@roundup.psfhosted.org>


Eric Wolf <robo-eric at gmx.de> added the comment:

SystemRandom seems to be slower:


from random import Random, SystemRandom
from timeit import timeit

user = Random()
system = SystemRandom()
characters = "abcdefghijklmnopqrstuvwxyz0123456789_"

timeit(lambda: user.choice(characters))
>>> 0.5491522020020057

timeit(lambda: system.choice(characters))
>>> 2.9195130389998667

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Mon Oct 26 22:33:29 2020
From: report at bugs.python.org (Benjamin Peterson)
Date: Tue, 27 Oct 2020 02:33:29 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1603766009.46.0.28112332563.issue42160@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:

I also wonder if the overhead of getpid() is actually significant for anything.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Mon Oct 26 22:51:47 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 02:51:47 +0000
Subject: [issue36225] [subinterpreters] Lingering subinterpreters should be
 implicitly cleared on shutdown
In-Reply-To: <1551964663.69.0.686712846789.issue36225@roundup.psfhosted.org>
Message-ID: <1603767107.3.0.991879555936.issue36225@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

If tomorrow Python allows to run two interpreters in parallel (see bpo-40512: "Meta issue: per-interpreter GIL"), I don't think that it will be safe to execute object finalizers of a subinterpreter from the main interpreter in Py_Finalize().

IMO subinterpreters must be finalized manually by the programmer, since it's too tricky.

The safest option is to display a warning in Py_Finalize() if there are running subinterpreters.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36225>
_______________________________________

From report at bugs.python.org  Mon Oct 26 22:59:19 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 02:59:19 +0000
Subject: [issue42157] Cleanup the unicodedata module
In-Reply-To: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>
Message-ID: <1603767559.4.0.568348843362.issue42157@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> The version 3.2.0 is needed for IDNA compatibility (...)

Oh, I missed your comment. I also discovered it by trying to remove it :-)

So I think that the last thing to do for this issue is to remove unicodedata.ucnhash_CAPI: PR 22994.

----------
components: +Unicode
nosy: +ezio.melotti

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42157>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:00:34 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 03:00:34 +0000
Subject: [issue12737] str.title() is overzealous by upcasing combining
 marks	inappropriately
In-Reply-To: <1313102254.23.0.17412568785.issue12737@psf.upfronthosting.co.za>
Message-ID: <1603767634.32.0.32930706474.issue12737@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12737>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:07:16 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 03:07:16 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603768036.28.0.40612189058.issue42096@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

ZipFile.open() checks the first 4 bytes:

            # Skip the file header:
            fheader = zef_file.read(sizeFileHeader)
            if len(fheader) != sizeFileHeader:
                raise BadZipFile("Truncated file header")
            fheader = struct.unpack(structFileHeader, fheader)
            if fheader[_FH_SIGNATURE] != stringFileHeader:
                raise BadZipFile("Bad magic number for file header")

But is_zipfile() does not. Code could be shared for that.

.gz and .zip files don't start by the same bytes, so this check should reduce the number of false positives.

--

You may have a look at the validate() methods of my old Hachoir project, they check a few bytes to check if a file looks a valid gzip or ZIP archive.

gzip:

https://github.com/vstinner/hachoir/blob/0f56883d7cea7082e784bfbdd2882e0f2dd2f34b/hachoir/parser/archive/gzip_parser.py#L51-L62

zip:

https://github.com/vstinner/hachoir/blob/0f56883d7cea7082e784bfbdd2882e0f2dd2f34b/hachoir/parser/archive/zip.py#L411-L430

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:10:18 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 03:10:18 +0000
Subject: [issue32122] Improve -x option documentation
In-Reply-To: <1511504808.14.0.213398074469.issue32122@psf.upfronthosting.co.za>
Message-ID: <1603768218.48.0.91632488579.issue32122@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The -x command line option is now stored as PyConfig.skip_source_first_line, documented as:
"Skip the first line of the source?"
https://docs.python.org/dev/c-api/init_config.html#c.PyConfig.skip_source_first_line

Include/cpython/initconfig.h contains a longer comment:

    /* Skip the first line of the source ('run_filename' parameter),
       allowing use of non-Unix forms of "#!cmd".
       This is intended for a DOS specific hack only.

       Set by the -x command line option. */
    int skip_source_first_line;

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32122>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:21:42 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 03:21:42 +0000
Subject: [issue41736] test_site: test_s_option() failed on AMD64 Windows8.1
 Refleaks 3.7
In-Reply-To: <1599488018.49.0.898281203833.issue41736@roundup.psfhosted.org>
Message-ID: <1603768902.55.0.326755112192.issue41736@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Unless refleaks are considered security holes,

This issue is unrelated to reference leak. It's just that when you run test_site multiple times, it fails sometimes. It looks like a race condition in the test.

My notes on unstable tests:
https://pythondev.readthedocs.io/unstable_tests.html


> On Windows 10 and master, I ran 12 copies of test_site in parallel 10 times.  Then I ran -R 3:100 3 times.  All pass.  

Maybe test_site only fails when other tests are run in parallel.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41736>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:21:41 2020
From: report at bugs.python.org (Eric Wolf)
Date: Tue, 27 Oct 2020 03:21:41 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1603768901.3.0.804265490483.issue42160@roundup.psfhosted.org>


Eric Wolf <robo-eric at gmx.de> added the comment:

It seems to be insignificant, however it would allow for easier monkey-patching: https://bugs.python.org/issue32276

Instead of changing _Random one could simply assign a new instance to _named_sequence

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:24:41 2020
From: report at bugs.python.org (Nikhil Benesch)
Date: Tue, 27 Oct 2020 03:24:41 +0000
Subject: [issue38705] venv creation on macOS Catalina is failing
In-Reply-To: <1572987486.08.0.312821972581.issue38705@roundup.psfhosted.org>
Message-ID: <1603769081.13.0.213627600968.issue38705@roundup.psfhosted.org>


Nikhil Benesch <nikhil.benesch at gmail.com> added the comment:

This issue continues to exist with the system Python on macOS. Here is how to reproduce on macOS Catalina 10.15.7 and Xcode 12.1.

$ /usr/bin/python3 --version
Python 3.8.2

$ /usr/bin/python3 -c 'import venv; venv.create("venv");'

$ venv/bin/python3
dyld: Library not loaded: @executable_path/../Python3
  Referenced from: /Users/benesch/venv/bin/python3
  Reason: image not found
Abort trap: 6

Weird, isn't it? The thing that gets copied into the venv is just a totally different file than /usr/bin/python3:

$ ls -lah venv/bin/python3
-rwxr-xr-x 1 benesch staff 148K Oct 26 23:16 venv/bin/python3

$ ls -lah /usr/bin/python3
-rwxr-xr-x 1 root wheel 31K Sep 21 20:29 /usr/bin/python3

I assume this is Apple's bug, but I'll be damned if I have to file another report into the blackhole that is radar. If someone needs a quick workaround, just create your venvs with symlinks, which works just fine:

$ /usr/bin/python3 -c 'import venv; venv.create("venv2");'
$ venv2/bin/python3
Python 3.8.2 (default, Sep 24 2020, 19:37:08) 
[Clang 12.0.0 (clang-1200.0.32.21)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> 

Incidentally this is why `/usr/bin/python3 -m venv` works just fine, since it defaults to `symlinks=True` on macOS.

----------
nosy: +benesch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38705>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:24:53 2020
From: report at bugs.python.org (Justin Arthur)
Date: Tue, 27 Oct 2020 03:24:53 +0000
Subject: [issue42140] asyncio.wait function creates futures set two times
In-Reply-To: <1603522282.48.0.50359686965.issue42140@roundup.psfhosted.org>
Message-ID: <1603769093.58.0.319108646796.issue42140@roundup.psfhosted.org>


Justin Arthur <justinarthur at gmail.com> added the comment:

I believe the documentation may be referring to the English set and not a Python set, but I could be wrong.

Yury changed the wording from sequence to set in 3.7, but we didn't document a breaking change as far as I know. The purpose of those set constructions was to handle the many things other than a set that can be passed in that may have non-unique values. Early asyncio documentation included examples of passing wait() a list.

I wouldn't be surprised if there are other libraries or apps out there for which removing iterator support was an accidentally-breaking change and it may be strange if this is only is broken in 3.9.x, but working both before and after.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42140>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:24:56 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 03:24:56 +0000
Subject: [issue42074] setup error on windows
In-Reply-To: <1603057749.44.0.277772505127.issue42074@roundup.psfhosted.org>
Message-ID: <1603769096.25.0.397059047878.issue42074@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42074>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:25:35 2020
From: report at bugs.python.org (Nikhil Benesch)
Date: Tue, 27 Oct 2020 03:25:35 +0000
Subject: [issue38705] venv creation on macOS Catalina is failing
In-Reply-To: <1572987486.08.0.312821972581.issue38705@roundup.psfhosted.org>
Message-ID: <1603769135.61.0.870345699689.issue38705@roundup.psfhosted.org>


Nikhil Benesch <nikhil.benesch at gmail.com> added the comment:

Oops, sorry, I forgot to actually include the correct command in the workaround. Here it is:

$ /usr/bin/python3 -c 'import venv; venv.create("venv2", symlinks=True);'

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38705>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:36:30 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 03:36:30 +0000
Subject: [issue42157] Cleanup the unicodedata module
In-Reply-To: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>
Message-ID: <1603769790.1.0.318871388384.issue42157@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 84f7382215b9e024a5590454726b6ae4b0ca70a0 by Victor Stinner in branch 'master':
bpo-42157: Rename unicodedata.ucnhash_CAPI (GH-22994)
https://github.com/python/cpython/commit/84f7382215b9e024a5590454726b6ae4b0ca70a0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42157>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:40:56 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 03:40:56 +0000
Subject: [issue42157] Cleanup the unicodedata module
In-Reply-To: <1603731920.79.0.612011686263.issue42157@roundup.psfhosted.org>
Message-ID: <1603770056.73.0.715606223435.issue42157@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I kept unicodedata.ucd_3_2_0 and added a comment to explain why it's still relevant in 2020.

I'm done with tasks listed in this issue, so I close it.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42157>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:41:37 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 03:41:37 +0000
Subject: [issue41474] Missing dependency on Include/cpython/frameobject.h
In-Reply-To: <1596551033.65.0.706475501997.issue41474@roundup.psfhosted.org>
Message-ID: <1603770097.9.0.713026292064.issue41474@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset a6879d9445f98833c4e300e187956e2a218a2315 by Victor Stinner in branch 'master':
bpo-41474, Makefile: Add dependency on cpython/frameobject.h (GH-22999)
https://github.com/python/cpython/commit/a6879d9445f98833c4e300e187956e2a218a2315


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41474>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:41:53 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 27 Oct 2020 03:41:53 +0000
Subject: [issue41474] Missing dependency on Include/cpython/frameobject.h
In-Reply-To: <1596551033.65.0.706475501997.issue41474@roundup.psfhosted.org>
Message-ID: <1603770113.04.0.0504664587019.issue41474@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +21915
pull_request: https://github.com/python/cpython/pull/23000

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41474>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:42:44 2020
From: report at bugs.python.org (Nikhil Benesch)
Date: Tue, 27 Oct 2020 03:42:44 +0000
Subject: [issue38705] venv creation on macOS Catalina is failing
In-Reply-To: <1572987486.08.0.312821972581.issue38705@roundup.psfhosted.org>
Message-ID: <1603770164.79.0.0351473277613.issue38705@roundup.psfhosted.org>


Nikhil Benesch <nikhil.benesch at gmail.com> added the comment:

So it looks like /usr/bin/python3 is just a shim that immediately execs the real Python binary:

    /Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.8/bin/python3

This binary is identical to the one that ends up in the venv.

Problematically, this binary is dynamically linked, and links the "Python3" shared library using a relative path:

$ otool -L /Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.8/bin/python3
/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.8/bin/python3:
	@executable_path/../Python3 (compatibility version 3.8.0, current version 3.8.0)
	/usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1292.0.0)

So obviously copying that binary to a different path breaks the @executable_path-relative link. Ah, well. Definitely seems like Apple's bug. Not sure there is anything that even could be done on the CPython side.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38705>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:42:46 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 03:42:46 +0000
Subject: [issue41474] Missing dependency on Include/cpython/frameobject.h
In-Reply-To: <1596551033.65.0.706475501997.issue41474@roundup.psfhosted.org>
Message-ID: <1603770166.76.0.751322359819.issue41474@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41474>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:43:12 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 03:43:12 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1603770192.17.0.756672876576.issue41490@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Mon Oct 26 23:43:27 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 03:43:27 +0000
Subject: [issue15125] argparse: positional arguments containing - in name not
 handled well
In-Reply-To: <1340292847.64.0.123942573403.issue15125@psf.upfronthosting.co.za>
Message-ID: <1603770207.01.0.448718268844.issue15125@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15125>
_______________________________________

From report at bugs.python.org  Tue Oct 27 00:02:03 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 27 Oct 2020 04:02:03 +0000
Subject: [issue41474] Missing dependency on Include/cpython/frameobject.h
In-Reply-To: <1596551033.65.0.706475501997.issue41474@roundup.psfhosted.org>
Message-ID: <1603771323.37.0.231341538541.issue41474@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 562ad7624e5fe22fdded9b39723c562255a49abd by Miss Skeleton (bot) in branch '3.9':
bpo-41474, Makefile: Add dependency on cpython/frameobject.h (GH-22999)
https://github.com/python/cpython/commit/562ad7624e5fe22fdded9b39723c562255a49abd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41474>
_______________________________________

From report at bugs.python.org  Tue Oct 27 00:05:56 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 04:05:56 +0000
Subject: [issue13451] sched.py: speedup cancel() method
In-Reply-To: <1321923822.73.0.49972384361.issue13451@psf.upfronthosting.co.za>
Message-ID: <1603771556.63.0.861750016749.issue13451@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13451>
_______________________________________

From report at bugs.python.org  Tue Oct 27 00:10:46 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 04:10:46 +0000
Subject: [issue38324] [Windows] test__locale fails on Windows local machines
In-Reply-To: <1569849277.36.0.00648751871696.issue38324@roundup.psfhosted.org>
Message-ID: <1603771846.69.0.996201167263.issue38324@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> New changeset f2312037e3a974d26ed3e23884f94c6af111a27a by TIGirardi in branch 'master':
> bpo-38324: Fix test__locale.py Windows failures (GH-20529)

Oh wow, that's a nice enhancmement of the Windows implementation of the locale module! It's way better than just skipping tests on Windows ;-) Thanks for this fix!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38324>
_______________________________________

From report at bugs.python.org  Tue Oct 27 00:12:07 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 04:12:07 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1603771927.36.0.894886447717.issue41798@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Also note that the capsule generally needs to hold references to the objects in exposes

Oh right, that's a great advice!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Tue Oct 27 00:18:24 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 04:18:24 +0000
Subject: [issue31818] [macOS] _scproxy.get_proxies() crash -- get_proxies() is
 not fork-safe?
In-Reply-To: <1508409035.64.0.213398074469.issue31818@psf.upfronthosting.co.za>
Message-ID: <1603772304.22.0.167951966311.issue31818@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31818>
_______________________________________

From report at bugs.python.org  Tue Oct 27 00:21:19 2020
From: report at bugs.python.org (Diogo Dutra)
Date: Tue, 27 Oct 2020 04:21:19 +0000
Subject: [issue42140] asyncio.wait function creates futures set two times
In-Reply-To: <1603769093.58.0.319108646796.issue42140@roundup.psfhosted.org>
Message-ID: <CAMJwLaFUsoUswL8j7qF4c8rHeHpoC7nkPkejJLbvrtT7bZ70eg@mail.gmail.com>


Diogo Dutra <diogodutradamata at gmail.com> added the comment:

> I wouldn't be surprised if there are other libraries or apps out there
for which removing iterator support was an accidentally-breaking change and
it may be strange if this is only is broken in 3.9.x, but working both
before and after.

Justin, when the deprecation message has been removed, the iterator will
works again, because the code will iterate just one time.
So the behaviour you describe will happen anyway.

My changes proposal is a ?improvement?, because the second iteration can be
made on the already created set.

I think that change make senses because it removes unnecessary data
creation.

Em ter, 27 de out de 2020 ?s 00:24, Justin Arthur <report at bugs.python.org>
escreveu:

>
> Justin Arthur <justinarthur at gmail.com> added the comment:
>
> I believe the documentation may be referring to the English set and not a
> Python set, but I could be wrong.
>
> Yury changed the wording from sequence to set in 3.7, but we didn't
> document a breaking change as far as I know. The purpose of those set
> constructions was to handle the many things other than a set that can be
> passed in that may have non-unique values. Early asyncio documentation
> included examples of passing wait() a list.
>
> I wouldn't be surprised if there are other libraries or apps out there for
> which removing iterator support was an accidentally-breaking change and it
> may be strange if this is only is broken in 3.9.x, but working both before
> and after.
>
> ----------
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue42140>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42140>
_______________________________________

From report at bugs.python.org  Tue Oct 27 00:22:53 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 04:22:53 +0000
Subject: [issue41052] Opt out serialization/deserialization for heap type
In-Reply-To: <1592659049.98.0.596314769567.issue41052@roundup.psfhosted.org>
Message-ID: <1603772573.44.0.896425860154.issue41052@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks for the fix Serhiy!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41052>
_______________________________________

From report at bugs.python.org  Tue Oct 27 00:57:25 2020
From: report at bugs.python.org (Justin Arthur)
Date: Tue, 27 Oct 2020 04:57:25 +0000
Subject: [issue42140] asyncio.wait function creates futures set two times
In-Reply-To: <1603522282.48.0.50359686965.issue42140@roundup.psfhosted.org>
Message-ID: <1603774645.92.0.63161103395.issue42140@roundup.psfhosted.org>


Justin Arthur <justinarthur at gmail.com> added the comment:

> So the behaviour you describe will happen anyway.
Unless we make your change against the 3.9 branch, in which case the fix will make it into the 3.9.x series of patch releases.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42140>
_______________________________________

From report at bugs.python.org  Tue Oct 27 02:12:00 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 27 Oct 2020 06:12:00 +0000
Subject: [issue42159] AsyncMock restores stopped patch if same object stopped
 multiple times
In-Reply-To: <1603746324.52.0.94475530038.issue42159@roundup.psfhosted.org>
Message-ID: <1603779120.22.0.702860436651.issue42159@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42159>
_______________________________________

From report at bugs.python.org  Tue Oct 27 02:50:04 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 27 Oct 2020 06:50:04 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603781404.06.0.60605924585.issue42096@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Tue Oct 27 02:50:19 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 27 Oct 2020 06:50:19 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603781419.24.0.162695933209.issue42096@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
assignee:  -> serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Tue Oct 27 02:56:33 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 27 Oct 2020 06:56:33 +0000
Subject: [issue42163] _replace() no longer works on platform.uname_result
 objects
In-Reply-To: <1603750912.81.0.950571190169.issue42163@roundup.psfhosted.org>
Message-ID: <1603781793.09.0.837101052453.issue42163@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +jaraco, rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42163>
_______________________________________

From report at bugs.python.org  Tue Oct 27 02:59:03 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 27 Oct 2020 06:59:03 +0000
Subject: [issue42159] AsyncMock restores stopped patch if same object stopped
 multiple times
In-Reply-To: <1603746324.52.0.94475530038.issue42159@roundup.psfhosted.org>
Message-ID: <1603781943.06.0.127932553655.issue42159@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This is not a problem with AsyncMock. The patching is not done when the patch object is created to store reference to the original unpatched function. Hence patcher1, patcher2 that patch the same function don't store a reference to the original sync_func. The lookup is done during start(). patcher1.start() makes a lookup and stores the function. When patcher2.start() makes a lookup the function is already patched with a mock and thus it resorts to the original as the mock. 

When stop is called on patcher1 it resets back to the original function. Meanwhile for patcher2 the original function set during start itself is a mock and it resets back to that. The lookup is done at https://github.com/python/cpython/blob/a6879d9445f98833c4e300e187956e2a218a2315/Lib/unittest/mock.py#L1360 . Here target will print the function for patcher1.start() but the mock for patcher2.start().

import asyncio
import unittest
from unittest import TestCase
from unittest.mock import *

def sync_func():
    raise Exception

class Test(TestCase):

    def test_simultaneous_mocks_sync(self):
        patcher1 = patch(f"{__name__}.sync_func")
        patcher2 = patch(f"{__name__}.sync_func")

        patcher1.start()
        print(sync_func())

        patcher2.start()
        print(sync_func())

        breakpoint()
        patcher1.stop()
        with self.assertRaises(Exception):
            sync_func()

        breakpoint()
        patcher2.stop()

        with self.assertRaises(Exception): # Fails, mock is restored!
            sync_func()

if __name__ == "__main__":
    unittest.main()

----------
components: +Library (Lib)
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42159>
_______________________________________

From report at bugs.python.org  Tue Oct 27 03:03:18 2020
From: report at bugs.python.org (hyoxt121)
Date: Tue, 27 Oct 2020 07:03:18 +0000
Subject: [issue42165] Question about converting numpy float to bytes (bug??)
Message-ID: <1603782198.74.0.214609178007.issue42165@roundup.psfhosted.org>


New submission from hyoxt121 <hyoxt121 at gmail.com>:

Hi! In order to convert numpy float to bytes, we are using tobytes() method:

import pickle
import numpy as np
pickle.loads(np.float64(0.34103))

and the expected result is like below (because np.float64(0.34103) is not bytes objects, appropriate errors are expected)
---------------------------------------------------------------------------
UnpicklingError Traceback (most recent call last)
<ipython-input-19-5c07606a60f1> in <module>
----> 1 pickle.loads(np.float64(0.34103))

UnpicklingError: invalid load key, '\xc1'.


Here we have some questions that some numbers (it is rare) like 0.34104 prints the following result without errors.
pickle.loads(np.float64(0.34104))
=> True

This occurs only when the converted bytes start with b'\x88 (for example 0.04263, 0.08526, 0.11651 ...)
Can anyone answer whether this issue is Python bugs?

Any answer will be highly appreciated.

----------
components: Library (Lib)
messages: 379738
nosy: hyoxt121
priority: normal
severity: normal
status: open
title: Question about converting numpy float to bytes (bug??)
type: behavior
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42165>
_______________________________________

From report at bugs.python.org  Tue Oct 27 03:06:49 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 27 Oct 2020 07:06:49 +0000
Subject: [issue42151] Pure Python xml.etree.ElementTree is missing default
 attribute values
In-Reply-To: <1603684290.04.0.0149631860455.issue42151@roundup.psfhosted.org>
Message-ID: <1603782409.52.0.579867195316.issue42151@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

specified_attributes = True is also set in xml.dom.expatbuilder. Should not it be set to true in the C implementation of ElementTree?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42151>
_______________________________________

From report at bugs.python.org  Tue Oct 27 03:20:46 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 27 Oct 2020 07:20:46 +0000
Subject: [issue42165] Question about converting numpy float to bytes (bug??)
In-Reply-To: <1603782198.74.0.214609178007.issue42165@roundup.psfhosted.org>
Message-ID: <1603783246.32.0.903047430045.issue42165@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Seems that np.float64 implements the buffer protocol, i.e. it can be accepted in any function that supports the buffer protocol (for example b'abc\xc1\x1c=~o\xd3\xd5?def'.index(np.float64(0.34103))). And pickle.loads() is one of such functions, it accepts bytes, bytearray, memoryview, mmap, etc.

There is no bug in Python, and I suppose it is an intended behavior in NumPy. It just happens that two features are used together in wrong way. The bug is in your code which passes wrong argument to pickle.loads().

----------
nosy: +serhiy.storchaka
resolution:  -> not a bug

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42165>
_______________________________________

From report at bugs.python.org  Tue Oct 27 03:24:36 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 27 Oct 2020 07:24:36 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603783476.51.0.920154143622.issue42096@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

ZipFile.open() is not the code for opening a zip file. :)

That's the code for opening a file embedded within an already constructed mode='r' archive as done the ZipFile.__init__() constructor.  By the time you've gotten to the open() method, you've loaded the entire unbounded in size central directory into memory as ZipInfo objects [constructor] and are checking signature of an individual file header you are attempting to read out of the archive.

Follow the ZipFile() constructor, it calls ZipFile._RealGetContents() which is the true start of parsing the archive.  https://github.com/python/cpython/blob/master/Lib/zipfile.py#L1317

Sure, more and more steps can be done.  But if you want to do that, you may as well just get rid of is_zipfile() entirely - a functions who's point is to be fast and not consume an amount of memory determined by the input data - and have people just call `zipfile.ZipFile(path_in_question, mode='r')` and live with the consequences of attempting to load and parse the whole thing.  If that doesn't raise an exception, it is more likely to be a zip file.  But that could still raise an exception when trying to open each of the files inside, so you'd need to iterate over this and open those and make sure they're valid.

is_zipfile() isn't a verify_zipfile_integrity() routine.  Just a quick best guess.

is_zipfile() cannot be perfect and is not intended to be.  There is always going to be yet another thing it _could_ try.  It isn't worth chasing the impossible goal and making it not be fast.

Just update the is_zipfile() docs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Tue Oct 27 03:37:48 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 27 Oct 2020 07:37:48 +0000
Subject: [issue30681] email.utils.parsedate_to_datetime() should return None
 when date cannot be parsed
In-Reply-To: <1497568363.46.0.596536376967.issue30681@psf.upfronthosting.co.za>
Message-ID: <1603784268.47.0.413059357619.issue30681@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

>>> email.utils.parsedate_to_datetime(None)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/serhiy/py/cpython/Lib/email/utils.py", line 200, in parsedate_to_datetime
    raise ValueError('Invalid date value or format "%s"' % str(data))
ValueError: Invalid date value or format "None"

First, the date value is None, not "None".

Second, why not just return None? parsedate() can be used in code like:

   parsedata(headers.get('Date'))

None is an expected argument if the header "Date" is absent. parsedate_to_datetime() is not compatible with parsedata() in this case.

It was a regression introduced in issue16714. Before that parsedate_to_datetime(None) returned None.

----------
nosy: +serhiy.storchaka
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30681>
_______________________________________

From report at bugs.python.org  Tue Oct 27 04:22:55 2020
From: report at bugs.python.org (kannan)
Date: Tue, 27 Oct 2020 08:22:55 +0000
Subject: [issue42166] corrupted size vs. prev_size
Message-ID: <1603786975.91.0.349324369107.issue42166@roundup.psfhosted.org>


New submission from kannan <kannaninfo93 at gmail.com>:

Getting the below error from long running python processes
----------------------------------------------------------

2020-10-18T21:52:59.383Z ======= Backtrace: =========
2020-10-18T21:52:59.383Z /lib64/libc.so.6(+0x7f3e4)[0x7f7bd3e053e4]
2020-10-18T21:52:59.383Z /lib64/libc.so.6(+0x814db)[0x7f7bd3e074db]
2020-10-18T21:52:59.383Z /lib64/libcrypto.so.10(CRYPTO_free+0x1d)[0x7f7bd1cfe80d]
2020-10-18T21:52:59.383Z /lib64/libssl.so.10(+0x41aa3)[0x7f7bd2134aa3]
2020-10-18T21:52:59.383Z /lib64/libssl.so.10(SSL_CTX_free+0x147)[0x7f7bd2136977]
2020-10-18T21:52:59.383Z /usr/local/lib/python3.7/lib-dynload/_ssl.cpython-37m-x86_64-linux-gnu.so(+0xe50b)[0x7f7bcf9d750b]
2020-10-18T21:52:59.383Z /lib64/libpython3.7m.so.1.0(+0x101bab)[0x7f7bd4db1bab]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xe2416)[0x7f7bd4d92416]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0x101ca1)[0x7f7bd4db1ca1]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xca6d9)[0x7f7bd4d7a6d9]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0x1f6255)[0x7f7bd4ea6255]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0x19fede)[0x7f7bd4e4fede]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyObject_GC_Malloc+0x133)[0x7f7bd4e50943]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyObject_GC_New+0xd)[0x7f7bd4e5099d]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xe3fdf)[0x7f7bd4d93fdf]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(PyObject_GetIter+0x16)[0x7f7bd4d62d86]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0x133a)[0x7f7bd4e0c55a]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xc562b)[0x7f7bd4d7562b]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0xa16)[0x7f7bd4e0bc36]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xc562b)[0x7f7bd4d7562b]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0xa16)[0x7f7bd4e0bc36]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xc562b)[0x7f7bd4d7562b]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0xa16)[0x7f7bd4e0bc36]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xc562b)[0x7f7bd4d7562b]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0xa16)[0x7f7bd4e0bc36]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xc562b)[0x7f7bd4d7562b]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0xa16)[0x7f7bd4e0bc36]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xc562b)[0x7f7bd4d7562b]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0xa16)[0x7f7bd4e0bc36]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xc562b)[0x7f7bd4d7562b]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0xa16)[0x7f7bd4e0bc36]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xc562b)[0x7f7bd4d7562b]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0xa16)[0x7f7bd4e0bc36]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xc562b)[0x7f7bd4d7562b]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0xa16)[0x7f7bd4e0bc36]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(+0xc562b)[0x7f7bd4d7562b]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0xa16)[0x7f7bd4e0bc36]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalCodeWithName+0x27e)[0x7f7bd4e1602e]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyFunction_FastCallKeywords+0xda)[0x7f7bd4d6d4aa]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0x4f34)[0x7f7bd4e10154]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalCodeWithName+0x27e)[0x7f7bd4e1602e]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyFunction_FastCallKeywords+0xda)[0x7f7bd4d6d4aa]
2020-10-18T21:52:59.384Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0x4f34)[0x7f7bd4e10154]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(+0xbcdfa)[0x7f7bd4d6cdfa]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0x4f34)[0x7f7bd4e10154]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(+0xbcdfa)[0x7f7bd4d6cdfa]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0x79c)[0x7f7bd4e0b9bc]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(+0xbcdfa)[0x7f7bd4d6cdfa]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyFunction_FastCallDict+0x66)[0x7f7bd4d6cfc6]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyObject_Call_Prepend+0x7b)[0x7f7bd4d6ef0b]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(+0x107b81)[0x7f7bd4db7b81]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(+0x1038a2)[0x7f7bd4db38a2]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyObject_FastCallKeywords+0x99)[0x7f7bd4d6dc89]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0x52c5)[0x7f7bd4e104e5]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(+0xbcdfa)[0x7f7bd4d6cdfa]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0x4f34)[0x7f7bd4e10154]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(+0xbcdfa)[0x7f7bd4d6cdfa]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyFunction_FastCallDict+0x66)[0x7f7bd4d6cfc6]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0x1fd8)[0x7f7bd4e0d1f8]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalCodeWithName+0x27e)[0x7f7bd4e1602e]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyFunction_FastCallKeywords+0xda)[0x7f7bd4d6d4aa]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalFrameDefault+0x4c4)[0x7f7bd4e0b6e4]
2020-10-18T21:52:59.385Z /lib64/libpython3.7m.so.1.0(_PyEval_EvalCodeWithName+0x27e)[0x7f7bd4e1602e]

----------
assignee: christian.heimes
components: SSL
messages: 379743
nosy: christian.heimes, kannanf9t
priority: normal
severity: normal
status: open
title: corrupted size vs. prev_size
type: crash
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42166>
_______________________________________

From report at bugs.python.org  Tue Oct 27 04:24:40 2020
From: report at bugs.python.org (kannan)
Date: Tue, 27 Oct 2020 08:24:40 +0000
Subject: [issue42166] corrupted size vs. prev_size
In-Reply-To: <1603786975.91.0.349324369107.issue42166@roundup.psfhosted.org>
Message-ID: <1603787080.63.0.49339810143.issue42166@roundup.psfhosted.org>


kannan <kannaninfo93 at gmail.com> added the comment:

python process getting killed after this error

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42166>
_______________________________________

From report at bugs.python.org  Tue Oct 27 04:27:27 2020
From: report at bugs.python.org (kannan)
Date: Tue, 27 Oct 2020 08:27:27 +0000
Subject: [issue42166] corrupted size vs. prev_size
In-Reply-To: <1603786975.91.0.349324369107.issue42166@roundup.psfhosted.org>
Message-ID: <1603787247.13.0.543858715809.issue42166@roundup.psfhosted.org>


kannan <kannaninfo93 at gmail.com> added the comment:

Implementation details
1). python long running stomp.py client (stomp+ssl)
2). main process thread used to create connection (while true sleep for holding the process)
3). listener thread receives message in another thread

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42166>
_______________________________________

From report at bugs.python.org  Tue Oct 27 04:39:33 2020
From: report at bugs.python.org (kannan)
Date: Tue, 27 Oct 2020 08:39:33 +0000
Subject: [issue42166] corrupted size vs. prev_size
In-Reply-To: <1603786975.91.0.349324369107.issue42166@roundup.psfhosted.org>
Message-ID: <1603787973.84.0.10330516329.issue42166@roundup.psfhosted.org>


kannan <kannaninfo93 at gmail.com> added the comment:

Implementation details
1). python long running stomp.py client (stomp+ssl)
2). main process thread used to create connection (while true sleep for holding the process)
3). listener thread receives message and processes it

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42166>
_______________________________________

From report at bugs.python.org  Tue Oct 27 05:34:21 2020
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 27 Oct 2020 09:34:21 +0000
Subject: [issue42166] corrupted size vs. prev_size
In-Reply-To: <1603786975.91.0.349324369107.issue42166@roundup.psfhosted.org>
Message-ID: <1603791261.55.0.233732887342.issue42166@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Could you please provide detailed information about your platform (OS, CPU, vendor/distribution, Python version, and OpenSSL version), a full stacktrace with debug symbols, and Python code to reproduce the error?

Why is the _ssl module in /usr/local/lib while the rest of your Python installation is in /lib64? Did you compile the module yourself?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42166>
_______________________________________

From report at bugs.python.org  Tue Oct 27 05:48:31 2020
From: report at bugs.python.org (hyoxt121)
Date: Tue, 27 Oct 2020 09:48:31 +0000
Subject: [issue42165] Question about converting numpy float to bytes (bug??)
In-Reply-To: <1603782198.74.0.214609178007.issue42165@roundup.psfhosted.org>
Message-ID: <1603792111.09.0.552487886902.issue42165@roundup.psfhosted.org>


hyoxt121 <hyoxt121 at gmail.com> added the comment:

If so, regardless of invalid operation, can anyone explain why "pickle.loads(np.float64(0.34104))" prints "True"?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42165>
_______________________________________

From report at bugs.python.org  Tue Oct 27 05:54:48 2020
From: report at bugs.python.org (Patrick Reader)
Date: Tue, 27 Oct 2020 09:54:48 +0000
Subject: [issue42167] Documentation for SETUP_WITH opcode is wrong
Message-ID: <1603792488.66.0.729213845644.issue42167@roundup.psfhosted.org>


New submission from Patrick Reader <pxeger at protonmail.com>:

bpo-33387 introduced two new opcodes, `RERAISE` and `WITH_EXCEPT_START` (previously called `WITH_EXCEPT_FINISH`), replacing the previous `WITH_CLEANUP_START`, `WITH_CLEANUP_FINISH`,
`BEGIN_FINALLY`, `END_FINALLY`, `CALL_FINALLY` and `POP_FINALLY`.

The [documentation](https://docs.python.org/3.9/library/dis.html#opcode-SETUP_WITH) for it references the since removed `WITH_CLEANUP_START`, which is definitely wrong. I don't know enough to be able to fix it though, sorry, so I've added the core team.

----------
assignee: docs at python
components: Documentation, Interpreter Core
messages: 379749
nosy: docs at python, pxeger
priority: normal
severity: normal
status: open
title: Documentation for SETUP_WITH opcode is wrong
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42167>
_______________________________________

From report at bugs.python.org  Tue Oct 27 06:05:21 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 27 Oct 2020 10:05:21 +0000
Subject: [issue42167] Documentation for SETUP_WITH opcode is wrong
In-Reply-To: <1603792488.66.0.729213845644.issue42167@roundup.psfhosted.org>
Message-ID: <1603793121.74.0.104989704203.issue42167@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42167>
_______________________________________

From report at bugs.python.org  Tue Oct 27 06:10:42 2020
From: report at bugs.python.org (hyoxt121)
Date: Tue, 27 Oct 2020 10:10:42 +0000
Subject: [issue42168] Question about deserializing some numbers (bug??)
Message-ID: <1603793442.12.0.906245378018.issue42168@roundup.psfhosted.org>


New submission from hyoxt121 <hyoxt121 at gmail.com>:

Hi! In order to deserialize bytes object, we use pickle.loads():

import pickle
import numpy as np
pickle.loads(np.float64(0.34103))

and the expected result is like below (because np.float64(0.34103) is not bytes objects, appropriate errors are expected)
---------------------------------------------------------------------------
UnpicklingError Traceback (most recent call last)
<ipython-input-19-5c07606a60f1> in <module>
----> 1 pickle.loads(np.float64(0.34103))

UnpicklingError: invalid load key, '\xc1'.


Here we have some questions that some numbers (it is rare) like 0.34104 prints the following result without errors.
pickle.loads(np.float64(0.34104))
=> True

This occurs only when the converted bytes start with b'\x88 (for example 0.04263, 0.08526, 0.11651 ...)
np.float64(0.34104).tobytes()
=> b'\x88.\xa8o\x99\xd3\xd5?'
Can anyone answer whether this issue is Python bugs?

Any answer will be highly appreciated.

----------
components: Library (Lib)
messages: 379750
nosy: hyoxt121
priority: normal
severity: normal
status: open
title: Question about deserializing some numbers (bug??)
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42168>
_______________________________________

From report at bugs.python.org  Tue Oct 27 06:12:13 2020
From: report at bugs.python.org (hyoxt121)
Date: Tue, 27 Oct 2020 10:12:13 +0000
Subject: [issue42165] Question about converting numpy float to bytes (bug??)
In-Reply-To: <1603782198.74.0.214609178007.issue42165@roundup.psfhosted.org>
Message-ID: <1603793533.37.0.574913415788.issue42165@roundup.psfhosted.org>


hyoxt121 <hyoxt121 at gmail.com> added the comment:

I will close and reopen again with some modification.

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42165>
_______________________________________

From report at bugs.python.org  Tue Oct 27 06:12:30 2020
From: report at bugs.python.org (hyoxt121)
Date: Tue, 27 Oct 2020 10:12:30 +0000
Subject: [issue42165] closed (reopen with other issue)
In-Reply-To: <1603782198.74.0.214609178007.issue42165@roundup.psfhosted.org>
Message-ID: <1603793550.9.0.225983878358.issue42165@roundup.psfhosted.org>


Change by hyoxt121 <hyoxt121 at gmail.com>:


----------
title: Question about converting numpy float to bytes (bug??) -> closed (reopen with other issue)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42165>
_______________________________________

From report at bugs.python.org  Tue Oct 27 06:13:25 2020
From: report at bugs.python.org (hyoxt121)
Date: Tue, 27 Oct 2020 10:13:25 +0000
Subject: [issue42168] Question about deserializing some numbers (bug??)
In-Reply-To: <1603793442.12.0.906245378018.issue42168@roundup.psfhosted.org>
Message-ID: <1603793605.86.0.979418956469.issue42168@roundup.psfhosted.org>


hyoxt121 <hyoxt121 at gmail.com> added the comment:

Can anyone explain "pickle.loads(np.float64(0.34104))" prints "True"?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42168>
_______________________________________

From report at bugs.python.org  Tue Oct 27 06:52:56 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 27 Oct 2020 10:52:56 +0000
Subject: [issue42111] Make the xxlimited module an example of best extension
 module practices
In-Reply-To: <1603310336.9.0.27411366123.issue42111@roundup.psfhosted.org>
Message-ID: <1603795976.88.0.307770231793.issue42111@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Thanks! That's my plan, but when I added tests I realized I need to pt in some general improvements to the stable ABI first.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42111>
_______________________________________

From report at bugs.python.org  Tue Oct 27 06:59:52 2020
From: report at bugs.python.org (Peilonrayz)
Date: Tue, 27 Oct 2020 10:59:52 +0000
Subject: [issue42169] Apparently all documentation on @typing.overload is wrong
Message-ID: <1603796392.82.0.758366735277.issue42169@roundup.psfhosted.org>


New submission from Peilonrayz <peilonrayz at gmail.com>:

The documentation for `typing.overload` says in a non-stub file the last definition shouldn't be typed. However running that through `mypy --strict` fails. I opened an issue on mypy a couple of days ago, however was told to report this on CPython.

```
>>> import typing
>>> help(typing.overload)
Help on function overload in module typing:

overload(func)
    Decorator for overloaded functions/methods.
    
    In a stub file, place two or more stub definitions for the same
    function in a row, each decorated with @overload.  For example:
    
      @overload
      def utf8(value: None) -> None: ...
      @overload
      def utf8(value: bytes) -> bytes: ...
      @overload
      def utf8(value: str) -> bytes: ...
    
    In a non-stub file (i.e. a regular .py file), do the same but
    follow it with an implementation.  The implementation should *not*
    be decorated with @overload.  For example:
    
      @overload
      def utf8(value: None) -> None: ...
      @overload
      def utf8(value: bytes) -> bytes: ...
      @overload
      def utf8(value: str) -> bytes: ...
      def utf8(value):
          # implementation goes here
```

The typing docs and PEP 484 say similar things.  
typing docs - https://docs.python.org/3/library/typing.html#typing.overload  
PEP 484 - https://www.python.org/dev/peps/pep-0484/#function-method-overloading

Jelle Zijlstra told me to report this here. https://github.com/python/mypy/issues/9633#issuecomment-716201251

> You should annotate the implementation. The example in the typing docs should perhaps also add an annotation, but that's an issue for the CPython repo, not for mypy.

Either way mypy errors which can be seen in the following playgrounds.

docs - https://mypy-play.net/?mypy=latest&python=3.9&flags=strict&gist=cffb94a2de9d5d55142da5e7d960102f
```
main.py:9: error: Function is missing a type annotation
Found 1 error in 1 file (checked 1 source file)
```

proper way? - https://mypy-play.net/?mypy=latest&python=3.9&gist=bfadffe92571b4faad04ea151b2b1c54
```
main.py:3: error: An overloaded function outside a stub file must have an implementation
Found 1 error in 1 file (checked 1 source file)
```

Is all the documentation on `typing.overload` wrong - should the implementation be annotated?

----------
assignee: docs at python
components: Documentation
messages: 379754
nosy: docs at python, peilonrayz
priority: normal
severity: normal
status: open
title: Apparently all documentation on @typing.overload is wrong
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42169>
_______________________________________

From report at bugs.python.org  Tue Oct 27 08:27:15 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Tue, 27 Oct 2020 12:27:15 +0000
Subject: [issue42165] closed (reopen with other issue)
In-Reply-To: <1603782198.74.0.214609178007.issue42165@roundup.psfhosted.org>
Message-ID: <1603801635.05.0.670828510866.issue42165@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

To answer the question:

> "can anyone explain why "pickle.loads(np.float64(0.34104))" prints "True"

You can use pickletools.dis:

>>> bytes(np.float64(0.34104))
b'\x88.\xa8o\x99\xd3\xd5?'

>>> pickletools.dis(bytes(np.float64(0.34104)))
    0: \x88 NEWTRUE
    1: .    STOP

Note that pickle ignores anything after the end of the pickle (the STOP opcode), so only the first 2 bytes are being used.

As Serhiy said, it's just chance that the bytes returned by numpy happen to be a valid pickle for some values. You should not be trying to .loads() something that isn't a valid pickle stream. It's not clear why you think a byte string returned by np.float64 would be a valid pickle.

----------
nosy: +eric.smith
stage: resolved -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42165>
_______________________________________

From report at bugs.python.org  Tue Oct 27 08:41:14 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 27 Oct 2020 12:41:14 +0000
Subject: [issue42165] closed (reopen with other issue)
In-Reply-To: <1603782198.74.0.214609178007.issue42165@roundup.psfhosted.org>
Message-ID: <1603802474.75.0.904620771659.issue42165@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42165>
_______________________________________

From report at bugs.python.org  Tue Oct 27 09:05:21 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Tue, 27 Oct 2020 13:05:21 +0000
Subject: [issue42163] _replace() no longer works on platform.uname_result
 objects
In-Reply-To: <1603750912.81.0.950571190169.issue42163@roundup.psfhosted.org>
Message-ID: <1603803921.52.0.521505084046.issue42163@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
assignee:  -> jaraco

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42163>
_______________________________________

From report at bugs.python.org  Tue Oct 27 09:05:06 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Tue, 27 Oct 2020 13:05:06 +0000
Subject: [issue42163] _replace() no longer works on platform.uname_result
 objects
In-Reply-To: <1603750912.81.0.950571190169.issue42163@roundup.psfhosted.org>
Message-ID: <1603803906.94.0.100014384552.issue42163@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

Indeed, it was unexpected that consumers of the `uname_result` were using `_replace`. In fact, the focus of the tests is on ensuring that users are able to access the items by index, e.g. `uname()[0]`.

It should be possible to support `_replace` on the `uname_result` as found in Python 3.9+. The real question is - is it important enough to declare and restore support for this use case based on this one report (and likely handful of other cases), or would it be better to discourage use of `_replace` for `uname_result` and provide a straightforward workaround (to be documented here) for those use-cases to employ?

Marc, do you have an opinion?

----------
nosy: +lemburg -rhettinger
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42163>
_______________________________________

From report at bugs.python.org  Tue Oct 27 09:55:36 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 13:55:36 +0000
Subject: [issue39573] [C API] Make PyObject an opaque structure in the limited
 C API
In-Reply-To: <1581030432.16.0.48160379721.issue39573@roundup.psfhosted.org>
Message-ID: <1603806936.43.0.714099716913.issue39573@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Miro:
> This also breaks pycurl:
> https://github.com/pycurl/pycurl/pull/660

Right, see my previous comment, another PR was already proposed in May!

me:
> This change broke pycurl:
> https://github.com/pycurl/pycurl/pull/636

Merged pycurl fix:
https://github.com/pycurl/pycurl/commit/e633f9a1ac4df5e249e78c218d5fbbd848219042

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39573>
_______________________________________

From report at bugs.python.org  Tue Oct 27 10:09:04 2020
From: report at bugs.python.org (Quentin Peter)
Date: Tue, 27 Oct 2020 14:09:04 +0000
Subject: [issue42170] splitdrive fails for UNC path with the "\\?\UNC\" prefix.
Message-ID: <1603807744.11.0.30805370189.issue42170@roundup.psfhosted.org>


Change by Quentin Peter <qpeter at bluewin.ch>:


----------
components: Library (Lib)
nosy: qpeter
priority: normal
severity: normal
status: open
title: splitdrive fails for UNC path with the "\\?\UNC\" prefix.
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42170>
_______________________________________

From report at bugs.python.org  Tue Oct 27 10:09:28 2020
From: report at bugs.python.org (Quentin Peter)
Date: Tue, 27 Oct 2020 14:09:28 +0000
Subject: [issue42170] splitdrive fails for UNC path with the "\\?\UNC\" prefix.
Message-ID: <1603807768.89.0.439108137807.issue42170@roundup.psfhosted.org>


New submission from Quentin Peter <qpeter at bluewin.ch>:

Python 3.7.6 (default, Jan  8 2020, 20:23:39) [MSC v.1916 64 bit (AMD64)]
Type "copyright", "credits" or "license" for more information.

IPython 7.18.1 -- An enhanced Interactive Python.

In [1]: import os.path

In [2]: os.path.splitdrive(r"\\machine\mountpoint\directory")
Out[2]: ('\\\\machine\\mountpoint', '\\directory')

In [3]: os.path.splitdrive(r"\\?\UNC\machine\mountpoint\directory")
Out[3]: ('\\\\?\\UNC', '\\machine\\mountpoint\\directory')

In [4]:

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42170>
_______________________________________

From report at bugs.python.org  Tue Oct 27 10:11:28 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 14:11:28 +0000
Subject: [issue39573] [C API] Make PyObject an opaque structure in the limited
 C API
In-Reply-To: <1581030432.16.0.48160379721.issue39573@roundup.psfhosted.org>
Message-ID: <1603807888.63.0.00786636927824.issue39573@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Miro:
> I don't understand the rationale for this change in depth, but does the benefit outweigh (yet another) backwards incompatibility?

I wrote PEP 620 "Hide implementation details from the C API" to explain the rationale:
https://www.python.org/dev/peps/pep-0620/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39573>
_______________________________________

From report at bugs.python.org  Tue Oct 27 10:11:30 2020
From: report at bugs.python.org (Quentin Peter)
Date: Tue, 27 Oct 2020 14:11:30 +0000
Subject: [issue42170] splitdrive fails for UNC path with the "\\?\UNC\" prefix.
In-Reply-To: <1603807768.89.0.439108137807.issue42170@roundup.psfhosted.org>
Message-ID: <1603807890.3.0.841108842727.issue42170@roundup.psfhosted.org>


Change by Quentin Peter <qpeter at bluewin.ch>:


----------
keywords: +patch
pull_requests: +21916
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23001

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42170>
_______________________________________

From report at bugs.python.org  Tue Oct 27 10:18:18 2020
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 27 Oct 2020 14:18:18 +0000
Subject: [issue42170] splitdrive fails for UNC path with the "\\?\UNC\" prefix.
In-Reply-To: <1603807768.89.0.439108137807.issue42170@roundup.psfhosted.org>
Message-ID: <1603808298.75.0.877997386653.issue42170@roundup.psfhosted.org>


Change by Eryk Sun <eryksun at gmail.com>:


----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> support "UNC" device paths in ntpath.splitdrive

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42170>
_______________________________________

From report at bugs.python.org  Tue Oct 27 10:15:54 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Tue, 27 Oct 2020 14:15:54 +0000
Subject: [issue42168] Question about deserializing some numbers (bug??)
In-Reply-To: <1603793442.12.0.906245378018.issue42168@roundup.psfhosted.org>
Message-ID: <1603808154.37.0.416373142217.issue42168@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I explained this in https://bugs.python.org/issue42165#msg379755

This is not a bug in python, it's a bug in your code. You should not expect to unpickle something that wasn't created by pickling it.

----------
nosy: +eric.smith
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42168>
_______________________________________

From report at bugs.python.org  Tue Oct 27 10:32:39 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 27 Oct 2020 14:32:39 +0000
Subject: [issue42111] Make the xxlimited module an example of best extension
 module practices
In-Reply-To: <1603310336.9.0.27411366123.issue42111@roundup.psfhosted.org>
Message-ID: <1603809159.39.0.608561786657.issue42111@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
assignee:  -> petr.viktorin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42111>
_______________________________________

From report at bugs.python.org  Tue Oct 27 10:29:50 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Tue, 27 Oct 2020 14:29:50 +0000
Subject: [issue42168] Question about deserializing some numbers (bug??)
In-Reply-To: <1603793442.12.0.906245378018.issue42168@roundup.psfhosted.org>
Message-ID: <1603808990.7.0.871845810202.issue42168@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Or stated differently: if you pass random byte strings to pickle.loads(), sometimes it might succeed and produce a random object because you've managed to create a valid pickle. But most often it will fail.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42168>
_______________________________________

From report at bugs.python.org  Tue Oct 27 10:50:49 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 27 Oct 2020 14:50:49 +0000
Subject: [issue42171] Add PEP 573 to the stable ABI
Message-ID: <1603810249.77.0.333997046365.issue42171@roundup.psfhosted.org>


New submission from Petr Viktorin <encukou at gmail.com>:

The following PEP 573 were not added to the Windows list of stable ABI symbols (PC/python3dll.c):
- PyModule_AddType
- PyType_FromModuleAndSpec
- PyType_GetModule
- PyType_GetModuleState

I'd like to add them.

Also, the PEP introduces the (METH_FASTCALL | METH_KEYWORDS | METH_METHOD) calling convention, but METH_FASTCALL is not part of the stable ABI (and it other uses are not suitable for stable ABI).
I propose adding a new value, METH_METHOD_ARGS_KWD (name up for bikeshedding), which would be equal to (METH_FASTCALL | METH_KEYWORDS | METH_METHOD) but part of the limited API.

Does that sound like a good idea?


On the sprint, Steve mentioned that it would be possible to backport this to Python 3.9.1, even though it would mean a weird minor-version requirement.
I no longer think that's a good idea: fixing the stable ABI will be a longer-term project, and I don't want to fight issues in a 3.9 backport.

FWIW, for the longer-term project, I started a brainstorming repo at https://github.com/encukou/abi3 (Yes, it has some overlap with Victor's more general notes at https://pythoncapi.readthedocs.io/ )
But I'd like to get the additions above in to unblock #42111 before I start on improving the stable ABI in general.

----------
components: C API
messages: 379762
nosy: ncoghlan, petr.viktorin, scoder, vstinner
priority: normal
severity: normal
status: open
title: Add PEP 573 to the stable ABI
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42171>
_______________________________________

From report at bugs.python.org  Tue Oct 27 10:57:48 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 14:57:48 +0000
Subject: [issue32659] Solaris "stat" should support "st_fstype"
In-Reply-To: <1516841214.25.0.467229070634.issue32659@psf.upfronthosting.co.za>
Message-ID: <1603810668.26.0.823932904948.issue32659@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32659>
_______________________________________

From report at bugs.python.org  Tue Oct 27 11:12:18 2020
From: report at bugs.python.org (Akashkumar D Khunt)
Date: Tue, 27 Oct 2020 15:12:18 +0000
Subject: [issue42172] Typo in test library for test_socket.py
Message-ID: <1603811538.08.0.134266779609.issue42172@roundup.psfhosted.org>


New submission from Akashkumar D Khunt <akashdkhunt at gmail.com>:

There is a typo in test_socket.py file where instead of ?testSecondCmsgTruncInData? function name is ?testSecomdCmsgTruncInData?.

----------
components: Tests
messages: 379763
nosy: adkhunt
priority: normal
severity: normal
status: open
title: Typo in test library for test_socket.py
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42172>
_______________________________________

From report at bugs.python.org  Tue Oct 27 11:17:59 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 27 Oct 2020 15:17:59 +0000
Subject: [issue42172] Typo in test library for test_socket.py
In-Reply-To: <1603811538.08.0.134266779609.issue42172@roundup.psfhosted.org>
Message-ID: <1603811879.78.0.425278992056.issue42172@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

@adkhunt
Do you want to submit the patch for this?
If you want, please ping me on your PR

----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42172>
_______________________________________

From report at bugs.python.org  Tue Oct 27 11:22:07 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 27 Oct 2020 15:22:07 +0000
Subject: [issue42171] Add PEP 573 to the stable ABI
In-Reply-To: <1603810249.77.0.333997046365.issue42171@roundup.psfhosted.org>
Message-ID: <1603812127.77.0.522316196108.issue42171@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

> I'd like to add it anyway.
Nice ;)

----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42171>
_______________________________________

From report at bugs.python.org  Tue Oct 27 11:18:09 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 27 Oct 2020 15:18:09 +0000
Subject: [issue42172] Typo in test library for test_socket.py
In-Reply-To: <1603811538.08.0.134266779609.issue42172@roundup.psfhosted.org>
Message-ID: <1603811889.02.0.571840016546.issue42172@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
versions: +Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42172>
_______________________________________

From report at bugs.python.org  Tue Oct 27 11:20:34 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 27 Oct 2020 15:20:34 +0000
Subject: [issue42171] Add PEP 573 to the stable ABI
In-Reply-To: <1603810249.77.0.333997046365.issue42171@roundup.psfhosted.org>
Message-ID: <1603812034.39.0.470517720363.issue42171@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Correction: PyModule_AddType is not from PEP 573. I'd like to add it anyway.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42171>
_______________________________________

From report at bugs.python.org  Tue Oct 27 11:59:08 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 15:59:08 +0000
Subject: [issue42173] Drop Solaris support
Message-ID: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

In past years, very few Python core developers took care of the Solaris support. The latest significant Solaris enhancement was in 2018 with the addition of a new Solaris st_fstype attribute to os.stat(), in Python 3.7, by Jes?s Cea Avi?n (bpo-32659).

Another recent Solaris-related change is bpo-41687: "Fix implementation of sendfile to be compatible with Solaris".

On the Oracle side, there was an article about Python on Solaris in 2019:
"Future of Python on Solaris" by  Darren Moffat 
https://blogs.oracle.com/solaris/future-of-python-on-solaris

I now that Giampaolo Rodola cares of the Solaris support for his psutil project:
https://github.com/giampaolo/psutil/

It's unclear to me if Oracle still plans to maintain Solaris. The latest release was published 2 years ago. The Wikipedia article says: "While Oracle did have a large layoff of Solaris development engineering staff, development continues today of which Solaris 11.4 was released in 2018."
https://en.wikipedia.org/wiki/Solaris_(operating_system)

There is currently 25 open issues which could be closed if we drop the Solaris support.

See also the PEP 11 for the process.

I asked asked 4 years ago (in 2016) if Solaris support should/can be removed:
"OpenIndiana and Solaris support"
https://mail.python.org/archives/list/python-dev at python.org/message/NOT2RORSNX72ZLUHK2UUGBD4GTPNKBUS/

Python has no longer buildbot workers running on Solaris or a Solaris variant (OpenIndiana, Illumos, etc.).

I propose to drop the Solaris support in Python to reduce the maintenance burden.

Python has a few features specific to Solaris:

* st_fstype attribute of os.stat()
* select.devpoll and selectors.DevpollSelector
* time.CLOCK_HIGHRES constant
* stat.S_ISDOOR()
* tarfile: "Solaris extended header" (no need to remove this one)

Solaris has many names and variants:

* SunOS
* SRV4
* Solaris
* Illumos (still active in July 2020 at least)
* OpenSolaris: "On Friday, August 13, 2010, details started to emerge relating to the discontinuation of the OpenSolaris project and the pending release of a new closed-source, proprietary version of Solaris, Solaris 11." says Wikipedia
* OpenIndiana (latest release in 2020)

I'm not sure on how to process? Deprecate all Solaris-specific features in Python 3.10, make sure that Python 3.11 cannot be built on Solaris anymore, and drop the code in Python 3.12? Or drop everything as soon as possible in Python 3.10?

The alternative is to leave the code unchanged and let the code slowly die, as we did for other platforms like HP-UX and IRIX.

See also my notes on platforms supported by Python:
https://pythondev.readthedocs.io/platforms.html

Attached draft PR gives an idea on how much code can be removed if Solaris support is removed. A coase estimation is the removal of 700 lines:

 Doc/c-api/init.rst                           |   3 +-
 Doc/distutils/apiref.rst                     |   1 -
 Doc/library/gettext.rst                      |  10 +-
 Doc/library/os.rst                           |  12 +-
 Doc/library/platform.rst                     |   5 +-
 Doc/library/posix.rst                        |   8 +-
 Doc/library/sys.rst                          |   3 +-
 Doc/library/sysconfig.rst                    |   1 -
 Doc/library/time.rst                         |  13 +-
 Doc/using/unix.rst                           |   7 -
 Include/pyport.h                             |   5 -
 Lib/cgi.py                                   |   4 +-
 Lib/ctypes/test/test_byteswap.py             |   2 +-
 Lib/ctypes/util.py                           | 100 ++--------
 Lib/distutils/command/bdist.py               |   2 +-
 Lib/distutils/tests/support.py               |   2 +-
 Lib/distutils/tests/test_build_ext.py        |  21 --
 Lib/distutils/util.py                        |  11 --
 Lib/gettext.py                               |   3 -
 Lib/logging/handlers.py                      |   2 -
 Lib/platform.py                              |  27 +--
 Lib/sysconfig.py                             |  11 --
 Lib/test/fork_wait.py                        |   4 +-
 Lib/test/subprocessdata/fd_status.py         |   3 -
 Lib/test/test__locale.py                     |  24 ---
 Lib/test/test_asyncio/test_sendfile.py       |   6 -
 Lib/test/test_asyncore.py                    |   2 -
 Lib/test/test_cmd_line.py                    |   2 +-
 Lib/test/test_curses.py                      |   2 +-
 Lib/test/test_fileio.py                      |   2 +-
 Lib/test/test_importlib/import_/test_path.py |   2 +-
 Lib/test/test_locale.py                      |   2 +-
 Lib/test/test_os.py                          |  14 +-
 Lib/test/test_posix.py                       |   7 +-
 Lib/test/test_pty.py                         |   4 -
 Lib/test/test_selectors.py                   |   2 +-
 Lib/test/test_shutil.py                      |   2 +-
 Lib/test/test_socket.py                      |   4 -
 Lib/test/test_strftime.py                    |   3 +-
 Lib/test/test_sys.py                         |   2 +-
 Lib/uuid.py                                  |   5 -
 Modules/Setup                                |   4 -
 Modules/_ctypes/ctypes.h                     |   4 -
 Modules/_cursesmodule.c                      |   2 +-
 Modules/_multiprocessing/multiprocessing.h   |  15 --
 Modules/_posixsubprocess.c                   |  11 --
 Modules/errnomodule.c                        |  23 +--
 Modules/mathmodule.c                         |   2 +-
 Modules/posixmodule.c                        |  65 +-----
 Modules/signalmodule.c                       |   2 +-
 Modules/socketmodule.c                       |   7 -
 Modules/termios.c                            |   8 +-
 Modules/timemodule.c                         |   9 +-
 Python/bootstrap_hash.c                      |  17 +-
 Python/fileutils.c                           |   3 +-
 Python/import.c                              |   3 +-
 Tools/freeze/README                          |   5 -
 Tools/i18n/pygettext.py                      |   3 +-
 Tools/pynche/Main.py                         |   2 -
 Tools/pynche/README                          |   2 +-
 Tools/scripts/nm2def.py                      |   2 +-
 configure                                    | 285 +--------------------------
 configure.ac                                 | 101 +---------
 pyconfig.h.in                                |  19 +-
 setup.py                                     |  20 +-
 65 files changed, 91 insertions(+), 868 deletions(-)

----------
components: Interpreter Core
messages: 379767
nosy: giampaolo.rodola, jcea, pablogsal, vstinner
priority: normal
severity: normal
status: open
title: Drop Solaris support
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:01:47 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Tue, 27 Oct 2020 16:01:47 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1603814507.03.0.807492148773.issue42173@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:02:24 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 16:02:24 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1603814544.21.0.678002384041.issue42173@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +21917
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23002

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:10:33 2020
From: report at bugs.python.org (Ken Jin)
Date: Tue, 27 Oct 2020 16:10:33 +0000
Subject: [issue42169] Apparently all documentation on @typing.overload is wrong
In-Reply-To: <1603796392.82.0.758366735277.issue42169@roundup.psfhosted.org>
Message-ID: <1603815033.3.0.939853933251.issue42169@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
nosy: +gvanrossum, kj, levkivskyi
versions:  -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42169>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:11:40 2020
From: report at bugs.python.org (Ken Jin)
Date: Tue, 27 Oct 2020 16:11:40 +0000
Subject: [issue42169] Apparently all documentation on @typing.overload is wrong
In-Reply-To: <1603796392.82.0.758366735277.issue42169@roundup.psfhosted.org>
Message-ID: <1603815100.7.0.988710293541.issue42169@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
versions: +Python 3.6, Python 3.7 -Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42169>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:13:12 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 16:13:12 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603815192.53.0.482372563108.issue42161@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 37834136d0afe51d274bfc79d8705514cbe73727 by Victor Stinner in branch 'master':
bpo-42161: Modules/ uses _PyLong_GetZero() and _PyLong_GetOne() (GH-22998)
https://github.com/python/cpython/commit/37834136d0afe51d274bfc79d8705514cbe73727


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:16:03 2020
From: report at bugs.python.org (Ken Jin)
Date: Tue, 27 Oct 2020 16:16:03 +0000
Subject: [issue42169] Apparently all documentation on @typing.overload is wrong
In-Reply-To: <1603796392.82.0.758366735277.issue42169@roundup.psfhosted.org>
Message-ID: <1603815363.47.0.731192283177.issue42169@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

Apologies to all for the spam, I made a misclick. 

Maybe the documentation could be clearer for that specific example. The following code seems to work on mypy (in a non-stub file):
```
from typing import overload, Any, Optional

@overload
def utf8(value: None) -> None: 
    ...
@overload
def utf8(value: bytes) -> bytes: 
    ...
def utf8(value: Optional[bytes]) -> Optional[bytes]:
    if value is None:
        return None
    return b''
```
But I don't know if that's the intended usage, because that makes overload appear rather redundant.

----------
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42169>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:16:49 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 16:16:49 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603815409.51.0.00463324965737.issue42161@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21918
pull_request: https://github.com/python/cpython/pull/23003

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:19:14 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 27 Oct 2020 16:19:14 +0000
Subject: [issue6761] Class calling
In-Reply-To: <1250961239.16.0.126736964049.issue6761@psf.upfronthosting.co.za>
Message-ID: <1603815554.41.0.197353808889.issue6761@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 6.0 -> 7.0
pull_requests: +21919
pull_request: https://github.com/python/cpython/pull/23004

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6761>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:19:22 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 27 Oct 2020 16:19:22 +0000
Subject: [issue6761] Class calling
In-Reply-To: <1250961239.16.0.126736964049.issue6761@psf.upfronthosting.co.za>
Message-ID: <1603815562.41.0.70851030181.issue6761@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21920
pull_request: https://github.com/python/cpython/pull/23005

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6761>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:19:05 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 16:19:05 +0000
Subject: [issue6761] Class calling
In-Reply-To: <1250961239.16.0.126736964049.issue6761@psf.upfronthosting.co.za>
Message-ID: <1603815545.39.0.0333681487979.issue6761@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 95f710c55714153f0c8cce48f8215bb3d866ac1d by Andre Delfino in branch 'master':
bpo-6761: Enhance __call__ documentation (GH-7987)
https://github.com/python/cpython/commit/95f710c55714153f0c8cce48f8215bb3d866ac1d


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6761>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:26:09 2020
From: report at bugs.python.org (Ken Jin)
Date: Tue, 27 Oct 2020 16:26:09 +0000
Subject: [issue42162] The license page for Python 3.0 is messed up
In-Reply-To: <1603750620.18.0.975456176895.issue42162@roundup.psfhosted.org>
Message-ID: <1603815969.97.0.228625796083.issue42162@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

Python 3.0.x is no longer being maintained. As such I don't think there's a way for a fix to be ported over. I might be wrong though.

----------
nosy: +kj

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42162>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:28:09 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 27 Oct 2020 16:28:09 +0000
Subject: [issue6761] Class calling
In-Reply-To: <1250961239.16.0.126736964049.issue6761@psf.upfronthosting.co.za>
Message-ID: <1603816089.25.0.376520567435.issue6761@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b1ce0440bfe87e092ca5e2e57875fb7fc1129137 by Miss Skeleton (bot) in branch '3.8':
bpo-6761: Enhance __call__ documentation (GH-7987)
https://github.com/python/cpython/commit/b1ce0440bfe87e092ca5e2e57875fb7fc1129137


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6761>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:32:31 2020
From: report at bugs.python.org (Florian Bruhin)
Date: Tue, 27 Oct 2020 16:32:31 +0000
Subject: [issue42174] shutil.get_terminal_size() returns 0 when run in a pty
Message-ID: <1603816351.29.0.440046743483.issue42174@roundup.psfhosted.org>


New submission from Florian Bruhin <python.org at the-compiler.org>:

When shutil.get_terminal_size() is used in a PTY, the os.get_terminal_size() call can return (0, 0).

With the pty script from https://github.com/python/mypy/issues/8144#issue-537760245:

$ python3 t.py python3 -c 'import shutil; print(shutil.get_terminal_size())'        
os.terminal_size(columns=0, lines=0)

While the following cases *are* handled by returning the fallback:

- COLUMNS or lines being non-existent or 0
- os.get_terminal_size raising

The case of os.get_terminal_size() succeeding but returning (0, 0) should probably be handled the same way as well.

This e.g. affects mypy when run with pre-commit:
https://github.com/pre-commit/mirrors-mypy/issues/29

----------
components: Library (Lib)
messages: 379773
nosy: The Compiler, giampaolo.rodola, tarek
priority: normal
severity: normal
status: open
title: shutil.get_terminal_size() returns 0 when run in a pty
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42174>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:42:46 2020
From: report at bugs.python.org (miss-islington)
Date: Tue, 27 Oct 2020 16:42:46 +0000
Subject: [issue6761] Class calling
In-Reply-To: <1250961239.16.0.126736964049.issue6761@psf.upfronthosting.co.za>
Message-ID: <1603816966.64.0.824039870396.issue6761@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 2cb259fcf3cde56f359c2f393280689784dcc834 by Miss Skeleton (bot) in branch '3.9':
bpo-6761: Enhance __call__ documentation (GH-7987)
https://github.com/python/cpython/commit/2cb259fcf3cde56f359c2f393280689784dcc834


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6761>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:46:37 2020
From: report at bugs.python.org (kannan)
Date: Tue, 27 Oct 2020 16:46:37 +0000
Subject: [issue42166] corrupted size vs. prev_size
In-Reply-To: <1603786975.91.0.349324369107.issue42166@roundup.psfhosted.org>
Message-ID: <1603817197.51.0.927935616946.issue42166@roundup.psfhosted.org>


kannan <kannaninfo93 at gmail.com> added the comment:

Thanks for the reply Christian Heimes
Environment details

1). os - centos 7
2). python - 3.7.3

python installed inside docker container and we are using AWS ECS with fargate for docker container deployment
while installing python37 we are copying below files

cp /usr/local/lib/libpython3.7m.so.1.0 /lib64/libpython3.7m.so.1.0
cp /usr/local/lib/python3.7 /usr/local/lib/python3.7

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42166>
_______________________________________

From report at bugs.python.org  Tue Oct 27 12:47:45 2020
From: report at bugs.python.org (kannan)
Date: Tue, 27 Oct 2020 16:47:45 +0000
Subject: [issue42166] corrupted size vs. prev_size
In-Reply-To: <1603786975.91.0.349324369107.issue42166@roundup.psfhosted.org>
Message-ID: <1603817265.66.0.326890989952.issue42166@roundup.psfhosted.org>


kannan <kannaninfo93 at gmail.com> added the comment:

we didn't compile the _ssl module

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42166>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:01:06 2020
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 27 Oct 2020 17:01:06 +0000
Subject: [issue42166] corrupted size vs. prev_size
In-Reply-To: <1603786975.91.0.349324369107.issue42166@roundup.psfhosted.org>
Message-ID: <1603818066.79.0.165942564211.issue42166@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Why are you copying the file around?

How did you install Python 3.7 in the first place. AFAIK CentOS 7 does not come with Python 3.7.

Python 3.7.3 is old and no longer supported. Can you upgrade to a more recent version of 3.7?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42166>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:12:45 2020
From: report at bugs.python.org (kannan)
Date: Tue, 27 Oct 2020 17:12:45 +0000
Subject: [issue42166] corrupted size vs. prev_size
In-Reply-To: <1603786975.91.0.349324369107.issue42166@roundup.psfhosted.org>
Message-ID: <1603818765.71.0.993820542174.issue42166@roundup.psfhosted.org>


kannan <kannaninfo93 at gmail.com> added the comment:

This error happens randomly and we couldn't able to reproduce the error.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42166>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:15:04 2020
From: report at bugs.python.org (kannan)
Date: Tue, 27 Oct 2020 17:15:04 +0000
Subject: [issue42166] corrupted size vs. prev_size
In-Reply-To: <1603786975.91.0.349324369107.issue42166@roundup.psfhosted.org>
Message-ID: <1603818904.83.0.0226672918544.issue42166@roundup.psfhosted.org>


kannan <kannaninfo93 at gmail.com> added the comment:

we are installing python using wget
https://www.python.org/ftp/python/3.7.3/Python-3.7.3.tgz
export LD_LIBRARY_PATH=/usr/local/Python3.7/lib
export PATH="/usr/local/bin:$PATH"

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42166>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:15:45 2020
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 27 Oct 2020 17:15:45 +0000
Subject: [issue37609] support "UNC" device paths in ntpath.splitdrive
In-Reply-To: <1563362794.09.0.456380769613.issue37609@roundup.psfhosted.org>
Message-ID: <1603818945.93.0.600912597211.issue37609@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

I'm attaching a rewrite of splitdrive() from msg352355. This version uses an internal _next() function to get the indices of the next path component, ignoring repeated separators. It also flattens the nested structure of the previous implementation by adding multiple return statements.

----------
Added file: https://bugs.python.org/file49541/splitdrive.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37609>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:27:48 2020
From: report at bugs.python.org (Bojan Jovanovic)
Date: Tue, 27 Oct 2020 17:27:48 +0000
Subject: [issue36457] functools.singledispatchmethod interacts poorly with
 subclasses
In-Reply-To: <1553744559.32.0.207343635807.issue36457@roundup.psfhosted.org>
Message-ID: <1603819668.06.0.958225567507.issue36457@roundup.psfhosted.org>


Change by Bojan Jovanovic <bojan.jovanovic.gtech at gmail.com>:


----------
nosy: +bojan.jovanovic.gtech

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36457>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:33:00 2020
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 27 Oct 2020 17:33:00 +0000
Subject: [issue42166] corrupted size vs. prev_size
In-Reply-To: <1603786975.91.0.349324369107.issue42166@roundup.psfhosted.org>
Message-ID: <1603819980.59.0.130968932241.issue42166@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

There isn't much I can do for you. CentOS 7 has OpenSSL 1.0.2. There might be a threading issue in OpenSSL or Python. Both Python 3.7.3 and OpenSSL 1.0.2 are no longer supported. The minimum supported versions are OpenSSL 1.1.1 and Python 3.7.9.  You'd have to update to CentOS 8 to get a more recent OpenSSL version.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42166>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:36:50 2020
From: report at bugs.python.org (Sagar Pant)
Date: Tue, 27 Oct 2020 17:36:50 +0000
Subject: [issue42036] Unchecked return in Modules/posixmodule.c from multiple
 function calls
In-Reply-To: <1602688870.73.0.257118876464.issue42036@roundup.psfhosted.org>
Message-ID: <1603820210.73.0.200301003867.issue42036@roundup.psfhosted.org>


Sagar Pant <sagpant at microsoft.com> added the comment:

Bumping this up for updates.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42036>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:37:23 2020
From: report at bugs.python.org (Sagar Pant)
Date: Tue, 27 Oct 2020 17:37:23 +0000
Subject: [issue42034] Unchecked return in Objects/typeobject.c and possible
 uninitialized variables in cls and new_mro
In-Reply-To: <1602683248.52.0.780024334642.issue42034@roundup.psfhosted.org>
Message-ID: <1603820243.08.0.511609952751.issue42034@roundup.psfhosted.org>


Sagar Pant <sagpant at microsoft.com> added the comment:

Bumping this up for updates.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42034>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:37:22 2020
From: report at bugs.python.org (Anthony Sottile)
Date: Tue, 27 Oct 2020 17:37:22 +0000
Subject: [issue42175] long lines from interactive stdin are truncated
Message-ID: <1603820242.16.0.850917923233.issue42175@roundup.psfhosted.org>


New submission from Anthony Sottile <asottile at umich.edu>:

this was originally pointed out in a comment on my youtube video here: https://youtu.be/Xf_82stIbB8


here's a reproduction:

1. produce 5000 characters of output: python3 -c 'print("a"*5000)'
2. copy that to the clipboard
3. run this: python3 -c 'import sys; print(len(sys.stdin.read()))'
4. paste
5. press enter
6. ^D

I get the following:

$ python3 -c 'import sys; print(len(sys.stdin.read()))'
...
4096

but I expect the value to be 5001 (+1 for the \n)

----------
messages: 379783
nosy: Anthony Sottile
priority: normal
severity: normal
status: open
title: long lines from interactive stdin are truncated
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42175>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:44:13 2020
From: report at bugs.python.org (kannan)
Date: Tue, 27 Oct 2020 17:44:13 +0000
Subject: [issue42166] corrupted size vs. prev_size
In-Reply-To: <1603786975.91.0.349324369107.issue42166@roundup.psfhosted.org>
Message-ID: <1603820653.69.0.460169502782.issue42166@roundup.psfhosted.org>


kannan <kannaninfo93 at gmail.com> added the comment:

As you said we are using a threaded consumers in which main thread will create connection and listener thread will receive message.
We are passing main thread object to listener to acknowledge the message using connection object (conn.ack)

in connection class
self.conn = activemq stomp connection
self.listener_obj = ConsumerListener(self)

in listener class
self.conn = conn_obj_from_main_thread
self.conn.ack(msg_id, subscription)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42166>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:44:47 2020
From: report at bugs.python.org (Ammar Askar)
Date: Tue, 27 Oct 2020 17:44:47 +0000
Subject: [issue42175] long lines from interactive stdin are truncated
In-Reply-To: <1603820242.16.0.850917923233.issue42175@roundup.psfhosted.org>
Message-ID: <1603820687.8.0.61330097202.issue42175@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

This doesn't show up in piping so I think it might be a Linux terminal limitation. This thread claims a 4096 limit in cooked terminals, would you mind giving one of the work-arounds here a try and see if it that gets rid of it: https://unix.stackexchange.com/questions/131105/how-to-read-over-4k-input-without-new-lines-on-a-terminal

----------
nosy: +ammar2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42175>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:47:31 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 27 Oct 2020 17:47:31 +0000
Subject: [issue42169] Apparently all documentation on @typing.overload is wrong
In-Reply-To: <1603796392.82.0.758366735277.issue42169@roundup.psfhosted.org>
Message-ID: <1603820851.66.0.538383575888.issue42169@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

> The documentation for `typing.overload` says in a non-stub file the last definition shouldn't be typed.

Incorrect. It doesn't say it shouldn't be *typed*, it says it shouldn't be *decorated with @overload*, which is a different thing.

The example is correct, since no annotation is the same as annotating with `Any`.

But with `mypy --strict`, no annotation causes an error, so if you are using that, you have to add *some* annotation (e.g. `Any`).

In your final example, the overloads are not redundant, since only the overloads tell the type checker that the output type corresponds to the input type.

For more information, please see Gitter (linked from the typing home page).

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42169>
_______________________________________

From report at bugs.python.org  Tue Oct 27 13:49:11 2020
From: report at bugs.python.org (Anthony Sottile)
Date: Tue, 27 Oct 2020 17:49:11 +0000
Subject: [issue42175] long lines from interactive stdin are truncated
In-Reply-To: <1603820242.16.0.850917923233.issue42175@roundup.psfhosted.org>
Message-ID: <1603820951.41.0.753390443436.issue42175@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

indeed! that's it -- you learn something every day :)

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42175>
_______________________________________

From report at bugs.python.org  Tue Oct 27 14:47:11 2020
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 27 Oct 2020 18:47:11 +0000
Subject: [issue42175] long lines from interactive stdin are truncated
In-Reply-To: <1603820242.16.0.850917923233.issue42175@roundup.psfhosted.org>
Message-ID: <1603824431.28.0.586671796803.issue42175@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

For Windows see issue 41849. The legacy limit (i.e. PYTHONLEGACYWINDOWSSTDIO) for reading input via io.FileIO is 8K characters in Windows, but with io._WindowsConsoleIO, it's only 512 characters, which is far too small in general. The legacy implementation of input() based on C fgets() is capped at 4K characters in Windows, which is the same as a Linux terminal. The new implementation of input() in Windows (i.e. _PyOS_WindowsConsoleReadline) increases the limit to 16K characters. I'd like to see both cases increased to 32K characters, which is the length limit of a command line or file path in Windows.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42175>
_______________________________________

From report at bugs.python.org  Tue Oct 27 14:52:25 2020
From: report at bugs.python.org (Boris Staletic)
Date: Tue, 27 Oct 2020 18:52:25 +0000
Subject: [issue42176] Valgrind reports "Conditional jump or move depends on
 uninitialised value(s)" in `PyUnicode_AsEncodedString` and `PyUnicode_Decode`
Message-ID: <1603824745.38.0.0631624355024.issue42176@roundup.psfhosted.org>


New submission from Boris Staletic <boris.staletic at gmail.com>:

When running valgrind on a C code that calls `PyUnicode_AsEncodedString` and `PyUnicode_Decode`, valgrind reports that there's a conditional jump based on uninitialized variable, if the encoding is "latin1".

I am able to replicate the error 100% of the time, on Ubuntu 20.04, with python 3.9.0 installed with pyenv. I also have repro'd the error in my CI (link below). Steps to repro:

1. docker run -it ubuntu:20.04 /bin/bash
2. apt update
3. apt install valgrind gcc build-essential libssl-dev zlib1g-dev libbz2-dev libreadline-dev libsqlite3-dev wget curl llvm libncurses5-dev libncursesw5-dev xz-utils tk-dev libffi-dev liblzma-dev python-openssl git
4. curl https://pyenv.run | bash
5. export PATH="/root/.pyenv/bin:$PATH"
6. eval "$(pyenv init -)"
7. PYTHON_CONFIGURE_OPTS="--enable-shared" pyenv install 3.9.0
8. Take the attached C file.
9. gcc -ggdb3 -I/root/.pyenv/versions/3.9.0/include/python3.9 -L/root/.pyenv/versions/3.9.0/lib test2.c -lpython3.9
10. LD_LIBRARY_PATH=/root/.pyenv/versions/3.9.0/lib/ PYTHONMALLOC=malloc valgrind ./a.out

Valgrind output:

==22783== Conditional jump or move depends on uninitialised value(s)
==22783==    at 0x49ABE64: PyUnicode_Decode (unicodeobject.c:3443)
==22783==    by 0x49ABE64: PyUnicode_Decode (unicodeobject.c:3398)
==22783==    by 0x109251: main (test2.c:5)
==22783==
==22783== Conditional jump or move depends on uninitialised value(s)
==22783==    at 0x499A294: PyUnicode_AsEncodedString (unicodeobject.c:3732)
==22783==    by 0x499A294: PyUnicode_AsEncodedString (unicodeobject.c:3688)
==22783==    by 0x10926D: main (test2.c:6)


CI log: https://dev.azure.com/borisstaletic/3ce92110-caa5-4c49-b8c3-44a433da676b/_apis/build/builds/1338/logs/6
Repository for testing the bug: https://github.com/bstaletic/ycmd/tree/python-error

----------
components: Interpreter Core
files: test.c
messages: 379790
nosy: bstaletic
priority: normal
severity: normal
status: open
title: Valgrind reports "Conditional jump or move depends on uninitialised value(s)" in `PyUnicode_AsEncodedString` and `PyUnicode_Decode`
type: compile error
versions: Python 3.9
Added file: https://bugs.python.org/file49542/test.c

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42176>
_______________________________________

From report at bugs.python.org  Tue Oct 27 14:53:33 2020
From: report at bugs.python.org (Brian Kohan)
Date: Tue, 27 Oct 2020 18:53:33 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603824813.94.0.592521996609.issue42096@roundup.psfhosted.org>


Brian Kohan <bckohan at gmail.com> added the comment:

I concur with Gregory. It seems that the action here is to just make it apparent in the docs the very real possibility of false positives.

In my experience processing data from the wild, I see a pretty high rate of about 1/1000. I'm sure the probability is a function of the types of files I'm working with. But in any case, is_zipfile can't be made to be sufficient in and of itself for reliably identifying zip files. It still has utility in weeding out true negatives though. In my case I don't ever expect to see a self extracting file or a file compounded into an executable so I use the results of is_zipfile as well as a manual check of the magic bytes at the start. So far so good.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Tue Oct 27 14:54:29 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Tue, 27 Oct 2020 18:54:29 +0000
Subject: [issue41659] PEG discrepancy on 'if {x} {a}: pass'
In-Reply-To: <1598650995.75.0.684602655166.issue41659@roundup.psfhosted.org>
Message-ID: <1603824869.37.0.0237078082273.issue41659@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:


New changeset 15acc4eaba8519d7d5f2acaffde65446b44dcf79 by Lysandros Nikolaou in branch 'master':
bpo-41659: Disallow curly brace directly after primary (GH-22996)
https://github.com/python/cpython/commit/15acc4eaba8519d7d5f2acaffde65446b44dcf79


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41659>
_______________________________________

From report at bugs.python.org  Tue Oct 27 14:56:02 2020
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 27 Oct 2020 18:56:02 +0000
Subject: [issue42099] Fix reference to ob_type in unionobject.c and ceval
In-Reply-To: <1603221539.38.0.388949807312.issue42099@roundup.psfhosted.org>
Message-ID: <1603824962.33.0.470721667214.issue42099@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:


New changeset 0564aafb71a153dd0aca4b9266dfae9336a4f2cb by Neil Schemenauer in branch 'master':
bpo-42099: Fix reference to ob_type in unionobject.c and ceval (GH-22829)
https://github.com/python/cpython/commit/0564aafb71a153dd0aca4b9266dfae9336a4f2cb


----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42099>
_______________________________________

From report at bugs.python.org  Tue Oct 27 14:56:34 2020
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Tue, 27 Oct 2020 18:56:34 +0000
Subject: [issue6761] Class calling
In-Reply-To: <1250961239.16.0.126736964049.issue6761@psf.upfronthosting.co.za>
Message-ID: <1603824994.23.0.0428202448201.issue6761@roundup.psfhosted.org>


Change by ?ric Araujo <merwok at netwok.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10, Python 3.9 -Python 2.6, Python 2.7, Python 3.1, Python 3.2, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6761>
_______________________________________

From report at bugs.python.org  Tue Oct 27 15:01:50 2020
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 27 Oct 2020 19:01:50 +0000
Subject: [issue42099] Fix reference to ob_type in unionobject.c and ceval
In-Reply-To: <1603221539.38.0.388949807312.issue42099@roundup.psfhosted.org>
Message-ID: <1603825310.89.0.847139455471.issue42099@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Thanks Neil

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42099>
_______________________________________

From report at bugs.python.org  Tue Oct 27 15:04:02 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Tue, 27 Oct 2020 19:04:02 +0000
Subject: [issue41659] PEG discrepancy on 'if {x} {a}: pass'
In-Reply-To: <1598650995.75.0.684602655166.issue41659@roundup.psfhosted.org>
Message-ID: <1603825442.52.0.380833109508.issue41659@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
pull_requests: +21921
pull_request: https://github.com/python/cpython/pull/23006

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41659>
_______________________________________

From report at bugs.python.org  Tue Oct 27 15:17:49 2020
From: report at bugs.python.org (Peilonrayz)
Date: Tue, 27 Oct 2020 19:17:49 +0000
Subject: [issue42169] Apparently all documentation on @typing.overload is wrong
In-Reply-To: <1603796392.82.0.758366735277.issue42169@roundup.psfhosted.org>
Message-ID: <1603826269.55.0.41672921583.issue42169@roundup.psfhosted.org>


Peilonrayz <peilonrayz at gmail.com> added the comment:

Thank you for the insight Guido. Sorry to be a bother everyone.

----------
resolution: not a bug -> 
versions: +Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42169>
_______________________________________

From report at bugs.python.org  Tue Oct 27 15:27:44 2020
From: report at bugs.python.org (Felix C. Stegerman)
Date: Tue, 27 Oct 2020 19:27:44 +0000
Subject: [issue42151] Pure Python xml.etree.ElementTree is missing default
 attribute values
In-Reply-To: <1603684290.04.0.0149631860455.issue42151@roundup.psfhosted.org>
Message-ID: <1603826864.32.0.116047770085.issue42151@roundup.psfhosted.org>


Felix C. Stegerman <flx at obfusk.net> added the comment:

> specified_attributes = True is also set in xml.dom.expatbuilder.

That's good to know and should perhaps be addressed as well.

> Should not it be set to true in the C implementation of ElementTree?

That would break existing code.  Including mine.

I also think the current behaviour of the C implementation makes a lot more sense, especially as there is currently no way to request the alternative.

I think using specified_attributes=False as the default behaviour for both implementations is the best solution.  But I certainly would not oppose adding e.g. a keyword argument to override the default behaviour for those who would prefer the alternative.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42151>
_______________________________________

From report at bugs.python.org  Tue Oct 27 15:38:26 2020
From: report at bugs.python.org (=?utf-8?q?Misty_De_M=C3=A9o?=)
Date: Tue, 27 Oct 2020 19:38:26 +0000
Subject: [issue41100] Build failure on macOS 11 (beta)
In-Reply-To: <1592999467.1.0.372512113251.issue41100@roundup.psfhosted.org>
Message-ID: <1603827506.88.0.567429133868.issue41100@roundup.psfhosted.org>


Change by Misty De M?o <mistydemeo at gmail.com>:


----------
nosy: +mistydemeo
nosy_count: 11.0 -> 12.0
pull_requests: +21922
pull_request: https://github.com/python/cpython/pull/22732

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41100>
_______________________________________

From report at bugs.python.org  Tue Oct 27 15:42:50 2020
From: report at bugs.python.org (Stavros Macrakis)
Date: Tue, 27 Oct 2020 19:42:50 +0000
Subject: [issue33896] Document what components make up the filecmp.cmp os.stat
 signature.
In-Reply-To: <1529345931.78.0.56676864532.issue33896@psf.upfronthosting.co.za>
Message-ID: <1603827770.58.0.941961479557.issue33896@roundup.psfhosted.org>


Stavros Macrakis <macrakis at gmail.com> added the comment:

I agree completely that the documentation should be more explicit. The concept of "os.stat signature" is not defined anywhere as far as I can tell. The naive reader (like me) might mistakenly assume that the "os.stat signature" is a "digital signature" (i.e. a hash) of all of os.stat, and in particular that it includes the st_ino.

I would suggest that the documentation be updated to read "If shallow is true, files with the same length, modification time, and mode are taken to be equal."

----------
nosy: +macrakis

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33896>
_______________________________________

From report at bugs.python.org  Tue Oct 27 15:50:25 2020
From: report at bugs.python.org (Lawrence D'Anna)
Date: Tue, 27 Oct 2020 19:50:25 +0000
Subject: [issue41100] Build failure on macOS 11 (beta)
In-Reply-To: <1592999467.1.0.372512113251.issue41100@roundup.psfhosted.org>
Message-ID: <1603828225.94.0.105030986473.issue41100@roundup.psfhosted.org>


Change by Lawrence D'Anna <lawrence_danna at apple.com>:


----------
pull_requests: +21923
pull_request: https://github.com/python/cpython/pull/21246

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41100>
_______________________________________

From report at bugs.python.org  Tue Oct 27 16:15:19 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 27 Oct 2020 20:15:19 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603829719.08.0.0883741055634.issue42161@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Why did you put _PyLong_GetOne() inside the loop for the fast path and outside the loop for the slow path?


==========================================================================
diff --git a/Modules/_collectionsmodule.c b/Modules/_collectionsmodule.c
index 8990071f51..0e6c64d1a6 100644
--- a/Modules/_collectionsmodule.c
+++ b/Modules/_collectionsmodule.c
@@ -2278,6 +2278,8 @@ _collections__count_elements_impl(PyObject *module, PyObject *mapping,
     PyObject *dict_get;
     PyObject *mapping_setitem;
     PyObject *dict_setitem;
+    PyObject *zero = _PyLong_GetZero();  // borrowed reference
+    PyObject *one = _PyLong_GetOne();    // borrowed reference

     it = PyObject_GetIter(iterable);
     if (it == NULL)
@@ -2324,10 +2326,10 @@ _collections__count_elements_impl(PyObject *module, PyObject *mapping,
             if (oldval == NULL) {
                 if (PyErr_Occurred())
                     goto done;
-                if (_PyDict_SetItem_KnownHash(mapping, key, _PyLong_GetOne(), hash) < 0)
+                if (_PyDict_SetItem_KnownHash(mapping, key, one, hash) < 0)
                     goto done;
             } else {
-                newval = PyNumber_Add(oldval, _PyLong_GetOne());
+                newval = PyNumber_Add(oldval, one);
                 if (newval == NULL)
                     goto done;
                 if (_PyDict_SetItem_KnownHash(mapping, key, newval, hash) < 0)
@@ -2341,8 +2343,6 @@ _collections__count_elements_impl(PyObject *module, PyObject *mapping,
         if (bound_get == NULL)
             goto done;

-        PyObject *zero = _PyLong_GetZero();  // borrowed reference
-        PyObject *one = _PyLong_GetOne();  // borrowed reference
         while (1) {
             key = PyIter_Next(it);
             if (key == NULL)

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Tue Oct 27 16:31:28 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 20:31:28 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603830688.55.0.155329283868.issue42161@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21924
pull_request: https://github.com/python/cpython/pull/23008

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Tue Oct 27 16:32:54 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 20:32:54 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603830774.87.0.273837313385.issue42161@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Why did you put _PyLong_GetOne() inside the loop for the fast path and outside the loop for the slow path?

Oh, I didn't notice that the first part was also a loop. I wrote PR 23008 to move the call out of the loop.

I tried to avoid calling the function if it's possible that the variable it not used. But here, it's always used, so it's relevant to move the loop invariant out of the loop ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Tue Oct 27 16:34:46 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 20:34:46 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603830886.17.0.60537077397.issue42161@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset c310185c081110741fae914c06c7aaf673ad3d0d by Victor Stinner in branch 'master':
bpo-42161: Remove private _PyLong_Zero and _PyLong_One (GH-23003)
https://github.com/python/cpython/commit/c310185c081110741fae914c06c7aaf673ad3d0d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Tue Oct 27 16:37:32 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 27 Oct 2020 20:37:32 +0000
Subject: [issue42169] Apparently all documentation on @typing.overload is wrong
In-Reply-To: <1603796392.82.0.758366735277.issue42169@roundup.psfhosted.org>
Message-ID: <1603831052.94.0.358828762723.issue42169@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
resolution:  -> not a bug

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42169>
_______________________________________

From report at bugs.python.org  Tue Oct 27 16:43:09 2020
From: report at bugs.python.org (Orian Zinger)
Date: Tue, 27 Oct 2020 20:43:09 +0000
Subject: [issue42177] Improving KeyError exception
Message-ID: <1603831389.37.0.739931289382.issue42177@roundup.psfhosted.org>


New submission from Orian Zinger <zinger777 at gmail.com>:

Hi all,

As a Python developer, I encountered lots of blurry exception messages in the product logs such as:
<time and date> <process name> <log severity> Failed to do something. Exception: 'some key'

I believe printing the key name without explaining the exception itself is bad (explicit is better than implicit).

Thus, after forking the repository, I added a short explanation about the Exception.
Now, it looks like:

>>> try:
...     {}['some key']
... except Exception as e:
...     print(e)
... 
Missing key: some key

I'm a newbie in a contribution to CPython, so please let me know if the idea behind my commit is good. If not, please explain how can I improve my commit so it'll be pulled later to the main branch.

https://github.com/zingero/cpython/commit/8c9e5d9e16296cee1f3ec05638dd6989dae8b811

Regards,
Orian.

----------
messages: 379801
nosy: zingero
priority: normal
severity: normal
status: open
title: Improving KeyError exception
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42177>
_______________________________________

From report at bugs.python.org  Tue Oct 27 16:47:25 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 20:47:25 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603831645.08.0.612067640091.issue42096@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

>  functions who's point is to be fast and not consume an amount of memory determined by the input data

I proposed to read the first 4 bytes of the file. It's a fixed length.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Tue Oct 27 16:52:33 2020
From: report at bugs.python.org (Charles McMarrow)
Date: Tue, 27 Oct 2020 20:52:33 +0000
Subject: [issue42178] failed pickle hangs python on exit in CMD.exe only
Message-ID: <1603831953.96.0.174038023621.issue42178@roundup.psfhosted.org>


New submission from Charles McMarrow <charles.mcmarrow.4 at gmail.com>:

This bug only happens for me in Windows 10 when using cmd.exe. This bug does not happen IDLE. It sometimes happens in PowerShell. 

I ran mp_hang.py
with 
3.9.0 hangs on cmd/powershell
3.8.6 hangs on cmd
3.8.5 hangs on cmd/powershell
Microsoft Windows [Version 10.0.19041.572]

3.8.6 error
```
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\Users\yoshi\AppData\Local\Programs\Python\Python38\lib\multiprocessing\spawn.py", line 102, in spawn_main
    source_process = _winapi.OpenProcess(
OSError: [WinError 87] The parameter is incorrect
```

----------
components: Windows
files: mp_hang.py
messages: 379803
nosy: charles.mcmarrow.4, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: failed pickle hangs python on exit in CMD.exe only
type: crash
versions: Python 3.9
Added file: https://bugs.python.org/file49543/mp_hang.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42178>
_______________________________________

From report at bugs.python.org  Tue Oct 27 17:24:41 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 21:24:41 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603833881.63.0.402848380929.issue42161@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 35b95aaf21534e4a8e3370dfd6f7482265316c9e by Victor Stinner in branch 'master':
bpo-42161: Micro-optimize _collections._count_elements() (GH-23008)
https://github.com/python/cpython/commit/35b95aaf21534e4a8e3370dfd6f7482265316c9e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Tue Oct 27 17:25:31 2020
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 27 Oct 2020 21:25:31 +0000
Subject: [issue42161] Remove private _PyLong_Zero and _PyLong_One variables
In-Reply-To: <1603749577.35.0.864358738107.issue42161@roundup.psfhosted.org>
Message-ID: <1603833931.13.0.523066220323.issue42161@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks Raymond, I fixed the code.

I close the issue, I removed _PyLong_Zero and _PyLong_One variables.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42161>
_______________________________________

From report at bugs.python.org  Tue Oct 27 17:37:21 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 27 Oct 2020 21:37:21 +0000
Subject: [issue41805] types.GenericAlias and types.Union have no documentation
In-Reply-To: <1600370908.0.0.224627521485.issue41805@roundup.psfhosted.org>
Message-ID: <1603834641.0.0.716359199547.issue41805@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 4173320920706b49a004bdddd8d7108e8984e3fc by kj in branch 'master':
bpo-41805: Documentation for PEP 585 (GH-22615)
https://github.com/python/cpython/commit/4173320920706b49a004bdddd8d7108e8984e3fc


----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41805>
_______________________________________

From report at bugs.python.org  Tue Oct 27 17:41:59 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 27 Oct 2020 21:41:59 +0000
Subject: [issue10663] configure shouldn't set a default OPT
In-Reply-To: <1291922731.34.0.0931517118305.issue10663@psf.upfronthosting.co.za>
Message-ID: <1603834919.68.0.21534045271.issue10663@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I couldn't find a configure.in. Is this issue out of date?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue10663>
_______________________________________

From report at bugs.python.org  Tue Oct 27 17:45:26 2020
From: report at bugs.python.org (Boris Staletic)
Date: Tue, 27 Oct 2020 21:45:26 +0000
Subject: [issue42176] Valgrind reports "Conditional jump or move depends on
 uninitialised value(s)" in `PyUnicode_AsEncodedString` and `PyUnicode_Decode`
In-Reply-To: <1603824745.38.0.0631624355024.issue42176@roundup.psfhosted.org>
Message-ID: <1603835126.45.0.754557085878.issue42176@roundup.psfhosted.org>


Boris Staletic <boris.staletic at gmail.com> added the comment:

I can also reproduce the same problem with the ubuntu packaged python3, which is 3.8.5 on Ubuntu 20.04. The only problem is that, with a stripped library, you don't get line numbers in valgrind's output. Steps to repro:

1. apt install valgrind gcc python3-config
2. Save the same attached file from the first comment as test.c.
3. gcc $(python3-config --includes) $(python3-config --ldflags) -lpython3.8 -o python-error
4. PYTHONMALLOC=malloc valgrind ./python-error

Valgrind output:

==1200== Conditional jump or move depends on uninitialised value(s)
==1200==    at 0x4A7B37B: PyUnicode_Decode (in /usr/lib/x86_64-linux-gnu/libpython3.8.so.1.0)
==1200==    by 0x109264: main (in /python-error)
==1200==
==1200== Conditional jump or move depends on uninitialised value(s)
==1200==    at 0x4A7AE57: PyUnicode_AsEncodedString (in /usr/lib/x86_64-linux-gnu/libpython3.8.so.1.0)
==1200==    by 0x109280: main (in /python-error)

I have not checked earlier versions of python.

----------
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42176>
_______________________________________

From report at bugs.python.org  Tue Oct 27 17:48:47 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 27 Oct 2020 21:48:47 +0000
Subject: [issue8943] Bug in InteractiveConsole /pickle
In-Reply-To: <1276014263.34.0.524334073977.issue8943@psf.upfronthosting.co.za>
Message-ID: <1603835327.86.0.191636755819.issue8943@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
title: Bug in InteractiveConsole -> Bug in InteractiveConsole /pickle
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.1, Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue8943>
_______________________________________

From report at bugs.python.org  Tue Oct 27 17:53:46 2020
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 27 Oct 2020 21:53:46 +0000
Subject: [issue15029] doc: Update Defining New Types chapter according to PEP
 253
In-Reply-To: <1339089909.82.0.778815916296.issue15029@psf.upfronthosting.co.za>
Message-ID: <1603835626.2.0.896345256854.issue15029@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
title: Update Defining New Types chapter according to PEP 253 -> doc: Update Defining New Types chapter according to PEP 253
versions: +Python 3.10, Python 3.9 -Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15029>
_______________________________________

From report at bugs.python.org  Tue Oct 27 18:08:33 2020
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 27 Oct 2020 22:08:33 +0000
Subject: [issue42171] Add PEP 573 to the stable ABI
In-Reply-To: <1603810249.77.0.333997046365.issue42171@roundup.psfhosted.org>
Message-ID: <1603836513.83.0.904111409346.issue42171@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
keywords: +patch
pull_requests: +21925
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23009

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42171>
_______________________________________

From report at bugs.python.org  Tue Oct 27 18:38:04 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Tue, 27 Oct 2020 22:38:04 +0000
Subject: [issue42163] _replace() no longer works on platform.uname_result
 objects
In-Reply-To: <1603750912.81.0.950571190169.issue42163@roundup.psfhosted.org>
Message-ID: <1603838284.27.0.125700466569.issue42163@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
keywords: +patch
pull_requests: +21926
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23010

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42163>
_______________________________________

From report at bugs.python.org  Tue Oct 27 18:38:48 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Tue, 27 Oct 2020 22:38:48 +0000
Subject: [issue41659] PEG discrepancy on 'if {x} {a}: pass'
In-Reply-To: <1598650995.75.0.684602655166.issue41659@roundup.psfhosted.org>
Message-ID: <1603838328.94.0.643971708333.issue41659@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:


New changeset c4b58cea4771afc0ddfdb857b0fb5115b9f4bc9f by Lysandros Nikolaou in branch '3.9':
[3.9] bpo-41659: Disallow curly brace directly after primary (GH-22996) (#23006)
https://github.com/python/cpython/commit/c4b58cea4771afc0ddfdb857b0fb5115b9f4bc9f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41659>
_______________________________________

From report at bugs.python.org  Tue Oct 27 18:39:15 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Tue, 27 Oct 2020 22:39:15 +0000
Subject: [issue41659] PEG discrepancy on 'if {x} {a}: pass'
In-Reply-To: <1598650995.75.0.684602655166.issue41659@roundup.psfhosted.org>
Message-ID: <1603838355.33.0.214515555421.issue41659@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41659>
_______________________________________

From report at bugs.python.org  Tue Oct 27 18:56:43 2020
From: report at bugs.python.org (Teugea Ioan-Teodor)
Date: Tue, 27 Oct 2020 22:56:43 +0000
Subject: [issue42061] Document __format__ method for IPv[46]Address
In-Reply-To: <1602939831.57.0.752623418103.issue42061@roundup.psfhosted.org>
Message-ID: <1603839403.24.0.362222556815.issue42061@roundup.psfhosted.org>


Teugea Ioan-Teodor <teodor.teugea at gmail.com> added the comment:

Hi. I would like to work on the documentation for the IP address format. I am new here so it might take me some time. I think it will have a PR ready in a day or two.

----------
nosy: +John-Ted

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42061>
_______________________________________

From report at bugs.python.org  Tue Oct 27 19:49:54 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Tue, 27 Oct 2020 23:49:54 +0000
Subject: [issue42123] Run parser twice;
 enable invalid_* rules only on the second run
In-Reply-To: <1603409743.28.0.787265357056.issue42123@roundup.psfhosted.org>
Message-ID: <1603842594.75.0.391710658185.issue42123@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
pull_requests: +21927
pull_request: https://github.com/python/cpython/pull/23011

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42123>
_______________________________________

From report at bugs.python.org  Tue Oct 27 19:51:34 2020
From: report at bugs.python.org (Marco Castelluccio)
Date: Tue, 27 Oct 2020 23:51:34 +0000
Subject: [issue34204] Bump the default pickle protocol in shelve
In-Reply-To: <1532423802.47.0.56676864532.issue34204@psf.upfronthosting.co.za>
Message-ID: <1603842694.12.0.913168047943.issue34204@roundup.psfhosted.org>


Change by Marco Castelluccio <mcastelluccio at mozilla.com>:


----------
nosy: +marco-c
nosy_count: 6.0 -> 7.0
pull_requests: +21928
pull_request: https://github.com/python/cpython/pull/22751

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34204>
_______________________________________

From report at bugs.python.org  Tue Oct 27 20:14:18 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Wed, 28 Oct 2020 00:14:18 +0000
Subject: [issue42123] Run parser twice;
 enable invalid_* rules only on the second run
In-Reply-To: <1603409743.28.0.787265357056.issue42123@roundup.psfhosted.org>
Message-ID: <1603844058.82.0.130247526846.issue42123@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:


New changeset 24a7c298d47658295673dc04d1b6d59f2b200a7c by Lysandros Nikolaou in branch '3.9':
[3.9] bpo-42123: Run the parser two times and only enable invalid rules on the second run (GH-22111) (GH-23011)
https://github.com/python/cpython/commit/24a7c298d47658295673dc04d1b6d59f2b200a7c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42123>
_______________________________________

From report at bugs.python.org  Tue Oct 27 20:17:30 2020
From: report at bugs.python.org (Marco Castelluccio)
Date: Wed, 28 Oct 2020 00:17:30 +0000
Subject: [issue34204] Bump the default pickle protocol in shelve
In-Reply-To: <1532423802.47.0.56676864532.issue34204@psf.upfronthosting.co.za>
Message-ID: <1603844250.19.0.259669364424.issue34204@roundup.psfhosted.org>


Marco Castelluccio <mcastelluccio at mozilla.com> added the comment:

I've opened https://github.com/python/cpython/pull/22751 to fix this, I know there was already a PR, but it seems to have been abandoned.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34204>
_______________________________________

From report at bugs.python.org  Tue Oct 27 22:26:15 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Wed, 28 Oct 2020 02:26:15 +0000
Subject: [issue9453] pulldom.SAX2DOM Doesn't support processing instructions
 before the root element
In-Reply-To: <1280746158.2.0.563581992561.issue9453@psf.upfronthosting.co.za>
Message-ID: <1603851975.41.0.937291525893.issue9453@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
nosy: +ZackerySpytz
nosy_count: 3.0 -> 4.0
pull_requests: +21929
pull_request: https://github.com/python/cpython/pull/23012

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9453>
_______________________________________

From report at bugs.python.org  Tue Oct 27 22:27:18 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Wed, 28 Oct 2020 02:27:18 +0000
Subject: [issue9453] pulldom.SAX2DOM Doesn't support processing instructions
 before the root element
In-Reply-To: <1280746158.2.0.563581992561.issue9453@psf.upfronthosting.co.za>
Message-ID: <1603852038.8.0.436671236006.issue9453@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
versions: +Python 3.10 -Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9453>
_______________________________________

From report at bugs.python.org  Tue Oct 27 22:28:17 2020
From: report at bugs.python.org (Zackery Spytz)
Date: Wed, 28 Oct 2020 02:28:17 +0000
Subject: [issue34204] Bump the default pickle protocol in shelve
In-Reply-To: <1532423802.47.0.56676864532.issue34204@psf.upfronthosting.co.za>
Message-ID: <1603852097.85.0.00805703404578.issue34204@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

It has not been abandoned.

----------
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34204>
_______________________________________

From report at bugs.python.org  Tue Oct 27 23:17:59 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Wed, 28 Oct 2020 03:17:59 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603855079.53.0.781050560433.issue42096@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

The first four bytes of the file do not identify a zip file.  A zip file is identified by the end of file central directory.  Which you then must read entries of to determine where the start of the archive may be... often not at position zero.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Tue Oct 27 23:18:19 2020
From: report at bugs.python.org (Akashkumar D Khunt)
Date: Wed, 28 Oct 2020 03:18:19 +0000
Subject: [issue42172] Typo in test library for test_socket.py
In-Reply-To: <1603811538.08.0.134266779609.issue42172@roundup.psfhosted.org>
Message-ID: <1603855099.63.0.366947583052.issue42172@roundup.psfhosted.org>


Akashkumar D Khunt <akashdkhunt at gmail.com> added the comment:

Sure, Will send out patch for review.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42172>
_______________________________________

From report at bugs.python.org  Tue Oct 27 23:36:26 2020
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 28 Oct 2020 03:36:26 +0000
Subject: [issue42178] failed pickle hangs python on exit in CMD.exe only
In-Reply-To: <1603831953.96.0.174038023621.issue42178@roundup.psfhosted.org>
Message-ID: <1603856186.84.0.981925098832.issue42178@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

Due to the exception raised when trying to pickle main.<locals>.dummy in popen_spawn_win32.Popen(), the main process may have already exited by the time the spawned worker calls WinAPI OpenProcess in spawn.spawn_main(). I suppose the reduction of prep_data and process_obj  in popen_spawn_win32.Popen() could be dumped to an io.BytesIO instance before WinAPI CreateProcess is called. That way an exception in the pickler would occur before the child process is created.

There's also a race condition that can hang the worker during interpreter startup. When sys.stdin is initialized, the buffered reader does a raw tell(). If the raw layer is an io.FileIO instance (e.g. console input with PYTHONLEGACYWINDOWSSTDIO defined), the raw tell() ultimately calls WinAPI SetFilePointerEx (via _lseeki64). This can hang if the kernel file is already blocked in a synchronous I/O request, which might be the case if the main process has already terminated and its parent (e.g. cmd.exe or powershell.exe) has resumed reading from the console. portable_lseek() in Modules/_io/fileio.c should detect a non-disk file via WinAPI GetFileType and just set self->seekable to 0 in this case.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42178>
_______________________________________

From report at bugs.python.org  Wed Oct 28 02:20:55 2020
From: report at bugs.python.org (Akashkumar D Khunt)
Date: Wed, 28 Oct 2020 06:20:55 +0000
Subject: [issue42172] Typo in test library for test_socket.py
In-Reply-To: <1603811538.08.0.134266779609.issue42172@roundup.psfhosted.org>
Message-ID: <1603866055.17.0.830922316892.issue42172@roundup.psfhosted.org>


Change by Akashkumar D Khunt <akashdkhunt at gmail.com>:


----------
keywords: +patch
pull_requests: +21930
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23013

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42172>
_______________________________________

From report at bugs.python.org  Wed Oct 28 02:28:16 2020
From: report at bugs.python.org (Ma Lin)
Date: Wed, 28 Oct 2020 06:28:16 +0000
Subject: [issue41486] Add _BlocksOutputBuffer for bz2/lzma/zlib module
In-Reply-To: <1596621344.28.0.22443935276.issue41486@roundup.psfhosted.org>
Message-ID: <1603866496.19.0.644887247405.issue41486@roundup.psfhosted.org>


Ma Lin <malincns at 163.com> added the comment:

I modify lzma module to use different growth factors, see attached picture different_factors.png

1.5x should be the growth factor of _PyBytesWriter under Windows.

So if change _PyBytesWriter to use memory blocks, maybe there will be no performance improvement.

Over allocate factor of _PyBytesWriter:

    # ifdef MS_WINDOWS
        # define OVERALLOCATE_FACTOR 2
    # else
        # define OVERALLOCATE_FACTOR 4
    # endif

(I'm using Windows 10)

----------
Added file: https://bugs.python.org/file49544/different_factors.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41486>
_______________________________________

From report at bugs.python.org  Wed Oct 28 02:52:34 2020
From: report at bugs.python.org (Boris Yang)
Date: Wed, 28 Oct 2020 06:52:34 +0000
Subject: [issue35286] wrong result for difflib.SequenceMatcher
Message-ID: <1603867954.06.0.763893531006.issue35286@roundup.psfhosted.org>


Change by Boris Yang <borisyang at gmail.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35286>
_______________________________________

From report at bugs.python.org  Wed Oct 28 03:05:12 2020
From: report at bugs.python.org (Vladimir Ryabtsev)
Date: Wed, 28 Oct 2020 07:05:12 +0000
Subject: [issue38413] Remove or change "Multithreading" section
In-Reply-To: <1570563042.6.0.0902531064636.issue38413@roundup.psfhosted.org>
Message-ID: <1603868712.43.0.264758561455.issue38413@roundup.psfhosted.org>


Vladimir Ryabtsev <greatvovan at gmail.com> added the comment:

I see no point in researching the version of sqlite, since Python does not allow user to specify it, you just use the compiled version that comes with Python distribution.

10 years now to the commit that introduced that piece of text: https://github.com/python/cpython/commit/c34d76cdc3212615f9a3c2c4b1c542592372b5f8

Let's just remove it, what it says is simply not true.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38413>
_______________________________________

From report at bugs.python.org  Wed Oct 28 04:02:36 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 28 Oct 2020 08:02:36 +0000
Subject: [issue42096] zipfile.is_zipfile incorrectly identifying a gzipped
 file as a zip archive
In-Reply-To: <1603183907.96.0.755065326181.issue42096@roundup.psfhosted.org>
Message-ID: <1603872156.75.0.292322503828.issue42096@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

This is a duplicate of issue28494.

I concur with Gregory. What we can do -- improve the documentation.

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> is_zipfile false positives

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42096>
_______________________________________

From report at bugs.python.org  Wed Oct 28 04:06:59 2020
From: report at bugs.python.org (Vladimir Ryabtsev)
Date: Wed, 28 Oct 2020 08:06:59 +0000
Subject: [issue38413] Remove or change "Multithreading" section
In-Reply-To: <1570563042.6.0.0902531064636.issue38413@roundup.psfhosted.org>
Message-ID: <1603872419.18.0.546371331959.issue38413@roundup.psfhosted.org>


Vladimir Ryabtsev <greatvovan at gmail.com> added the comment:

May by I was wrong above and it uses system's Sqlite... But anyway it does not cancel the fact that this section contradicts to another one.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38413>
_______________________________________

From report at bugs.python.org  Wed Oct 28 04:12:34 2020
From: report at bugs.python.org (Vladimir Ryabtsev)
Date: Wed, 28 Oct 2020 08:12:34 +0000
Subject: [issue38413] Remove or change "Multithreading" section
In-Reply-To: <1570563042.6.0.0902531064636.issue38413@roundup.psfhosted.org>
Message-ID: <1603872754.09.0.543924390004.issue38413@roundup.psfhosted.org>


Vladimir Ryabtsev <greatvovan at gmail.com> added the comment:

Also the footnote requires some minor corrections (formatting and style). I suggest the following wording:

To get loadable extension support, your Python must be compiled with ``-?enable-loadable-sqlite-extensions`` option in ``PYTHON_CONFIGURE_OPTS``.

I believe otherwise it is basically not clear what is said here.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38413>
_______________________________________

From report at bugs.python.org  Wed Oct 28 04:15:32 2020
From: report at bugs.python.org (Tal Einat)
Date: Wed, 28 Oct 2020 08:15:32 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603872932.12.0.104634534681.issue41972@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

After spending quite a while setting up my dev machine for (hopefully) reliable benchmarking, I can say with a high level of certainty that the latest PR (GH-22904, commit fe9e9d9c1f1c5f98c797d19e2214d1413701f6de) runs stringbench.py significantly faster than the master branch (commit fb5db7ec58624cab0797b4050735be865d380823). See attached results.

I've also run the zipf-distributed random string benchmarks provided by Dennis, with a slight addition of `random.seed(1)` in the do_timings function. Those show significant, consistent improvements on needles of length over 100, but not on shorter needles. The results are also found in the attached file.


My conclusion is that the current two-way implementation is certainly better for needles of length over 100, but for shorter needles the situation is still unclear.


System details:
Dell XPS 9560
Intel i7-7700HQ
Ubuntu 20.04

Steps taken to prepare system for performance tuning:
* Enable CPU isolation for two physical cores
* Disable Intel p-state driver
* Disable turbo-boost
* Run `pyperf system tune`
* Run benchmarks with CPU pinning

----------
nosy: +taleinat
Added file: https://bugs.python.org/file49545/twoway-benchmark-results-2020-10-28.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Wed Oct 28 04:31:31 2020
From: report at bugs.python.org (Vladimir Ryabtsev)
Date: Wed, 28 Oct 2020 08:31:31 +0000
Subject: [issue42179] Clarify chaining exceptions in tutorial/errors.rst
Message-ID: <1603873891.9.0.500762071742.issue42179@roundup.psfhosted.org>


New submission from Vladimir Ryabtsev <greatvovan at gmail.com>:

A new section has been added to the page as a result of https://bugs.python.org/issue37826. The change: https://github.com/python/cpython/commit/dcfe111eb5602333135b8776996332a8dcf59392

The wording it uses (in the beginning of section 8.5), defines chaining as setting __cause__ attribute in an exception, and later states that "Exception chaining happens automatically when an exception is raised inside an exception handler or finally section". This may lead the reader to a wrong idea that re-raising an exception without "from" in "except" and "finally" automatically sets __cause__. In reality it sets only __context__ attribute, which is similar concept to __cause__, but work a bit differently, as explained in library/exceptions.rst. I suggest to mention that difference and provide a link to the main article.

----------
assignee: docs at python
components: Documentation
messages: 379823
nosy: Vladimir Ryabtsev, docs at python
priority: normal
severity: normal
status: open
title: Clarify chaining exceptions in tutorial/errors.rst
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42179>
_______________________________________

From report at bugs.python.org  Wed Oct 28 04:57:34 2020
From: report at bugs.python.org (Stefan Behnel)
Date: Wed, 28 Oct 2020 08:57:34 +0000
Subject: [issue42151] Pure Python xml.etree.ElementTree is missing default
 attribute values
In-Reply-To: <1603684290.04.0.0149631860455.issue42151@roundup.psfhosted.org>
Message-ID: <1603875454.68.0.0165478427429.issue42151@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

In general, since the C accelerator is enabled by default, and few people would consider disabling it explicitly, I generally consider the behaviour of the C implementation to be "right", if both implementations differ.

As a single data point, the reason why the difference was found in this case was differing behaviour in PyPy (which uses only the Python implementation). It was only later found to be a problem on the CPython side.

Changing the behaviour of the C implementation would certainly break a lot more code than changing the Python implementation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42151>
_______________________________________

From report at bugs.python.org  Wed Oct 28 05:14:22 2020
From: report at bugs.python.org (Tal Einat)
Date: Wed, 28 Oct 2020 09:14:22 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1603876462.77.0.974502849562.issue41972@roundup.psfhosted.org>


Tal Einat <taleinat+python at gmail.com> added the comment:

I should also mention that I configured and compiled Python for each of the above-mentioned versions using the --enable-optimizations` flag.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Wed Oct 28 06:17:50 2020
From: report at bugs.python.org (Edouard Moine)
Date: Wed, 28 Oct 2020 10:17:50 +0000
Subject: [issue40562] SEO: differentiate between Python 2 and Python 3 docs on
 Google SERP
In-Reply-To: <1588948512.43.0.0539170221338.issue40562@roundup.psfhosted.org>
Message-ID: <1603880270.26.0.74363423321.issue40562@roundup.psfhosted.org>


Edouard Moine <moine.edouard at gmail.com> added the comment:

Hey Simon, you can use the breadcrumb markup and other markups structured data with json on your webpage if you want google to read more efficiently your page in the browser. I used it on my <a href="https://www.mixy-design.com/">web agency website</a> if you want to have a look at the structure ;)

----------
nosy: +mixy-design

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40562>
_______________________________________

From report at bugs.python.org  Wed Oct 28 07:08:34 2020
From: report at bugs.python.org (Rafael Fontenelle)
Date: Wed, 28 Oct 2020 11:08:34 +0000
Subject: [issue42180] Missing a plural in library/functions
Message-ID: <1603883314.74.0.667097394746.issue42180@roundup.psfhosted.org>


New submission from Rafael Fontenelle <rffontenelle at gmail.com>:

Missing plural in the start of the following sentence from library/functions:

"The optional argument *flags* and *dont_inherit* controls which :ref:`compiler options <ast-compiler-flags>` should be activated and which :ref:`future features <future>` should be allowed."

This was introduced in bpo-40484, probably by accident.

Link to source code: https://github.com/python/cpython/blob/master/Doc/library/functions.rst#L262

----------
messages: 379827
nosy: rffontenelle
priority: normal
severity: normal
status: open
title: Missing a plural in library/functions
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42180>
_______________________________________

From report at bugs.python.org  Wed Oct 28 07:21:53 2020
From: report at bugs.python.org (Rafael Fontenelle)
Date: Wed, 28 Oct 2020 11:21:53 +0000
Subject: [issue42180] Missing a plural in library/functions
In-Reply-To: <1603883314.74.0.667097394746.issue42180@roundup.psfhosted.org>
Message-ID: <1603884113.57.0.453426604028.issue42180@roundup.psfhosted.org>


Change by Rafael Fontenelle <rffontenelle at gmail.com>:


----------
keywords: +patch
pull_requests: +21931
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23015

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42180>
_______________________________________

From report at bugs.python.org  Wed Oct 28 07:35:02 2020
From: report at bugs.python.org (Jakub Wilk)
Date: Wed, 28 Oct 2020 11:35:02 +0000
Subject: [issue2142] difflib.unified_diff(...) produces invalid patches
In-Reply-To: <1203365817.7.0.0998491412302.issue2142@psf.upfronthosting.co.za>
Message-ID: <1603884902.9.0.55042851141.issue2142@roundup.psfhosted.org>


Change by Jakub Wilk <jwilk at jwilk.net>:


----------
nosy: +jwilk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2142>
_______________________________________

From report at bugs.python.org  Wed Oct 28 10:13:37 2020
From: report at bugs.python.org (Steve Holden)
Date: Wed, 28 Oct 2020 14:13:37 +0000
Subject: [issue8943] Bug in InteractiveConsole /pickle
In-Reply-To: <1276014263.34.0.524334073977.issue8943@psf.upfronthosting.co.za>
Message-ID: <1603894417.45.0.741644959987.issue8943@roundup.psfhosted.org>


Change by Steve Holden <steve at holdenweb.com>:


----------
nosy:  -holdenweb

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue8943>
_______________________________________

From report at bugs.python.org  Wed Oct 28 10:18:31 2020
From: report at bugs.python.org (Joachim)
Date: Wed, 28 Oct 2020 14:18:31 +0000
Subject: [issue42181] describe PyEval_CallObjectWithKeywords and its
 replacement
Message-ID: <1603894711.43.0.142721480752.issue42181@roundup.psfhosted.org>


New submission from Joachim <j.wuttke at fz-juelich.de>:

The current 3.9 docs do not describe PyEval_CallObjectWithKeywords, among other PyEval_CallObject* functions.

Yes, I know, these functions are deprecated. But they are still part of the API; they ought to be documented.

Rather, given that they are deprecated, there is more need than ever to document them: The documentation should specify when they have been deprecated, until then they are guaranteed to be supported, and most importantly, how they are to be replaced.

Fulltext search leads me to the 3.9 Changelog that says: ?PyEval_CallFunction, PyEval_CallMethod and PyEval_CallObjectWithKeywords are deprecated. Use PyObject_Call() and its variants instead.? This is far not enough. As a maintainer of 3rd-party code with no knowledge of and no interest in the Python C API, I do not want to spend half a day on finding out which variant to use, and how argument lists differ.

----------
components: C API
messages: 379828
nosy: j5w6, jdemeyer
priority: normal
severity: normal
status: open
title: describe PyEval_CallObjectWithKeywords and its replacement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42181>
_______________________________________

From report at bugs.python.org  Wed Oct 28 11:01:37 2020
From: report at bugs.python.org (Ken Jin)
Date: Wed, 28 Oct 2020 15:01:37 +0000
Subject: [issue41805] types.GenericAlias and types.Union have no documentation
In-Reply-To: <1600370908.0.0.224627521485.issue41805@roundup.psfhosted.org>
Message-ID: <1603897297.54.0.221897458143.issue41805@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
pull_requests: +21932
pull_request: https://github.com/python/cpython/pull/23016

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41805>
_______________________________________

From report at bugs.python.org  Wed Oct 28 11:28:27 2020
From: report at bugs.python.org (Ken Jin)
Date: Wed, 28 Oct 2020 15:28:27 +0000
Subject: [issue42182] 3.10 Documentation Not Hyperlinking Some Methods
Message-ID: <1603898907.29.0.300729601022.issue42182@roundup.psfhosted.org>


New submission from Ken Jin <kenjin4096 at gmail.com>:

Some ``:meth:`` markups are not being hyperlinked at all, while some are. This only occurs for Python 3.10. This also seems related to https://bugs.python.org/issue42042.

Eg. 
For 3.9, https://docs.python.org/3.9/library/stdtypes.html#truth-value-testing:
``__bool__``, ``__len__`` are hyperlinked.

For 3.10, https://docs.python.org/3.10/library/stdtypes.html#truth-value-testing:
``__bool__``, ``__len__`` are not hyperlinked.

This occurs throughout the documentation, but it doesn't seem to consistently happen. For example, in https://docs.python.org/3.10/library/stdtypes.html#contextmanager.__exit__ , ``__exit__`` is hyperlinked, but right below that section, the other ``__exit__``s are not. This is puzzling since their markup both uses the same :meth:`__exit__`.

I'm not able to locally reproduce this using Sphinx 2.4.0. I don't know which version exactly of Sphinx this regression occured.

----------
assignee: docs at python
components: Documentation
messages: 379829
nosy: docs at python, kj
priority: normal
severity: normal
status: open
title: 3.10 Documentation Not Hyperlinking Some Methods
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42182>
_______________________________________

From report at bugs.python.org  Wed Oct 28 11:34:14 2020
From: report at bugs.python.org (miss-islington)
Date: Wed, 28 Oct 2020 15:34:14 +0000
Subject: [issue41805] types.GenericAlias and types.Union have no documentation
In-Reply-To: <1600370908.0.0.224627521485.issue41805@roundup.psfhosted.org>
Message-ID: <1603899254.94.0.191319903833.issue41805@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 577d7c4e628260eb7926d043ca9c355ece583eb7 by kj in branch '3.9':
[3.9] bpo-41805: Documentation for PEP 585 (GH-22615) (GH-23016)
https://github.com/python/cpython/commit/577d7c4e628260eb7926d043ca9c355ece583eb7


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41805>
_______________________________________

From report at bugs.python.org  Wed Oct 28 11:36:44 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 28 Oct 2020 15:36:44 +0000
Subject: [issue42128] Structural Pattern Matching (PEP 634)
In-Reply-To: <1603466540.96.0.7677855399.issue42128@roundup.psfhosted.org>
Message-ID: <1603899404.68.0.62953749448.issue42128@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

Thinking ahead...

A lot of work has gone into writing these PEPs...  we should see how much we can easily convert into actual docs. It seems to me:

- Parts of PEP 634 and PEP 635 can be worked into the language reference.

- Guido's overview (the appendix of PEP 636) can probably just be dropped verbatim into the What's New for 3.10.

- The rest of PEP 636 can just be lifted into the docs as a proper tutorial and linked to from the What's New.

Also, we need to document the stdlib changes (ast, collections, dataclasses, keyword, ...). The dis module docs are already part of the implementation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42128>
_______________________________________

From report at bugs.python.org  Wed Oct 28 11:59:14 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 28 Oct 2020 15:59:14 +0000
Subject: [issue41805] types.GenericAlias and types.Union have no documentation
In-Reply-To: <1600370908.0.0.224627521485.issue41805@roundup.psfhosted.org>
Message-ID: <1603900754.73.0.208550078511.issue41805@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Thanks Ken Ji! Are you planning more doc patches?

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41805>
_______________________________________

From report at bugs.python.org  Wed Oct 28 12:01:41 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 28 Oct 2020 16:01:41 +0000
Subject: [issue42128] Structural Pattern Matching (PEP 634)
In-Reply-To: <1603899404.68.0.62953749448.issue42128@roundup.psfhosted.org>
Message-ID: <CAP7+vJJdkiLZT-y5T6q7bHn-sgCrzX96ujN3j3PxZhF1YOUdLA@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

If you feel up to it, you might see if you could open a new, separate
(draft) PR that updates all those docs. (But you could also wait and see if
someone volunteers. There are some good doc writers active ATM.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42128>
_______________________________________

From report at bugs.python.org  Wed Oct 28 12:07:22 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 28 Oct 2020 16:07:22 +0000
Subject: [issue42128] Structural Pattern Matching (PEP 634)
In-Reply-To: <1603466540.96.0.7677855399.issue42128@roundup.psfhosted.org>
Message-ID: <1603901242.67.0.0781709031225.issue42128@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

I'll wait till the SC makes a ruling, then send a message to our docs list (I think we have one)? I'm fine coordinating/reviewing that, or making PRs myself if nobody else steps up.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42128>
_______________________________________

From report at bugs.python.org  Wed Oct 28 12:10:26 2020
From: report at bugs.python.org (Ken Jin)
Date: Wed, 28 Oct 2020 16:10:26 +0000
Subject: [issue41805] types.GenericAlias and types.Union have no documentation
In-Reply-To: <1600370908.0.0.224627521485.issue41805@roundup.psfhosted.org>
Message-ID: <1603901426.22.0.867341700652.issue41805@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

@guido, you're welcome! I'm thinking of updating the temporary hyperlinks for GenericAlias/PEP 585 in Union, subscriptions and typing, I'll submit 2 separate PRs since subscription and typing require backporting. 

If I think of anything major, I'll open a separate bpo to keep track of it there. Thanks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41805>
_______________________________________

From report at bugs.python.org  Wed Oct 28 12:13:11 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 28 Oct 2020 16:13:11 +0000
Subject: [issue41805] types.GenericAlias and types.Union have no documentation
In-Reply-To: <1600370908.0.0.224627521485.issue41805@roundup.psfhosted.org>
Message-ID: <1603901591.96.0.658586999336.issue41805@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Cool. Please add me to the nosy list of any issues you open.

Also, if you're interesting helping out with the match statement, once the SC approves it, we'll need to add docs for that. See issue42128 for a possible plan.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41805>
_______________________________________

From report at bugs.python.org  Wed Oct 28 12:59:24 2020
From: report at bugs.python.org (Gobot1234)
Date: Wed, 28 Oct 2020 16:59:24 +0000
Subject: [issue42183] Stack overflow error with asyncio.all_tasks and wait_for
Message-ID: <1603904364.33.0.601096284613.issue42183@roundup.psfhosted.org>


New submission from Gobot1234 <gobot1234yt at gmail.com>:

Using asyncio.wait_for and asyncio.all_tasks in combination causes a stack overflow error. 

Code to reproduce issue:
```
import asyncio

async def func():
    return asyncio.all_tasks()

async def main():
    print(await asyncio.wait_for(func(), timeout=10))

asyncio.run(main())
```

I'm not too sure how far back this goes but I've managed to reproduce it on sys.version_info(major=3, minor=8, micro=0, releaselevel='final', serial=0) and sys.version_info(major=3, minor=9, micro=0, releaselevel='final', serial=0).

----------
components: asyncio
messages: 379837
nosy: Gobot1234, asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: Stack overflow error with asyncio.all_tasks and wait_for
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42183>
_______________________________________

From report at bugs.python.org  Wed Oct 28 14:07:15 2020
From: report at bugs.python.org (Adam Merchant)
Date: Wed, 28 Oct 2020 18:07:15 +0000
Subject: [issue42184] pdb exits unexpectedly when calling args
Message-ID: <1603908435.7.0.582462540621.issue42184@roundup.psfhosted.org>


New submission from Adam Merchant <xgenadam at gmail.com>:

When an objects __repr__ or __str__ methods return None a TypeError is raised. However if this object is passed to a function and `args` is called from within pdb, pdb will immediately exit.

Attached to this is bug_example.py which contains a simple example of how to reproduce this.

Depending on circumstances this can make debugging difficult.

exact python version that this happened with:
Python 3.6.11

----------
files: bug_example.py
messages: 379838
nosy: xgenadam
priority: normal
severity: normal
status: open
title: pdb exits unexpectedly when calling args
type: behavior
versions: Python 3.6
Added file: https://bugs.python.org/file49546/bug_example.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42184>
_______________________________________

From report at bugs.python.org  Wed Oct 28 14:17:34 2020
From: report at bugs.python.org (Gregory P. Smith)
Date: Wed, 28 Oct 2020 18:17:34 +0000
Subject: [issue42185] class body bytecode uses less efficient *_NAME opcodes
Message-ID: <1603909054.81.0.403875611557.issue42185@roundup.psfhosted.org>


New submission from Gregory P. Smith <greg at krypto.org>:

The opcodes generated for the closure defining a class body looks like they might be suboptimal.  It seems stuck using the generic LOAD_NAME and STORE_NAME opcodes rather than the LOAD_GLOBAL and STORE_FAST and friends as one would expect and as happens within a normal function closure.

If true and the normal optimization pass (which I believe is done by `compiler.c` `compiler_nameop()` if i'm understanding this area of the code I don't know very well correctly...?) is not happening, it _appears_ maybe to be due to the `PyST_GetScope` call not currently having a way to represent this situation rather than being in a normal function?

I tried searching for an open issue on this but was at a loss of what to search for.  semi-related concepts might be found in:
 https://bugs.python.org/issue34750 - "locals().update doesn't work in Enum body, even though direct assignment to locals() does"
 https://bugs.python.org/issue10399 - "AST Optimization: inlining of function calls"
 https://bugs.python.org/issue9226 - "errors creating classes inside a closure"

None of those is really the same though.  if there are other filed issues regarding this, feel free to link to them in comments.

If this can be improved as it has been for function bodies already, it should be a measurable improvement to CPython startup time and/or import time.  Especially on larger programs and things with a lot of generated code full of classes.

```
>>> import dis
>>> klass_def = '''
... class Klassy:
...   pinky = 'brain'
... def Funktion(castle_argh):
...   __module__ = __name__
...   __qualname__ = 'not Klassy'
...   pinky = 'brain'
... '''
>>> dis.dis(compile(klass_def, '<Hi mom!>', 'exec'))
  2           0 LOAD_BUILD_CLASS
              2 LOAD_CONST               0 (<code object Klassy at 0x7f62f4f6e3a0, file "<Hi mom!>", line 2>)
              4 LOAD_CONST               1 ('Klassy')
              6 MAKE_FUNCTION            0
              8 LOAD_CONST               1 ('Klassy')
             10 CALL_FUNCTION            2
             12 STORE_NAME               0 (Klassy)

  4          14 LOAD_CONST               2 (<code object Funktion at 0x7f62f4f7fa80, file "<Hi mom!>", line 4>)
             16 LOAD_CONST               3 ('Funktion')
             18 MAKE_FUNCTION            0
             20 STORE_NAME               1 (Funktion)
             22 LOAD_CONST               4 (None)
             24 RETURN_VALUE

Disassembly of <code object Klassy at 0x7f62f4f6e3a0, file "<Hi mom!>", line 2>:
  2           0 LOAD_NAME                0 (__name__)
              2 STORE_NAME               1 (__module__)
              4 LOAD_CONST               0 ('Klassy')
              6 STORE_NAME               2 (__qualname__)

  3           8 LOAD_CONST               1 ('brain')
             10 STORE_NAME               3 (pinky)
             12 LOAD_CONST               2 (None)
             14 RETURN_VALUE

Disassembly of <code object Funktion at 0x7f62f4f7fa80, file "<Hi mom!>", line 4>:
  5           0 LOAD_GLOBAL              0 (__name__)
              2 STORE_FAST               1 (__module__)

  6           4 LOAD_CONST               1 ('not Klassy')
              6 STORE_FAST               2 (__qualname__)

  7           8 LOAD_CONST               2 ('brain')
             10 STORE_FAST               3 (pinky)
             12 LOAD_CONST               0 (None)
             14 RETURN_VALUE
```

----------
components: Interpreter Core
messages: 379839
nosy: gregory.p.smith, twouters
priority: normal
severity: normal
stage: needs patch
status: open
title: class body bytecode uses less efficient *_NAME opcodes
type: performance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42185>
_______________________________________

From report at bugs.python.org  Wed Oct 28 15:17:39 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 28 Oct 2020 19:17:39 +0000
Subject: [issue42185] class body bytecode uses less efficient *_NAME opcodes
In-Reply-To: <1603909054.81.0.403875611557.issue42185@roundup.psfhosted.org>
Message-ID: <1603912659.64.0.632011722276.issue42185@roundup.psfhosted.org>


Change by Brandt Bucher <brandtbucher at gmail.com>:


----------
nosy: +brandtbucher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42185>
_______________________________________

From report at bugs.python.org  Wed Oct 28 15:49:24 2020
From: report at bugs.python.org (Zachary Ware)
Date: Wed, 28 Oct 2020 19:49:24 +0000
Subject: [issue42024] Exception ignored in: <function
 WeakValueDictionary.__init__.<locals>.remove at 0x7f6a325f2ea0>
In-Reply-To: <1602566139.42.0.455519135805.issue42024@roundup.psfhosted.org>
Message-ID: <1603914564.02.0.475926613965.issue42024@roundup.psfhosted.org>


Change by Zachary Ware <zachary.ware at gmail.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42024>
_______________________________________

From report at bugs.python.org  Wed Oct 28 15:56:12 2020
From: report at bugs.python.org (Ezio Melotti)
Date: Wed, 28 Oct 2020 19:56:12 +0000
Subject: [issue27886] Docs: the difference between rename and replace is not
 obvious
In-Reply-To: <1472411232.42.0.47360960084.issue27886@psf.upfronthosting.co.za>
Message-ID: <1603914972.24.0.752431949265.issue27886@roundup.psfhosted.org>


Change by Ezio Melotti <ezio.melotti at gmail.com>:


----------
nosy: +ezio.melotti

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27886>
_______________________________________

From report at bugs.python.org  Wed Oct 28 15:58:26 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 28 Oct 2020 19:58:26 +0000
Subject: [issue42185] class body bytecode uses less efficient *_NAME opcodes
In-Reply-To: <1603909054.81.0.403875611557.issue42185@roundup.psfhosted.org>
Message-ID: <1603915106.04.0.275659771807.issue42185@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

Hm, I believe it is related to the reason why we need to use LOAD_CLASSDEREF instead of LOAD_DEREF with nonlocal names in class scope. If I understand correctly, the purpose is to keep nonlocal statements in methods from referencing class-level names.

>From https://docs.python.org/3/reference/executionmodel.html#resolution-of-names:

> Class definition blocks and arguments to exec() and eval() are special in the context of name resolution. A class definition is an executable statement that may use and define names. These references follow the normal rules for name resolution with an exception that unbound local variables are looked up in the global namespace. The namespace of the class definition becomes the attribute dictionary of the class. The scope of names defined in a class block is limited to the class block; it does not extend to the code blocks of methods ? this includes comprehensions and generator expressions since they are implemented using a function scope. This means that the following will fail:
> 
> class A:
>     a = 42
>     b = list(a + i for i in range(10))

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42185>
_______________________________________

From report at bugs.python.org  Wed Oct 28 16:08:48 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 28 Oct 2020 20:08:48 +0000
Subject: [issue42185] class body bytecode uses less efficient *_NAME opcodes
In-Reply-To: <1603909054.81.0.403875611557.issue42185@roundup.psfhosted.org>
Message-ID: <1603915728.53.0.382690924546.issue42185@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

Actually, that doesn't make much sense in this context (more relevant would be a class-within-a-class or class-within-a-function).

I need to think about this more...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42185>
_______________________________________

From report at bugs.python.org  Wed Oct 28 16:35:09 2020
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 28 Oct 2020 20:35:09 +0000
Subject: [issue42185] class body bytecode uses less efficient *_NAME opcodes
In-Reply-To: <1603909054.81.0.403875611557.issue42185@roundup.psfhosted.org>
Message-ID: <1603917309.42.0.55777935872.issue42185@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

In any case, I think the proposed change could break the current behavior:

>>> x = "global"
>>> class C:
...     x = "local"
...     l = x
...     del x
...     g = x
... 
>>> C.l
'local'
>>> C.g
'global'

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42185>
_______________________________________

From report at bugs.python.org  Wed Oct 28 16:42:28 2020
From: report at bugs.python.org (Yilei Yang)
Date: Wed, 28 Oct 2020 20:42:28 +0000
Subject: [issue42186] unittest overrides more serious warnings filter added
 before unittest.main()
Message-ID: <1603917748.58.0.497118511027.issue42186@roundup.psfhosted.org>


New submission from Yilei Yang <yileiyang9 at gmail.com>:

Because unittest adds a `default` filter before tests run, other warnings filters are overridden if added before.

Ideally, unittest should not make the warnings less serious, e.g. if there is already an 'error' filter that raises exception, it shouldn't "downgrade" to 'default' that simply prints.

The following example, using lib.a_function() raises exception in a regular program, but the unit test passes:

$ cat lib.py
import warnings
class MyWarning(UserWarning):
    pass
warnings.filterwarnings('error', category=MyWarning)
def a_function():
  warnings.warn('Do not use.', MyWarning)

$ cat lib_test.py
import unittest
import lib
class TestLib(unittest.TestCase):
    def test_function(self):
        lib.a_function()
if __name__ == '__main__':
    unittest.main()

$ python -m unittest -v lib_test
test_function (lib_test.TestLib) ... lib.py:6: MyWarning: Do not use.
  warnings.warn('Do not use.', MyWarning)
ok

----------------------------------------------------------------------
Ran 1 test in 0.000s

OK

$ python
>>> import lib
>>> lib.a_function()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "lib.py", line 6, in a_function
    warnings.warn('Do not use.', MyWarning)
lib.MyWarning: Do not use.

----------
components: Library (Lib)
messages: 379843
nosy: yilei
priority: normal
severity: normal
status: open
title: unittest overrides more serious warnings filter added before unittest.main()
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42186>
_______________________________________

From report at bugs.python.org  Wed Oct 28 16:57:30 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Wed, 28 Oct 2020 20:57:30 +0000
Subject: [issue42187] Deprecating / removing token.ISTERMINAL/ISNONTERMINAL
Message-ID: <1603918650.53.0.755514465217.issue42187@roundup.psfhosted.org>


New submission from Batuhan Taskaya <isidentical at gmail.com>:

Since the parser & symbol modules are removed, there is no real use case for ISTERMINAL/ISNONTERMINAL since the only input that contains grammar symbols is the input of the tokenize, which all its outputs are terminals. Which restricts the practicality of token.ISTERMINAL/ISNONTERMINAL. I'd propose we either deprecate them or remove them completely.

Search over the most populer PyPI packages (a set of 4k) showed there are only 2 projects that uses these functions, which all cases coupled with the parser module.
pyglet-1.5.7/pyglet/text/formats/attributed.py
133:        if token.ISNONTERMINAL(node[0]):
gdata-2.0.18/tests/coverage.py
328:        if token.ISNONTERMINAL(tree[0]):

If we are going through a deprecation period, I will also propose to remove ISEOF, since it can be easily replaced and very under used. The only project that uses token.ISEOF in my dataset is asttokens, which I would say all cases there can be easily replaced tok.type == token.EOF

asttokens-2.0.4/asttokens/mark_tokens.py
105:           not token.ISEOF(t.type)):

Also, these functions are originally reflections of C macros used in the past, and since they are not used right now, we can also remove those macros.

I have no opinions about the token.NT_OFFSET though, but there are a couple of occurrences so we might keep that? 
Paste-3.4.4/paste/util/PySourceColor.py
205:ARGS = token.NT_OFFSET + 1
206:DOUBLECOMMENT = token.NT_OFFSET + 2

ipython-7.18.1/IPython/utils/PyColorize.py
54:_KEYWORD = token.NT_OFFSET + 1
55:_TEXT    = token.NT_OFFSET + 2

----------
keywords: 3.4regression
messages: 379844
nosy: BTaskaya, gvanrossum, lys.nikolaou, pablogsal
priority: normal
severity: normal
status: open
title: Deprecating / removing token.ISTERMINAL/ISNONTERMINAL

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42187>
_______________________________________

From report at bugs.python.org  Wed Oct 28 17:00:06 2020
From: report at bugs.python.org (Teugea Ioan-Teodor)
Date: Wed, 28 Oct 2020 21:00:06 +0000
Subject: [issue42061] Document __format__ method for IPv[46]Address
In-Reply-To: <1602939831.57.0.752623418103.issue42061@roundup.psfhosted.org>
Message-ID: <1603918806.34.0.738248348794.issue42061@roundup.psfhosted.org>


Change by Teugea Ioan-Teodor <teodor.teugea at gmail.com>:


----------
keywords: +patch
pull_requests: +21933
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/23018

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42061>
_______________________________________

From report at bugs.python.org  Wed Oct 28 17:28:50 2020
From: report at bugs.python.org (Joel Lopes Da Silva)
Date: Wed, 28 Oct 2020 21:28:50 +0000
Subject: [issue36281] OSError: handle is closed for ProcessPoolExecutor and
 run_in_executor
In-Reply-To: <1552498582.24.0.716871849164.issue36281@roundup.psfhosted.org>
Message-ID: <1603920530.28.0.838644935662.issue36281@roundup.psfhosted.org>


Change by Joel Lopes Da Silva <joel at lopes-da-silva.com>:


----------
nosy: +JoeKun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36281>
_______________________________________

From report at bugs.python.org  Wed Oct 28 18:05:11 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 28 Oct 2020 22:05:11 +0000
Subject: [issue42185] class body bytecode uses less efficient *_NAME opcodes
In-Reply-To: <1603909054.81.0.403875611557.issue42185@roundup.psfhosted.org>
Message-ID: <1603922711.99.0.244915207722.issue42185@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It cannot use LOAD_GLOBAL because the name can be not global. For example:

    def f(self): ...
    f = property(f)

It cannot use STORE_FAST and LOAD_FAST because they work with specific representation of locals as array, but in a class body it can be arbitrary mapping (returned by __prepare__()).

Also, executing bytecode takes only minor part of the class creation time, so optimization of LOAD_NAME and STORE_NAME is preliminary.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42185>
_______________________________________

From report at bugs.python.org  Wed Oct 28 18:10:49 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 28 Oct 2020 22:10:49 +0000
Subject: [issue42176] Valgrind reports "Conditional jump or move depends on
 uninitialised value(s)" in `PyUnicode_AsEncodedString` and `PyUnicode_Decode`
In-Reply-To: <1603824745.38.0.0631624355024.issue42176@roundup.psfhosted.org>
Message-ID: <1603923049.75.0.313170841264.issue42176@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It points on strcmp(lower, "us_ascii") == 0.

Seems that the compiler optimizes calling strcmp() with compile-time constant "us_ascii" by reading and comparing first 8 bytes as single word. But if lower contains "latin1" it has only 7 bytes initialized, and the 8-th is not initialized. It does not affect the result, but valgrind complains. Looks like a bug in valgrind.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42176>
_______________________________________

From report at bugs.python.org  Wed Oct 28 19:00:25 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Wed, 28 Oct 2020 23:00:25 +0000
Subject: [issue42187] Deprecating / removing token.ISTERMINAL/ISNONTERMINAL
In-Reply-To: <1603918650.53.0.755514465217.issue42187@roundup.psfhosted.org>
Message-ID: <1603926025.3.0.913602167659.issue42187@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
keywords:  -3.4regression

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42187>
_______________________________________

From report at bugs.python.org  Wed Oct 28 19:03:31 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 28 Oct 2020 23:03:31 +0000
Subject: [issue42187] Deprecating / removing token.ISTERMINAL/ISNONTERMINAL
In-Reply-To: <1603918650.53.0.755514465217.issue42187@roundup.psfhosted.org>
Message-ID: <1603926211.92.0.824962861932.issue42187@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Since there are so few projects, maybe you can just contact them?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42187>
_______________________________________

From report at bugs.python.org  Wed Oct 28 19:09:12 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Wed, 28 Oct 2020 23:09:12 +0000
Subject: [issue42187] Deprecating / removing token.ISTERMINAL/ISNONTERMINAL
In-Reply-To: <1603918650.53.0.755514465217.issue42187@roundup.psfhosted.org>
Message-ID: <1603926552.26.0.543291065712.issue42187@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

> Since there are so few projects, maybe you can just contact them?

For NT_OFFSET?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42187>
_______________________________________

From report at bugs.python.org  Wed Oct 28 19:46:51 2020
From: report at bugs.python.org (Yonatan Goldschmidt)
Date: Wed, 28 Oct 2020 23:46:51 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1603928811.29.0.480878727468.issue42173@roundup.psfhosted.org>


Change by Yonatan Goldschmidt <yon.goldschmidt at gmail.com>:


----------
nosy: +Yonatan Goldschmidt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Wed Oct 28 20:25:05 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 29 Oct 2020 00:25:05 +0000
Subject: [issue42186] unittest overrides more serious warnings filter added
 before unittest.main()
In-Reply-To: <1603917748.58.0.497118511027.issue42186@roundup.psfhosted.org>
Message-ID: <1603931105.81.0.823363207304.issue42186@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42186>
_______________________________________

From report at bugs.python.org  Wed Oct 28 20:26:54 2020
From: report at bugs.python.org (Boris Staletic)
Date: Thu, 29 Oct 2020 00:26:54 +0000
Subject: [issue42176] Valgrind reports "Conditional jump or move depends on
 uninitialised value(s)" in `PyUnicode_AsEncodedString` and `PyUnicode_Decode`
In-Reply-To: <1603824745.38.0.0631624355024.issue42176@roundup.psfhosted.org>
Message-ID: <1603931214.71.0.269376650341.issue42176@roundup.psfhosted.org>


Boris Staletic <boris.staletic at gmail.com> added the comment:

Thanks for looking into this.

> Looks like a bug in valgrind.

That actually explains why I wasn't able to reproduce this problem on my local machine. Ubuntu 20.04 comes with valgrind 3.15.0, while my local machine has 3.16.1. Upgrading valgrind on Ubuntu 20.04 does fix the issue.

This is good enough for me and I guess this can be closed as "not a bug".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42176>
_______________________________________

From report at bugs.python.org  Wed Oct 28 20:34:46 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 29 Oct 2020 00:34:46 +0000
Subject: [issue42186] unittest overrides more serious warnings filter added
 before unittest.main()
In-Reply-To: <1603917748.58.0.497118511027.issue42186@roundup.psfhosted.org>
Message-ID: <1603931686.59.0.0508800909827.issue42186@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Seems to be a duplicate of https://bugs.python.org/issue15626. See also https://bugs.python.org/issue31975

----------
nosy: +ncoghlan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42186>
_______________________________________

From report at bugs.python.org  Wed Oct 28 20:40:06 2020
From: report at bugs.python.org (Colin)
Date: Thu, 29 Oct 2020 00:40:06 +0000
Subject: [issue42188] forkserver not reused in child processes
Message-ID: <1603932006.71.0.807048888281.issue42188@roundup.psfhosted.org>


New submission from Colin <cjphlo94 at gmail.com>:

The docstring on Forkserver.ensure_running states that a child process will use the forkserver process started by its parent:

"""
Make sure that a fork server is running.

This can be called from any process.  Note that usually a child
process will just reuse the forkserver started by its parent, so
ensure_running() will do nothing.
"""

Link to definition: https://github.com/python/cpython/blob/master/Lib/multiprocessing/forkserver.py#L105

That is not the behavior that I am seeing, however. I'm seeing each child (that start a process itself) will first spawn a *new* forkserver.

----------
components: Library (Lib)
files: test.py
messages: 379851
nosy: cchomey
priority: normal
severity: normal
status: open
title: forkserver not reused in child processes
type: behavior
versions: Python 3.8
Added file: https://bugs.python.org/file49547/test.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42188>
_______________________________________

From report at bugs.python.org  Wed Oct 28 20:54:11 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 29 Oct 2020 00:54:11 +0000
Subject: [issue42187] Deprecating / removing token.ISTERMINAL/ISNONTERMINAL
In-Reply-To: <1603926552.26.0.543291065712.issue42187@roundup.psfhosted.org>
Message-ID: <CAP7+vJJ6YMFf=mDB0N+d5tpdTS48va2-87Q8kvioNHQ24tRd3w@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

I thought for all?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42187>
_______________________________________

From report at bugs.python.org  Wed Oct 28 21:53:35 2020
From: report at bugs.python.org (Robert O'Callahan)
Date: Thu, 29 Oct 2020 01:53:35 +0000
Subject: [issue42189] copy.deepcopy() no longer works on platform.uname_result
 objects
Message-ID: <1603936415.14.0.266024580779.issue42189@roundup.psfhosted.org>


New submission from Robert O'Callahan <rocallahan at gmail.com>:

Starting from Python 3.9, copy.deepcopy can't copy a platform.uname_result object.

```
Python 3.9.0 (default, Oct  6 2020, 00:00:00) 
[GCC 10.2.1 20200826 (Red Hat 10.2.1-3)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import platform
>>> import copy
>>> u = platform.uname()
>>> print(u)
uname_result(system='Linux', node='localhost.localdomain', release='5.8.16-300.fc33.x86_64', version='#1 SMP Mon Oct 19 13:18:33 UTC 2020', machine='x86_64')
>>> v = copy.deepcopy(u)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib64/python3.9/copy.py", line 172, in deepcopy
    y = _reconstruct(x, memo, *rv)
  File "/usr/lib64/python3.9/copy.py", line 264, in _reconstruct
    y = func(*args)
  File "/usr/lib64/python3.9/copyreg.py", line 91, in __newobj__
    return cls.__new__(cls, *args)
TypeError: <lambda>() takes 6 positional arguments but 7 were given
```

Looks similar to issue 42163 but I guess it might need to be fixed differently.

This has broken building Intel's Xed library, which uses a Python-based build system: https://github.com/intelxed/mbuild

----------
components: Library (Lib)
messages: 379853
nosy: rocallahan
priority: normal
severity: normal
status: open
title: copy.deepcopy() no longer works on platform.uname_result objects
type: behavior
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42189>
_______________________________________

From report at bugs.python.org  Wed Oct 28 22:06:31 2020
From: report at bugs.python.org (Robert O'Callahan)
Date: Thu, 29 Oct 2020 02:06:31 +0000
Subject: [issue42163] _replace() no longer works on platform.uname_result
 objects
In-Reply-To: <1603750912.81.0.950571190169.issue42163@roundup.psfhosted.org>
Message-ID: <1603937191.45.0.768814283127.issue42163@roundup.psfhosted.org>


Robert O'Callahan <rocallahan at gmail.com> added the comment:

I filed issue 42189, which is similar but maybe worse: copy.deepcopy() is broken for platform.uname_result objects.

----------
nosy: +rocallahan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42163>
_______________________________________

From report at bugs.python.org  Thu Oct 29 01:07:31 2020
From: report at bugs.python.org (Kevin Shweh)
Date: Thu, 29 Oct 2020 05:07:31 +0000
Subject: [issue42190] global declarations affect too much inside exec or
 compile
Message-ID: <1603948051.35.0.0996569389685.issue42190@roundup.psfhosted.org>


New submission from Kevin Shweh <kevin.shweh at gmail.com>:

A global declaration inside a function is only supposed to affect assignments inside that function, but in code executed with exec, a global declaration affects assignments outside the function:

>>> gdict = {}
>>> ldict = {}
>>> exec('x = 1', gdict, ldict)
>>> 'x' in gdict
False
>>> 'x' in ldict
True
>>> 
>>> gdict = {}
>>> ldict = {}
>>> exec('''
... x = 1
... def f(): global x''', gdict, ldict)
>>> 'x' in gdict
True
>>> 'x' in ldict
False

Here, we can see that the presence of a "global x" declaration inside f causes the "x = 1" outside of f to assign to globals instead of locals. This also affects code objects compiled with compile().

----------
components: Interpreter Core
messages: 379855
nosy: Kevin Shweh
priority: normal
severity: normal
status: open
title: global declarations affect too much inside exec or compile
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42190>
_______________________________________

From report at bugs.python.org  Thu Oct 29 01:51:27 2020
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 29 Oct 2020 05:51:27 +0000
Subject: [issue42176] Valgrind reports "Conditional jump or move depends on
 uninitialised value(s)" in `PyUnicode_AsEncodedString` and `PyUnicode_Decode`
In-Reply-To: <1603824745.38.0.0631624355024.issue42176@roundup.psfhosted.org>
Message-ID: <1603950687.29.0.858433177517.issue42176@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42176>
_______________________________________

From report at bugs.python.org  Thu Oct 29 03:45:26 2020
From: report at bugs.python.org (Aschwin)
Date: Thu, 29 Oct 2020 07:45:26 +0000
Subject: [issue42191] lib.argparse._check_value() using repre instead of str
Message-ID: <1603957526.8.0.0927596859344.issue42191@roundup.psfhosted.org>


New submission from Aschwin <aschwin at vanderwoude.info>:

When using a custom type in add_argument(), the error message on an incorrect value uses repr instead of str, which looks ugly.

Example code:

login2account = {
    c.account.login: c.account for c in self.admin.get_accounts()
}

action_add_parser.add_argument(
    "--user", 
    dest="user",
    type=lambda x: login2account.get(x, x),
    choices=list(login2account.values()), 
    help="Login name of the user",
)


When using an unknown user, the output is something alike:
   action add: error: argument --assignee: invalid choice: karen (choose from <Account(login=john)>, <Account(login=peter)>)

The culprit is the following line in lib.argparse._check_value():

    args = {'value': value,
            'choices': ', '.join(map(repr, action.choices))}

Which should be the following for prettier output:

    args = {'value': value,
            'choices': ', '.join(map(str, action.choices))}

----------
components: Library (Lib)
messages: 379856
nosy: avdwoude
priority: normal
severity: normal
status: open
title: lib.argparse._check_value() using repre instead of str
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42191>
_______________________________________

From report at bugs.python.org  Thu Oct 29 03:56:23 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 29 Oct 2020 07:56:23 +0000
Subject: [issue42191] lib.argparse._check_value() using repre instead of str
In-Reply-To: <1603957526.8.0.0927596859344.issue42191@roundup.psfhosted.org>
Message-ID: <1603958183.28.0.508286906259.issue42191@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +paul.j3, rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42191>
_______________________________________

From report at bugs.python.org  Thu Oct 29 04:27:55 2020
From: report at bugs.python.org (Andrew Svetlov)
Date: Thu, 29 Oct 2020 08:27:55 +0000
Subject: [issue42183] Stack overflow error with asyncio.all_tasks and wait_for
In-Reply-To: <1603904364.33.0.601096284613.issue42183@roundup.psfhosted.org>
Message-ID: <1603960075.77.0.766592974681.issue42183@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I cannot reproduce on 3.9 but 3.8.6 crashes on `repr`:

  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/asyncio/base_futures.py", line 31 in format_cb
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/asyncio/base_futures.py", line 34 in _format_callbacks
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/asyncio/base_futures.py", line 57 in _future_repr_info
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/asyncio/base_tasks.py", line 9 in _task_repr_info
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/reprlib.py", line 139 in repr_instance
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/reprlib.py", line 62 in repr1
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/reprlib.py", line 71 in <listcomp>
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/reprlib.py", line 71 in _repr_iterable
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/reprlib.py", line 93 in repr_set
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/reprlib.py", line 60 in repr1
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/reprlib.py", line 52 in repr
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/asyncio/base_futures.py", line 54 in _future_repr_info
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/asyncio/base_tasks.py", line 9 in _task_repr_info
  File "/home/andrew/.pyenv/versions/3.8.6/lib/python3.8/reprlib.py", line 139 in repr_instance
... the stack tail recursively repeats

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42183>
_______________________________________

From report at bugs.python.org  Thu Oct 29 04:35:00 2020
From: report at bugs.python.org (Aschwin)
Date: Thu, 29 Oct 2020 08:35:00 +0000
Subject: [issue42191] lib.argparse._check_value() using repr instead of str
In-Reply-To: <1603957526.8.0.0927596859344.issue42191@roundup.psfhosted.org>
Message-ID: <1603960500.22.0.0325395261549.issue42191@roundup.psfhosted.org>


Change by Aschwin <aschwin at vanderwoude.info>:


----------
title: lib.argparse._check_value() using repre instead of str -> lib.argparse._check_value() using repr instead of str

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42191>
_______________________________________

From report at bugs.python.org  Thu Oct 29 05:14:03 2020
From: report at bugs.python.org (Andrew Svetlov)
Date: Thu, 29 Oct 2020 09:14:03 +0000
Subject: [issue42183] Stack overflow error with asyncio.all_tasks and wait_for
In-Reply-To: <1603904364.33.0.601096284613.issue42183@roundup.psfhosted.org>
Message-ID: <1603962843.58.0.685959869738.issue42183@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
type:  -> crash
versions: +Python 3.10, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42183>
_______________________________________

From report at bugs.python.org  Thu Oct 29 05:13:13 2020
From: report at bugs.python.org (Andrew Svetlov)
Date: Thu, 29 Oct 2020 09:13:13 +0000
Subject: [issue42183] Stack overflow error with asyncio.all_tasks and wait_for
In-Reply-To: <1603904364.33.0.601096284613.issue42183@roundup.psfhosted.org>
Message-ID: <1603962793.59.0.689070551079.issue42183@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Update: the bug is present in all supported Python versions bug sometimes may be hidden by race conditions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42183>
_______________________________________

From report at bugs.python.org  Thu Oct 29 05:16:07 2020
From: report at bugs.python.org (Martin Gfeller)
Date: Thu, 29 Oct 2020 09:16:07 +0000
Subject: [issue42192] Python Windows .exe Installer ignores /TargetDir if
 there is an existing installation
Message-ID: <1603962967.32.0.325420802039.issue42192@roundup.psfhosted.org>


New submission from Martin Gfeller <martin.gfeller at swisscom.com>:

I would like to install Python in a new location, completely separate and not affecting an existing installation of the same version. 

Despite I use /TargetDir=newdir, the installer goes into the "Modify Setup" dialog. If I chose "Modify", it shows my TargetDir read-only in the Customize installation location, but then modifies the original installation. 

If I run it with /passive or /quiet, it also modifies the existing installation instead of creating a new one at /TargetDir (doing nothing, since there is nothing to modify).

If I choose repair at the prompt, it installs the Debug version (only!) into the TargetDir, with no library files except venv\scripts\nt (containing the debug .exe). 

It seems the installer checks whether there is an existing installation based on the registry (or by other means such peeking into the default installation directory). If there is an existing installation, the  /TargetDir seems to be ignored, except for the peculiar repair installation of the debug build (which I never asked for).

I believe this to be a bug in the installer; however if ignoring the /TargetDir once an existing installation is found (which I do not find desirable), it should be documented. 

The /TARGETDIR option of the old .msi installer didn't have this problem, it would reliably install into the target dir.

----------
components: Installation, Windows
messages: 379859
nosy: Martin.Gfeller, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Python Windows .exe Installer ignores /TargetDir if there is an existing installation
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42192>
_______________________________________

From report at bugs.python.org  Thu Oct 29 05:22:09 2020
From: report at bugs.python.org (Andrew Svetlov)
Date: Thu, 29 Oct 2020 09:22:09 +0000
Subject: [issue42183] Stack overflow error with asyncio.all_tasks and wait_for
In-Reply-To: <1603904364.33.0.601096284613.issue42183@roundup.psfhosted.org>
Message-ID: <1603963329.58.0.634573558692.issue42183@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
keywords: +patch
pull_requests: +21934
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23020

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42183>
_______________________________________

From report at bugs.python.org  Thu Oct 29 05:23:59 2020
From: report at bugs.python.org (Andrew Svetlov)
Date: Thu, 29 Oct 2020 09:23:59 +0000
Subject: [issue42183] Stack overflow error with asyncio.all_tasks and wait_for
In-Reply-To: <1603904364.33.0.601096284613.issue42183@roundup.psfhosted.org>
Message-ID: <1603963439.45.0.370029480322.issue42183@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

The fix is ready

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42183>
_______________________________________

From report at bugs.python.org  Thu Oct 29 05:45:09 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 29 Oct 2020 09:45:09 +0000
Subject: [issue34204] Bump the default pickle protocol in shelve
In-Reply-To: <1532423802.47.0.56676864532.issue34204@psf.upfronthosting.co.za>
Message-ID: <1603964709.13.0.307733812651.issue34204@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset df59273c7a384ea8c890fa8e9b80c92825df841c by Zackery Spytz in branch 'master':
bpo-34204: Use pickle.DEFAULT_PROTOCOL in shelve (GH-19639)
https://github.com/python/cpython/commit/df59273c7a384ea8c890fa8e9b80c92825df841c


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34204>
_______________________________________

From report at bugs.python.org  Thu Oct 29 05:46:33 2020
From: report at bugs.python.org (Cheryl Sabella)
Date: Thu, 29 Oct 2020 09:46:33 +0000
Subject: [issue34204] Bump the default pickle protocol in shelve
In-Reply-To: <1532423802.47.0.56676864532.issue34204@psf.upfronthosting.co.za>
Message-ID: <1603964793.39.0.991410943828.issue34204@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
nosy:  -miss-islington
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34204>
_______________________________________

From report at bugs.python.org  Thu Oct 29 05:55:09 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 29 Oct 2020 09:55:09 +0000
Subject: [issue42189] copy.deepcopy() no longer works on platform.uname_result
 objects
In-Reply-To: <1603936415.14.0.266024580779.issue42189@roundup.psfhosted.org>
Message-ID: <1603965309.66.0.925376362837.issue42189@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +jaraco

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42189>
_______________________________________

From report at bugs.python.org  Thu Oct 29 05:58:04 2020
From: report at bugs.python.org (Martin Gfeller)
Date: Thu, 29 Oct 2020 09:58:04 +0000
Subject: [issue42192] Python Windows .exe Installer ignores /TargetDir if
 there is an existing installation
In-Reply-To: <1603962967.32.0.325420802039.issue42192@roundup.psfhosted.org>
Message-ID: <1603965484.66.0.638075386322.issue42192@roundup.psfhosted.org>


Martin Gfeller <martin.gfeller at swisscom.com> added the comment:

Windows Version is Windows 10, version 1803 (build 17134.1726).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42192>
_______________________________________

From report at bugs.python.org  Thu Oct 29 05:59:29 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 29 Oct 2020 09:59:29 +0000
Subject: [issue42143] Corruptions in func_dealloc() with partially-created
 function object
In-Reply-To: <1603583345.9.0.605339724776.issue42143@roundup.psfhosted.org>
Message-ID: <1603965569.22.0.476835768126.issue42143@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 350526105fa9b131d8b941ae753378b741dabb2f by Yonatan Goldschmidt in branch 'master':
bpo-42143: Ensure PyFunction_NewWithQualName() can't fail after creating the func object (GH-22953)
https://github.com/python/cpython/commit/350526105fa9b131d8b941ae753378b741dabb2f


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42143>
_______________________________________

From report at bugs.python.org  Thu Oct 29 05:59:33 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 29 Oct 2020 09:59:33 +0000
Subject: [issue42143] Corruptions in func_dealloc() with partially-created
 function object
In-Reply-To: <1603583345.9.0.605339724776.issue42143@roundup.psfhosted.org>
Message-ID: <1603965573.62.0.61139255164.issue42143@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21936
pull_request: https://github.com/python/cpython/pull/23022

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42143>
_______________________________________

From report at bugs.python.org  Thu Oct 29 05:59:24 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 29 Oct 2020 09:59:24 +0000
Subject: [issue42143] Corruptions in func_dealloc() with partially-created
 function object
In-Reply-To: <1603583345.9.0.605339724776.issue42143@roundup.psfhosted.org>
Message-ID: <1603965564.05.0.711026339795.issue42143@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 1.0 -> 2.0
pull_requests: +21935
pull_request: https://github.com/python/cpython/pull/23021

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42143>
_______________________________________

From report at bugs.python.org  Thu Oct 29 06:24:16 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 29 Oct 2020 10:24:16 +0000
Subject: [issue42143] Corruptions in func_dealloc() with partially-created
 function object
In-Reply-To: <1603583345.9.0.605339724776.issue42143@roundup.psfhosted.org>
Message-ID: <1603967056.35.0.0999465413641.issue42143@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 9ede1b071bf5250ba5f2d04d7ba86a24c06d41a1 by Miss Skeleton (bot) in branch '3.8':
bpo-42143: Ensure PyFunction_NewWithQualName() can't fail after creating the func object (GH-22953)
https://github.com/python/cpython/commit/9ede1b071bf5250ba5f2d04d7ba86a24c06d41a1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42143>
_______________________________________

From report at bugs.python.org  Thu Oct 29 06:42:52 2020
From: report at bugs.python.org (flying sheep)
Date: Thu, 29 Oct 2020 10:42:52 +0000
Subject: [issue42193] Improve socket.bind error message
Message-ID: <1603968172.16.0.632211666249.issue42193@roundup.psfhosted.org>


New submission from flying sheep <flying-sheep at web.de>:

In the end of my stack trace, I just see

      File "...", line 174, in bind_sockets
        sock.bind(sockaddr)
    OSError: [Errno 99] Cannot assign requested address

It would be useful if it would tell me which socket that was in the error message.

----------
messages: 379865
nosy: flying sheep
priority: normal
severity: normal
status: open
title: Improve socket.bind error message

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42193>
_______________________________________

From report at bugs.python.org  Thu Oct 29 06:43:40 2020
From: report at bugs.python.org (flying sheep)
Date: Thu, 29 Oct 2020 10:43:40 +0000
Subject: [issue42193] Improve socket.bind error message
In-Reply-To: <1603968172.16.0.632211666249.issue42193@roundup.psfhosted.org>
Message-ID: <1603968220.1.0.693237199627.issue42193@roundup.psfhosted.org>


Change by flying sheep <flying-sheep at web.de>:


----------
components: +IO
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42193>
_______________________________________

From report at bugs.python.org  Thu Oct 29 06:50:16 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 29 Oct 2020 10:50:16 +0000
Subject: [issue42029] Remove dynload_dl.c
In-Reply-To: <1602633475.18.0.479019652279.issue42029@roundup.psfhosted.org>
Message-ID: <1603968616.07.0.971902958826.issue42029@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21937
pull_request: https://github.com/python/cpython/pull/23023

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42029>
_______________________________________

From report at bugs.python.org  Thu Oct 29 07:03:13 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 29 Oct 2020 11:03:13 +0000
Subject: [issue42143] Corruptions in func_dealloc() with partially-created
 function object
In-Reply-To: <1603583345.9.0.605339724776.issue42143@roundup.psfhosted.org>
Message-ID: <1603969393.43.0.0341309615971.issue42143@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42143>
_______________________________________

From report at bugs.python.org  Thu Oct 29 07:03:20 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 29 Oct 2020 11:03:20 +0000
Subject: [issue42143] Corruptions in func_dealloc() with partially-created
 function object
In-Reply-To: <1603583345.9.0.605339724776.issue42143@roundup.psfhosted.org>
Message-ID: <1603969400.79.0.0593581750938.issue42143@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 60324d26b58c89d68abb23fb42f1563d395c3910 by Miss Skeleton (bot) in branch '3.9':
bpo-42143: Ensure PyFunction_NewWithQualName() can't fail after creating the func object (GH-22953) (GH-23021)
https://github.com/python/cpython/commit/60324d26b58c89d68abb23fb42f1563d395c3910


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42143>
_______________________________________

From report at bugs.python.org  Thu Oct 29 07:49:54 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 29 Oct 2020 11:49:54 +0000
Subject: [issue41796] _ast module state should be made per interpreter
In-Reply-To: <1600251024.87.0.709557549839.issue41796@roundup.psfhosted.org>
Message-ID: <1603972194.28.0.739426953553.issue41796@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +21938
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23024

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41796>
_______________________________________

From report at bugs.python.org  Thu Oct 29 07:52:16 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 29 Oct 2020 11:52:16 +0000
Subject: [issue41194] Python 3.9.0b3 crash on compile() in PyAST_Check() when
 the _ast module is loaded more than once
In-Reply-To: <1593682119.68.0.42848291784.issue41194@roundup.psfhosted.org>
Message-ID: <1603972336.84.0.618998428851.issue41194@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21939
pull_request: https://github.com/python/cpython/pull/23024

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41194>
_______________________________________

From report at bugs.python.org  Thu Oct 29 07:52:17 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 29 Oct 2020 11:52:17 +0000
Subject: [issue41261] 3.9-dev SEGV in object_recursive_isinstance in
 ast.literal_eval
In-Reply-To: <1594319150.59.0.418042347071.issue41261@roundup.psfhosted.org>
Message-ID: <1603972337.11.0.744300797801.issue41261@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21940
pull_request: https://github.com/python/cpython/pull/23024

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41261>
_______________________________________

From report at bugs.python.org  Thu Oct 29 07:52:17 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 29 Oct 2020 11:52:17 +0000
Subject: [issue41631] _ast module: get_global_ast_state() doesn't work with
 Mercurial lazy import
In-Reply-To: <1598350561.88.0.831200620813.issue41631@roundup.psfhosted.org>
Message-ID: <1603972337.19.0.937568748393.issue41631@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21941
pull_request: https://github.com/python/cpython/pull/23024

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41631>
_______________________________________

From report at bugs.python.org  Thu Oct 29 07:54:09 2020
From: report at bugs.python.org (shangxiao)
Date: Thu, 29 Oct 2020 11:54:09 +0000
Subject: [issue42194] BooleanOptionalAction missing "New in version 3.9"
Message-ID: <1603972449.31.0.552627573436.issue42194@roundup.psfhosted.org>


New submission from shangxiao <shang.xiao.sanders at gmail.com>:

The section that describes BooleanOptionalAction just requires a "New in version 3.9" tag

----------
assignee: docs at python
components: Documentation
messages: 379867
nosy: docs at python, shangxiao
priority: normal
severity: normal
status: open
title: BooleanOptionalAction missing "New in version 3.9"
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42194>
_______________________________________

From report at bugs.python.org  Thu Oct 29 08:06:03 2020
From: report at bugs.python.org (daniel hahler)
Date: Thu, 29 Oct 2020 12:06:03 +0000
Subject: [issue24120] pathlib.(r)glob stops on PermissionDenied exception
In-Reply-To: <1430675548.94.0.105476682455.issue24120@psf.upfronthosting.co.za>
Message-ID: <1603973163.91.0.75734018745.issue24120@roundup.psfhosted.org>


Change by daniel hahler <python-bugs at thequod.de>:


----------
nosy: +blueyed
nosy_count: 7.0 -> 8.0
pull_requests: +21942
pull_request: https://github.com/python/cpython/pull/23025

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24120>
_______________________________________

From report at bugs.python.org  Thu Oct 29 08:06:04 2020
From: report at bugs.python.org (daniel hahler)
Date: Thu, 29 Oct 2020 12:06:04 +0000
Subject: [issue38894] Path.glob() sometimes misses files that match
In-Reply-To: <1574431567.77.0.580808736749.issue38894@roundup.psfhosted.org>
Message-ID: <1603973164.33.0.556960092446.issue38894@roundup.psfhosted.org>


Change by daniel hahler <python-bugs at thequod.de>:


----------
nosy: +blueyed
nosy_count: 4.0 -> 5.0
pull_requests: +21943
pull_request: https://github.com/python/cpython/pull/23025

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38894>
_______________________________________

From report at bugs.python.org  Thu Oct 29 08:06:54 2020
From: report at bugs.python.org (shangxiao)
Date: Thu, 29 Oct 2020 12:06:54 +0000
Subject: [issue42194] Docs for argparse.BooleanOptionalAction missing "New in
 version 3.9"
In-Reply-To: <1603972449.31.0.552627573436.issue42194@roundup.psfhosted.org>
Message-ID: <1603973214.44.0.854498581516.issue42194@roundup.psfhosted.org>


shangxiao <shang.xiao.sanders at gmail.com> added the comment:

Here's the section in the docs for BooleanOptionalAction: https://docs.python.org/3.9/library/argparse.html#action

----------
title: BooleanOptionalAction missing "New in version 3.9" -> Docs for argparse.BooleanOptionalAction missing "New in version 3.9"

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42194>
_______________________________________

From report at bugs.python.org  Thu Oct 29 08:04:50 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 29 Oct 2020 12:04:50 +0000
Subject: [issue42156] Currency not correct for all locales
In-Reply-To: <1603719185.4.0.390571957235.issue42156@roundup.psfhosted.org>
Message-ID: <1603973090.24.0.23444733094.issue42156@roundup.psfhosted.org>


Change by Eric V. Smith <eric at trueblade.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42156>
_______________________________________

From report at bugs.python.org  Thu Oct 29 08:25:19 2020
From: report at bugs.python.org (Zac Hatfield-Dodds)
Date: Thu, 29 Oct 2020 12:25:19 +0000
Subject: [issue42195] Inconsistent __args__ between typing.Callable and
 collections.abc.Callable
Message-ID: <1603974319.88.0.166786801787.issue42195@roundup.psfhosted.org>


New submission from Zac Hatfield-Dodds <zac.hatfield.dodds at gmail.com>:

The two ways of getting a parametrised Callable have inconsistent __args__:

    >>> import collections.abc, typing
    >>> typing.Callable[[int, int], int].__args__
    (int, int, int)
    >>> collections.abc.Callable[[int, int], int].__args__
    ([int, int], int)

I discovered this while working on PEP 585 support in Hypothesis [1], where it is easy enough to work around but carries a potentially serious performance cost - the list means we cannot use the type as a cache key for non-`...` argument types.  

https://bugs.python.org/issue40494 and https://bugs.python.org/issue40398 may be related.

[1] https://github.com/HypothesisWorks/hypothesis/pull/2653

----------
components: Library (Lib)
messages: 379869
nosy: Zac Hatfield-Dodds, gvanrossum, levkivskyi, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Inconsistent __args__ between typing.Callable and collections.abc.Callable
type: behavior
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42195>
_______________________________________

From report at bugs.python.org  Thu Oct 29 08:57:55 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Thu, 29 Oct 2020 12:57:55 +0000
Subject: [issue42189] copy.deepcopy() no longer works on platform.uname_result
 objects
In-Reply-To: <1603936415.14.0.266024580779.issue42189@roundup.psfhosted.org>
Message-ID: <1603976275.92.0.168484847792.issue42189@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

Acknowledged. Thanks for the report. I'll likely address this issue alongside the other (same PR).

----------
assignee:  -> jaraco

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42189>
_______________________________________

From report at bugs.python.org  Thu Oct 29 08:58:48 2020
From: report at bugs.python.org (Roundup Robot)
Date: Thu, 29 Oct 2020 12:58:48 +0000
Subject: [issue42194] Docs for argparse.BooleanOptionalAction missing "New in
 version 3.9"
In-Reply-To: <1603972449.31.0.552627573436.issue42194@roundup.psfhosted.org>
Message-ID: <1603976328.4.0.867225422413.issue42194@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 2.0 -> 3.0
pull_requests: +21944
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23026

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42194>
_______________________________________

From report at bugs.python.org  Thu Oct 29 09:07:18 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Thu, 29 Oct 2020 13:07:18 +0000
Subject: [issue42189] copy.deepcopy() no longer works on platform.uname_result
 objects
In-Reply-To: <1603936415.14.0.266024580779.issue42189@roundup.psfhosted.org>
Message-ID: <1603976838.33.0.0495899188847.issue42189@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
keywords: +patch
pull_requests: +21945
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23010

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42189>
_______________________________________

From report at bugs.python.org  Thu Oct 29 09:06:01 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 29 Oct 2020 13:06:01 +0000
Subject: [issue40255] Fixing Copy on Writes from reference counting
In-Reply-To: <1586619621.82.0.553262088399.issue40255@roundup.psfhosted.org>
Message-ID: <1603976761.52.0.107185341478.issue40255@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Fast shutdown option

You can use os._exit(0).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40255>
_______________________________________

From report at bugs.python.org  Thu Oct 29 09:23:58 2020
From: report at bugs.python.org (Jason R. Coombs)
Date: Thu, 29 Oct 2020 13:23:58 +0000
Subject: [issue42163] _replace() no longer works on platform.uname_result
 objects
In-Reply-To: <1603750912.81.0.950571190169.issue42163@roundup.psfhosted.org>
Message-ID: <1603977838.77.0.557840014502.issue42163@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

Please take a look at the PR. Let me know what you think about the limited compatibility it adds (still doesn't allow _replace on 'processor').

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42163>
_______________________________________

From report at bugs.python.org  Thu Oct 29 09:30:04 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 29 Oct 2020 13:30:04 +0000
Subject: [issue42194] Docs for argparse.BooleanOptionalAction missing "New in
 version 3.9"
In-Reply-To: <1603972449.31.0.552627573436.issue42194@roundup.psfhosted.org>
Message-ID: <1603978204.78.0.294570516295.issue42194@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +paul.j3, rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42194>
_______________________________________

From report at bugs.python.org  Thu Oct 29 09:39:00 2020
From: report at bugs.python.org (shakir_juolay)
Date: Thu, 29 Oct 2020 13:39:00 +0000
Subject: [issue42196] Python Windows Installation Error 0x800705aa
Message-ID: <1603978740.79.0.0573376832754.issue42196@roundup.psfhosted.org>


New submission from shakir_juolay <shakir_juolay at yahoo.com>:

I have recently changed my laptop and my Admin copied everything from D:\Users\sjuolay folder from the old laptop to new laptop. Both Windows 10. I had Python 3.8 64bit on the old laptop. I am trying to install Python 3.9 64bit on my new laptop. But I failed with error 0x800705aa. Attached is the log file.

Also Windows CMD is behaving strange. It does not throw any error on 'python' command but does nothing. It throws error on 'py' command.

Microsoft Windows [Version 10.0.19041.546]
(c) 2020 Microsoft Corporation. All rights reserved.

D:\Users\sjuolay>python

D:\Users\sjuolay>py
'py' is not recognized as an internal or external command,
operable program or batch file.

D:\Users\sjuolay>

----------
components: Installation
files: Pyhon39InstallLog.txt
messages: 379873
nosy: shakir_juolay
priority: normal
severity: normal
status: open
title: Python Windows Installation Error 0x800705aa
versions: Python 3.9
Added file: https://bugs.python.org/file49548/Pyhon39InstallLog.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42196>
_______________________________________

From report at bugs.python.org  Thu Oct 29 10:01:48 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 29 Oct 2020 14:01:48 +0000
Subject: [issue42196] Python Windows Installation Error 0x800705aa
In-Reply-To: <1603978740.79.0.0573376832754.issue42196@roundup.psfhosted.org>
Message-ID: <1603980108.93.0.353597405416.issue42196@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42196>
_______________________________________

From report at bugs.python.org  Thu Oct 29 10:16:41 2020
From: report at bugs.python.org (Fabio Zadrozny)
Date: Thu, 29 Oct 2020 14:16:41 +0000
Subject: [issue42197] Disable automatic update of frame locals during tracing
Message-ID: <1603981001.04.0.667888856285.issue42197@roundup.psfhosted.org>


New submission from Fabio Zadrozny <fabioz at users.sourceforge.net>:

Right now, when a debugger is active, the number of local variables can affect the tracing speed quite a lot.

For instance, having tracing setup in a program such as the one below takes 4.64 seconds to run, yet, changing all the variables to have the same name -- i.e.: change all assignments to `a = 1` (such that there's only a single variable in the namespace), it takes 1.47 seconds (in my machine)... the higher the number of variables, the slower the tracing becomes.

```
import time
t = time.time()

def call():
    a = 1
    b = 1
    c = 1
    d = 1
    e = 1
    f = 1

def noop(frame, event, arg):
    return noop

import sys
sys.settrace(noop)

for i in range(1_000_000):
    call()

print('%.2fs' % (time.time() - t,))
```

This happens because `PyFrame_FastToLocalsWithError` and `PyFrame_LocalsToFast` are called inside the `call_trampoline` (https://github.com/python/cpython/blob/master/Python/sysmodule.c#L946).

So, I'd like to simply remove those calls.

Debuggers can call  `PyFrame_LocalsToFast` when needed -- otherwise mutating non-current frames doesn't work anyways. As a note, pydevd already has such a call: https://github.com/fabioz/PyDev.Debugger/blob/0d4d210f01a1c0a8647178b2e665b53ab113509d/_pydevd_bundle/pydevd_save_locals.py#L57 and PyPy also has a counterpart.

As for `PyFrame_FastToLocalsWithError`, I don't really see any reason to call it at all.

i.e.: something as the code below prints the `a` variable from the `main()` frame regardless of that and I checked all pydevd tests and nothing seems to be affected (it seems that accessing f_locals already does this: https://github.com/python/cpython/blob/cb9879b948a19c9434316f8ab6aba9c4601a8173/Objects/frameobject.c#L35, so, I don't see much reason to call it at all).

```
def call():
    import sys
    frame = sys._getframe()
    print(frame.f_back.f_locals)
   
def main():
    a = 1
    call()
   
if __name__ == '__main__':
    main()
```

So, the idea is removing those lines (I expect that I'll be able to provide a pull request for this).

----------
components: Interpreter Core
messages: 379874
nosy: fabioz
priority: normal
severity: normal
status: open
title: Disable automatic update of frame locals during tracing
type: performance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42197>
_______________________________________

From report at bugs.python.org  Thu Oct 29 10:16:43 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 29 Oct 2020 14:16:43 +0000
Subject: [issue42029] Remove dynload_dl.c
In-Reply-To: <1602633475.18.0.479019652279.issue42029@roundup.psfhosted.org>
Message-ID: <1603981003.49.0.114924694316.issue42029@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 5776663675b48f011d428a5874cc3c79d1deb59e by Victor Stinner in branch 'master':
bpo-42029: Remove IRIX code (GH-23023)
https://github.com/python/cpython/commit/5776663675b48f011d428a5874cc3c79d1deb59e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42029>
_______________________________________

From report at bugs.python.org  Thu Oct 29 11:32:56 2020
From: report at bugs.python.org (hai shi)
Date: Thu, 29 Oct 2020 15:32:56 +0000
Subject: [issue41796] _ast module state should be made per interpreter
In-Reply-To: <1600251024.87.0.709557549839.issue41796@roundup.psfhosted.org>
Message-ID: <1603985576.04.0.733826513686.issue41796@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41796>
_______________________________________

From report at bugs.python.org  Thu Oct 29 11:33:23 2020
From: report at bugs.python.org (hai shi)
Date: Thu, 29 Oct 2020 15:33:23 +0000
Subject: [issue42171] Add PEP 573 to the stable ABI
In-Reply-To: <1603810249.77.0.333997046365.issue42171@roundup.psfhosted.org>
Message-ID: <1603985603.9.0.648815983944.issue42171@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42171>
_______________________________________

From report at bugs.python.org  Thu Oct 29 11:33:50 2020
From: report at bugs.python.org (hai shi)
Date: Thu, 29 Oct 2020 15:33:50 +0000
Subject: [issue42111] Make the xxlimited module an example of best extension
 module practices
In-Reply-To: <1603310336.9.0.27411366123.issue42111@roundup.psfhosted.org>
Message-ID: <1603985630.68.0.638001910786.issue42111@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42111>
_______________________________________

From report at bugs.python.org  Thu Oct 29 11:39:44 2020
From: report at bugs.python.org (Ken Jin)
Date: Thu, 29 Oct 2020 15:39:44 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
Message-ID: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>


New submission from Ken Jin <kenjin4096 at gmail.com>:

This is an umbrella issue to clean up docs for Union and GenericAlias. To-do (not in order):

1. Update links in typing, subscription and union to point to GenericAlias.

2. Park GenericAlias and Union under a new section 'Type Annotation Types' in stdtypes for 3.10. The reason is to follow with the rest of the stdtypes' doc convention.

3. Consistency nitpicks for Union's docs.

----------
assignee: docs at python
components: Documentation
messages: 379876
nosy: docs at python, gvanrossum, kj
priority: normal
severity: normal
status: open
title: Clean up docs for Union and GenericAlias
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Thu Oct 29 11:41:05 2020
From: report at bugs.python.org (Roundup Robot)
Date: Thu, 29 Oct 2020 15:41:05 +0000
Subject: [issue42197] Disable automatic update of frame locals during tracing
In-Reply-To: <1603981001.04.0.667888856285.issue42197@roundup.psfhosted.org>
Message-ID: <1603986065.78.0.314793164463.issue42197@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 1.0 -> 2.0
pull_requests: +21947
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23028

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42197>
_______________________________________

From report at bugs.python.org  Thu Oct 29 11:43:34 2020
From: report at bugs.python.org (Ken Jin)
Date: Thu, 29 Oct 2020 15:43:34 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1603986214.08.0.486820755748.issue42198@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
keywords: +patch
pull_requests: +21948
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23029

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Thu Oct 29 12:00:15 2020
From: report at bugs.python.org (Daniel Alley)
Date: Thu, 29 Oct 2020 16:00:15 +0000
Subject: [issue41699] Potential memory leak with asyncio and run_in_executor
In-Reply-To: <1599103455.66.0.578420174204.issue41699@roundup.psfhosted.org>
Message-ID: <1603987215.37.0.626026316807.issue41699@roundup.psfhosted.org>


Daniel Alley <dalley at redhat.com> added the comment:

This seems likely to be a duplicate of https://bugs.python.org/issue41588, as run_in_executor(None, ...) submits tasks to a ThreadPoolExecutor underneath the hood.

----------
nosy: +dralley

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41699>
_______________________________________

From report at bugs.python.org  Thu Oct 29 12:02:21 2020
From: report at bugs.python.org (Ken Jin)
Date: Thu, 29 Oct 2020 16:02:21 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1603987341.23.0.620986339147.issue42198@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

4. types.GenericAlias's __call__ signature of (origin, args) is not documented anywhere, I'll create a PR to types.rst eventually.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Thu Oct 29 12:04:31 2020
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 29 Oct 2020 16:04:31 +0000
Subject: [issue42196] Python Windows Installation Error 0x800705aa
In-Reply-To: <1603978740.79.0.0573376832754.issue42196@roundup.psfhosted.org>
Message-ID: <1603987471.06.0.391356125123.issue42196@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

0x8007_05AA is ERROR_NO_SYSTEM_RESOURCES (1450, 0x05AA) returned as an HRESULT value. This error is usually due to a system call failing with the status code STATUS_INSUFFICIENT_RESOURCES. From "Pyhon39InstallLog.txt", apparently the installer failed to create an uninstall registry key for the current user. Can you successfully install other programs for just the current user (non-elevated)?

For the issue with `python` not doing anything, check `where.exe python`. The first match is the one that CMD would try to execute.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42196>
_______________________________________

From report at bugs.python.org  Thu Oct 29 12:39:31 2020
From: report at bugs.python.org (paul j3)
Date: Thu, 29 Oct 2020 16:39:31 +0000
Subject: [issue42191] lib.argparse._check_value() using repr instead of str
In-Reply-To: <1603957526.8.0.0927596859344.issue42191@roundup.psfhosted.org>
Message-ID: <1603989571.5.0.88301877593.issue42191@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

In the Help formatting, 

    choice_strs = [str(choice) for choice in action.choices]

The use of `repr` in this check_value() error message was, I think, deliberate.  For simple choices like strings and numbers it doesn't matter.  But for other cases, it may help to know more about the identify of the choice objects, such as their class.

The actual parsing test is just a 'in' test.

    value not in action.choices

There is the added complication that the _get_value() function has already applied the type function the argument string, converting it to a compatible object (for testing). 

Should argparse be changed, or should it be up to the developer to use a type/choices pairing that gives the desired help and error messages?

To improve the discussion, I think your 'self.admin' example should be replaced by a self contained type and class.  In the spirit of a StackOverFlow question I'd like concrete minimal example that I can test and play with.  I don't want to write a pseudo-account class.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42191>
_______________________________________

From report at bugs.python.org  Thu Oct 29 12:53:11 2020
From: report at bugs.python.org (paul j3)
Date: Thu, 29 Oct 2020 16:53:11 +0000
Subject: [issue42191] lib.argparse._check_value() using repr instead of str
In-Reply-To: <1603957526.8.0.0927596859344.issue42191@roundup.psfhosted.org>
Message-ID: <1603990391.05.0.573423207508.issue42191@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

Do you realize that `choices` can be a dictionary?  And since you want the user to supply a key, not a value, you might not want to use a type that does the conversion.

To illustrate consider two ways of using a simple dictionary.

import argparse

adict = {'a': [1,2,3], 'b': 'astring'}

parser = argparse.ArgumentParser()
parser.add_argument('-f', 
    type = lambda x: adict.get(x,x),
    choices = list(adict.values())
    )
parser.add_argument('-g', choices = adict)

args =  parser.parse_args()
print(args)
print(args.f, adict[args.g])

sample runs:

valid key:

    0942:~/mypy$ python3 issue42191.py -f a -g a
    Namespace(f=[1, 2, 3], g='a')
    [1, 2, 3] [1, 2, 3]

help:

    0945:~/mypy$ python3 issue42191.py -h
    usage: issue42191.py [-h] [-f {[1, 2, 3],astring}] [-g {a,b}]

    optional arguments:
        -h, --help            show this help message and exit
        -f {[1, 2, 3],astring}
        -g {a,b}

Error cases:

    0945:~/mypy$ python3 issue42191.py -f x
    usage: issue42191.py [-h] [-f {[1, 2, 3],astring}] [-g {a,b}]
    issue42191.py: error: argument -f: invalid choice: 'x' (choose from 
    [1, 2, 3], 'astring')

    0945:~/mypy$ python3 issue42191.py -g x
    usage: issue42191.py [-h] [-f {[1, 2, 3],astring}] [-g {a,b}]
    issue42191.py: error: argument -g: invalid choice: 'x' (choose from 
    'a', 'b')

With -g, we have to perform the dictionary lookup after parsing, but choices, {a,b}, are clear in both the help and error.

With -f, both the help (which uses str) and the error, give wrong user choices, the dictionary values rather than the keys.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42191>
_______________________________________

From report at bugs.python.org  Thu Oct 29 13:26:02 2020
From: report at bugs.python.org (Ken Jin)
Date: Thu, 29 Oct 2020 17:26:02 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1603992362.55.0.200896104714.issue42198@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
pull_requests: +21949
pull_request: https://github.com/python/cpython/pull/23030

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Thu Oct 29 14:58:59 2020
From: report at bugs.python.org (Steve Dower)
Date: Thu, 29 Oct 2020 18:58:59 +0000
Subject: [issue42192] Python Windows .exe Installer ignores /TargetDir if
 there is an existing installation
In-Reply-To: <1603962967.32.0.325420802039.issue42192@roundup.psfhosted.org>
Message-ID: <1603997939.42.0.462704347363.issue42192@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Unfortunately, this is deliberate, or at least deliberate enough to not consider it a bug.

The installer from python.org is intended to only support a single install per-machine.

In general, if you simply copy the installation folder to a new location it will be isolated from the first. However, there are some circumstances where this is not the case (unless you take additional steps to isolate it, such as adding a ._pth file).

If you can share a bit more about what you're trying to achieve, we may be able to suggest an alternative approach. Otherwise, you may need to find another distribution/installer of CPython.

----------
type: behavior -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42192>
_______________________________________

From report at bugs.python.org  Thu Oct 29 16:48:24 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 29 Oct 2020 20:48:24 +0000
Subject: [issue42180] Missing a plural in library/functions
In-Reply-To: <1603883314.74.0.667097394746.issue42180@roundup.psfhosted.org>
Message-ID: <1604004504.62.0.530268615351.issue42180@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset b76a8400217827e604ebb543f45156f3caacd9a0 by Rafael Fontenelle in branch 'master':
bpo-42180: fix plural in arguments and control (GH-23015)
https://github.com/python/cpython/commit/b76a8400217827e604ebb543f45156f3caacd9a0


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42180>
_______________________________________

From report at bugs.python.org  Thu Oct 29 16:53:21 2020
From: report at bugs.python.org (Sophia Wisdom)
Date: Thu, 29 Oct 2020 20:53:21 +0000
Subject: [issue41699] Potential memory leak with asyncio and run_in_executor
In-Reply-To: <1599103455.66.0.578420174204.issue41699@roundup.psfhosted.org>
Message-ID: <1604004801.81.0.527679174592.issue41699@roundup.psfhosted.org>


Sophia Wisdom <sophia at reduct.video> added the comment:

It looks like it's not specific to the ThreadPoolExecutor.

```
import asyncio
import concurrent

def leaker_func():
    list(range(int(1000)))
    # removed 1/0 because this causes issues with the ProcessPoolExecutor

async def function():
    loop = asyncio.get_running_loop()
    for i in range(10000):
        loop.run_in_executor(concurrent.futures.ProcessPoolExecutor(), leaker_func)
```
10MB at this point

then after executing this:
```
asyncio.run(function())
```
40MB. (~same as ThreadPoolExecutor in python3.10)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41699>
_______________________________________

From report at bugs.python.org  Thu Oct 29 16:53:39 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 29 Oct 2020 20:53:39 +0000
Subject: [issue42180] Missing a plural in library/functions
In-Reply-To: <1603883314.74.0.667097394746.issue42180@roundup.psfhosted.org>
Message-ID: <1604004819.22.0.33110213625.issue42180@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42180>
_______________________________________

From report at bugs.python.org  Thu Oct 29 16:55:16 2020
From: report at bugs.python.org (Kyle Stanley)
Date: Thu, 29 Oct 2020 20:55:16 +0000
Subject: [issue41588] Potential Memory leak with
 concurrent.futures.ThreadPoolExecutor's map
In-Reply-To: <1597845315.75.0.199249722825.issue41588@roundup.psfhosted.org>
Message-ID: <1604004916.78.0.045749709817.issue41588@roundup.psfhosted.org>


Change by Kyle Stanley <aeros167 at gmail.com>:


----------
nosy: +aeros, bquinlan, pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41588>
_______________________________________

From report at bugs.python.org  Thu Oct 29 17:01:29 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 29 Oct 2020 21:01:29 +0000
Subject: [issue42197] Disable automatic update of frame locals during tracing
In-Reply-To: <1603981001.04.0.667888856285.issue42197@roundup.psfhosted.org>
Message-ID: <1604005289.49.0.331431005214.issue42197@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42197>
_______________________________________

From report at bugs.python.org  Thu Oct 29 17:22:06 2020
From: report at bugs.python.org (Maxwell Bernstein)
Date: Thu, 29 Oct 2020 21:22:06 +0000
Subject: [issue42199] bytecode_helper assertNotInBytecode fails too eagerly
Message-ID: <1604006526.43.0.914046612592.issue42199@roundup.psfhosted.org>


New submission from Maxwell Bernstein <tekk.nolagi at gmail.com>:

assertNotInBytecode should only fail if:

* the instr matches and the arg is unspecified, or
* the instr matches, the arg is specified, and the arg matches

But right now it fails in a third case because of the dangling self.fail() call. The self.fail() call should be moved into the `if`/`elif`.

----------
components: Tests
messages: 379885
nosy: tekknolagi
priority: normal
severity: normal
status: open
title: bytecode_helper assertNotInBytecode fails too eagerly
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42199>
_______________________________________

From report at bugs.python.org  Thu Oct 29 17:24:14 2020
From: report at bugs.python.org (Maxwell Bernstein)
Date: Thu, 29 Oct 2020 21:24:14 +0000
Subject: [issue42199] bytecode_helper assertNotInBytecode fails too eagerly
In-Reply-To: <1604006526.43.0.914046612592.issue42199@roundup.psfhosted.org>
Message-ID: <1604006654.64.0.279405483696.issue42199@roundup.psfhosted.org>


Change by Maxwell Bernstein <tekk.nolagi at gmail.com>:


----------
keywords: +patch
pull_requests: +21950
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23031

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42199>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:13:07 2020
From: report at bugs.python.org (Sebastian Wiedenroth)
Date: Thu, 29 Oct 2020 22:13:07 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604009587.36.0.704074935658.issue42173@roundup.psfhosted.org>


Sebastian Wiedenroth <wiedi at frubar.net> added the comment:

Please don't.

Even if Oracle doesn't care anymore, the open source illumos community does.
We (illumos) share the same uname "SunOS" and depend on this support.

I have offered to host an illumos buildbot in the past and that offer is still valid.
At that time the testsuite did not pass and I could not figure out the fix yet.
If having this fixed is a requirement to keep illumos supported I will invest more time into this. I can also offer shell access to anyone interested in helping with this.

----------
nosy: +wiedi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:13:29 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 29 Oct 2020 22:13:29 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604009609.94.0.575946470126.issue42173@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I looked at PyPI download statistics of the "six" module over the last 180 days (6 months), grouped by operating system name:

* SunOS: 3,975 downloads
* TOTAL: 590,727,298 downloads

SunOS is 0.0007% of all six downloads.

For comparison, the top 4 is:

* Linux: 91% (535,804,817)
* Windows: 4% (21,053,173)
* <empty system name>: 3% (18,695,360)
* macOS (Darwin): 3% (14,776,993)

Raw data of the top 14:

num_downloads,system_name
535804817,Linux
21053173,Windows
18695360,
14776993,Darwin
347090,FreeBSD
9759,Qnx
5350,Java
3975,SunOS
3178,CYGWIN_NT-10.0-14393
3177,CYGWIN_NT-10.0-17763
2505,CYGWIN_NT-10.0-18363
2263,AIX
2061,NetBSD
1891,OpenBSD

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:14:26 2020
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 29 Oct 2020 22:14:26 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604009666.17.0.298424158034.issue42173@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> We (illumos) share the same uname "SunOS" and depend on this support.

Which Python version do you use?

https://blogs.oracle.com/solaris/future-of-python-on-solaris mentions Python 2.7 and 3.4.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:18:08 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 29 Oct 2020 22:18:08 +0000
Subject: [issue42061] Document __format__ method for IPv[46]Address
In-Reply-To: <1602939831.57.0.752623418103.issue42061@roundup.psfhosted.org>
Message-ID: <1604009888.46.0.887800696357.issue42061@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 3317466061509c83dce257caab3661d52571cab1 by Teugea Ioan-Teodor in branch 'master':
bpo-42061: Document __format__ for IP addresses (GH-23018)
https://github.com/python/cpython/commit/3317466061509c83dce257caab3661d52571cab1


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42061>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:18:42 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 29 Oct 2020 22:18:42 +0000
Subject: [issue42061] Document __format__ method for IPv[46]Address
In-Reply-To: <1602939831.57.0.752623418103.issue42061@roundup.psfhosted.org>
Message-ID: <1604009922.44.0.752774009311.issue42061@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21951
pull_request: https://github.com/python/cpython/pull/23032

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42061>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:22:17 2020
From: report at bugs.python.org (Sebastian Wiedenroth)
Date: Thu, 29 Oct 2020 22:22:17 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604010137.05.0.622752463187.issue42173@roundup.psfhosted.org>


Sebastian Wiedenroth <wiedi at frubar.net> added the comment:

> Which Python version do you use?

Myself currently mostly python 3.8 via pkgsrc on SmartOS (one of the illumos distributions).

OmniOS ships 3.7: https://github.com/omniosorg/omnios-build/tree/master/build/python37

OpenIndiana ships at least 2.7, 3.5, 3.7.

The illumos build process also depends on python and was updated to support 3.9 two weeks ago: https://www.illumos.org/issues/13217

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:36:38 2020
From: report at bugs.python.org (=?utf-8?b?T25kxZllaiBTw7prdXA=?=)
Date: Thu, 29 Oct 2020 22:36:38 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604010998.11.0.0571929152811.issue42173@roundup.psfhosted.org>


Ond?ej S?kup <mimi.vx at gmail.com> added the comment:

Oracle moved solaris 11.4 to +- rolling release mode, last SRU is 26 from 20.10.2020 with month release cadence.

On another side, almost all informations are behind the Oracle paywall

----------
nosy: +mimi.vx

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:38:20 2020
From: report at bugs.python.org (miss-islington)
Date: Thu, 29 Oct 2020 22:38:20 +0000
Subject: [issue42061] Document __format__ method for IPv[46]Address
In-Reply-To: <1602939831.57.0.752623418103.issue42061@roundup.psfhosted.org>
Message-ID: <1604011100.0.0.504927782545.issue42061@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b626d2218c03127502025ccdf93d555e0487ea95 by Miss Skeleton (bot) in branch '3.9':
bpo-42061: Document __format__ for IP addresses (GH-23018)
https://github.com/python/cpython/commit/b626d2218c03127502025ccdf93d555e0487ea95


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42061>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:38:57 2020
From: report at bugs.python.org (=?utf-8?b?SmVzw7pzIENlYSBBdmnDs24=?=)
Date: Thu, 29 Oct 2020 22:38:57 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604011137.72.0.782461175343.issue42173@roundup.psfhosted.org>


Jes?s Cea Avi?n <jcea at jcea.es> added the comment:

I think Solaris Support is still important and I could invest more time on it.

About package downloads:

1. I routinely download packages in my laptop (Linux) and distribute them to a fleet of servers (Linux and Solaris) via ansible and similar. Many servers in intranets don't install packages directly via PIP.

2. Under OmniOS or SmartOS (Illumos distributions), many people use the system package manager to install Python packages, not "PIP". For instance, http://netbsd.2816.n7.nabble.com/WIP-commit-Upgrade-to-Mailman-2-1-34-td427426.html.

Buildbots: I used to manage a buildbot with OpenIndiana, but it didn't survived the GITHUB migration. I could provide now a SmartOS buildbot.

As a core developer, I do care about Solaris. I fully realize I have been quite inactive since the github migration. My fault. I could devote more time to the task.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:45:29 2020
From: report at bugs.python.org (=?utf-8?b?SmVzw7pzIENlYSBBdmnDs24=?=)
Date: Thu, 29 Oct 2020 22:45:29 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604011529.95.0.644526465466.issue42173@roundup.psfhosted.org>


Jes?s Cea Avi?n <jcea at jcea.es> added the comment:

I am using Python 3.8 installed via pkgsrc in SmartOS with some Zones running Python 3.9 self compiled code.

More about the downloads stats:

4% packages in windows: I am pretty sure that most windows programmers install packages via conda-like tools. Surely there is more that 4% of python programmers on windows, even more in machine learning and data science areas, where windows and MacOS X rule (apparently being only 7% of PIP downloads).

Even if the PIP download stats would reflect penetration, Solaris is ahead of NetBSD and OpenBSD together.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:48:27 2020
From: report at bugs.python.org (Joshua M. Clulow)
Date: Thu, 29 Oct 2020 22:48:27 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604011707.15.0.308702285665.issue42173@roundup.psfhosted.org>


Joshua M. Clulow <josh at sysmgr.org> added the comment:

Hi!  I'm a member of the illumos core team, and I'm also pretty keen for us to keep Python support!  Some of our core OS build and packaging tooling is written in Python, and certainly applications like Synapse (Matrix) and Review Board are important to myself.

We currently provide a virtual machine for builds to the Go project that is wired in to their official CI/CD.  I expect we can help out with a similar thing here!

I know some illumos distributions (OmniOS, OpenIndiana, anything with pkgsrc, etc) are maintaining some patches against the stock Python to fix failing tests, etc.  Hopefully we can figure out how to get those things upstreamed and increase our participation there.

----------
nosy: +jclulow

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:51:46 2020
From: report at bugs.python.org (Ryan Sobol)
Date: Thu, 29 Oct 2020 22:51:46 +0000
Subject: [issue41987] singledispatchmethod raises an error when relying on a
 forward declaration
In-Reply-To: <1602274303.54.0.362260014367.issue41987@roundup.psfhosted.org>
Message-ID: <1604011906.39.0.0159967456788.issue41987@roundup.psfhosted.org>


Ryan Sobol <hello at ryansobol.com> added the comment:

It's worth pointing out that a similar error is produced for a forward-referenced return type of a registered method, but only for python3.9. For example:

from __future__ import annotations
from functools import singledispatchmethod


class Integer:
    def __init__(self, value: int):
        self.value = value

    def __str__(self) -> str:
        return str(self.value)

    @singledispatchmethod
    def add(self, other: object) -> Integer:
        raise NotImplementedError(f"Unsupported type {type(other)}")

    @add.register
    def _(self, other: int) -> "Integer":
        return Integer(self.value + other)


print(Integer(2).add(40))

This code runs without error in python3.8, and I am using this technique in code running in a production environment.

$ python3.8 --version
Python 3.8.6
$ python3.8 integer.py
42

However, this code throws a NameError in python3.9.

$ python3.9 --version
Python 3.9.0
$ python3.9 integer.py
Traceback (most recent call last):
  File "/Users/ryansobol/Downloads/integer.py", line 5, in <module>
    class Integer:
  File "/Users/ryansobol/Downloads/integer.py", line 17, in Integer
    def _(self, other: int) -> "Integer":
  File "/usr/local/Cellar/python at 3.9/3.9.0_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/functools.py", line 909, in register
    return self.dispatcher.register(cls, func=method)
  File "/usr/local/Cellar/python at 3.9/3.9.0_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/functools.py", line 860, in register
    argname, cls = next(iter(get_type_hints(func).items()))
  File "/usr/local/Cellar/python at 3.9/3.9.0_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/typing.py", line 1386, in get_type_hints
    value = _eval_type(value, globalns, localns)
  File "/usr/local/Cellar/python at 3.9/3.9.0_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/typing.py", line 254, in _eval_type
    return t._evaluate(globalns, localns, recursive_guard)
  File "/usr/local/Cellar/python at 3.9/3.9.0_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/typing.py", line 497, in _evaluate
    self.__forward_value__ = _eval_type(
  File "/usr/local/Cellar/python at 3.9/3.9.0_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/typing.py", line 254, in _eval_type
    return t._evaluate(globalns, localns, recursive_guard)
  File "/usr/local/Cellar/python at 3.9/3.9.0_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/typing.py", line 493, in _evaluate
    eval(self.__forward_code__, globalns, localns),
  File "<string>", line 1, in <module>
NameError: name 'Integer' is not defined

I know that some may see this issue as a feature request for 3.10+. However, for me, it is a bug preventing my code from migrating to 3.9.

----------
nosy: +ryansobol

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41987>
_______________________________________

From report at bugs.python.org  Thu Oct 29 18:59:14 2020
From: report at bugs.python.org (Andy Fiddaman)
Date: Thu, 29 Oct 2020 22:59:14 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604012354.01.0.442213488313.issue42173@roundup.psfhosted.org>


Andy Fiddaman <andy at omnios.org> added the comment:

We at OmniOS (an illumos distribution) are in the process of upgrading to Python 3.9 and working on getting tests clean. We're in pretty good shape with a few local patches and only having to skip a few tests at the moment, and most of those patches should be suitable for integrating generally.

Some of the tests just need adjusting to be aware of the different platform (e.g. illumos does not support multiple SCM_RIGHTS messages in a single packet), some still need investigating to find the root cause, but the list is small.

----------
nosy: +omnios

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 19:05:29 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 29 Oct 2020 23:05:29 +0000
Subject: [issue42061] Document __format__ method for IPv[46]Address
In-Reply-To: <1602939831.57.0.752623418103.issue42061@roundup.psfhosted.org>
Message-ID: <1604012729.55.0.351013380965.issue42061@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Thanks for the contribution, @John-Ted!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42061>
_______________________________________

From report at bugs.python.org  Thu Oct 29 19:06:31 2020
From: report at bugs.python.org (Andy Fiddaman)
Date: Thu, 29 Oct 2020 23:06:31 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604012791.85.0.721882039288.issue42173@roundup.psfhosted.org>


Andy Fiddaman <andy at omnios.org> added the comment:

Re: Downloads

OmniOS makes modules like 'six' available through its own IPS packaging system (which is written in Python) so installations won't show up pypi stats.

six is a core module on the platform so it is installed on 1000s of OmniOS machines (and then large numbers of SmartOS, OpenIndiana and tribblix ones too - all using the SunOS tag). The numbers aren't going to be in the same league as other platforms but the downloads stats definitely don't represent the illumos installation base and dependency on Python.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 19:36:23 2020
From: report at bugs.python.org (Colin)
Date: Thu, 29 Oct 2020 23:36:23 +0000
Subject: [issue42188] forkserver not reused in child processes
In-Reply-To: <1603932006.71.0.807048888281.issue42188@roundup.psfhosted.org>
Message-ID: <1604014583.46.0.339610571748.issue42188@roundup.psfhosted.org>


Change by Colin <cjphlo94 at gmail.com>:


Removed file: https://bugs.python.org/file49547/test.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42188>
_______________________________________

From report at bugs.python.org  Thu Oct 29 19:36:31 2020
From: report at bugs.python.org (Colin)
Date: Thu, 29 Oct 2020 23:36:31 +0000
Subject: [issue42188] forkserver not reused in child processes
In-Reply-To: <1603932006.71.0.807048888281.issue42188@roundup.psfhosted.org>
Message-ID: <1604014591.58.0.752730286516.issue42188@roundup.psfhosted.org>


Change by Colin <cjphlo94 at gmail.com>:


Added file: https://bugs.python.org/file49549/test.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42188>
_______________________________________

From report at bugs.python.org  Thu Oct 29 19:39:32 2020
From: report at bugs.python.org (hajma)
Date: Thu, 29 Oct 2020 23:39:32 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604014772.07.0.266529636481.issue42173@roundup.psfhosted.org>


hajma <tropikhajma at gmail.com> added the comment:

Like OmniOS, Oracle Solaris provides the 'six' (and many other) module prepackaged.
You can review a clone of the development repository at
https://github.com/oracle/solaris-userland/tree/master/components/python/six

----------
nosy: +tropikhajma at gmail.com

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 20:47:00 2020
From: report at bugs.python.org (Peter Firmstone)
Date: Fri, 30 Oct 2020 00:47:00 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604018820.21.0.957767065002.issue42173@roundup.psfhosted.org>


Peter Firmstone <pfirmsto at gmail.com> added the comment:

No, please continue supporting Illumos, I'm still using it.  Illumos is still relevant on servers.

----------
nosy: +pfirmsto

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 21:12:52 2020
From: report at bugs.python.org (Dima Tisnek)
Date: Fri, 30 Oct 2020 01:12:52 +0000
Subject: [issue39951] Ignore specific errors when closing ssl connections
In-Reply-To: <1584070801.03.0.867475481059.issue39951@roundup.psfhosted.org>
Message-ID: <1604020372.47.0.368262881574.issue39951@roundup.psfhosted.org>


Dima Tisnek <dimaqq at gmail.com> added the comment:

https://bugs.python.org/issue39953 has landed and the errors are now more sensible:
(that patch was not backported to 3.7, because it's not a security issue).

Python 3.7.8 [SSL: KRB5_S_INIT] application data after close notify
Python 3.8.5 [SSL: APPLICATION_DATA_AFTER_CLOSE_NOTIFY] application data after close notify
Python 3.9.0 [SSL: APPLICATION_DATA_AFTER_CLOSE_NOTIFY] application data after close notify
Python 3.10.0a1 [SSL: APPLICATION_DATA_AFTER_CLOSE_NOTIFY] application data after close notify

I guess I shall work on a patch to ignore this specific error when closing the connection.

I would appreciate guidance on half-closed state that, it seems, is possible since TLS 1.3 ?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39951>
_______________________________________

From report at bugs.python.org  Thu Oct 29 21:17:54 2020
From: report at bugs.python.org (Alan Coopersmith)
Date: Fri, 30 Oct 2020 01:17:54 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604020674.58.0.538251160286.issue42173@roundup.psfhosted.org>


Change by Alan Coopersmith <alan.coopersmith at oracle.com>:


----------
nosy: +alanc

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 21:37:22 2020
From: report at bugs.python.org (Dima Tisnek)
Date: Fri, 30 Oct 2020 01:37:22 +0000
Subject: [issue37355] SSLSocket.read does a GIL round-trip for every 16KB TLS
 record
In-Reply-To: <1561056169.29.0.814417679233.issue37355@roundup.psfhosted.org>
Message-ID: <1604021842.05.0.582552079529.issue37355@roundup.psfhosted.org>


Dima Tisnek <dimaqq at gmail.com> added the comment:

Amazing! Would you consider making a pull request out of your branch?

re: `PyErr_HasSignals` is a notable addition to the cpython API, it may need discussion, and (imo) documentation.

----------
nosy: +Dima.Tisnek

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37355>
_______________________________________

From report at bugs.python.org  Thu Oct 29 21:36:50 2020
From: report at bugs.python.org (Kyle Stanley)
Date: Fri, 30 Oct 2020 01:36:50 +0000
Subject: [issue41699] Potential memory leak with asyncio and run_in_executor
In-Reply-To: <1599103455.66.0.578420174204.issue41699@roundup.psfhosted.org>
Message-ID: <1604021810.11.0.0779848703111.issue41699@roundup.psfhosted.org>


Kyle Stanley <aeros167 at gmail.com> added the comment:

In the snippet provided, at least part of the resources are not finalized because executor.shutdown() was not called in the program (which should be done when creating a local instance of the executors, either explicitly or using the context manager). For the event loop's default threadpool (used w/ loop.run_in_executor(None, ...), I added a coroutine function loop.shutdown_default_executor() in 3.9+ handles this (called in asyncio.run()).

Without ever calling executor.shutdown(), the worker threads/processes and their associated resources are not finalized until interpreter shutdown. There's also some additional finalization that occurs in `_python_exit()` for both TPE and PPE (see https://github.com/python/cpython/blob/3317466061509c83dce257caab3661d52571cab1/Lib/concurrent/futures/thread.py#L23 or https://github.com/python/cpython/blob/3317466061509c83dce257caab3661d52571cab1/Lib/concurrent/futures/process.py#L87), which is called just before all non-daemon threads are joined just before interpreter shutdown occurs.

However, even considering the above, there still seems to be a significant additional difference in RSS compared to using ThreadPoolExecutor vs loop.run_in_executor() that I can't seem to account for (before and after asyncio.run()):

```
import asyncio
import concurrent.futures as cf
import os
import gc
import argparse

from concurrent.futures.thread import _python_exit

def leaker(n):
    list(range(n))

def func_TPE(n):
    with cf.ThreadPoolExecutor() as executor:
        for i in range(10_000):
            executor.submit(leaker, n)

async def func_run_in_executor(n):
    loop = asyncio.get_running_loop()
    for i in range(10_000):
        loop.run_in_executor(None, leaker, n)

def display_rss():
    os.system(f"grep ^VmRSS /proc/{os.getpid()}/status")

def main(n=100, asyncio_=False):
    try:
        if asyncio_:
            asyncio.run(func_run_in_executor(n))
        else:
            func_TPE(n)
    finally:
        _python_exit()
        gc.collect()
        print(f"after 10_000 iterations of {n} element lists:")
        display_rss()

if __name__ == "__main__":
    parser = argparse.ArgumentParser()
    parser.add_argument("-n", type=int, default=100)
    parser.add_argument("--asyncio", action=argparse.BooleanOptionalAction)

    print("start RSS memory:")
    display_rss()

    args = parser.parse_args()
    main(args.n, args.asyncio)
```
Results (on latest commit to master, 3.10):
asyncio -
```
[aeros:~/repos/cpython]$ ./python ~/programming/python/asyncio_run_in_exec_leak.py -n=10000 --asyncio
start RSS memory:
VmRSS:     16948 kB
after 10_000 iterations of 10000 element lists:
VmRSS:     27080 kB
```
concurrent.futures -
```
[aeros:~/repos/cpython]$ ./python ~/programming/python/asyncio_run_in_exec_leak.py -n=10000 --no-asyncio
start RSS memory:
VmRSS:     17024 kB
after 10_000 iterations of 10000 element lists:
VmRSS:     19572 kB
```
When using await before loop.run_in_executor(), the results are more similar to using ThreadPoolExecutor directly:
```
[aeros:~/repos/cpython]$ ./python ~/programming/python/asyncio_run_in_exec_leak.py -n=10000 --asyncio  
start RSS memory:
VmRSS:     16940 kB
after 10_000 iterations of 10000 element lists:
VmRSS:     17756 kB
```
However, as mentioned by the OP, if stored in a container and awaited later (such as w/ asyncio.gather()), a substantial memory difference is present (increases with list size):
```
[aeros:~/repos/cpython]$ ./python ~/programming/python/asyncio_run_in_exec_leak.py -n=10000 --asyncio
start RSS memory:
VmRSS:     16980 kB
after 10_000 iterations of 10000 element lists:
VmRSS:     29744 kB
```

Based on the above results, I think there may be a smaller leak occurring in concurrent.futures (potentially related to the linked bpo-41588) and a bit of a larger leak occurring in loop.run_in_executor(). So they can remain as separate issues IMO.

At the moment, my best guess is that there's some memory leak that occurs from the future not being fully cleaned up, but I'm not certain about that. This will likely require some further investigation.

Input from Yury and/or Andrew would definitely be appreciated. Is there something that I'm potentially missing here?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41699>
_______________________________________

From report at bugs.python.org  Thu Oct 29 21:41:37 2020
From: report at bugs.python.org (Kyle Stanley)
Date: Fri, 30 Oct 2020 01:41:37 +0000
Subject: [issue41699] Potential memory leak with asyncio and run_in_executor
In-Reply-To: <1599103455.66.0.578420174204.issue41699@roundup.psfhosted.org>
Message-ID: <1604022097.35.0.716274397921.issue41699@roundup.psfhosted.org>


Kyle Stanley <aeros167 at gmail.com> added the comment:

Also note that the difference in memory is much higher when an exception occurs (presumably because the exception is stored on future._exception and not cleaned up?):
```
[aeros:~/repos/cpython]$ ./python ~/programming/python/asyncio_run_in_exec_leak.py -n=10000 --asyncio
start RSS memory:
VmRSS:     16976 kB
after 10_000 iterations of 10000 element lists:
VmRSS:     64132 kB
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41699>
_______________________________________

From report at bugs.python.org  Thu Oct 29 21:44:07 2020
From: report at bugs.python.org (brett)
Date: Fri, 30 Oct 2020 01:44:07 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604022247.65.0.97499937008.issue42173@roundup.psfhosted.org>


brett <brett at librum.org> added the comment:

Between SmartOS, Illumos, and mainline Solaris, there is ample interest and support for ensuring that SunOS derivatives remain 1st class python platforms.

Platform genocide is both unnecessary and unwarranted.

----------
nosy: +brett3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 22:22:37 2020
From: report at bugs.python.org (Sophia Wisdom)
Date: Fri, 30 Oct 2020 02:22:37 +0000
Subject: [issue41699] Potential memory leak with asyncio and run_in_executor
In-Reply-To: <1599103455.66.0.578420174204.issue41699@roundup.psfhosted.org>
Message-ID: <1604024557.29.0.0191396556386.issue41699@roundup.psfhosted.org>


Sophia Wisdom <sophia at reduct.video> added the comment:

While not calling executor.shutdown() may leave some resources still used, it should be small and fixed. Regularly calling executor.shutdown() and then instantiating a new ThreadPoolExecutor in order to run an asyncio program does not seem like a good API to me.

You mention there appear to be both an event loop and a futures leak -- I think I have a good test case for the futures, without using threads at all. This seems to be leaking `future._result`s somehow even though their __del__ is called.

```
import asyncio
from concurrent.futures import Executor, Future
import gc

result_gcs = 0
suture_gcs = 0

class ResultHolder:
    def __init__(self, mem_size):
        self.mem = list(range(mem_size)) # so we can see the leak
    
    def __del__(self):
        global result_gcs
        result_gc += 1

class Suture(Future):
   def __del__(self):
       global suture_gcs
       suture_gcs += 1

class SimpleExecutor(Executor):
    def submit(self, fn):
        future = Suture()
        future.set_result(ResultHolder(1000))
        return future

async def function():
    loop = asyncio.get_running_loop()
    for i in range(10000):
        loop.run_in_executor(SimpleExecutor(), lambda x:x)

def run():
    asyncio.run(function())
    print(suture_gcs, result_gcs)
```
10MB

```
> run()
10000 10000
```
100MB

Both result_gcs and suture_gcs are 10000 every time. My best guess for why this would happen (for me it doesn't seem to happen without the loop.run_in_executor) is the conversion from a concurrent.Future to an asyncio.Future, which involves callbacks to check on the result, but that doesn't make sense, because the result itself has __del__ called on it but somehow it doesn't free the memory!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41699>
_______________________________________

From report at bugs.python.org  Thu Oct 29 22:24:05 2020
From: report at bugs.python.org (Dima Tisnek)
Date: Fri, 30 Oct 2020 02:24:05 +0000
Subject: [issue42200] Support TLS 1.3 half-closed connections
Message-ID: <1604024645.33.0.358615043309.issue42200@roundup.psfhosted.org>


New submission from Dima Tisnek <dimaqq at gmail.com>:

(apologies if this was raised before, I couldn't find it in bugs, mailing lists or discourse).
(also apologies if I misunderstood something about the protocol)

Up to an including TLS 1.2, a single close notify terminates both upstream and downstream; Starting with TLS 1.3 there are separate close notify alerts for upstream and downstream.

This means that it's possible to have a TLS connection in half-closed state, e.g. to send "GET / HTTP xx; close notify" and then wait for the server response.

Today, that's not possible, at least in asyncio, as evidenced by https://bugs.python.org/issue39951 
(I did not check synchronous wrapped sockets)

----------
assignee: christian.heimes
components: SSL
messages: 379908
nosy: Dima.Tisnek, christian.heimes
priority: normal
severity: normal
status: open
title: Support TLS 1.3 half-closed connections
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42200>
_______________________________________

From report at bugs.python.org  Thu Oct 29 23:11:23 2020
From: report at bugs.python.org (Kyle Stanley)
Date: Fri, 30 Oct 2020 03:11:23 +0000
Subject: [issue41699] Potential memory leak with asyncio and run_in_executor
In-Reply-To: <1599103455.66.0.578420174204.issue41699@roundup.psfhosted.org>
Message-ID: <1604027483.9.0.328637090803.issue41699@roundup.psfhosted.org>


Kyle Stanley <aeros167 at gmail.com> added the comment:

> Regularly calling executor.shutdown() and then instantiating a new ThreadPoolExecutor in order to run an asyncio program does not seem like a good API to me.

Clarification: you're typically only supposed to instantiate a single ThreadPoolExecutor or ProcessPoolExecutor per program (sometimes one of each depending on use case), and continuously submit jobs to it rather than creating multiple executor instances. Otherwise, it's generally unneeded overhead.

(I'll take a look at the other parts once I find the time, just wanted to briefly mention the above in the meantime.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41699>
_______________________________________

From report at bugs.python.org  Thu Oct 29 23:28:51 2020
From: report at bugs.python.org (Robert D. French)
Date: Fri, 30 Oct 2020 03:28:51 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604028531.38.0.0333827429013.issue42173@roundup.psfhosted.org>


Robert D. French <robert at robertdfrench.me> added the comment:

Hello! I just want to lend my voice in favor of maintaining "Solarish" support as well, and offer what help I may for resolving issues.

----------
nosy: +robertdfrench

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Thu Oct 29 23:34:17 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 30 Oct 2020 03:34:17 +0000
Subject: [issue41987] singledispatchmethod raises an error when relying on a
 forward declaration
In-Reply-To: <1602274303.54.0.362260014367.issue41987@roundup.psfhosted.org>
Message-ID: <1604028857.75.0.957791326978.issue41987@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I'm not an expert on singledispatch. It seems the get_type_hints() call is present in 3.8 as well.

Could you investigate and find a root cause? Then maybe we can fix it. (If you come up with a PR that would be very much appreciated.)

----------
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41987>
_______________________________________

From report at bugs.python.org  Fri Oct 30 00:01:37 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 30 Oct 2020 04:01:37 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604030497.19.0.0732988539883.issue42198@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 9129af6050b747f288baa9d4e7d43031647ed222 by kj in branch 'master':
bpo-42198: Link to GenericAlias in typing and expressions (GH-23030)
https://github.com/python/cpython/commit/9129af6050b747f288baa9d4e7d43031647ed222


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Fri Oct 30 00:01:38 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 30 Oct 2020 04:01:38 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604030498.6.0.812308740868.issue42198@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21952
pull_request: https://github.com/python/cpython/pull/23033

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Fri Oct 30 00:17:55 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 30 Oct 2020 04:17:55 +0000
Subject: [issue42195] Inconsistent __args__ between typing.Callable and
 collections.abc.Callable
In-Reply-To: <1603974319.88.0.166786801787.issue42195@roundup.psfhosted.org>
Message-ID: <1604031475.31.0.865880797755.issue42195@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Good find! I see that typing.Callable has adopted this structure precisely to enable caching.

We should see if we can fix _collections_abc.Callable. It's still early in the life of 3.9 so I think this is reasonable.

We'll need a subclass of GenericAlias so that the repr() of Callable[[int, int], int] still comes out correctly. This is similar to how typing.Callable solves it.

Do you feel up to submitting a PR for this? Otherwise maybe Batuhan feels like contributing a fix for this?

----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42195>
_______________________________________

From report at bugs.python.org  Fri Oct 30 00:23:42 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 30 Oct 2020 04:23:42 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604031822.32.0.615658128746.issue42198@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset a39068bf48766e5520e175eae8cda33531e16039 by Miss Skeleton (bot) in branch '3.9':
bpo-42198: Link to GenericAlias in typing and expressions (GH-23030)
https://github.com/python/cpython/commit/a39068bf48766e5520e175eae8cda33531e16039


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Fri Oct 30 00:24:13 2020
From: report at bugs.python.org (jason matthews)
Date: Fri, 30 Oct 2020 04:24:13 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604031853.03.0.205269961216.issue42173@roundup.psfhosted.org>


jason matthews <jason at broken.net> added the comment:

Please do not drop support. 

Python is widely used in the "Solaris" community with most people downloading packages from Openindiana/Hipster or Joyent/SmartOS repos. Most "Solaris" users are not using Solaris proper.

The download stats published in this ticket is not a good representation of usage. Similarly most (Free|Open|*)BSD users install from their respective versions of ports.

----------
nosy: +jm650

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 00:56:40 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 30 Oct 2020 04:56:40 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604033800.3.0.0570378620025.issue42160@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 8e409cebad42032bb7d0f2cadd8b1e36081d98af by Eric W in branch 'master':
bpo-42160: tempfile: Reduce overhead of pid check. (GH-22997)
https://github.com/python/cpython/commit/8e409cebad42032bb7d0f2cadd8b1e36081d98af


----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Fri Oct 30 01:07:37 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 30 Oct 2020 05:07:37 +0000
Subject: [issue40255] Fixing Copy on Writes from reference counting
In-Reply-To: <1586619621.82.0.553262088399.issue40255@roundup.psfhosted.org>
Message-ID: <1604034457.82.0.0558583168481.issue40255@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

>> Fast shutdown option
>
> You can use os._exit(0).

Yes. Instagram use it as `atexit.register(os._exit, 0)`.

https://instagram-engineering.com/dismissing-python-garbage-collection-at-instagram-4dca40b29172

I think this hack can be supported in multiprocessing module in some way.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40255>
_______________________________________

From report at bugs.python.org  Fri Oct 30 01:56:16 2020
From: report at bugs.python.org (Zac Hatfield-Dodds)
Date: Fri, 30 Oct 2020 05:56:16 +0000
Subject: [issue42195] Inconsistent __args__ between typing.Callable and
 collections.abc.Callable
In-Reply-To: <1603974319.88.0.166786801787.issue42195@roundup.psfhosted.org>
Message-ID: <1604037376.13.0.237047459646.issue42195@roundup.psfhosted.org>


Zac Hatfield-Dodds <zac.hatfield.dodds at gmail.com> added the comment:

Unfortunately I'm overcommitted for the next few weeks-months :-/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42195>
_______________________________________

From report at bugs.python.org  Fri Oct 30 02:03:59 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 30 Oct 2020 06:03:59 +0000
Subject: [issue42172] Typo in test library for test_socket.py
In-Reply-To: <1603811538.08.0.134266779609.issue42172@roundup.psfhosted.org>
Message-ID: <1604037839.39.0.323508951366.issue42172@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:


New changeset d6238ba82d07e8e0783b692f37dc4b7c8617294b by Akashkumar D Khunt in branch 'master':
bpo-42172: Correct typo for test_socket.py  (GH-23013)
https://github.com/python/cpython/commit/d6238ba82d07e8e0783b692f37dc4b7c8617294b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42172>
_______________________________________

From report at bugs.python.org  Fri Oct 30 02:05:55 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 30 Oct 2020 06:05:55 +0000
Subject: [issue42172] Typo in test library for test_socket.py
In-Reply-To: <1603811538.08.0.134266779609.issue42172@roundup.psfhosted.org>
Message-ID: <1604037955.37.0.38148773202.issue42172@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
versions:  -Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42172>
_______________________________________

From report at bugs.python.org  Fri Oct 30 02:05:48 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 30 Oct 2020 06:05:48 +0000
Subject: [issue42172] Typo in test library for test_socket.py
In-Reply-To: <1603811538.08.0.134266779609.issue42172@roundup.psfhosted.org>
Message-ID: <1604037948.72.0.428641842896.issue42172@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

merged! Thank you for working on this!! @adkhunt ;)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42172>
_______________________________________

From report at bugs.python.org  Fri Oct 30 02:14:04 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 30 Oct 2020 06:14:04 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604038444.3.0.0906090763196.issue42160@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Thanks

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Fri Oct 30 02:40:34 2020
From: report at bugs.python.org (=?utf-8?b?0JTQsNC90LjQuNC7INCb0Y/RhdC+0LI=?=)
Date: Fri, 30 Oct 2020 06:40:34 +0000
Subject: [issue42201] Priority queue realization issue
Message-ID: <1604040034.11.0.135907036135.issue42201@roundup.psfhosted.org>


New submission from ?????? ????? <dupeljan at gmail.com>:

In Priority queue realization in docs https://docs.python.org/3/library/heapq.html there is no appointments that priority can be equal and the task can have different type. For example, if you store number of graph node in your priority queue, than it is possible to get "TypeError: '<' not supported between instances of 'int' and 'str'", because inside heappop there is comparison between elements, and if the fist elements the same, than it compare tasks, which can be tagged as removed and has '<removed-task>' value as opposed to number of node, which is int.

----------
assignee: docs at python
components: Documentation
messages: 379922
nosy: docs at python, dupeljan
priority: normal
severity: normal
status: open
title: Priority queue realization issue
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42201>
_______________________________________

From report at bugs.python.org  Fri Oct 30 02:47:15 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 30 Oct 2020 06:47:15 +0000
Subject: [issue42202] Optimize function annotation
Message-ID: <1604040435.44.0.369975398522.issue42202@roundup.psfhosted.org>


New submission from Inada Naoki <songofacandy at gmail.com>:

Look this example:

code:

```
# code
def foo(x: int, /, y, *, z: float) -> Hoge:
    pass

# dis
 2          12 LOAD_CONST               2 ('int')
            14 LOAD_CONST               3 ('float')
            16 LOAD_CONST               4 ('Hoge')
            18 LOAD_CONST               5 (('x', 'z', 'return'))
            20 BUILD_CONST_KEY_MAP      3
            22 LOAD_CONST               6 (<code object foo at ...>)
            24 LOAD_CONST               7 ('foo')
            26 MAKE_FUNCTION            4 (annotations)
            28 STORE_NAME               2 (foo) 
```

Four `LOAD_CONST` and `BUILD_CONST_KEY_MAP` are used to generate annotation dict. This makes program load slow and eat more memory.

Annotation information can be stored in some compact form. And creating annotation dict can be postponed to when `func.__annotation__` is accessed.

Ideas for the compact form:

1. Tuple.
   In above example, `('int', None, 'float', 'Hoge')` can be used. None means no annotation for the 'y' parameter.

2. Serialize into str or bytes.
   JSON like format can be used, like `x:int,z:float;Hoge`. Compact. But the string/bytes has lower chance to be shared with other constants in same module.

----------
components: Interpreter Core
messages: 379923
nosy: methane
priority: normal
severity: normal
status: open
title: Optimize function annotation
type: resource usage
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42202>
_______________________________________

From report at bugs.python.org  Fri Oct 30 03:01:20 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 30 Oct 2020 07:01:20 +0000
Subject: [issue42195] Inconsistent __args__ between typing.Callable and
 collections.abc.Callable
In-Reply-To: <1603974319.88.0.166786801787.issue42195@roundup.psfhosted.org>
Message-ID: <1604041280.91.0.884564748016.issue42195@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42195>
_______________________________________

From report at bugs.python.org  Fri Oct 30 03:21:04 2020
From: report at bugs.python.org (Tony Albers)
Date: Fri, 30 Oct 2020 07:21:04 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604042464.28.0.475771283008.issue42173@roundup.psfhosted.org>


Tony Albers <tba at kb.dk> added the comment:

No no no, please don't.

Apart from FreeBSD, illumos distros are the only really hard-core UNIX OS'es still freely available, the features taken into account. 
SMF, dtrace and several hypervisor types makes illumos really stand out.

I understand that there are resources that need to be assigned to maintaining Python on illumos/SunOS, but please reach out to their communities, maybe someone can help.

----------
nosy: +tbalbers

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 03:28:01 2020
From: report at bugs.python.org (Marius Pana)
Date: Fri, 30 Oct 2020 07:28:01 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604042881.3.0.9299415036.issue42173@roundup.psfhosted.org>


Marius Pana <mp at spearhead.systems> added the comment:

Please do not drop support for SunOS. 
We are happy to provide some hosting services on SmartOS/Illumos for building.

----------
nosy: +mariuspana

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 03:33:41 2020
From: report at bugs.python.org (Jasper Siepkes)
Date: Fri, 30 Oct 2020 07:33:41 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604043221.95.0.0190650589133.issue42173@roundup.psfhosted.org>


Jasper Siepkes <jasper at siepkes.nl> added the comment:

I'm another Illumos user that has crawled from under a rock ;-) to request not to drop Illumos support.

----------
nosy: +siepkes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 03:37:20 2020
From: report at bugs.python.org (Carsten Grzemba)
Date: Fri, 30 Oct 2020 07:37:20 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604043440.25.0.664801425988.issue42173@roundup.psfhosted.org>


Carsten Grzemba <cgrzemba at opencsw.org> added the comment:

Please continue support for Solaris/IllumOS! For build resources on the most recent Solaris platforms you can contact opencsw.org.

----------
nosy: +cgrzemba

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 03:39:24 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 30 Oct 2020 07:39:24 +0000
Subject: [issue42202] Optimize function annotation
In-Reply-To: <1604040435.44.0.369975398522.issue42202@roundup.psfhosted.org>
Message-ID: <1604043564.59.0.662897993877.issue42202@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Are annotations now always known at compile time?

As for representation, it can also be a sequence of pairs (('x', 'int'), ('z', 'float'), ('return', 'Hoge')) or a pair of sequences (('x', 'z', 'return'), ('int', 'float', 'Hoge')). It would be better to save a dict directly in pyc files, but it needs changing the marshal protocol.

Also, it makes sense to make annotations attribute of the code object, so avoid the overhead at function creation time.

I have a dream to split the pyc file into several files or sections and save docstrings and annotations (and maybe line numbers) separately from the main code. They should be loaded by demand, when you read __doc__ or __annotation__. Most code does not use them at run time, so we can save memory and loading time. It can also help with internationalization.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42202>
_______________________________________

From report at bugs.python.org  Fri Oct 30 03:40:50 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 30 Oct 2020 07:40:50 +0000
Subject: [issue42202] Optimize function annotation
In-Reply-To: <1604040435.44.0.369975398522.issue42202@roundup.psfhosted.org>
Message-ID: <1604043650.28.0.197023800173.issue42202@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

I like the 1st option which uses a tuple

----------
nosy: +corona10 -serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42202>
_______________________________________

From report at bugs.python.org  Fri Oct 30 03:43:45 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 30 Oct 2020 07:43:45 +0000
Subject: [issue42202] Optimize function annotation
In-Reply-To: <1604040435.44.0.369975398522.issue42202@roundup.psfhosted.org>
Message-ID: <1604043825.75.0.0886559294382.issue42202@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

@serhiy race condition sorry ;)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42202>
_______________________________________

From report at bugs.python.org  Fri Oct 30 03:44:09 2020
From: report at bugs.python.org (john ryan)
Date: Fri, 30 Oct 2020 07:44:09 +0000
Subject: [issue42203] Unexpected behaviour NameError: name 'open' is not
 defined
Message-ID: <1604043849.8.0.342211011492.issue42203@roundup.psfhosted.org>


New submission from john ryan <jryan at tactiq.co.uk>:

My test environment runs Ubuntu 18.04 in a virtualbox hosted on Windows 8.1 and Python executes within a venv running Python 3.9.0 (Python 3.9.0 (default, Oct 26 2020, 09:02:51) 
[GCC 7.5.0] on linux

Running a test with unittest.IsolatedAsyncioTestCase my code hung so I hit ctrl-C twice to stop it and got the below traceback.

The really odd behaviour is that open is reported as not defined.

The behaviour is repeatable in my test, but I do not know how to produce a simple test case. I do not know what the issue is with my code.


 ^C^CTraceback (most recent call last):
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/async_case.py", line 158, in run
    return super().run(result)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/case.py", line 593, in run
    self._callTestMethod(testMethod)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/async_case.py", line 65, in _callTestMethod
    self._callMaybeAsync(method)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/async_case.py", line 88, in _callMaybeAsync
    return self._asyncioTestLoop.run_until_complete(fut)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/asyncio/base_events.py", line 629, in run_until_complete
    self.run_forever()
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/asyncio/base_events.py", line 596, in run_forever
    self._run_once()
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/asyncio/base_events.py", line 1854, in _run_once
    event_list = self._selector.select(timeout)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/selectors.py", line 469, in select
    fd_event_list = self._selector.poll(timeout, max_ev)
KeyboardInterrupt

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/__main__.py", line 18, in <module>
    main(module=None)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/main.py", line 101, in __init__
    self.runTests()
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/main.py", line 271, in runTests
    self.result = testRunner.run(self.test)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/runner.py", line 176, in run
    test(result)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/suite.py", line 84, in __call__
    return self.run(*args, **kwds)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/suite.py", line 122, in run
    test(result)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/suite.py", line 84, in __call__
    return self.run(*args, **kwds)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/suite.py", line 122, in run
    test(result)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/suite.py", line 84, in __call__
    return self.run(*args, **kwds)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/suite.py", line 122, in run
    test(result)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/case.py", line 653, in __call__
    return self.run(*args, **kwds)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/async_case.py", line 160, in run
    self._tearDownAsyncioLoop()
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/unittest/async_case.py", line 126, in _tearDownAsyncioLoop
    loop.run_until_complete(self._asyncioCallsQueue.join())
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/asyncio/base_events.py", line 629, in run_until_complete
    self.run_forever()
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/asyncio/base_events.py", line 596, in run_forever
    self._run_once()
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/asyncio/base_events.py", line 1854, in _run_once
    event_list = self._selector.select(timeout)
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/selectors.py", line 469, in select
    fd_event_list = self._selector.poll(timeout, max_ev)
KeyboardInterrupt
Exception ignored in: <bound method BaseEventLoop.call_exception_handler of <_UnixSelectorEventLoop running=False closed=False debug=True>>
Traceback (most recent call last):
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/asyncio/base_events.py", line 1771, in call_exception_handler
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/logging/__init__.py", line 1463, in error
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/logging/__init__.py", line 1577, in _log
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/logging/__init__.py", line 1587, in handle
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/logging/__init__.py", line 1649, in callHandlers
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/logging/__init__.py", line 948, in handle
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/logging/__init__.py", line 1182, in emit
  File "/home/john/.pyenv/versions/3.9.0/lib/python3.9/logging/__init__.py", line 1171, in _open
NameError: name 'open' is not defined

----------
components: asyncio
messages: 379931
nosy: asvetlov, jryan, yselivanov
priority: normal
severity: normal
status: open
title: Unexpected behaviour NameError: name 'open' is not defined
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42203>
_______________________________________

From report at bugs.python.org  Fri Oct 30 03:43:21 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 30 Oct 2020 07:43:21 +0000
Subject: [issue42202] Optimize function annotation
In-Reply-To: <1604040435.44.0.369975398522.issue42202@roundup.psfhosted.org>
Message-ID: <1604043801.98.0.470541317351.issue42202@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42202>
_______________________________________

From report at bugs.python.org  Fri Oct 30 04:14:07 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 30 Oct 2020 08:14:07 +0000
Subject: [issue42203] Unexpected behaviour NameError: name 'open' is not
 defined
In-Reply-To: <1604043849.8.0.342211011492.issue42203@roundup.psfhosted.org>
Message-ID: <1604045647.04.0.461970231829.issue42203@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It can happen if the code is executed very late at the shutdown stage. The builtin module is restored to its initial state (open is imported from io) to get rid of reference cycles.

----------
nosy: +serhiy.storchaka, vinay.sajip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42203>
_______________________________________

From report at bugs.python.org  Fri Oct 30 04:16:48 2020
From: report at bugs.python.org (Steven Yan)
Date: Fri, 30 Oct 2020 08:16:48 +0000
Subject: [issue42204] "import setuptools" Results in "ModuleNotFoundError: No
 module named '_distutils_hack'"
Message-ID: <1604045808.38.0.790448283251.issue42204@roundup.psfhosted.org>


Change by Steven Yan <Steven_Bot_Yan at 126.com>:


----------
components: Distutils
files: pic.png
nosy: dstufft, eric.araujo, sy
priority: normal
severity: normal
status: open
title: "import setuptools" Results in "ModuleNotFoundError: No module named '_distutils_hack'"
type: behavior
versions: Python 3.9
Added file: https://bugs.python.org/file49550/pic.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42204>
_______________________________________

From report at bugs.python.org  Fri Oct 30 04:17:59 2020
From: report at bugs.python.org (Paolo Marcheschi)
Date: Fri, 30 Oct 2020 08:17:59 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604045879.31.0.336209419575.issue42173@roundup.psfhosted.org>


Paolo Marcheschi <paolo at ftgm.it> added the comment:

Please continue support for Solaris/IllumOS!
This is very important for us.

----------
nosy: +marcheschi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 04:21:15 2020
From: report at bugs.python.org (john ryan)
Date: Fri, 30 Oct 2020 08:21:15 +0000
Subject: [issue42203] Unexpected behaviour NameError: name 'open' is not
 defined
In-Reply-To: <1604043849.8.0.342211011492.issue42203@roundup.psfhosted.org>
Message-ID: <1604046075.93.0.944375268537.issue42203@roundup.psfhosted.org>


john ryan <jryan at tactiq.co.uk> added the comment:

Thanks. That is understandable. I reported it in case it was helpful.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42203>
_______________________________________

From report at bugs.python.org  Fri Oct 30 04:23:25 2020
From: report at bugs.python.org (Steven Yan)
Date: Fri, 30 Oct 2020 08:23:25 +0000
Subject: [issue42204] "import setuptools" Results in "ModuleNotFoundError: No
 module named '_distutils_hack'"
Message-ID: <1604046205.69.0.249655030774.issue42204@roundup.psfhosted.org>


Change by Steven Yan <Steven_Bot_Yan at 126.com>:


Added file: https://bugs.python.org/file49551/pic.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42204>
_______________________________________

From report at bugs.python.org  Fri Oct 30 04:24:20 2020
From: report at bugs.python.org (Steven Yan)
Date: Fri, 30 Oct 2020 08:24:20 +0000
Subject: [issue42204] "import setuptools" Results in "ModuleNotFoundError: No
 module named '_distutils_hack'"
Message-ID: <1604046260.78.0.899821430283.issue42204@roundup.psfhosted.org>


Change by Steven Yan <Steven_Bot_Yan at 126.com>:


Removed file: https://bugs.python.org/file49550/pic.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42204>
_______________________________________

From report at bugs.python.org  Fri Oct 30 04:28:08 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 30 Oct 2020 08:28:08 +0000
Subject: [issue42203] Unexpected behaviour NameError: name 'open' is not
 defined
In-Reply-To: <1604043849.8.0.342211011492.issue42203@roundup.psfhosted.org>
Message-ID: <1604046488.97.0.662674946795.issue42203@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

See:

#26789 #39513

Serhiy, is a test case still needed? Should this be closed and pushed back to fixing logging?

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42203>
_______________________________________

From report at bugs.python.org  Fri Oct 30 04:32:03 2020
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 30 Oct 2020 08:32:03 +0000
Subject: [issue42202] Optimize function annotation
In-Reply-To: <1604040435.44.0.369975398522.issue42202@roundup.psfhosted.org>
Message-ID: <1604046723.06.0.0830563263964.issue42202@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> Are annotations now always known at compile time?

Yes, because `from __future__ import annotations` is enabled by default from Python 3.10.

> As for representation, it can also be a sequence of pairs (('x', 'int'), ('z', 'float'), ('return', 'Hoge')) or a pair of sequences (('x', 'z', 'return'), ('int', 'float', 'Hoge')). It would be better to save a dict directly in pyc files, but it needs changing the marshal protocol.

Yes, but it is bit larger than my single tuple idea in most cases.
Since most annotations are not used by runtime, we don't need to create a dict until `func.__annotation__` is read.

> Also, it makes sense to make annotations attribute of the code object, so avoid the overhead at function creation time.

I am not sure this is the best option because there are many code object without annotation.

> I have a dream to split the pyc file into several files or sections and save docstrings and annotations (and maybe line numbers) separately from the main code. They should be loaded by demand, when you read __doc__ or __annotation__. Most code does not use them at run time, so we can save memory and loading time. It can also help with internationalization.

I have same dream.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42202>
_______________________________________

From report at bugs.python.org  Fri Oct 30 04:44:02 2020
From: report at bugs.python.org (abarbu)
Date: Fri, 30 Oct 2020 08:44:02 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604047442.97.0.569519518322.issue42173@roundup.psfhosted.org>


abarbu <ab at spearhead.systems> added the comment:

Please don't drop Solaris support, we still use it to this day.

----------
nosy: +abarbu

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 04:46:16 2020
From: report at bugs.python.org (=?utf-8?b?UHJlZHJhZyBaZcSNZXZpxIc=?=)
Date: Fri, 30 Oct 2020 08:46:16 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604047576.05.0.782850401074.issue42173@roundup.psfhosted.org>


Predrag Ze?evi? <predrag.zecevic.1961 at googlemail.com> added the comment:

Please, keep support!

----------
nosy: +predrag.zecevic.1961
versions:  -Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 05:01:44 2020
From: report at bugs.python.org (Martin Gfeller)
Date: Fri, 30 Oct 2020 09:01:44 +0000
Subject: [issue42192] Python Windows .exe Installer ignores /TargetDir if
 there is an existing installation
In-Reply-To: <1603962967.32.0.325420802039.issue42192@roundup.psfhosted.org>
Message-ID: <1604048504.89.0.540140334282.issue42192@roundup.psfhosted.org>


Martin Gfeller <martin.gfeller at swisscom.com> added the comment:

Thank you, Steve, for your rapid response and explanation!

I would like to have my installation fully isolated in case somebody (running the machine) fiddles with the installation in the standard location. I used to do that without problems with the 2.7 .msi installer, but now I?ve finally almost finished converting to 3.8 (I know I?m late) and that approach doesn?t work any longer.

I tried to reverse engineer it a bit by looking at the log files and zapping the registry entry HKLM\Software\Python\PythonCore\3.8 (for an all-users install), with no success. Modify or repair would randomly install some stuff in the target dir and other stuff into a previous installation. The Windows Installer technology seems to be rather implicit than explicit. How does it detect the previous installation?s location?

Although it?s not a bug and an /isolated mode doesn?t seem to be feasible, perhaps it could check and warn that /targetdir is being ignored. The doc could mention that it?s intended only for a single installation per version per machine.  

And thank you again for your contributions to make Python on Windows such a joy ? highly appreciated! 
Martin

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42192>
_______________________________________

From report at bugs.python.org  Fri Oct 30 05:16:03 2020
From: report at bugs.python.org (waicalibre)
Date: Fri, 30 Oct 2020 09:16:03 +0000
Subject: [issue42205] Add image/webp to list of non-standard mimetypes
Message-ID: <1604049363.03.0.933855009454.issue42205@roundup.psfhosted.org>


New submission from waicalibre <waicailbre_aayx at protonmail.com>:

WebP is an open-source image format that isn't included in Python's mimetypes. It hasn't been added because it has no IANA registration: https://bugs.python.org/issue38902

In mimetypes.py there is a list of common but non-standard media types that only match if strict=0 flag is given to the API methods. If WebP isn't going to be added to the big standard list, it could be added to the non-standard list.

----------
components: Library (Lib)
messages: 379940
nosy: waicalibre
priority: normal
severity: normal
status: open
title: Add image/webp to list of non-standard mimetypes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42205>
_______________________________________

From report at bugs.python.org  Fri Oct 30 05:17:22 2020
From: report at bugs.python.org (waicalibre)
Date: Fri, 30 Oct 2020 09:17:22 +0000
Subject: [issue42205] Add image/webp to list of non-standard mimetypes
In-Reply-To: <1604049363.03.0.933855009454.issue42205@roundup.psfhosted.org>
Message-ID: <1604049442.35.0.296037010729.issue42205@roundup.psfhosted.org>


Change by waicalibre <waicailbre_aayx at protonmail.com>:


----------
keywords: +patch
pull_requests: +21953
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23034

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42205>
_______________________________________

From report at bugs.python.org  Fri Oct 30 05:24:06 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 30 Oct 2020 09:24:06 +0000
Subject: [issue42201] Priority queue realization issue
In-Reply-To: <1604040034.11.0.135907036135.issue42201@roundup.psfhosted.org>
Message-ID: <1604049846.56.0.278885747882.issue42201@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee: docs at python -> rhettinger
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42201>
_______________________________________

From report at bugs.python.org  Fri Oct 30 06:09:19 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Fri, 30 Oct 2020 10:09:19 +0000
Subject: [issue42206] Pegen: Raise errors occurred by the AST validator
Message-ID: <1604052559.69.0.261468356002.issue42206@roundup.psfhosted.org>


New submission from Batuhan Taskaya <isidentical at gmail.com>:

When working on the AST validator, it is unclear that which of the changes caused parser to fail on valid input. I propose to propagate the error and raise it.

Current:
$ ./python t.py
python: Parser/pegen.c:1146: _PyPegen_run_parser: Assertion `PyAST_Validate(res)' failed.

Proposed:
$ ./python t.py
ValueError: Test AST error raised by the Python/ast.c

----------
components: Interpreter Core
messages: 379941
nosy: BTaskaya, gvanrossum, lys.nikolaou, pablogsal
priority: normal
severity: normal
status: open
title: Pegen: Raise errors occurred by the AST validator

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42206>
_______________________________________

From report at bugs.python.org  Fri Oct 30 06:12:22 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Fri, 30 Oct 2020 10:12:22 +0000
Subject: [issue42206] Pegen: Raise errors occurred by the AST validator
In-Reply-To: <1604052559.69.0.261468356002.issue42206@roundup.psfhosted.org>
Message-ID: <1604052742.78.0.646842860836.issue42206@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
keywords: +patch
pull_requests: +21954
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23035

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42206>
_______________________________________

From report at bugs.python.org  Fri Oct 30 06:21:51 2020
From: report at bugs.python.org (Jorge Schrauwen)
Date: Fri, 30 Oct 2020 10:21:51 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604053311.27.0.968386969304.issue42173@roundup.psfhosted.org>


Jorge Schrauwen <jorge.schrauwen at gmail.com> added the comment:

I'm an illumos user too, mostly SmartOS and some OmniOS.

I'm a heavy user of salt and thus phyton too, slowly prepping to get my stuff moved from 2.7 to 3.8 atm.

As mentioned above parts of the illumos build also use python and are moving to wads 3.9.

As mentioned I rarely use pip at all to install packages, nearly everything I need is available via IPS or pkgsrc depending on the distro.

----------
nosy: +jorge.schrauwen

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 06:27:25 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 30 Oct 2020 10:27:25 +0000
Subject: [issue42206] Pegen: Raise errors occurred by the AST validator
In-Reply-To: <1604052559.69.0.261468356002.issue42206@roundup.psfhosted.org>
Message-ID: <1604053645.0.0.73638555317.issue42206@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

This will slow down the parser massively. The reason we went' with the assert is so we only do the check in debug mode. We could propagate if you want, but it needs to be surrounded by debug preprocessor checks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42206>
_______________________________________

From report at bugs.python.org  Fri Oct 30 06:28:12 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 30 Oct 2020 10:28:12 +0000
Subject: [issue42206] Pegen: Raise errors occurred by the AST validator
In-Reply-To: <1604052559.69.0.261468356002.issue42206@roundup.psfhosted.org>
Message-ID: <1604053692.56.0.568132753214.issue42206@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> This will slow down the parser massively. The reason we went' with the assert is so we only do the check in debug mode. We could propagate if you want, but it needs to be surrounded by debug preprocessor checks.

Oh, I just checked and it currently is surrounded. Nevermind

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42206>
_______________________________________

From report at bugs.python.org  Fri Oct 30 06:41:56 2020
From: report at bugs.python.org (shakir_juolay)
Date: Fri, 30 Oct 2020 10:41:56 +0000
Subject: [issue42196] Python Windows Installation Error 0x800705aa
In-Reply-To: <1603978740.79.0.0573376832754.issue42196@roundup.psfhosted.org>
Message-ID: <1604054516.13.0.71016819613.issue42196@roundup.psfhosted.org>


shakir_juolay <shakir_juolay at yahoo.com> added the comment:

I have installed Zoom without Admin rights in the default folder D:\Users\sjuolay\AppData\Roaming\Zoom\bin. I am assuming it's only me since the application is not installed in Program Files.

Regarding CMD trying to run Python

D:\Users\sjuolay>where.exe python
D:\Users\sjuolay\AppData\Local\Microsoft\WindowsApps\python.exe

D:\Users\sjuolay>echo %PATH%
C:\Program Files\Teradata\Client\16.20\bin;C:\Program Files (x86)\Teradata\Client\16.20\bin;C:\app\product\11.2.0\client_1\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\WINDOWS\System32\OpenSSH\;D:\Users\sjuolay\AppData\Local\Microsoft\WindowsApps;

Looks like I have it because of https://devblogs.microsoft.com/python/python-in-the-windows-10-may-2019-update/

Hope this is not interfering with what I am trying to do.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42196>
_______________________________________

From report at bugs.python.org  Fri Oct 30 06:43:04 2020
From: report at bugs.python.org (shakir_juolay)
Date: Fri, 30 Oct 2020 10:43:04 +0000
Subject: [issue42196] Python Windows Installation Error 0x800705aa
In-Reply-To: <1603978740.79.0.0573376832754.issue42196@roundup.psfhosted.org>
Message-ID: <1604054584.02.0.268953224493.issue42196@roundup.psfhosted.org>


Change by shakir_juolay <shakir_juolay at yahoo.com>:


Added file: https://bugs.python.org/file49552/Capture.JPG

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42196>
_______________________________________

From report at bugs.python.org  Fri Oct 30 06:51:36 2020
From: report at bugs.python.org (Olaf Bohlen)
Date: Fri, 30 Oct 2020 10:51:36 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604055096.7.0.0993085623562.issue42173@roundup.psfhosted.org>


Olaf Bohlen <olafbohlen at googlemail.com> added the comment:

Also, let me join in here. 
OpenIndiana hipster and all other illumos distributions will suffer if you drop the "Solaris" support. Just to get an idea which packages in a nearly default install depend on python:
pkg uninstall: Unable to remove 'runtime/python-35 at 3.5.9-2020.0.1.1' due to the following packages that depend on it:

  communication/im/pidgin at 2.13.0-2020.0.1.4
  desktop/compiz/ccsm at 0.8.16-2020.0.1.0
  desktop/time-slider at 0.2.101-2020.0.1.116
  desktop/xdg/menu-editor/mozo at 1.24.0-2020.0.1.0
  developer/build/onbld at 0.5.11-2020.0.1.20038
  developer/clang-80 at 8.0.1-2020.0.1.0
  developer/ui-designer/glade at 3.22.2-2020.0.1.0
  developer/versioning/mercurial-35 at 5.3.2-2020.0.1.0
  diagnostic/ddu at 1.3.1-2020.0.1.40
  gnome/config/gconf at 2.32.4-2020.0.1.8
  install/distribution-constructor at 0.5.11-2020.0.1.1052
  metapackages/build-essential at 1.0-2020.0.1.21
  package/pkg at 0.5.11-2020.0.1.5543
  package/pkg/system-repository at 0.5.11-2020.0.1.5543
  print/cups/system-config-printer at 2.30.0-2020.0.1.3
  print/filter/hplip at 3.19.12-2020.0.1.0
  release/os-welcome at 1.0-2020.0.1.23
  service/gnome/desktop-cache at 0.2.2-2020.0.1.7
  service/network/samba at 4.12.5-2020.0.1.0
  system/file-system/zfs at 0.5.11-2020.0.1.20038
  system/input-method/imf-startup at 0.5.11-2020.0.1.3
  system/install at 0.5.11-2020.0.1.1052
  system/network/avahi at 0.7-2020.0.1.3
  system/network/avahi/gui at 0.7-2020.0.1.3
  system/zones/brand/ipkg at 0.5.11-2020.0.1.5543
  text/texinfo at 6.7-2020.0.1.1
  web/server/apache-24/module/apache-wsgi-35 at 4.5.22-2020.0.1.5

Actually the package manager itself, installer, ZFS helpers, cups, the illumos build-system and and and all depend on python.

----------
nosy: +olafbohlen

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 07:25:39 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 30 Oct 2020 11:25:39 +0000
Subject: [issue42202] Optimize function annotation
In-Reply-To: <1604040435.44.0.369975398522.issue42202@roundup.psfhosted.org>
Message-ID: <1604057139.5.0.182516590428.issue42202@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

> Yes, but it is bit larger than my single tuple idea in most cases.

Yes, but the code for creating a dict can be simpler. In any case we will better see what format is better when try to write a code.

> I am not sure this is the best option because there are many code object without annotation.

In this case it can be None or NULL.

I like your idea. It is easy to implement it now. Later we can make annotations an attribute of the code object.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42202>
_______________________________________

From report at bugs.python.org  Fri Oct 30 07:47:36 2020
From: report at bugs.python.org (hai shi)
Date: Fri, 30 Oct 2020 11:47:36 +0000
Subject: [issue41618] [C API] How many slots of static types should be exposed
 in PyType_GetSlot()
In-Reply-To: <1598172498.12.0.869607269568.issue41618@roundup.psfhosted.org>
Message-ID: <1604058456.73.0.0577339444095.issue41618@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

> IMO, a slot should be exposed if there is some reason for exposing it.

Can we write those info to docs? In case some developer want to exposing slot in future.

> Which other slots are we missing?

nb_inserved in PyNumberMethods should be removed?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41618>
_______________________________________

From report at bugs.python.org  Fri Oct 30 07:49:10 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 30 Oct 2020 11:49:10 +0000
Subject: [issue42206] Pegen: Raise errors occurred by the AST validator
In-Reply-To: <1604052559.69.0.261468356002.issue42206@roundup.psfhosted.org>
Message-ID: <1604058550.73.0.271991233053.issue42206@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 3af4b585527743e455145d294049c46b7c823ed9 by Batuhan Taskaya in branch 'master':
bpo-42206: Propagate and raise errors from PyAST_Validate in the parser (GH-23035)
https://github.com/python/cpython/commit/3af4b585527743e455145d294049c46b7c823ed9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42206>
_______________________________________

From report at bugs.python.org  Fri Oct 30 07:56:14 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 11:56:14 +0000
Subject: [issue39715] Implement __repr__ methods for AST classes
In-Reply-To: <1582308303.42.0.673674481243.issue39715@roundup.psfhosted.org>
Message-ID: <1604058974.12.0.741391066601.issue39715@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I'm not sure that it's a good idea to make repr(_ast.AST) longer. I suggest to reject this feature request. As Serhiy wrote, ast.dump() can already be used.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39715>
_______________________________________

From report at bugs.python.org  Fri Oct 30 07:59:16 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 30 Oct 2020 11:59:16 +0000
Subject: [issue39513] NameError: name 'open' is not defined
In-Reply-To: <1580498337.58.0.0606728460892.issue39513@roundup.psfhosted.org>
Message-ID: <1604059156.22.0.792038432596.issue39513@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I think this is a multi-level problem, and it perhaps should be solved on different levels separately.

As for logging, it can be used at shutdown by user code, it may help to understand the problem with the user code, and it may work most of time. But if it happen too late, it fails, and the printed traceback does not help but confuses user. The logging module should try the best to help the user. It should be ready to handle such situation. It is not failure of the end user that this error happens, and they cannot do anything in any way, so it is better to suppress the confusion traceback (maybe emit a warning?).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39513>
_______________________________________

From report at bugs.python.org  Fri Oct 30 08:01:07 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Fri, 30 Oct 2020 12:01:07 +0000
Subject: [issue42206] Pegen: Raise errors occurred by the AST validator
In-Reply-To: <1604052559.69.0.261468356002.issue42206@roundup.psfhosted.org>
Message-ID: <1604059267.21.0.990816031633.issue42206@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42206>
_______________________________________

From report at bugs.python.org  Fri Oct 30 08:02:57 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Fri, 30 Oct 2020 12:02:57 +0000
Subject: [issue39715] Implement __repr__ methods for AST classes
In-Reply-To: <1582308303.42.0.673674481243.issue39715@roundup.psfhosted.org>
Message-ID: <1604059377.81.0.502141806369.issue39715@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

> I suggest to reject this feature request

+1

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39715>
_______________________________________

From report at bugs.python.org  Fri Oct 30 08:03:45 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 30 Oct 2020 12:03:45 +0000
Subject: [issue42203] Unexpected behaviour NameError: name 'open' is not
 defined
In-Reply-To: <1604043849.8.0.342211011492.issue42203@roundup.psfhosted.org>
Message-ID: <1604059425.07.0.109475038238.issue42203@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Yes, solving any of issue26789 or issue39513 will likely solve also this issue. But this issue is the one which relates to asyncio tests, so there may be some flaw in tests which should be fixed too. Solving issue26789 or issue39513 will eliminate symptoms, so it would be harder to fix the bug in test is there is one.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42203>
_______________________________________

From report at bugs.python.org  Fri Oct 30 08:39:00 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 30 Oct 2020 12:39:00 +0000
Subject: [issue42203] Unexpected behaviour NameError: name 'open' is not
 defined
In-Reply-To: <1604043849.8.0.342211011492.issue42203@roundup.psfhosted.org>
Message-ID: <1604061540.38.0.775118957428.issue42203@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This is a duplicate of below

https://bugs.python.org/issue26789
https://bugs.python.org/issue39513

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42203>
_______________________________________

From report at bugs.python.org  Fri Oct 30 08:40:33 2020
From: report at bugs.python.org (Juraj Lutter)
Date: Fri, 30 Oct 2020 12:40:33 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604061633.67.0.713422427765.issue42173@roundup.psfhosted.org>


Juraj Lutter <juraj at lutter.sk> added the comment:

We, in danubecloud (https://github.com/erigones/esdc-ce) are relying on Python, too. Keep up the good work, folks :-)

----------
nosy: +otis

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 08:47:06 2020
From: report at bugs.python.org (Mike La Spina)
Date: Fri, 30 Oct 2020 12:47:06 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604062026.99.0.290587409763.issue42173@roundup.psfhosted.org>


Mike La Spina <michael.laspina at gmail.com> added the comment:

I suspect the download stats are not a full indication of usage on ?SunOS? based on download stats. The bits are preinstalled. I do use it frequently via Illumos. Please support the platform.

Regards,
Mike

----------
nosy: +michael.laspina

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 08:51:51 2020
From: report at bugs.python.org (Antti Haapala)
Date: Fri, 30 Oct 2020 12:51:51 +0000
Subject: [issue26175] Fully implement IOBase abstract on SpooledTemporaryFile
In-Reply-To: <1453413274.25.0.536987988375.issue26175@psf.upfronthosting.co.za>
Message-ID: <1604062311.96.0.105513318299.issue26175@roundup.psfhosted.org>


Antti Haapala <antti at haapala.name> added the comment:

Another test case:

import tempfile
import io
import json


with tempfile.SpooledTemporaryFile(max_size=2**20) as f:
    tf = io.TextIOWrapper(f, encoding='utf-8')
    json.dump({}, fp=tf)

I was writing json to a file-like object that I need to read in as binary (to upload to S3). Originally the code used BytesIO and I thought it would be wise to actually spool this to disk as I was operating with possible limited RAM... except that of course it didn't work.

----------
nosy: +ztane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26175>
_______________________________________

From report at bugs.python.org  Fri Oct 30 08:54:02 2020
From: report at bugs.python.org (Antti Haapala)
Date: Fri, 30 Oct 2020 12:54:02 +0000
Subject: [issue26175] Fully implement IOBase abstract on SpooledTemporaryFile
In-Reply-To: <1453413274.25.0.536987988375.issue26175@psf.upfronthosting.co.za>
Message-ID: <1604062442.59.0.622235881827.issue26175@roundup.psfhosted.org>


Antti Haapala <antti at haapala.name> added the comment:

... to further clarify, it is disappointing that either BytesIO or TemporaryFile would work alone, but the one that merges these two doesn't.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26175>
_______________________________________

From report at bugs.python.org  Fri Oct 30 08:57:35 2020
From: report at bugs.python.org (Jan Poctavek)
Date: Fri, 30 Oct 2020 12:57:35 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604062655.4.0.707306943023.issue42173@roundup.psfhosted.org>


Jan Poctavek <janci at binaryparadise.com> added the comment:

I'm speaking officially for Danube Cloud, an advanced project which is open-source virtualization platform similar to Proxmox, XCP-NG, oVirt, Joyent Triton, etc. Our base platform is SmartOS and we have everything written in Python.

If you drop support for "Solaris", it will hurt our project a lot. Python has become heart of many projects and it should not limit itself to support just the mainstream platforms and OSes.

Thank you for everything you've done so far and I hope we can continue together.

Jan Poctavek

Danube Cloud
https://github.com/erigones/esdc-ce

----------
nosy: +yanchii

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 09:00:56 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 13:00:56 +0000
Subject: [issue39715] Implement __repr__ methods for AST classes
In-Reply-To: <1582308303.42.0.673674481243.issue39715@roundup.psfhosted.org>
Message-ID: <1604062856.86.0.318259454397.issue39715@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I reject the feature request.

While repr() on AST nodes could be enhanced for some specific nodes, you have to know that the code is mostly implemented in C which make enhancements non-trivial. Moreover, this code (Python/Python-ast.c) is generated by a script (Parser/asdl_c.py) which makes it even worse to enhance.

I suggest you to develop tooling outside of the stdlib to format an AST tree or a list of AST nodes, something like pprint and reprlib modules. It would benefit to more Python versions and will give you way more freedom on how to format these nodes.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39715>
_______________________________________

From report at bugs.python.org  Fri Oct 30 09:04:53 2020
From: report at bugs.python.org (Gaige Paulsen)
Date: Fri, 30 Oct 2020 13:04:53 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604063093.47.0.0865999000023.issue42173@roundup.psfhosted.org>


Gaige Paulsen <gaige at cluetrust.com> added the comment:

Let me add my voice to those who ask to keep Solaris support in Python going forward. We use SmartOS which is an Illumos and thus Solaris derivative.

We use Ansible extensively to automate our SmartOS deployments. We have a couple hundred VMs and 2 part-time volunteers on staff. We are extremely reliant on Ansible, and thus Python.

I have multiple blogs and a couple of django-based web sites that are running on SmartOS and we run a wide variety of tools that use Python as part of their mix.

----------
nosy: +gaige

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 09:06:27 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 13:06:27 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604063187.64.0.965331962333.issue42173@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

It seems like two Python core developers (Ronald Oussoren and Jes?s Cea Avi?n) are volunteer to maintain the Solaris support. Moreover, it seems like some people would like to provide a Solaris server to run a buildbot server. In this case, I would be fine to keep the Solaris code.

But it's not enough, please call for help:
https://mail.python.org/archives/list/python-dev at python.org/message/NYWF4DUPFYZSKUUZ3ZHOSBQCWAF4IIQO/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 09:06:52 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 13:06:52 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604063212.58.0.730233833178.issue42173@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> But it's not enough, please call for help:

Please *read* my call for help

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 09:35:05 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 13:35:05 +0000
Subject: [issue41839] Solaris: Fix error checking in sched_get_priority_
 functions
In-Reply-To: <1600854291.47.0.647428852002.issue41839@roundup.psfhosted.org>
Message-ID: <1604064905.3.0.144965649158.issue41839@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
title: Fix error checking in sched_get_priority_ functions -> Solaris: Fix error checking in sched_get_priority_ functions

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41839>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:23:08 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 30 Oct 2020 14:23:08 +0000
Subject: [issue42042] sphinx3 renders diffrently docs.python.org for 3.10
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1604067788.26.0.603887376614.issue42042@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
priority: normal -> release blocker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:23:31 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 14:23:31 +0000
Subject: [issue42203] Unexpected behaviour NameError: name 'open' is not
 defined
In-Reply-To: <1604043849.8.0.342211011492.issue42203@roundup.psfhosted.org>
Message-ID: <1604067811.13.0.744509590518.issue42203@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I mark this issue as a duplicate of bpo-26789.

----------
nosy: +vstinner
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> asyncio: Please do not log during shutdown

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42203>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:23:33 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 14:23:33 +0000
Subject: [issue39513] NameError: name 'open' is not defined
In-Reply-To: <1580498337.58.0.0606728460892.issue39513@roundup.psfhosted.org>
Message-ID: <1604067813.37.0.736794137533.issue39513@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I mark this issue as a duplicate of bpo-26789.

----------
nosy: +vstinner
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> asyncio: Please do not log during shutdown

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39513>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:27:19 2020
From: report at bugs.python.org (hai shi)
Date: Fri, 30 Oct 2020 14:27:19 +0000
Subject: [issue41626] port shebang of tools from python2 to python3
In-Reply-To: <1598286525.38.0.443257169426.issue41626@roundup.psfhosted.org>
Message-ID: <1604068039.11.0.0449076475161.issue41626@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

Sorry for my delay~

>I think some of these work with any Python, but some need the locally built interpreter to give correct results.
>It could avoid confusion and mistakes to remove the shebangs and executable bits from the scripts that need a local Python, and make dure their documentation mentions `./python path/to/tool`.

I update Objects/typeslots.py in #PR21913 recently and using f-format in this script(it means that just local python or python3 can run). So I will accept your suggestion from this file after this PR merged:)

>(Oh and by the way, Tools/scripts/fixps.py is a tool to replace `/usr/local/bin/python` shebangs with `/usr/bin/env python`?  You can judge if that is useful and/or correct.)

Thanks, I will take a look.

> So if things are changed (let?s get a couple opinions here), maybe this needs separate PRs for 1/2/3, and make sure to get reviews to ensure we don?t break IDLE / Mac installers / pegen / etc.

Agree. To corner case, a single sepereate PR is good.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41626>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:28:59 2020
From: report at bugs.python.org (hai shi)
Date: Fri, 30 Oct 2020 14:28:59 +0000
Subject: [issue41626] port shebang of tools from python2 to python3
In-Reply-To: <1598286525.38.0.443257169426.issue41626@roundup.psfhosted.org>
Message-ID: <1604068139.81.0.0703527174552.issue41626@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

typo error: PR21913->PR21931

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41626>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:24:35 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 14:24:35 +0000
Subject: [issue26789] logging: Trying to log during Python finalization with
 NameError: name 'open' is not defined
In-Reply-To: <1460905927.74.0.222378341822.issue26789@psf.upfronthosting.co.za>
Message-ID: <1604067875.39.0.771249810634.issue26789@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I marked bpo-39513 and bpo-42203 as duplicates of this issue.

I changed the title to reflect that the root issue is that logging during Python finalization can fail with NameError: name 'open' is not defined.

----------
components: +Library (Lib) -asyncio
nosy: +vstinner
title: asyncio: Please do not log during shutdown -> logging: Trying to log during Python finalization with NameError: name 'open' is not defined
versions: +Python 3.10 -Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26789>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:26:10 2020
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Fri, 30 Oct 2020 14:26:10 +0000
Subject: [issue26789] logging: Trying to log during Python finalization with
 NameError: name 'open' is not defined
In-Reply-To: <1460905927.74.0.222378341822.issue26789@psf.upfronthosting.co.za>
Message-ID: <1604067970.45.0.949779619445.issue26789@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

> In the OP, the error is caused by `open` being unavailable, which is a builtin. According to what Serhiy says, this error would be after step 6

I think you read the post above incorrectly. The phase 3 is the one where open is removed, since it's not a "native" builtin, but imported from io.

----------
nosy: +veky

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26789>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:24:51 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 30 Oct 2020 14:24:51 +0000
Subject: [issue42042] sphinx3 renders diffrently docs.python.org for 3.10
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1604067891.11.0.355100992409.issue42042@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

@pablogsal

Since this is the developer guide of 3.10.
I would like to suggest as release bloker, if you don't agree you can change it ;)

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:32:19 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 14:32:19 +0000
Subject: [issue26789] logging: Trying to log during Python finalization with
 NameError: name 'open' is not defined
In-Reply-To: <1460905927.74.0.222378341822.issue26789@psf.upfronthosting.co.za>
Message-ID: <1604068339.89.0.187805594311.issue26789@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I hacked logging.FileHandler to keep a reference to the builtin open() function. I got new problems.

In my test, I got a crash because of an unclosed file. It happens after PyInterpreterState_Clear(), in finalize_interp_clear():

    /* Last explicit GC collection */
    _PyGC_CollectNoFail();

setup_context() of Python/_warings.c does crash because tstate->interp->sysdict is NULL at this point.

Moreover, _io.TextIOWrapper.__init__() fails to import the locale module (to call locale.getpreferredencoding(), since the encoding is None) and picks the "ascii" encoding.

Moreover, even if I work around all these issues, _warnings.showwarnings() logs "lost sys.stderr" into stderr because, again, tstate->interp->sysdict is NULL at this point (and so sys.stderr no longer exists).

It looks like a bug in finalize_interp_clear() which triggers a garbage collection, whereas Python is no longer usable.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26789>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:45:04 2020
From: report at bugs.python.org (serge-sans-paille)
Date: Fri, 30 Oct 2020 14:45:04 +0000
Subject: [issue42207] Python 3.9 testing fails when building with clang and
 optimizations are enabled
Message-ID: <1604069104.85.0.435616508554.issue42207@roundup.psfhosted.org>


New submission from serge-sans-paille <serge.guelton at telecom-bretagne.eu>:

How to reproduce:

```
git clone https://github.com/python/cpython && cd cpython
mkdir -p _build/optimized
cd _build/optimized
../../configure --enable-optimizations CC=clang
make
cd ..
./optimized/python -m test.regrtest -wW --slowest -j0 --timeout=1800 2>&1 | grep "error: Could not read profile code.profclangd"
```

This bug no longer happens on master branch because it's related to test_peg_generator.

----------
components: Build
messages: 379972
nosy: serge-sans-paille
priority: normal
severity: normal
status: open
title: Python 3.9 testing fails when building with clang and optimizations are enabled
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42207>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:46:11 2020
From: report at bugs.python.org (serge-sans-paille)
Date: Fri, 30 Oct 2020 14:46:11 +0000
Subject: [issue42207] Python 3.9 testing fails when building with clang and
 optimizations are enabled
In-Reply-To: <1604069104.85.0.435616508554.issue42207@roundup.psfhosted.org>
Message-ID: <1604069171.39.0.799432144984.issue42207@roundup.psfhosted.org>


Change by serge-sans-paille <serge.guelton at telecom-bretagne.eu>:


----------
keywords: +patch
pull_requests: +21955
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23037

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42207>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:54:17 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 30 Oct 2020 14:54:17 +0000
Subject: [issue42042] sphinx3 renders diffrently docs.python.org for 3.10
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1604069657.35.0.25489848778.issue42042@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> I would like to suggest as release bloker, if you don't agree you can change it ;)

This is indeed a release blocker, but likely for the beta/release candidate phases.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:57:24 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 14:57:24 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604069844.25.0.026327699139.issue42208@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


Added file: https://bugs.python.org/file49554/crash.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:57:54 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 14:57:54 +0000
Subject: [issue26789] logging: Trying to log during Python finalization with
 NameError: name 'open' is not defined
In-Reply-To: <1460905927.74.0.222378341822.issue26789@psf.upfronthosting.co.za>
Message-ID: <1604069874.8.0.816698430884.issue26789@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> It looks like a bug in finalize_interp_clear() which triggers a garbage collection, whereas Python is no longer usable.

I created bpo-42208 "Using logging or warnings during Python finalization does crash Python".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26789>
_______________________________________

From report at bugs.python.org  Fri Oct 30 10:57:17 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 14:57:17 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
Message-ID: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

If you apply attached logging.patch, Python crash using attached crash.py:

$ echo|./python -i crash.py
>>>
>>> 
python: Python/_warnings.c:872: setup_context: Assertion `globals != NULL' failed.
Abandon (core dumped)


Attached logging.patch is a fix for bpo-26789: logging.FileHandler keeps a reference to the builtin open() function.

Attached crash.py does crash because of an unclosed file. It happens after PyInterpreterState_Clear(), in finalize_interp_clear():

    /* Last explicit GC collection */
    _PyGC_CollectNoFail();

setup_context() of Python/_warings.c does crash because tstate->interp->sysdict is NULL at this point.

Moreover, _io.TextIOWrapper.__init__() fails to import the locale module (to call locale.getpreferredencoding(), since the encoding is None) and picks the "ascii" encoding.

Moreover, even if I work around all these issues, _warnings.showwarnings() logs "lost sys.stderr" into stderr because, again, tstate->interp->sysdict is NULL at this point (and so sys.stderr no longer exists).

It looks like a bug in finalize_interp_clear() which triggers a garbage collection, whereas Python is no longer usable.

--

The logging module does automatically close files at exit using:

   atexit.register(shutdown)

But crash.py, a new file is opened by a logging handler after logging.shutdown() is called. Maybe another problem is that the logging module does not clear logger handlers, or prevent handlers to log more message, after shutdown() is called.

----------
components: Interpreter Core
files: logging.patch
keywords: patch
messages: 379974
nosy: vstinner
priority: normal
severity: normal
status: open
title: Using logging or warnings during Python finalization does crash Python
versions: Python 3.10
Added file: https://bugs.python.org/file49553/logging.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 11:13:09 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 30 Oct 2020 15:13:09 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604070789.97.0.250532431769.issue42208@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 11:18:10 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 30 Oct 2020 15:18:10 +0000
Subject: [issue42042] sphinx3 renders diffrently docs.python.org for 3.10
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1604071090.19.0.75595789102.issue42042@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

> but likely for the beta/release candidate phases.

I think so too

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Fri Oct 30 11:29:34 2020
From: report at bugs.python.org (gKuhn)
Date: Fri, 30 Oct 2020 15:29:34 +0000
Subject: [issue42209] Incorrect line reported in syntax error
Message-ID: <1604071774.71.0.0589140009748.issue42209@roundup.psfhosted.org>


New submission from gKuhn <gregorykuhn at gmail.com>:

Attempting to parse the following python code results in a fairly unhelpful syntax error along with an incorrect line number being reported:

    #a dodgy f-string

    def dodgy(**kwargs):
        print(f"{**kwargs}")

The result:

  File "<fstring>", line 1
    (**kwargs)
     ^
SyntaxError: invalid syntax


$ python -VV
Python 3.8.5 (tags/v3.8.5:580fbb0, Jul 20 2020, 15:43:08) [MSC v.1926 32 bit (Intel)]

----------
messages: 379977
nosy: gkuhn
priority: normal
severity: normal
status: open
title: Incorrect line reported in syntax error
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42209>
_______________________________________

From report at bugs.python.org  Fri Oct 30 11:29:35 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 15:29:35 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604071775.05.0.196637764528.issue42208@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21957
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23038

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 12:00:08 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 16:00:08 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604073608.97.0.110319972733.issue42208@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 8b3414818f5289eac530bf38bcfbd7b2b851805c by Victor Stinner in branch 'master':
bpo-42208: Pass tstate to _PyGC_CollectNoFail() (GH-23038)
https://github.com/python/cpython/commit/8b3414818f5289eac530bf38bcfbd7b2b851805c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 12:04:29 2020
From: report at bugs.python.org (Sree)
Date: Fri, 30 Oct 2020 16:04:29 +0000
Subject: [issue42210] float.hex discards sign from -nan
Message-ID: <1604073869.82.0.718371202647.issue42210@roundup.psfhosted.org>


New submission from Sree <sree314 at gmail.com>:

float.hex(float.fromhex("-nan")) returns 'nan'.

PyOS_double_to_string seems to check only if it is a NaN, but ignores the sign (unlike its handling of inf a few lines below):

<https://github.com/python/cpython/blob/e9e7d284c434768333fdfb53a3663eae74cb995a/Python/pystrtod.c#L903>

Issue 5981 (https://bugs.python.org/issue5981) added the ability for fromhex to recognize -nan, but hex should probably have been updated at the same time.

Encountered when testing float implementations.

----------
components: Interpreter Core
messages: 379979
nosy: sree314
priority: normal
severity: normal
status: open
title: float.hex discards sign from -nan
type: behavior
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42210>
_______________________________________

From report at bugs.python.org  Fri Oct 30 12:10:47 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Fri, 30 Oct 2020 16:10:47 +0000
Subject: [issue42209] Incorrect line reported in syntax error
In-Reply-To: <1604071774.71.0.0589140009748.issue42209@roundup.psfhosted.org>
Message-ID: <1604074247.51.0.662952708947.issue42209@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

The line number has been fixed in python 3.9:

  File "...\foo.py", line 5
    (**kwargs)
     ^
SyntaxError: f-string: invalid syntax

The error message should improve when we move parsing of f-strings into the parser. I doubt we'd put in the effort to do anything before then.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42209>
_______________________________________

From report at bugs.python.org  Fri Oct 30 12:11:41 2020
From: report at bugs.python.org (Ken Jin)
Date: Fri, 30 Oct 2020 16:11:41 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604074301.96.0.104782069541.issue42198@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
pull_requests: +21958
pull_request: https://github.com/python/cpython/pull/23039

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Fri Oct 30 12:23:45 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 16:23:45 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604075025.15.0.489684811482.issue42208@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21959
pull_request: https://github.com/python/cpython/pull/23040

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 12:38:08 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 30 Oct 2020 16:38:08 +0000
Subject: [issue26789] logging: Trying to log during Python finalization with
 NameError: name 'open' is not defined
In-Reply-To: <1460905927.74.0.222378341822.issue26789@psf.upfronthosting.co.za>
Message-ID: <1604075888.35.0.258541689441.issue26789@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I am not sure that its all the same issue. There may be several different issues:

* Issue39513. Logging fails with confusing traceback when called late at shutdown. I think that if logging cannot work at this stage it should either do nothing or emit a warning.

* Issue26789. asyncio creates reference loops which caused to executing code late at shutdown, and that code uses logging which always fail. It would be better to avoid creating reference loops, and if it is impossible, break the earlier.

* Issue42203. And there may be different issue in asyncio tests. Tests should clean up after them and do not leave the code be executed later. It may be the same as issue26789, but tests can make additional efforts to clean up.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26789>
_______________________________________

From report at bugs.python.org  Fri Oct 30 12:46:18 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 16:46:18 +0000
Subject: [issue42042] sphinx3 renders diffrently docs.python.org for 3.10
In-Reply-To: <1602763041.43.0.432643801896.issue42042@roundup.psfhosted.org>
Message-ID: <1604076378.6.0.987805585948.issue42042@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42042>
_______________________________________

From report at bugs.python.org  Fri Oct 30 12:49:44 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 16:49:44 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604076584.42.0.739851287402.issue42208@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21960
pull_request: https://github.com/python/cpython/pull/23041

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 12:51:25 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 30 Oct 2020 16:51:25 +0000
Subject: [issue39513] NameError: name 'open' is not defined
In-Reply-To: <1580498337.58.0.0606728460892.issue39513@roundup.psfhosted.org>
Message-ID: <1604076685.44.0.946053405383.issue39513@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Issue26789 is about asyncio, but this issue about logging.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39513>
_______________________________________

From report at bugs.python.org  Fri Oct 30 12:56:11 2020
From: report at bugs.python.org (Soham Badame)
Date: Fri, 30 Oct 2020 16:56:11 +0000
Subject: [issue42211] CRASH
Message-ID: <1604076971.85.0.802956431757.issue42211@roundup.psfhosted.org>


New submission from Soham Badame <badamesoham8 at gmail.com>:

If you apply attached logging.patch, Python crash using attached crash.py:

$ echo|./python -i crash.py
>>>
>>> 
python: Python/_warnings.c:872: setup_context: Assertion `globals != NULL' failed.
Abandon (core dumped)


Attached logging.patch is a fix for bpo-26789: logging.FileHandler keeps a reference to the builtin open() function.

Attached crash.py does crash because of an unclosed file. It happens after PyInterpreterState_Clear(), in finalize_interp_clear():

    /* Last explicit GC collection */
    _PyGC_CollectNoFail();

setup_context() of Python/_warings.c does crash because tstate->interp->sysdict is NULL at this point.

Moreover, _io.TextIOWrapper.__init__() fails to import the locale module (to call locale.getpreferredencoding(), since the encoding is None) and picks the "ascii" encoding.

Moreover, even if I work around all these issues, _warnings.showwarnings() logs "lost sys.stderr" into stderr because, again, tstate->interp->sysdict is NULL at this point (and so sys.stderr no longer exists).

It looks like a bug in finalize_interp_clear() which triggers a garbage collection, whereas Python is no longer usable.

--

The logging module does automatically close files at exit using:

   atexit.register(shutdown)

But crash.py, a new file is opened by a logging handler after logging.shutdown() is called. Maybe another problem is that the logging module does not clear logger handlers, or prevent handlers to log more message, after shutdown() is called.

----------
messages: 379984
nosy: badamesoham8
priority: normal
severity: normal
status: open
title: CRASH
type: crash
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42211>
_______________________________________

From report at bugs.python.org  Fri Oct 30 12:59:21 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 16:59:21 +0000
Subject: [issue39513] NameError: name 'open' is not defined
In-Reply-To: <1580498337.58.0.0606728460892.issue39513@roundup.psfhosted.org>
Message-ID: <1604077161.41.0.841960587768.issue39513@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Issue26789 is about asyncio, but this issue about logging.

I chose to reassign Issue26789 to the logging module.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39513>
_______________________________________

From report at bugs.python.org  Fri Oct 30 13:01:05 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 17:01:05 +0000
Subject: [issue26789] logging: Trying to log during Python finalization with
 NameError: name 'open' is not defined
In-Reply-To: <1460905927.74.0.222378341822.issue26789@psf.upfronthosting.co.za>
Message-ID: <1604077265.25.0.784504049937.issue26789@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Issue26789. asyncio creates reference loops which caused to executing code late at shutdown, and that code uses logging which always fail.

Well, I suggest to attempt fixing logging.

The reference cycle in asyncio.Task.set_exception() is *by design*. It's really trick to fix it. Since the creation of asyncio, nobody managed to find a solution to fix it. Once I propose to create an asyncio task forcing a GC collection every minute, but it was never implemented.

If you have a clever idea to fix Task.set_exception() design, please open a separated issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26789>
_______________________________________

From report at bugs.python.org  Fri Oct 30 13:03:35 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 17:03:35 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604077415.85.0.497434890569.issue42208@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset dff1ad509051f7e07e77d1e3ec83314d53fb1118 by Victor Stinner in branch 'master':
bpo-42208: Move _PyImport_Cleanup() to pylifecycle.c (GH-23040)
https://github.com/python/cpython/commit/dff1ad509051f7e07e77d1e3ec83314d53fb1118


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 13:04:34 2020
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 30 Oct 2020 17:04:34 +0000
Subject: [issue42211] CRASH
In-Reply-To: <1604076971.85.0.802956431757.issue42211@roundup.psfhosted.org>
Message-ID: <1604077474.87.0.0846399596003.issue42211@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Please attach crash.py and logging.patch files

----------
nosy: +vstinner, xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42211>
_______________________________________

From report at bugs.python.org  Fri Oct 30 13:22:37 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Fri, 30 Oct 2020 17:22:37 +0000
Subject: [issue42212] Check if generated files are up-to-date in Github Actions
Message-ID: <1604078557.08.0.656569996113.issue42212@roundup.psfhosted.org>


Change by Filipe La?ns <lains at riseup.net>:


----------
nosy: FFY00, vstinner
priority: normal
severity: normal
status: open
title: Check if generated files are up-to-date in Github Actions

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42212>
_______________________________________

From report at bugs.python.org  Fri Oct 30 13:23:24 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Fri, 30 Oct 2020 17:23:24 +0000
Subject: [issue42212] Check if generated files are up-to-date in Github Actions
Message-ID: <1604078604.78.0.892502447015.issue42212@roundup.psfhosted.org>


New submission from Filipe La?ns <lains at riseup.net>:

https://github.com/python/core-workflow/issues/380

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42212>
_______________________________________

From report at bugs.python.org  Fri Oct 30 13:24:15 2020
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Fri, 30 Oct 2020 17:24:15 +0000
Subject: [issue42212] Check if generated files are up-to-date in Github Actions
In-Reply-To: <1604078604.78.0.892502447015.issue42212@roundup.psfhosted.org>
Message-ID: <1604078655.85.0.0497316521599.issue42212@roundup.psfhosted.org>


Change by Filipe La?ns <lains at riseup.net>:


----------
keywords: +patch
pull_requests: +21961
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23042

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42212>
_______________________________________

From report at bugs.python.org  Fri Oct 30 13:57:02 2020
From: report at bugs.python.org (gKuhn)
Date: Fri, 30 Oct 2020 17:57:02 +0000
Subject: [issue42209] Incorrect line reported in syntax error
In-Reply-To: <1604071774.71.0.0589140009748.issue42209@roundup.psfhosted.org>
Message-ID: <1604080622.99.0.32286314919.issue42209@roundup.psfhosted.org>


gKuhn <gregorykuhn at gmail.com> added the comment:

Ah, that makes sense, thank you for the info.

The line number is probably the most important piece of information here anyway. 

It sounds like the syntax error string is already planned and as such this is probably a duplicate. 

Please close if this is the case. 

Cheers

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42209>
_______________________________________

From report at bugs.python.org  Fri Oct 30 14:36:59 2020
From: report at bugs.python.org (cyrus torros)
Date: Fri, 30 Oct 2020 18:36:59 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604083019.7.0.18309516914.issue42173@roundup.psfhosted.org>


cyrus torros <sugondesenuts007 at gmail.com> added the comment:

Why?? I use python on solaris in my every day toolchain and at work. 

There is no harm in keeping it supported, it's not hard. 

Please do not drop support.

----------
nosy: +sugondesenuts007

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 14:51:23 2020
From: report at bugs.python.org (Jakub Kulik)
Date: Fri, 30 Oct 2020 18:51:23 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604083883.95.0.00583027443142.issue42173@roundup.psfhosted.org>


Jakub Kulik <kulikjak at gmail.com> added the comment:

Hi, here I am passing on several notes from the Oracle Solaris team:

- Oracle continues to develop and advance Oracle Solaris technology, and have committed to doing so for years to come. We release a new update (so called SRU) every month (https://blogs.oracle.com/solaris/oracle-solaris%3a-update-to-the-continuous-delivery-model).
- Python is essential for Oracle Solaris and actively worked on. In fact, we recently finished migration to Python 3.7 and integrated Python 3.9, which will be released to customers soon.
- Internally, we are performing daily testing for each Python version from 3.7+ and reporting any issues that are found* (fortunately, there are not many of them because Python works very well!).
- Python 3 is running for more than a year now on any machine running Oracle Solaris 11.4.
- Looking at six download statistics is very misleading because we are packaging Python and its modules in Solaris packages. This package is essential (meaning that every Oracle Solaris machine will have it installed). Also, we are caching archives internally, so unless customers download a newer version into a virtual environment, you won't see more than a few downloads from Oracle Solaris (which are then distributed onto thousands of machines running Oracle Solaris).
- We are looking at how to provide build bots running on Oracle Solaris.
- We are trying to be part of the Python community and also put back Solaris specific fixes (we provide patches for many of those issues reported).
- It is certainly much better (hopefully for everyone) to resolve any specific Solaris issues and help with the maintenance within the Python community than do this just internally as part of Oracle Solaris development.

*) everything reported by me are Solaris related issues

Jakub

----------
nosy: +kulikjak -sugondesenuts007

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 14:57:38 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 30 Oct 2020 18:57:38 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604084258.75.0.909018842366.issue42173@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I think the PR needs to be withdrawn.  Users have spoken.  There is zero need to cut them off.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 15:08:52 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 30 Oct 2020 19:08:52 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604084932.51.0.32220926985.issue42173@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Discussions are happening in this thread, including the requirements for supported platforms going forward:

https://mail.python.org/archives/list/python-dev at python.org/thread/VDD7NMEDFXMOP4S74GEYJUHJRJPK2UR3/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 15:59:37 2020
From: report at bugs.python.org (Eric Wolf)
Date: Fri, 30 Oct 2020 19:59:37 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604087977.87.0.866081132637.issue42160@roundup.psfhosted.org>


Eric Wolf <robo-eric at gmx.de> added the comment:

Thanks

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Fri Oct 30 16:09:55 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 20:09:55 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604088595.36.0.0693240407787.issue42208@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset b9ee4af4c643a323779fd7076e80b29d611f2709 by Victor Stinner in branch 'master':
bpo-42208: Fix test_gdb for gc_collect_main() name (GH-23041)
https://github.com/python/cpython/commit/b9ee4af4c643a323779fd7076e80b29d611f2709


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 16:24:12 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 20:24:12 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604089452.68.0.303862547111.issue42208@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> bpo-42208: Pass tstate to _PyGC_CollectNoFail() (GH-23038)
> https://github.com/python/cpython/commit/8b3414818f5289eac530bf38bcfbd7b2b851805c

This change renames collect() to gc_collect_main(). It broke test_gdb on buildbots, whereas test_gdb passed on Travis CI on my PR 23038. Also, test_gdb is skipped on the Ubuntu job of GitHub Action since gdb is not installed. I created https://github.com/python/core-workflow/issues/383 to add gdb to Ubuntu dependencies. My PR 23043 adds gdb dependency.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 16:24:21 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 20:24:21 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604089461.5.0.0646172169459.issue42208@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21962
pull_request: https://github.com/python/cpython/pull/23043

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 16:50:21 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 20:50:21 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604091021.6.0.531930117502.issue42208@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21963
pull_request: https://github.com/python/cpython/pull/23044

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 16:53:12 2020
From: report at bugs.python.org (Eric Snow)
Date: Fri, 30 Oct 2020 20:53:12 +0000
Subject: [issue36876] [subinterpreters] Global C variables are a problem
In-Reply-To: <1557514902.13.0.853517754348.issue36876@roundup.psfhosted.org>
Message-ID: <1604091192.77.0.0703353618529.issue36876@roundup.psfhosted.org>


Change by Eric Snow <ericsnowcurrently at gmail.com>:


----------
pull_requests: +21964
pull_request: https://github.com/python/cpython/pull/23045

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36876>
_______________________________________

From report at bugs.python.org  Fri Oct 30 17:44:11 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 30 Oct 2020 21:44:11 +0000
Subject: [issue42213] Get rid of cyclic GC hack in sqlite3.Connection and
 sqlite3.Cache
Message-ID: <1604094251.24.0.415072580215.issue42213@roundup.psfhosted.org>


New submission from Erlend Egeberg Aasland <erlend.aasland at innova.no>:

Get rid of the `pysqlite_Cache->decref_factory` hack by implementing proper support for cyclic garbage collection.

----------
components: Library (Lib)
messages: 379998
nosy: berker.peksag, erlendaasland
priority: normal
severity: normal
status: open
title: Get rid of cyclic GC hack in sqlite3.Connection and sqlite3.Cache
type: resource usage
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42213>
_______________________________________

From report at bugs.python.org  Fri Oct 30 17:46:55 2020
From: report at bugs.python.org (Eric Snow)
Date: Fri, 30 Oct 2020 21:46:55 +0000
Subject: [issue36876] [subinterpreters] Global C variables are a problem
In-Reply-To: <1557514902.13.0.853517754348.issue36876@roundup.psfhosted.org>
Message-ID: <1604094415.6.0.748825473935.issue36876@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:


New changeset 4fe72090deb7fb7bc09bfa56c92f6b3b0967d395 by Eric Snow in branch 'master':
bpo-36876: Small adjustments to the C-analyzer tool. (GH-23045)
https://github.com/python/cpython/commit/4fe72090deb7fb7bc09bfa56c92f6b3b0967d395


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36876>
_______________________________________

From report at bugs.python.org  Fri Oct 30 17:49:28 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 30 Oct 2020 21:49:28 +0000
Subject: [issue42213] Get rid of cyclic GC hack in sqlite3.Connection and
 sqlite3.Cache
In-Reply-To: <1604094251.24.0.415072580215.issue42213@roundup.psfhosted.org>
Message-ID: <1604094568.54.0.613779383391.issue42213@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
keywords: +patch
pull_requests: +21965
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23046

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42213>
_______________________________________

From report at bugs.python.org  Fri Oct 30 17:49:45 2020
From: report at bugs.python.org (Marco Sulla)
Date: Fri, 30 Oct 2020 21:49:45 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1604094585.97.0.348498093645.issue41835@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

Well, following your example, since split dicts seems to be no more supported, I decided to be more drastic. If you see the last push in PR 22346, I do not check anymore but always resize, so the dict is always combined. This seems to be especially good for the "unpack_sequence" bench, even if I do not know what it is:

| chaos                   | 132 ms           | 136 ms         | 1.03x slower | Significant (t=-18.09) |
| crypto_pyaes            | 136 ms           | 141 ms         | 1.03x slower | Significant (t=-11.60) |
| float                   | 133 ms           | 137 ms         | 1.03x slower | Significant (t=-16.94) |
| go                      | 276 ms           | 282 ms         | 1.02x slower | Significant (t=-11.58) |
| logging_format          | 12.3 us          | 12.6 us        | 1.02x slower | Significant (t=-9.75)  |
| logging_silent          | 194 ns           | 203 ns         | 1.05x slower | Significant (t=-9.00)  |
| logging_simple          | 11.3 us          | 11.6 us        | 1.02x slower | Significant (t=-12.56) |
| mako                    | 16.5 ms          | 17.4 ms        | 1.05x slower | Significant (t=-17.34) |
| meteor_contest          | 116 ms           | 120 ms         | 1.04x slower | Significant (t=-25.59) |
| nbody                   | 158 ms           | 166 ms         | 1.05x slower | Significant (t=-12.73) |
| nqueens                 | 107 ms           | 111 ms         | 1.03x slower | Significant (t=-11.39) |
| pickle_pure_python      | 631 us           | 619 us         | 1.02x faster | Significant (t=6.28)   |
| regex_compile           | 206 ms           | 214 ms         | 1.04x slower | Significant (t=-24.24) |
| regex_v8                | 28.4 ms          | 26.7 ms        | 1.06x faster | Significant (t=10.92)  |
| richards                | 87.8 ms          | 90.3 ms        | 1.03x slower | Significant (t=-10.91) |
| scimark_lu              | 165 ms           | 162 ms         | 1.02x faster | Significant (t=4.55)   |
| scimark_sor             | 210 ms           | 215 ms         | 1.02x slower | Significant (t=-10.14) |
| scimark_sparse_mat_mult | 6.45 ms          | 6.64 ms        | 1.03x slower | Significant (t=-6.66)  |
| spectral_norm           | 158 ms           | 171 ms         | 1.08x slower | Significant (t=-29.11) |
| sympy_expand            | 599 ms           | 619 ms         | 1.03x slower | Significant (t=-21.93) |
| sympy_str               | 376 ms           | 389 ms         | 1.04x slower | Significant (t=-23.80) |
| sympy_sum               | 233 ms           | 239 ms         | 1.02x slower | Significant (t=-14.70) |
| telco                   | 7.40 ms          | 7.61 ms        | 1.03x slower | Significant (t=-10.08) |
| unpack_sequence         | 70.0 ns          | 56.1 ns        | 1.25x faster | Significant (t=10.62)  |
| xml_etree_generate      | 108 ms           | 106 ms         | 1.02x faster | Significant (t=5.52)   |
| xml_etree_iterparse     | 133 ms           | 130 ms         | 1.02x faster | Significant (t=11.33)  |
| xml_etree_parse         | 208 ms           | 204 ms         | 1.02x faster | Significant (t=9.19)   |

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Fri Oct 30 17:51:05 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 21:51:05 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604094665.6.0.376223006555.issue42208@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset eba5bf2f5672bf4861c626937597b85ac0c242b9 by Victor Stinner in branch 'master':
bpo-42208: Call GC collect earlier in PyInterpreterState_Clear() (GH-23044)
https://github.com/python/cpython/commit/eba5bf2f5672bf4861c626937597b85ac0c242b9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:06:15 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 22:06:15 +0000
Subject: [issue42214] Parser/pegen.c:68: _PyPegen_check_barry_as_flufl:
 Assertion `t->type == NOTEQUAL' failed
In-Reply-To: <1604095531.24.0.280205642021.issue42214@roundup.psfhosted.org>
Message-ID: <1604095575.06.0.652282660251.issue42214@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Barry: what did you do?

----------
nosy: +barry

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42214>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:05:31 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 22:05:31 +0000
Subject: [issue42214] Parser/pegen.c:68: _PyPegen_check_barry_as_flufl:
 Assertion `t->type == NOTEQUAL' failed
Message-ID: <1604095531.24.0.280205642021.issue42214@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

When Python is built in debug mode, it fails with an assertion error on the following code:
---
def func1():
    if a != b:
        raise ValueError

def func2():
    try
        return 1
    finally:
        pass
---

Try attached pgen_bug.py:

$ ./python pgen_bug.py 
python: Parser/pegen.c:68: _PyPegen_check_barry_as_flufl: Assertion `t->type == NOTEQUAL' failed.
Abandon (core dumped)

----------
components: Interpreter Core
files: pgen_bug.py
messages: 380002
nosy: gvanrossum, lys.nikolaou, pablogsal, vstinner
priority: normal
severity: normal
status: open
title: Parser/pegen.c:68: _PyPegen_check_barry_as_flufl: Assertion `t->type == NOTEQUAL' failed
versions: Python 3.10
Added file: https://bugs.python.org/file49555/pgen_bug.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42214>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:06:25 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 22:06:25 +0000
Subject: [issue42214] Parser/pegen.c:68: _PyPegen_check_barry_as_flufl:
 Assertion `t->type == NOTEQUAL' failed
In-Reply-To: <1604095531.24.0.280205642021.issue42214@roundup.psfhosted.org>
Message-ID: <1604095585.52.0.38974935528.issue42214@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42214>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:06:54 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 22:06:54 +0000
Subject: [issue42214] Parser/pegen.c:68: _PyPegen_check_barry_as_flufl:
 Assertion `t->type == NOTEQUAL' failed
In-Reply-To: <1604095531.24.0.280205642021.issue42214@roundup.psfhosted.org>
Message-ID: <1604095614.36.0.561024041407.issue42214@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

In release mode, there is no assertion error:

$ python3.10 pgen_bug.py 
  File "/home/vstinner/python/master/pgen_bug.py", line 6
    try
       ^
SyntaxError: invalid syntax

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42214>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:15:52 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 30 Oct 2020 22:15:52 +0000
Subject: [issue42214] Parser/pegen.c:68: _PyPegen_check_barry_as_flufl:
 Assertion `t->type == NOTEQUAL' failed
In-Reply-To: <1604095531.24.0.280205642021.issue42214@roundup.psfhosted.org>
Message-ID: <1604096152.51.0.0345888238859.issue42214@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +21966
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23048

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42214>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:16:06 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 30 Oct 2020 22:16:06 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604096166.73.0.17294704893.issue42208@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +21967
pull_request: https://github.com/python/cpython/pull/23047

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:17:04 2020
From: report at bugs.python.org (miss-islington)
Date: Fri, 30 Oct 2020 22:17:04 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604096224.19.0.695617281281.issue42208@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +21968
pull_request: https://github.com/python/cpython/pull/23049

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:16:26 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 22:16:26 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604096186.06.0.879355809315.issue42208@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 09c6120be8c70366495b027ae3daa213609de3ed by Miss Skeleton (bot) in branch '3.9':
 bpo-42208: GitHub Action: Add gdb to posix dependencies (GH-23043) (GH-23047)
https://github.com/python/cpython/commit/09c6120be8c70366495b027ae3daa213609de3ed


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:24:14 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 30 Oct 2020 22:24:14 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604096654.2.0.0789304714282.issue42173@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Dear Solaris Python fans (about 20 so far here): Here is the situation.  There are 1000s of open issues on this tracker and at least 100s of open cpython PRs, and only 20-30 core developers, mostly volunteers, actively (depending on definition) merging PRs and maybe another 10 triagers helping to manage issues.

You all can help on issues by checking whether reported bugs still exist with current Python (3.8+) on current 'Solaris' (which includes what?).  Searching open issues for 'Solaris' in 'All text' just returned 114 hits.  About half were last touched over two years ago, and sometimes the last touch was inconsequential (a version or nosy change).  I suspect many of the 114 are obsolete.  For example, the last comment, five years ago, on #1471934, says the problem was fixed in Solaris 11.2.  Does this mean the issue should be closed?

The bottleneck for merging PRs is reviewing PRs.  We coredevs cannot do enough reviews ourselves.  But any competent user can  help.  Reviewing has two components.  First, does the patch fix the problem?  Testing this requires a Github account and a local clone and ability to build a test binary.  See devguide.python.org for more.  Second, does the patch meet our standards of code quality.  Solaris-specific patches likely change the C part of cpython, so C competence and understanding of PEP 7 is needed here.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:26:02 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 30 Oct 2020 22:26:02 +0000
Subject: [issue42210] float.hex discards sign from -nan
In-Reply-To: <1604073869.82.0.718371202647.issue42210@roundup.psfhosted.org>
Message-ID: <1604096762.84.0.988224872115.issue42210@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Having fromhex() support signed NaNs was reasonable because it is a valid possible input; however, the case isn't as clear-cut for output. Since applications are allowed to ignore the sign bit, no application should rely on seeing a particular sign for a NaN.  

Also, existing applications may already have NaNs where the sign bit is set.  If we change the output, we could break their published examples and doctests.  So, this proposal may cause more harm than good.

----------
nosy: +mark.dickinson, rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42210>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:26:15 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 30 Oct 2020 22:26:15 +0000
Subject: [issue42210] float.hex discards sign from -nan
In-Reply-To: <1604073869.82.0.718371202647.issue42210@roundup.psfhosted.org>
Message-ID: <1604096775.56.0.724328722222.issue42210@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42210>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:30:47 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 22:30:47 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604097047.88.0.314314858788.issue42173@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Jakub: Would you mind to build the master branch of Python, run the test suite and post the tests results? In short:

git clone https://github.com/python/cpython.git
cd cpython
./configure
./python -m test -j0 -r

If possible, try to install dependencies (readline, lzma, etc.).

If there are failures, please copy them into a file, and attach the file to this issue.

It is to have an idea if it would be worth it to add a Python buildbot running on Solaris. If there are too many failures, it would be better to fix first most failures before considering to add a buildbot.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:40:20 2020
From: report at bugs.python.org (Steve Dower)
Date: Fri, 30 Oct 2020 22:40:20 +0000
Subject: [issue42196] Python Windows Installation Error 0x800705aa
In-Reply-To: <1603978740.79.0.0573376832754.issue42196@roundup.psfhosted.org>
Message-ID: <1604097620.14.0.684020513448.issue42196@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

That python.exe stub being there may be the reason it doesn't appear to do anything. If you aren't fully up to date on preview builds (which is likely), then running it with any arguments will silently exit.

If you run it just as "python.exe" then it will pop open the Microsoft Store to the Python installation there. However, if you're hitting "insufficient resource" errors already then this may also fail.

First I'd make sure you've installed all updates and rebooted your machine. If there's a problem at that point, it's likely to be the cause of other issues.

If it all seems fine, installing from the Microsoft Store might be an option that works for you. (Installing that will also replace the stubs you found, or you can just disable them through the UI you posted. Rest assured, they aren't impacting the installer downloaded from python.org.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42196>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:56:23 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 22:56:23 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604098583.44.0.273810847183.issue42208@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21969
pull_request: https://github.com/python/cpython/pull/23050

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 18:59:01 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 30 Oct 2020 22:59:01 +0000
Subject: [issue42162] The license page for Python 3.0.1 is messed up
In-Reply-To: <1603750620.18.0.975456176895.issue42162@roundup.psfhosted.org>
Message-ID: <1604098741.49.0.694283861234.issue42162@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The docs pages interpret x.y as x.y.latest.  So the 3.0 doc is for the 3.0.1 release, the last for 3.0.
https://docs.python.org/release/3.0.1/license.html
https://docs.python.org/release/3.0/license.html is fine.

What's messed up is the license history table at the top due to a merge conflict artifact that should have been deleted.  I am not sure whether there are also '\n's missing.  The actual 3.0(.0 now) page, 

All 3.x branches no longer getting security fixes have been 'locked' (I am not sure of the term.)  This just happened with 3.5, so 3.6.  Ditto for 2.x before 2.7.  (2.7 is not locked either because Benjamin has just done it yet or because he want to let people extract it.

Fixing this would require one of the python/cpython owners to temporarily unlock the branch.  I am closing this because I doubt any would think this important enough, but anyone is welcome to post on pydev list asking.

The real problem, which we would like to fix but cannot, is web searches returning obsolete links.

----------
nosy: +terry.reedy
resolution:  -> out of date
stage:  -> resolved
status: open -> closed
title: The license page for Python 3.0 is messed up -> The license page for Python 3.0.1 is messed up

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42162>
_______________________________________

From report at bugs.python.org  Fri Oct 30 19:07:36 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 30 Oct 2020 23:07:36 +0000
Subject: [issue42184] pdb exits unexpectedly when calling args
In-Reply-To: <1603908435.7.0.582462540621.issue42184@roundup.psfhosted.org>
Message-ID: <1604099256.79.0.426033419993.issue42184@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This is true in 3.10 as well. The same happens if __repr__ raises an exception. do_args command doesn't handle exceptions from repr.

See also issue37022.

----------
components: +Library (Lib)
nosy: +iritkatriel
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42184>
_______________________________________

From report at bugs.python.org  Fri Oct 30 19:13:35 2020
From: report at bugs.python.org (Steve Dower)
Date: Fri, 30 Oct 2020 23:13:35 +0000
Subject: [issue42192] Python Windows .exe Installer ignores /TargetDir if
 there is an existing installation
In-Reply-To: <1603962967.32.0.325420802039.issue42192@roundup.psfhosted.org>
Message-ID: <1604099615.12.0.834148509164.issue42192@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

So for a manually managed install, your best bet is to just copy the install directory somewhere else (and then maybe remove the original? Up to you). That will break the MSI tracking that lets us do reliable upgrades and repairs, but shouldn't break Python itself.

If you're planning to include it in another application, you may want to look at the embeddable distro, which is reduced in size/scope for this purpose (it generally also requires a regular install for build/pip installs).

Basic levels of fiddling can also be avoided by using virtual environments. Nothing much we can do will protect against really dedicated (or malicious) fiddling, but using the MSI installs we have means that a repair should quickly fix it up.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42192>
_______________________________________

From report at bugs.python.org  Fri Oct 30 19:24:34 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 30 Oct 2020 23:24:34 +0000
Subject: [issue10936] Simple CSS fix for left margin at docs.python.org
In-Reply-To: <1295377924.0.0.902429691003.issue10936@psf.upfronthosting.co.za>
Message-ID: <1604100274.35.0.195709992469.issue10936@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.7, Python 3.2, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue10936>
_______________________________________

From report at bugs.python.org  Fri Oct 30 19:30:21 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 30 Oct 2020 23:30:21 +0000
Subject: [issue1509060] Interrupt/kill threads w/exception
Message-ID: <1604100621.55.0.915890967085.issue1509060@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
stage: test needed -> needs patch
versions: +Python 3.10, Python 3.9 -Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1509060>
_______________________________________

From report at bugs.python.org  Fri Oct 30 19:35:37 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 30 Oct 2020 23:35:37 +0000
Subject: [issue42177] Improving KeyError exception
In-Reply-To: <1603831389.37.0.739931289382.issue42177@roundup.psfhosted.org>
Message-ID: <1604100937.95.0.201297081075.issue42177@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Printing an exception is defined as printing the exception message, which currently is e.args[0].  We will not change that as it would break code worldwide.  To print more, the class name can be used directly or as a key into a dict of replacements or replacement functions.

Questions and vague ideas should be directed to python-list.  Fleshed out ideas can go to python-ideas.

>>> {}['d']
Traceback (most recent call last):
  File "<pyshell#0>", line 1, in <module>
    {}['d']
KeyError: 'd'

>>> try:
	{}['d']
except Exception as e:
	print(e)
	
'd'

>>> try:
	{}['d']
except Exception as e:
	print(e.args)

('d',)

>>> try:
	{}['d']
except Exception as e:
	print(f'{e.__class__.__name__}: {e}')  # Reproduce standard report.

KeyError: 'd'

----------
nosy: +terry.reedy
resolution:  -> rejected
stage:  -> resolved
status: open -> closed
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42177>
_______________________________________

From report at bugs.python.org  Fri Oct 30 19:41:57 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 30 Oct 2020 23:41:57 +0000
Subject: [issue21078] multiprocessing.managers.BaseManager.__init__'s
 "serializer" argument is not documented
In-Reply-To: <1395938991.3.0.211293361393.issue21078@psf.upfronthosting.co.za>
Message-ID: <1604101317.61.0.408202180144.issue21078@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
components: +Library (Lib)
type:  -> behavior
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 2.7, Python 3.1, Python 3.2, Python 3.3, Python 3.4, Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21078>
_______________________________________

From report at bugs.python.org  Fri Oct 30 19:48:48 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 30 Oct 2020 23:48:48 +0000
Subject: [issue42214] Parser/pegen.c:68: _PyPegen_check_barry_as_flufl:
 Assertion `t->type == NOTEQUAL' failed
In-Reply-To: <1604095531.24.0.280205642021.issue42214@roundup.psfhosted.org>
Message-ID: <1604101728.59.0.507455337913.issue42214@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 06f8c3328dcd81c84d1ee2b3a57b5381dcb38482 by Pablo Galindo in branch 'master':
bpo-42214: Fix check for NOTEQUAL token in the PEG parser for the barry_as_flufl rule (GH-23048)
https://github.com/python/cpython/commit/06f8c3328dcd81c84d1ee2b3a57b5381dcb38482


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42214>
_______________________________________

From report at bugs.python.org  Fri Oct 30 19:49:27 2020
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 30 Oct 2020 23:49:27 +0000
Subject: [issue5996] abstract class instantiable when subclassing built-in
 types
In-Reply-To: <1242050763.07.0.145569961651.issue5996@psf.upfronthosting.co.za>
Message-ID: <1604101767.56.0.848651690782.issue5996@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.9 -Python 2.7, Python 3.1, Python 3.2, Python 3.3, Python 3.4, Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5996>
_______________________________________

From report at bugs.python.org  Fri Oct 30 19:52:56 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 30 Oct 2020 23:52:56 +0000
Subject: [issue42214] Parser/pegen.c:68: _PyPegen_check_barry_as_flufl:
 Assertion `t->type == NOTEQUAL' failed
In-Reply-To: <1604095531.24.0.280205642021.issue42214@roundup.psfhosted.org>
Message-ID: <1604101976.01.0.886211818479.issue42214@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +21970
pull_request: https://github.com/python/cpython/pull/23051

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42214>
_______________________________________

From report at bugs.python.org  Fri Oct 30 19:53:40 2020
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 30 Oct 2020 23:53:40 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604102020.52.0.768634920389.issue42208@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> This change renames collect() to gc_collect_main(). It broke test_gdb on buildbots, whereas test_gdb passed on Travis CI on my PR 23038. Also, test_gdb is skipped on the Ubuntu job of GitHub Action since gdb is not installed. I created https://github.com/python/core-workflow/issues/383 to add gdb to Ubuntu dependencies. My PR 23043 adds gdb dependency.

Fixed by:

commit 6e03c0ad156797cd6e9132e895d55dac0344d340 (upstream/master, master)
Author: Victor Stinner <vstinner at python.org>
Date:   Fri Oct 30 22:52:30 2020 +0100

    GitHub Action: Add gdb to posix dependencies (GH-23043)
    
    Sort also dependencies and remove duplicates (liblzma-dev).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 19:59:51 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 30 Oct 2020 23:59:51 +0000
Subject: [issue42186] unittest overrides more serious warnings filter added
 before unittest.main()
In-Reply-To: <1603917748.58.0.497118511027.issue42186@roundup.psfhosted.org>
Message-ID: <1604102391.93.0.561680241896.issue42186@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Nick and/or Victor: should this be closed in favor of #15626? or should the latter be closed as mostly fixed, with this being left open as a followup?

----------
nosy: +terry.reedy, vstinner
versions:  -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42186>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:02:16 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 00:02:16 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604102536.66.0.894081360838.issue42208@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 710e82630775774dceba5e8f24b1b10e6dfaf9b7 by Victor Stinner in branch 'master':
bpo-42208: Add _Py_GetLocaleEncoding() (GH-23050)
https://github.com/python/cpython/commit/710e82630775774dceba5e8f24b1b10e6dfaf9b7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:03:50 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 31 Oct 2020 00:03:50 +0000
Subject: [issue14845] list(<generator expression>) != [<list comprehension>]
In-Reply-To: <1337294857.69.0.824992743087.issue14845@psf.upfronthosting.co.za>
Message-ID: <1604102630.66.0.405739747956.issue14845@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> out of date
stage: needs patch -> resolved
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14845>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:06:14 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 31 Oct 2020 00:06:14 +0000
Subject: [issue41803] Robots.txt
In-Reply-To: <1600343411.93.0.266726612445.issue41803@roundup.psfhosted.org>
Message-ID: <1604102774.15.0.323525550589.issue41803@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> rejected
stage:  -> resolved
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41803>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:07:05 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 00:07:05 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604102825.92.0.545481826216.issue42208@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +21971
pull_request: https://github.com/python/cpython/pull/23052

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:11:40 2020
From: report at bugs.python.org (Rangel Reale)
Date: Sat, 31 Oct 2020 00:11:40 +0000
Subject: [issue42215] urlparse with a Windows path returns the drive name as
 the scheme
Message-ID: <1604103100.11.0.415033865754.issue42215@roundup.psfhosted.org>


New submission from Rangel Reale <rangelspam at gmail.com>:

Passing a Windows path to urllib.parse.urlparse, without file://, makes it detect the drive as the scheme even it having '\' after the ':', which makes it completelly wrong for a url.

Probably this function shouldn't be used with non-uri paths, but it shouldn't return a result that is so wrong as this. I think at least it should return the same input string if the url doesn't start with ://.


Python 3.8.3 (tags/v3.8.3:6f8c832, May 13 2020, 22:37:02) [MSC v.1924 64 bit (AMD64)] on win32
from urllib.parse import urlparse
urlparse('M:\\prog\\tests\\python\\json-ref-dict\\tests/schemas/master.yaml')
Out[3]: ParseResult(scheme='m', netloc='', path='\\prog\\tests\\python\\json-ref-dict\\tests/schemas/master.yaml', params='', query='', fragment='')
str(urlparse('M:\\prog\\tests\\python\\json-ref-dict\\tests/schemas/master.yaml'))
Out[4]: "ParseResult(scheme='m', netloc='', path='\\\\prog\\\\tests\\\\python\\\\json-ref-dict\\\\tests/schemas/master.yaml', params='', query='', fragment='')"
urlparse('M:\prog\tests\python\json-ref-dict\\tests/schemas/master.yaml')
Out[5]: ParseResult(scheme='m', netloc='', path='\\prog\tests\\python\\json-ref-dict\\tests/schemas/master.yaml', params='', query='', fragment='')

----------
components: Windows
messages: 380018
nosy: paul.moore, rangelspam, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: urlparse with a Windows path returns the drive name as the scheme
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42215>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:25:11 2020
From: report at bugs.python.org (Eric V. Smith)
Date: Sat, 31 Oct 2020 00:25:11 +0000
Subject: [issue42209] Incorrect line reported in syntax error
In-Reply-To: <1604071774.71.0.0589140009748.issue42209@roundup.psfhosted.org>
Message-ID: <1604103911.24.0.487298759249.issue42209@roundup.psfhosted.org>


Change by Eric V. Smith <eric at trueblade.com>:


----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42209>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:30:54 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 00:30:54 +0000
Subject: [issue26789] logging: Trying to log during Python finalization with
 NameError: name 'open' is not defined
In-Reply-To: <1460905927.74.0.222378341822.issue26789@psf.upfronthosting.co.za>
Message-ID: <1604104254.81.0.807666431308.issue26789@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +21972
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23053

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26789>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:32:14 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 00:32:14 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604104334.73.0.477286216883.issue42208@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset b62bdf71ea0cd52041d49691d8ae3dc645bd48e1 by Victor Stinner in branch 'master':
bpo-42208: Add _locale._get_locale_encoding() (GH-23052)
https://github.com/python/cpython/commit/b62bdf71ea0cd52041d49691d8ae3dc645bd48e1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:33:13 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 00:33:13 +0000
Subject: [issue42208] Using logging or warnings during Python finalization
 does crash Python
In-Reply-To: <1604069837.91.0.668538321247.issue42208@roundup.psfhosted.org>
Message-ID: <1604104393.31.0.393437079374.issue42208@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I fixed all issues which prevented to fix bpo-26789, I close thie issue.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42208>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:35:50 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 00:35:50 +0000
Subject: [issue26789] logging: Trying to log during Python finalization with
 NameError: name 'open' is not defined
In-Reply-To: <1460905927.74.0.222378341822.issue26789@psf.upfronthosting.co.za>
Message-ID: <1604104550.29.0.160190734795.issue26789@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Note: Attached error.py no longer works with a recent aiohttp version.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26789>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:36:15 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 31 Oct 2020 00:36:15 +0000
Subject: [issue42216] Optimize dict.popitem() & insert use case.
Message-ID: <1604104575.27.0.467151062817.issue42216@roundup.psfhosted.org>


New submission from Inada Naoki <songofacandy at gmail.com>:

PyDict_DelItem stores DUMMY entry in the hash table. Without DUMMY, collision chain will be broken so proving will be not working.

But `dict.popitem()` returns the last item in the insertion order. The item must be the last item of collision chain too.
So `dict.popitem()` can use EMPTY entry instead of DUMMY, and reduce dict resizing.

----------
components: Interpreter Core
messages: 380022
nosy: methane
priority: normal
severity: normal
status: open
title: Optimize dict.popitem() & insert use case.
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42216>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:37:01 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 31 Oct 2020 00:37:01 +0000
Subject: [issue42190] global declarations affect too much inside exec or
 compile
In-Reply-To: <1603948051.35.0.0996569389685.issue42190@roundup.psfhosted.org>
Message-ID: <1604104621.85.0.491018690771.issue42190@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

exec with different global and local dicts is most like executing code in a class definition, where locals is different from globals.  But mimicking your exec with an actual class statement does not produce the same result.

>>> gdict = {}
>>> class C:
	x = 1
	def f(): global x
	
>>> gdict
{}
>>> C.x
1

# To continue, I reproduced the behavior in 3.10.
>>> ldict = {}
>>> exec('''
x = 1
def f(): global x''', gdict, ldict)
>>> 'x' in gdict
True

# And that putting x in gdict required the global declaration.
>>> gdict = {}
>>> exec('''
x = 1
def f(): pass''', gdict, ldict)

>>> 'x' in gdict
False
>>> 'x' in ldict
True

This seems like a bug to me too.  The change is in the bytecode, not the subsequent execution thereof.

>>> dis.dis('x = 1')
  1           0 LOAD_CONST               0 (1)
              2 STORE_NAME               0 (x)
              ...

# Ditto if add '\ndef f(): pass', but here is the test case.
>>> dis.dis('x = 1\ndef f(): global x')
  1           0 LOAD_CONST               0 (1)
              2 STORE_GLOBAL             0 (x)
              ...

# Same result for 'global x; x = 1', but 'x = 1; global x' raises
SyntaxError: name 'x' is assigned to before global declaration


The change is inconsequential when locals is globals, but not when not.

----------
nosy: +gvanrossum, lys.nikolaou, pablogsal, terry.reedy
stage:  -> needs patch
versions: +Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42190>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:36:58 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 00:36:58 +0000
Subject: [issue26789] logging: Trying to log during Python finalization with
 NameError: name 'open' is not defined
In-Reply-To: <1460905927.74.0.222378341822.issue26789@psf.upfronthosting.co.za>
Message-ID: <1604104618.55.0.988218173893.issue26789@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Attached PR 23053 fix the root issue of the infamous "NameError: name 'open' is not defined" error in the logging module.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26789>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:40:51 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 31 Oct 2020 00:40:51 +0000
Subject: [issue42214] Parser/pegen.c:68: _PyPegen_check_barry_as_flufl:
 Assertion `t->type == NOTEQUAL' failed
In-Reply-To: <1604095531.24.0.280205642021.issue42214@roundup.psfhosted.org>
Message-ID: <1604104851.57.0.967338415783.issue42214@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42214>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:40:51 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 31 Oct 2020 00:40:51 +0000
Subject: [issue42214] Parser/pegen.c:68: _PyPegen_check_barry_as_flufl:
 Assertion `t->type == NOTEQUAL' failed
In-Reply-To: <1604095531.24.0.280205642021.issue42214@roundup.psfhosted.org>
Message-ID: <1604104851.41.0.641926612012.issue42214@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset ddcd57e3ea75ab0ad370bbaaa6b76338edbca395 by Pablo Galindo in branch '3.9':
[3.9] bpo-42214: Fix check for NOTEQUAL token in the PEG parser for the barry_as_flufl rule (GH-23048) (GH-23051)
https://github.com/python/cpython/commit/ddcd57e3ea75ab0ad370bbaaa6b76338edbca395


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42214>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:41:29 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 00:41:29 +0000
Subject: [issue26528] NameError for built in function open when re-raising
 stored exception from yielded function
In-Reply-To: <1457611797.69.0.202848672993.issue26528@psf.upfronthosting.co.za>
Message-ID: <1604104889.41.0.823269606574.issue26528@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Davide Rizzo:
> I've just stumbled on the same thing happening on some code that attempts to use logging on __del__.
> (...)
> File ".../logging/__init__.py", line 1121, in _open
> NameError: name 'open' is not defined

This is bpo-26789 which is unrelated to this issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26528>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:49:24 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 00:49:24 +0000
Subject: [issue42211] CRASH
In-Reply-To: <1604076971.85.0.802956431757.issue42211@roundup.psfhosted.org>
Message-ID: <1604105364.22.0.984795331246.issue42211@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

This is a strange copy of my bpo-42208 issue...

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Using logging or warnings during Python finalization does crash Python

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42211>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:50:47 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 31 Oct 2020 00:50:47 +0000
Subject: [issue42216] Optimize dict.popitem() & insert use case.
In-Reply-To: <1604104575.27.0.467151062817.issue42216@roundup.psfhosted.org>
Message-ID: <1604105447.01.0.91063756432.issue42216@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
keywords: +patch
pull_requests: +21973
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23054

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42216>
_______________________________________

From report at bugs.python.org  Fri Oct 30 20:54:12 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 31 Oct 2020 00:54:12 +0000
Subject: [issue42190] global declarations affect too much inside exec or
 compile
In-Reply-To: <1603948051.35.0.0996569389685.issue42190@roundup.psfhosted.org>
Message-ID: <1604105652.91.0.597051730179.issue42190@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Looks like a bug. Maybe someone can bisect and find when this started happening?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42190>
_______________________________________

From report at bugs.python.org  Fri Oct 30 21:01:46 2020
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 31 Oct 2020 01:01:46 +0000
Subject: [issue42190] global declarations affect too much inside exec or
 compile
In-Reply-To: <1603948051.35.0.0996569389685.issue42190@roundup.psfhosted.org>
Message-ID: <1604106106.83.0.833051392156.issue42190@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Maybe someone can bisect and find when this started happening?

As far as I understand, this has been the case since Python 2 at least:

$cat code.py
gdict = {}
ldict = {}
exec('''
x = 1
def f(): global x''', gdict, ldict)
print(('x' in gdict, 'x' in ldict))


gdict = {}
ldict = {}
exec('''
x = 1
def f(): pass''', gdict, ldict)
print(('x' in gdict, 'x' in ldict))


$ python2 code.py
(True, False)
(False, True)

$ python3.9 code.py
(True, False)
(False, True)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42190>
_______________________________________

From report at bugs.python.org  Fri Oct 30 21:03:35 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 01:03:35 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604106215.97.0.50369477316.issue42160@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The commit 8e409cebad42032bb7d0f2cadd8b1e36081d98af introduced a reference leak:
https://buildbot.python.org/all/#/builders/320/builds/71

$ make && ./python -m test test_tempfile -R 3:3
...
test_tempfile leaked [49, 49, 49] references, sum=147
test_tempfile leaked [28, 28, 28] memory blocks, sum=84
...

Single test reproducing the leak:

$ ./python -m test test_tempfile -R 3:3 -m test.test_tempfile.TestGetDefaultTempdir.test_no_files_left_behind
...
test_tempfile leaked [21, 21, 21] references, sum=63
test_tempfile leaked [12, 12, 12] memory blocks, sum=36
...

----------
nosy: +vstinner
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Fri Oct 30 21:11:33 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 31 Oct 2020 01:11:33 +0000
Subject: [issue42195] Inconsistent __args__ between typing.Callable and
 collections.abc.Callable
In-Reply-To: <1603974319.88.0.166786801787.issue42195@roundup.psfhosted.org>
Message-ID: <1604106693.05.0.114108700972.issue42195@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

@corona10 Do I hear that you'd like to work on this?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42195>
_______________________________________

From report at bugs.python.org  Fri Oct 30 21:16:55 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 31 Oct 2020 01:16:55 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604107015.04.0.991211004668.issue42160@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Oh, _RandomNameSequence is not true singleton. Instance is used in tests actually.
Using `os.register_at_fork` was but idea. Let's reject it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Fri Oct 30 21:17:28 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 31 Oct 2020 01:17:28 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604107048.08.0.788718509478.issue42160@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +21974
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/23055

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Fri Oct 30 21:26:46 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 31 Oct 2020 01:26:46 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1604107606.74.0.878329808258.issue41835@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

unpack_sequence is very sensitive benchmark. Speed is dramatically changed by code alignment. PGO+LTO will reduce the noise, but we see noise always.

I believe there is no significant performance change in macro benchmarks when optimizing this part.

Not significant in macro benchmarks doesn't mean we must reject the optimization, because pyperformance doesn't cover whole application in the world.
But it means that we must be conservative about the optimization.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Fri Oct 30 22:15:45 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 31 Oct 2020 02:15:45 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604110545.97.0.818045299446.issue42160@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 43ca084c88d1e46a44199f347c72e26db84903c9 by Inada Naoki in branch 'master':
Revert "bpo-42160: tempfile: Reduce overhead of pid check. (GH-22997)"
https://github.com/python/cpython/commit/43ca084c88d1e46a44199f347c72e26db84903c9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Fri Oct 30 22:16:55 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 31 Oct 2020 02:16:55 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604110615.27.0.574114592392.issue42160@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

@Deric-W Please create another PR to change from `choise` to `choises` if you want to optimize it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Fri Oct 30 22:45:10 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 31 Oct 2020 02:45:10 +0000
Subject: [issue42216] Optimize dict.popitem() & insert use case.
In-Reply-To: <1604104575.27.0.467151062817.issue42216@roundup.psfhosted.org>
Message-ID: <1604112310.5.0.199366439143.issue42216@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> But `dict.popitem()` returns the last item in the insertion order. The item must be the last item of collision chain too.

This assumption was wrong. Inserting new item may overwrite dummy entry. In this case, the last item in the middle of collision chain.

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42216>
_______________________________________

From report at bugs.python.org  Sat Oct 31 00:23:17 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 31 Oct 2020 04:23:17 +0000
Subject: [issue42201] Priority queue realization issue
In-Reply-To: <1604040034.11.0.135907036135.issue42201@roundup.psfhosted.org>
Message-ID: <1604118197.92.0.183672501828.issue42201@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

The previous example, PrioritizedItem, shows how to address the issue.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42201>
_______________________________________

From report at bugs.python.org  Sat Oct 31 00:38:07 2020
From: report at bugs.python.org (hai shi)
Date: Sat, 31 Oct 2020 04:38:07 +0000
Subject: [issue42100] Add _PyType_GetModuleByDef
In-Reply-To: <1603226105.52.0.971925860816.issue42100@roundup.psfhosted.org>
Message-ID: <1604119087.35.0.266815502332.issue42100@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42100>
_______________________________________

From report at bugs.python.org  Sat Oct 31 01:07:43 2020
From: report at bugs.python.org (Nick Coghlan)
Date: Sat, 31 Oct 2020 05:07:43 +0000
Subject: [issue15626] unittest.main negates -bb option and programmatic
 warning configuration
In-Reply-To: <1344730376.57.0.519562827761.issue15626@psf.upfronthosting.co.za>
Message-ID: <1604120863.65.0.949020826124.issue15626@roundup.psfhosted.org>


Change by Nick Coghlan <ncoghlan at gmail.com>:


----------
superseder:  -> unittest overrides more serious warnings filter added before unittest.main()

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15626>
_______________________________________

From report at bugs.python.org  Sat Oct 31 01:07:26 2020
From: report at bugs.python.org (Nick Coghlan)
Date: Sat, 31 Oct 2020 05:07:26 +0000
Subject: [issue15626] unittest.main negates -bb option and programmatic
 warning configuration
In-Reply-To: <1344730376.57.0.519562827761.issue15626@psf.upfronthosting.co.za>
Message-ID: <1604120846.15.0.239466482882.issue15626@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

Issue #42186 now covers the request to have a way to tell unittest to leave the warnings filter alone even if it's set programmatically rather than by modifying ``sys.warnoptions``.

(Changing version to 3.7 to indicate when the interaction with `-bb` was fixed, rather than the version it was reported against)

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed
versions: +Python 3.7 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15626>
_______________________________________

From report at bugs.python.org  Sat Oct 31 01:15:34 2020
From: report at bugs.python.org (Nick Coghlan)
Date: Sat, 31 Oct 2020 05:15:34 +0000
Subject: [issue42186] unittest overrides more serious warnings filter added
 before unittest.main()
In-Reply-To: <1603917748.58.0.497118511027.issue42186@roundup.psfhosted.org>
Message-ID: <1604121334.27.0.783798337536.issue42186@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

Closing the old one as partially fixed, and linking here as a superseder makes sense to me, so I went ahead and did that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42186>
_______________________________________

From report at bugs.python.org  Sat Oct 31 01:53:27 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 31 Oct 2020 05:53:27 +0000
Subject: [issue42195] Inconsistent __args__ between typing.Callable and
 collections.abc.Callable
In-Reply-To: <1603974319.88.0.166786801787.issue42195@roundup.psfhosted.org>
Message-ID: <1604123607.7.0.483838926481.issue42195@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

@gvanrossum

Sorry, Not this time. I just add myself to observe how to solve this issue.

Maybe Batuhan is the proper member to handle this issue.

Just question to this issue.
Since GenericAlias does not have a Py_TPFLAGS_BASETYPE flag, IMHO we have to add Py_TPFLAGS_BASETYPE to type declaration and this behavior does not occur any regression?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42195>
_______________________________________

From report at bugs.python.org  Sat Oct 31 02:02:45 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 31 Oct 2020 06:02:45 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604124165.96.0.224599431408.issue42198@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset bcbf758476c1148993ddf4b54d3f6169b973ee1c by kj in branch 'master':
bpo-42198: Document __new__ for types.GenericAlias (GH-23039)
https://github.com/python/cpython/commit/bcbf758476c1148993ddf4b54d3f6169b973ee1c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Sat Oct 31 02:07:51 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 31 Oct 2020 06:07:51 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1604124471.54.0.572196385204.issue40956@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:


New changeset 7d210271579ae31f43b32f73c2aff5bc4fe0d27f by Erlend Egeberg Aasland in branch 'master':
bpo-40956: Convert _sqlite3 module level functions to Argument Clinic (GH-22484)
https://github.com/python/cpython/commit/7d210271579ae31f43b32f73c2aff5bc4fe0d27f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Sat Oct 31 02:09:37 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 31 Oct 2020 06:09:37 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1604124577.08.0.25250811822.issue40956@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

@erlendaasland

Thank you erlendaasland for working on GH-22484.
This time was a good time to review my AC knowledge ;)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Sat Oct 31 02:39:05 2020
From: report at bugs.python.org (Vinay Sajip)
Date: Sat, 31 Oct 2020 06:39:05 +0000
Subject: [issue42203] Unexpected behaviour NameError: name 'open' is not
 defined
In-Reply-To: <1604043849.8.0.342211011492.issue42203@roundup.psfhosted.org>
Message-ID: <1604126345.58.0.627850388279.issue42203@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> Should this be closed and pushed back to fixing logging?

It's not particularly a logging issue, though it can surface in logging because that's a mechanism to notify users about stuff. After all, most parts of the stdlib would expect open() to always be available. ISTM it's more a case of shutdown behaviour and user expectations relating to that. Users should be able to avoid any logging by calling logging.shutdown(), which can be done during a controlled process shutdown in user code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42203>
_______________________________________

From report at bugs.python.org  Sat Oct 31 03:50:02 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 31 Oct 2020 07:50:02 +0000
Subject: [issue42217] compiler: merge co_code and co_lnotab
Message-ID: <1604130602.05.0.173247705477.issue42217@roundup.psfhosted.org>


New submission from Inada Naoki <songofacandy at gmail.com>:

co_consts are merged already, but I forget about code attributes other than co_consts.
Duplication ratio is vary by code style, but in case of logging, we can reduce 25% of them.

```
>>> data = open('Lib/logging/__pycache__/__init__.python-310.pyc', 'rb').read()
>>> import marshal
>>> x = []
>>> def walk(c):
...     x.append(c.co_code)
...     x.append(c.co_lnotab)
...     for cc in c.co_consts:
...         if hasattr(cc, 'co_code'):
...             walk(cc)
...
>>> code = marshal.loads(data[16:])
>>> walk(code)
>>> len(x)
336
>>> len(set(x))
249
>>> 249/336
0.7410714285714286
```

----------
components: Interpreter Core
messages: 380045
nosy: methane
priority: normal
severity: normal
status: open
title: compiler: merge co_code and co_lnotab
type: resource usage
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42217>
_______________________________________

From report at bugs.python.org  Sat Oct 31 03:58:03 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 31 Oct 2020 07:58:03 +0000
Subject: [issue42217] compiler: merge co_code and co_lnotab
In-Reply-To: <1604130602.05.0.173247705477.issue42217@roundup.psfhosted.org>
Message-ID: <1604131083.54.0.866742199326.issue42217@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
keywords: +patch
pull_requests: +21975
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23056

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42217>
_______________________________________

From report at bugs.python.org  Sat Oct 31 04:44:52 2020
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Sat, 31 Oct 2020 08:44:52 +0000
Subject: [issue42210] float.hex discards sign from -nan
In-Reply-To: <1604073869.82.0.718371202647.issue42210@roundup.psfhosted.org>
Message-ID: <1604133892.79.0.44222194024.issue42210@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

inf and -inf are really two different values (in the scope of the standard). Same as 5. and -5., or even 0. and -0. They behave differently in some exactly specified operations, and it is useful.

Are there any exactly specified operations whose specifications require the unequal treatment of nans with + and - signs? I don't think so, since it goes against the whole idea of nan as an unspecified number. (If you want to track its _history_, that's what payload is for.) My interpretation is that nan can have a sign bit only so unary minus and absolute value can be implemented quicker (without having to check whether the input is nan) -- not because it carries any useful semantics within the standard.

----------
nosy: +veky

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42210>
_______________________________________

From report at bugs.python.org  Sat Oct 31 05:45:37 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Sat, 31 Oct 2020 09:45:37 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1604137537.19.0.642075610762.issue40956@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +21976
pull_request: https://github.com/python/cpython/pull/23057

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Sat Oct 31 05:49:19 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Sat, 31 Oct 2020 09:49:19 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1604137759.32.0.0207159690542.issue40956@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

> Thank you erlendaasland for working on GH-22484.

? and thank you for taking the time to review this!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Sat Oct 31 06:08:32 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 31 Oct 2020 10:08:32 +0000
Subject: [issue42195] Inconsistent __args__ between typing.Callable and
 collections.abc.Callable
In-Reply-To: <1603974319.88.0.166786801787.issue42195@roundup.psfhosted.org>
Message-ID: <1604138912.9.0.496538921016.issue42195@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Would not be better to change typing.Callable?

Attributes __origin__, __args__ and __parameters__ are not documented in the typing module. They are also not mentioned in any PEP except PEP 585. So I don't know what is intention and correct value of these attributes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42195>
_______________________________________

From report at bugs.python.org  Sat Oct 31 06:16:11 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 31 Oct 2020 10:16:11 +0000
Subject: [issue42217] compiler: merge co_code and co_lnotab
In-Reply-To: <1604130602.05.0.173247705477.issue42217@roundup.psfhosted.org>
Message-ID: <1604139371.8.0.516499216776.issue42217@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Do you mean sharing values of co_code and co_lnotab between code objects of the same module?

How much memory does this save (in absolute and relative value)? Which functions have the same co_code?

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42217>
_______________________________________

From report at bugs.python.org  Sat Oct 31 06:23:57 2020
From: report at bugs.python.org (Mark Shannon)
Date: Sat, 31 Oct 2020 10:23:57 +0000
Subject: [issue42217] compiler: merge co_code and co_lnotab
In-Reply-To: <1604130602.05.0.173247705477.issue42217@roundup.psfhosted.org>
Message-ID: <1604139837.92.0.901083609067.issue42217@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

PEP 626 has just been accepted.
Could you please leave this until I have merged in the implementation of PEP 626 which uses a different line number table format

----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42217>
_______________________________________

From report at bugs.python.org  Sat Oct 31 06:29:17 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 31 Oct 2020 10:29:17 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1604140157.99.0.899407906279.issue41835@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Both changes add significant amount of code (100 and 85 lines correspondingly). Even if they speed up a particular case of dict constructor it is not common use case.

I think that it would be better to reject these changes. They make maintenance harder, the benefit seems insignificant, and there is always a danger that new code can slow down other code. The dict object is performance critical for python, so it is better to not touch its code without need.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Sat Oct 31 06:40:32 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 31 Oct 2020 10:40:32 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604140832.7.0.862959455447.issue42160@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

See also issue30030.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Sat Oct 31 07:16:42 2020
From: report at bugs.python.org (Zac Hatfield-Dodds)
Date: Sat, 31 Oct 2020 11:16:42 +0000
Subject: [issue42218] SystemError in compile builtin function
Message-ID: <1604143002.46.0.930999995617.issue42218@roundup.psfhosted.org>


New submission from Zac Hatfield-Dodds <zac.hatfield.dodds at gmail.com>:

In Python 3.9.0, running

    compile('A.\u018a\\ ', '<string>', 'single')

raises

    SystemError: <built-in function normalize> returned a result with an error set

This is obviously invalid syntax, but it would still be nice to raise SyntaxError for that and the SystemError may be symptomatic of a bug.  Unfortunately I have no insight to offer beyond this hand-minimised reproducer :-/

----------
components: Interpreter Core
messages: 380053
nosy: Zac Hatfield-Dodds
priority: normal
severity: normal
status: open
title: SystemError in compile builtin function
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42218>
_______________________________________

From report at bugs.python.org  Sat Oct 31 07:17:34 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Sat, 31 Oct 2020 11:17:34 +0000
Subject: [issue42218] SystemError in compile builtin function
In-Reply-To: <1604143002.46.0.930999995617.issue42218@roundup.psfhosted.org>
Message-ID: <1604143054.7.0.818204363471.issue42218@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42218>
_______________________________________

From report at bugs.python.org  Sat Oct 31 08:06:44 2020
From: report at bugs.python.org (Batuhan Taskaya)
Date: Sat, 31 Oct 2020 12:06:44 +0000
Subject: [issue42218] SystemError in compile builtin function
In-Reply-To: <1604143002.46.0.930999995617.issue42218@roundup.psfhosted.org>
Message-ID: <1604146004.85.0.969345082939.issue42218@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
keywords: +patch
pull_requests: +21977
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23058

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42218>
_______________________________________

From report at bugs.python.org  Sat Oct 31 08:11:03 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sat, 31 Oct 2020 12:11:03 +0000
Subject: [issue26377] Tkinter dialogs will not close if root window not packed.
In-Reply-To: <1455721620.42.0.0590186130956.issue26377@psf.upfronthosting.co.za>
Message-ID: <1604146263.13.0.246522713216.issue26377@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Is this problem still present?

I've used the following script to test:

import tkinter
from tkinter import messagebox

root = tkinter.Tk()
box = messagebox.showinfo("Title", "A Message")

# -- EOF ---

With this script I can close the message box without problems (by clicking on the OK button). Both when running from the command-line and when running from IDLE.

Python 3.9, installer from python.org.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26377>
_______________________________________

From report at bugs.python.org  Sat Oct 31 08:25:13 2020
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 31 Oct 2020 12:25:13 +0000
Subject: [issue42210] float.hex discards sign from -nan
In-Reply-To: <1604073869.82.0.718371202647.issue42210@roundup.psfhosted.org>
Message-ID: <1604147113.63.0.131580503795.issue42210@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

This isn't a bug: it was a deliberate decision, just like the choice to represent `-nan` as `nan` in `float.__repr__` was a deliberate decision. NaNs don't have a meaningful sign - they have a sign *bit*, but it's best to regard that as just an extra bit of metadata (like the payload bits).

IEEE 754 explicitly refuses to interpret the sign bit of a NaN: section 1.4 of the 2019 version of the standard says: "This standard does not specify [...] Interpretation of the sign and significand fields of NaNs."

As Vedran points out, infinities are a very different beast: the difference between negative infinity and positive infinity matters.

[Raymond]

> no application should rely on seeing a particular sign for a NaN

Yep, exactly.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42210>
_______________________________________

From report at bugs.python.org  Sat Oct 31 08:32:07 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sat, 31 Oct 2020 12:32:07 +0000
Subject: [issue29566] binhex() creates files with mixed line endings
In-Reply-To: <1487161265.61.0.450348509296.issue29566@psf.upfronthosting.co.za>
Message-ID: <1604147527.45.0.712308430412.issue29566@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
keywords: +patch
pull_requests: +21978
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23059

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29566>
_______________________________________

From report at bugs.python.org  Sat Oct 31 08:34:04 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sat, 31 Oct 2020 12:34:04 +0000
Subject: [issue29566] binhex() creates files with mixed line endings
In-Reply-To: <1487161265.61.0.450348509296.issue29566@psf.upfronthosting.co.za>
Message-ID: <1604147644.25.0.834264757195.issue29566@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I've added a PR that changes the line ending to "\r" in encoded data.

Not very useful now that binhex is deprecated, but this allows us to close this issue.

----------
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29566>
_______________________________________

From report at bugs.python.org  Sat Oct 31 08:38:23 2020
From: report at bugs.python.org (Sebastian Wiedenroth)
Date: Sat, 31 Oct 2020 12:38:23 +0000
Subject: [issue16902] Add OSS module support for Solaris
In-Reply-To: <1357720040.2.0.175199652567.issue16902@psf.upfronthosting.co.za>
Message-ID: <1604147903.59.0.448648063034.issue16902@roundup.psfhosted.org>


Sebastian Wiedenroth <wiedi at frubar.net> added the comment:

This patch has also been applied to the python versions shipped by OpenIndiana and OmniOS for a long time. I'd say it's safe to merge.

----------
nosy: +wiedi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16902>
_______________________________________

From report at bugs.python.org  Sat Oct 31 08:44:15 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sat, 31 Oct 2020 12:44:15 +0000
Subject: [issue32937] Multiprocessing worker functions not terminating with a
 large number of processes and a manager
In-Reply-To: <1519481823.24.0.467229070634.issue32937@psf.upfronthosting.co.za>
Message-ID: <1604148255.32.0.752516127386.issue32937@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

This issue can probably be closed as out of date:

Using: Python3.9, installer from python.org. On my laptop os.cpu_count() == 8.

"python -c 'import repro; repro.main()' works for me (it runs a while and exists when all workers have exited). The repro module contains the code below, this is the code from the original message with some changes because of changes to the multiprocessing launcher strategy on macOS.

# repro.py
import multiprocessing
from multiprocessing import Pool, Manager
import time
import random

def worker_function( index, messages ):

    print( "%d: Entered" % index )
    time.sleep( random.randint( 3, 15 ) )
    messages.put( "From: %d" % index )
    print( "%d: Exited" % index )


def main():
    manager = Manager()
    messages = manager.Queue()
    with Pool( processes = None ) as pool:

        for x in range( 30 ):
            pool.apply_async( worker_function, [ x, messages ] )

        pool.close()
        pool.join()
# EOF

----------
nosy: +ronaldoussoren
resolution:  -> out of date
stage:  -> resolved
status: open -> pending
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32937>
_______________________________________

From report at bugs.python.org  Sat Oct 31 08:50:23 2020
From: report at bugs.python.org (Ken Jin)
Date: Sat, 31 Oct 2020 12:50:23 +0000
Subject: [issue42195] Inconsistent __args__ between typing.Callable and
 collections.abc.Callable
In-Reply-To: <1603974319.88.0.166786801787.issue42195@roundup.psfhosted.org>
Message-ID: <1604148623.57.0.834826829463.issue42195@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
keywords: +patch
nosy: +kj
nosy_count: 6.0 -> 7.0
pull_requests: +21979
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23060

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42195>
_______________________________________

From report at bugs.python.org  Sat Oct 31 08:50:52 2020
From: report at bugs.python.org (Ken Jin)
Date: Sat, 31 Oct 2020 12:50:52 +0000
Subject: [issue42195] Inconsistent __args__ between typing.Callable and
 collections.abc.Callable
In-Reply-To: <1603974319.88.0.166786801787.issue42195@roundup.psfhosted.org>
Message-ID: <1604148652.68.0.583625294902.issue42195@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

Hi, I submitted a PR for a proof-of-concept on how the code which subclasses GenericAlias might look like for everyone's consideration.  

Personally, I'd lean more towards what Serhiy said and change typing.Callable rather than GenericAlias which affects many other classes' __class_getitem__. However, considering that typing.Callable has been around for years, I'm hesitant to change its __args__ which might break programs which rely on it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42195>
_______________________________________

From report at bugs.python.org  Sat Oct 31 09:01:10 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 31 Oct 2020 13:01:10 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1604149270.74.0.642152242488.issue41835@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> Both changes add significant amount of code (100 and 85 lines correspondingly). Even if they speed up a particular case of dict constructor it is not common use case.

You are right, but please wait.

Marco is new contributor and he can write correct C code for now.
So I am searching some parts which can be optimized by his code before rejecting it.

* bpo-42126, GH-22911: I can make dict display (aka. dict literal) 50% faster. But it introduce additional complexity to compiler and ceval. So I will reject it unless I find real world code using dict display in performance critical part.

* _PyStack_AsDict (https://github.com/methane/cpython/pull/25): I thought this is performance critical function. But I could not see significant performance gain in pyperformance.

* _PyEval_EvalCode (https://github.com/python/cpython/blob/master/Python/ceval.c#L4465): I am still not sure we can assume there are no duplicated keyword argument here. If we can assume it, we can optimize calling function receiving **kwds argument.

These three parts are all I found. I will reject this issue after I failed to optimize _PyEval_EvalCode.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Sat Oct 31 09:05:08 2020
From: report at bugs.python.org (Ken Jin)
Date: Sat, 31 Oct 2020 13:05:08 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604149508.94.0.0426989204663.issue42198@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
pull_requests: +21980
pull_request: https://github.com/python/cpython/pull/23061

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Sat Oct 31 09:08:27 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 31 Oct 2020 13:08:27 +0000
Subject: [issue42217] compiler: merge co_code and co_lnotab
In-Reply-To: <1604130602.05.0.173247705477.issue42217@roundup.psfhosted.org>
Message-ID: <1604149707.31.0.664792430057.issue42217@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

@Serhiy 

> Do you mean sharing values of co_code and co_lnotab between code objects of the same module?

Yes.

> How much memory does this save (in absolute and relative value)?

Maybe 1~3%, but I am not sure. I am more interested in reducing number of objects, because it will reduce import time.
Additionally, co_code is used while executing code. Unlike other cold data (e.g. docstring, annotations), sharing co_code will improve CPU cache utilization.

> Which functions have the same co_code?

For example,

```
# logging/__init__.py

    @property
    def manager(self):
        return self.logger.manager
...
    @property
    def name(self):
        return self.logger.name
```

Such simple functions are very common in OO-style code.

@Mark Shannon

Sure.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42217>
_______________________________________

From report at bugs.python.org  Sat Oct 31 09:16:11 2020
From: report at bugs.python.org (Eric Wolf)
Date: Sat, 31 Oct 2020 13:16:11 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604150171.61.0.054288705952.issue42160@roundup.psfhosted.org>


Eric Wolf <robo-eric at gmx.de> added the comment:

It would be possible to allow the GC to finalize the Random instances through weak references.
On the other hand, if many _RandomNameSequence instances were used temporarily, a lot of callbacks would be registered via os.register_at_fork(), could that cause problems?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Sat Oct 31 09:34:17 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 31 Oct 2020 13:34:17 +0000
Subject: [issue42218] SystemError in compile builtin function
In-Reply-To: <1604143002.46.0.930999995617.issue42218@roundup.psfhosted.org>
Message-ID: <1604151257.4.0.851626486847.issue42218@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Nice catch Zac!

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42218>
_______________________________________

From report at bugs.python.org  Sat Oct 31 09:50:11 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 31 Oct 2020 13:50:11 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604152211.05.0.428882565872.issue42160@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Instead of os.getpid() we can use a global variable, and the single callback can reset it.

But is it worth? Is os.getpid() so slow?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Sat Oct 31 10:02:26 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sat, 31 Oct 2020 14:02:26 +0000
Subject: [issue41552] uuid.uuid1() on certain Macs does not generate unique IDs
In-Reply-To: <1597398238.17.0.874687707711.issue41552@roundup.psfhosted.org>
Message-ID: <1604152946.6.0.156481510026.issue41552@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I've verified that python 3.8 and 3.9 use the system uuid functions (part of libsystem). This means this issue might not be fixable without dropping the use of the _uuid extension.

@terrygreeniaus: Can you still reproduce this issue?  If so, does "import _uuid" work on your system?


I do have a system with an iBridge interface, but that interface is below the active network interface and is never used.   That system is headless, I cannot easily try to reproduce the issue by messing with its network interfaces.

I wonder how useful it is to try to fix this issue, I'd personally prefer to use uuid4() because that doesn't leak information about the host.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41552>
_______________________________________

From report at bugs.python.org  Sat Oct 31 10:04:52 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 31 Oct 2020 14:04:52 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1604153092.68.0.719444098074.issue41835@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Do not overestimate the importance of _PyStack_AsDict(). Most of calls (~90-95% or like) are with positional only arguments, and most of functions do not have var-keyword parameter. So efforts in last years were spent on optimizing common cases, in particularly avoiding creation of a dict without need. _PyStack_AsDict() can affect perhaps 1% of code, or less, and these functions are usually not performance critical.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Sat Oct 31 10:15:00 2020
From: report at bugs.python.org (Eric Wolf)
Date: Sat, 31 Oct 2020 14:15:00 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604153700.23.0.452655908005.issue42160@roundup.psfhosted.org>


Eric Wolf <robo-eric at gmx.de> added the comment:

>>> timeit(os.getpid)
0.08990733299999931

Considering the reference leaks, os.getpid() seems to be the better solution.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Sat Oct 31 10:30:26 2020
From: report at bugs.python.org (Ronald Oussoren)
Date: Sat, 31 Oct 2020 14:30:26 +0000
Subject: [issue41552] uuid.uuid1() on certain Macs does not generate unique IDs
In-Reply-To: <1597398238.17.0.874687707711.issue41552@roundup.psfhosted.org>
Message-ID: <1604154626.29.0.498582555448.issue41552@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

An option is to use the host UUID instead of libuuid (as used by the _uuid extension). This has two problems though: (1) the RFC prescribes that the node id is a IEEE 802 MAC address, and (2) the host UUID is a full UUID and would have to be post processed.   Because of this I don't think this is a usable alternative.

The relevant API is gethostuuid().

Related stackoverflow: https://stackoverflow.com/questions/933460/unique-hardware-id-in-mac-os-x

Related elastic issue (where I found gethostuuid): https://github.com/elastic/beats/issues/14439

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41552>
_______________________________________

From report at bugs.python.org  Sat Oct 31 10:46:39 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 31 Oct 2020 14:46:39 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604155599.47.0.215578384139.issue42160@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I have tested my idea, such optimization speeds up _RandomNameSequence by 16%. At the cost of more complex code. It is not worth.

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Sat Oct 31 10:46:55 2020
From: report at bugs.python.org (Akshay.Gupta)
Date: Sat, 31 Oct 2020 14:46:55 +0000
Subject: [issue42219] Typo in comment of listobject.h
Message-ID: <1604155615.24.0.944991659801.issue42219@roundup.psfhosted.org>


New submission from Akshay.Gupta <akshay.j398p at gmail.com>:

There is a typo in comment of _PyList_Cast(op) macro.
It should say 'PyListObject*' instead of 'PyTupleObject*'.

----------
assignee: docs at python
components: Documentation
messages: 380070
nosy: akshayj398p, docs at python
priority: normal
severity: normal
status: open
title: Typo in comment of listobject.h
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42219>
_______________________________________

From report at bugs.python.org  Sat Oct 31 11:02:25 2020
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 31 Oct 2020 15:02:25 +0000
Subject: [issue37483] Add PyObject_CallOneArg()
In-Reply-To: <1562069683.82.0.624448792444.issue37483@roundup.psfhosted.org>
Message-ID: <1604156545.13.0.0840118848106.issue37483@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10
nosy_count: 4.0 -> 5.0
pull_requests: +21981
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/23062

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37483>
_______________________________________

From report at bugs.python.org  Sat Oct 31 11:04:46 2020
From: report at bugs.python.org (Akshay.Gupta)
Date: Sat, 31 Oct 2020 15:04:46 +0000
Subject: [issue42219] Typo in comment of listobject.h
In-Reply-To: <1604155615.24.0.944991659801.issue42219@roundup.psfhosted.org>
Message-ID: <1604156686.85.0.158868770715.issue42219@roundup.psfhosted.org>


Akshay.Gupta <akshay.j398p at gmail.com> added the comment:

My bad was not on the latest master. 
Fix already merged in 22588

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42219>
_______________________________________

From report at bugs.python.org  Sat Oct 31 11:05:39 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 31 Oct 2020 15:05:39 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604156739.76.0.693216363754.issue42198@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset dbaa07db671c4e5842629c8be912f2b0370be794 by kj in branch '3.9':
[3.9] bpo-42198: Document __new__ for types.GenericAlias (GH-23039) (GH-23061)
https://github.com/python/cpython/commit/dbaa07db671c4e5842629c8be912f2b0370be794


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Sat Oct 31 11:08:20 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 31 Oct 2020 15:08:20 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604156900.4.0.371100270378.issue42198@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset d21cb2d5ee56b8975d92e2ee094aba81f0801be5 by kj in branch 'master':
bpo-42198: Improve consistency of Union docs (GH-23029)
https://github.com/python/cpython/commit/d21cb2d5ee56b8975d92e2ee094aba81f0801be5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Sat Oct 31 11:09:28 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 31 Oct 2020 15:09:28 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604156968.76.0.234457724285.issue42198@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Thanks for all your efforts, KJ! Can this issue be closed?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Sat Oct 31 11:16:34 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 31 Oct 2020 15:16:34 +0000
Subject: [issue33300] Bad usage example in id() DocString
In-Reply-To: <1523995335.26.0.682650639539.issue33300@psf.upfronthosting.co.za>
Message-ID: <1604157394.18.0.112346179828.issue33300@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
stage:  -> resolved
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33300>
_______________________________________

From report at bugs.python.org  Sat Oct 31 11:23:09 2020
From: report at bugs.python.org (Ken Jin)
Date: Sat, 31 Oct 2020 15:23:09 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604157789.29.0.570776399728.issue42198@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

Guido, I have one last one -- "2. Park GenericAlias and Union under a new section 'Type Annotation Types' in stdtypes for 3.10". After which I'll close this issue. 

Thanks for reviewing my PRs so quickly!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Sat Oct 31 12:02:56 2020
From: report at bugs.python.org (Andrew)
Date: Sat, 31 Oct 2020 16:02:56 +0000
Subject: [issue42220] Argparse: wildcards processing
Message-ID: <1604160176.59.0.918392301984.issue42220@roundup.psfhosted.org>


New submission from Andrew <andrew-aralov at yandex.ru>:

It's known that Linux and Windows shells process wildcards like '*' and '?' differently. Linux shell usually expands wildcards so the application gets list of files. In contrast, Windows passes the wildcards to application. So in cross-platform applications we have to expand wildcards manually only for windows. It may not be beautiful since it's usually not part of program's logic and seems kinda of arguments processing.
Could this problem be solved via adding optional functionality to argparse library? For instance some option 'expand_wildcards' in ArgumentParser constructor with default value False (in order to not break compatibility)?

----------
components: Library (Lib)
messages: 380076
nosy: Andrew
priority: normal
severity: normal
status: open
title: Argparse: wildcards processing
type: enhancement
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42220>
_______________________________________

From report at bugs.python.org  Sat Oct 31 12:16:40 2020
From: report at bugs.python.org (Daniel Alley)
Date: Sat, 31 Oct 2020 16:16:40 +0000
Subject: [issue42221] Potential memory leak in resize_compact() (for unicode
 objects)
Message-ID: <1604161000.37.0.700108867907.issue42221@roundup.psfhosted.org>


New submission from Daniel Alley <dalley at redhat.com>:

Disclaimer: I'm not familiar with the interpreter internals, nor am I really a C dev, so I could be misinterpreting these results due to inexperience.

I've been attempting to debug a memory leak which I thought was caused by a C API extension that we are using.  When running the unit tests for this library under valgrind, I get a couple of results like the following, where the bottom of the call stack is a realloc() triggered by _PyUnicodeWriter_Finish()

==5732== 76 bytes in 1 blocks are definitely lost in loss record 4,571 of 9,822
==5732==    at 0x4C2C291: realloc (vg_replace_malloc.c:836)
==5732==    by 0x4F52323: _PyUnicodeWriter_Finish (in /usr/lib64/libpython3.6m.so.1.0)
==5732==    by 0x4F5A087: PyUnicode_FromFormatV (in /usr/lib64/libpython3.6m.so.1.0)
==5732==    by 0x4F937BC: PyErr_FormatV (in /usr/lib64/libpython3.6m.so.1.0)
==5732==    by 0x4F93433: PyErr_Format (in /usr/lib64/libpython3.6m.so.1.0)
==5732==    by 0x4F836B9: _PyEval_EvalFrameDefault (in /usr/lib64/libpython3.6m.so.1.0)
==5732==    by 0x4F87C9E: PyEval_EvalCodeEx (in /usr/lib64/libpython3.6m.so.1.0)
==5732==    by 0x4EF6DE2: ??? (in /usr/lib64/libpython3.6m.so.1.0)
==5732==    by 0x4EDEF62: PyObject_Call (in /usr/lib64/libpython3.6m.so.1.0)
==5732==    by 0xF9785EF: c_warningcb (in /usr/local/lib/pulp/lib/python3.6/site-packages/createrepo_c/_createrepo_c.so)
==5732==    by 0xF98F897: cr_xml_parser_warning (in /usr/local/lib/pulp/lib/python3.6/site-packages/createrepo_c/_createrepo_c.so)
==5732==    by 0xF98B59E: cr_start_handler (in /usr/local/lib/pulp/lib/python3.6/site-packages/createrepo_c/_createrepo_c.so)

There is no explicit call to realloc() in that function, but there is a call to resize_compact(), which in turn calls PyObject_Realloc(). I assume all those are getting inlined which is why it looks like there's nothing in-beteween -- if not, then maybe the leak is actually somewhere else.

The following is speculation given that I have limited understanding of interpreter workings.

In the version of Python I am using (3.6), resize_compact() has some code that looks suspicious to me: [0]

Two things jump out: 

1) "_Py_ForgetReference(unicode)", which according to this mailing list email [1] is used "to avoid having the deallocator run as result of the
DECREF".  The definition and usage of "_Py_ForgetReference(unicode)" in newer versions of Python is hidden behind "#ifdef Py_TRACE_REFS" flags [2], but it was not being done previously, which raises the question if perhaps it was being used improperly in previous versions. Forgetting about an object without deallocating it would certainly cause a leak.

2) When comparing [0] to a nearly identical piece of code meant for resizing bytestrings [3], I notice that in the branch handling the out of memory case, the bytestring version calls "PyObject_Del()" whereas the unicode version calls "_Py_NewReference()".

Can someone with more knowledge take a look at this?  And if neither of these are "the problem" then perhaps help me investigate what might be causing this Valgrind output?


[0] https://github.com/python/cpython/blob/3.6/Objects/unicodeobject.c#L943-L952

[1] https://www.mail-archive.com/python-dev at python.org/msg108525.html

[2] https://github.com/python/cpython/pull/18332/files#diff-34c966e7876d6f8bf801dd51896327e4f68bba02cddb95fbf3963f0b2e39c38aR1043-R1045

[3] https://github.com/python/cpython/blob/3.6/Objects/bytesobject.c#L3006-L3015

----------
components: Interpreter Core
messages: 380077
nosy: dralley
priority: normal
severity: normal
status: open
title: Potential memory leak in resize_compact() (for unicode objects)
type: resource usage
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42221>
_______________________________________

From report at bugs.python.org  Sat Oct 31 12:25:14 2020
From: report at bugs.python.org (Ken Jin)
Date: Sat, 31 Oct 2020 16:25:14 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604161514.65.0.179707303224.issue42198@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
pull_requests: +21982
pull_request: https://github.com/python/cpython/pull/23063

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Sat Oct 31 12:34:42 2020
From: report at bugs.python.org (Marco Sulla)
Date: Sat, 31 Oct 2020 16:34:42 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1604162082.0.0.462696486235.issue41835@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

Well, actually Serhiy is right, it does not seem that the macro benchs did show something significant. Maybe the code can be used in other parts of CPython, for example in _pickle, where dicts are loaded. But it needs also to expose, maybe internally only, dictresize() and DICT_NEXT_VERSION(). Not sure it's something desirable.

There's something that I do not understand: the speedup to unpack_sequence. I checked the pyperformance code, and it's a microbench for:

a, b = some_sequence

It should *not* be affected by the change. Anyway, I run the bench other 10 times, and the lowest value with the CPython code without the PR is not lower than 67.7 ns. With the PR, it reaches 53.5 ns. And I do not understand why. Maybe it affects the creation of the dicts with the local and global vars?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Sat Oct 31 12:59:23 2020
From: report at bugs.python.org (Ken Jin)
Date: Sat, 31 Oct 2020 16:59:23 +0000
Subject: [issue40814] Update typing module documentation based on PEP 585
In-Reply-To: <1590755313.42.0.558710518983.issue40814@roundup.psfhosted.org>
Message-ID: <1604163563.57.0.922556714024.issue40814@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

IMO, this can now be closed.

Most code examples in typing were changed to builtin generics:
https://github.com/python/cpython/commit/d9ab95ff1fe81efdf70e545d536d9f6927d1ba81
https://github.com/python/cpython/commit/7f54e563dc150cd670ca8df678437455c3a7f2cd

Docs for PEP 585's GenericAlias was added:
https://github.com/python/cpython/commit/4173320920706b49a004bdddd8d7108e8984e3fc

Dict, List, and friends were also all marked as deprecated in 3.9.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40814>
_______________________________________

From report at bugs.python.org  Sat Oct 31 13:02:52 2020
From: report at bugs.python.org (Apostolos Syropoulos)
Date: Sat, 31 Oct 2020 17:02:52 +0000
Subject: [issue42173] Drop Solaris support
In-Reply-To: <1603814348.33.0.839225742612.issue42173@roundup.psfhosted.org>
Message-ID: <1604163772.11.0.144863711416.issue42173@roundup.psfhosted.org>


Apostolos Syropoulos <ijdt.editor at gmail.com> added the comment:

I think this is really a bad idea. I am using OpenIndiana in my classrooms and I teach Python! So if your drop Solaris support, it means I have to install a new supported OS on my many systems, to learn and teach many things, etc, This will make my life extremely difficult.

----------
nosy: +ijdt.editor

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42173>
_______________________________________

From report at bugs.python.org  Sat Oct 31 13:15:03 2020
From: report at bugs.python.org (Martin Gfeller)
Date: Sat, 31 Oct 2020 17:15:03 +0000
Subject: [issue42192] Python Windows .exe Installer ignores /TargetDir if
 there is an existing installation
In-Reply-To: <1603962967.32.0.325420802039.issue42192@roundup.psfhosted.org>
Message-ID: <1604164503.34.0.98798175535.issue42192@roundup.psfhosted.org>


Martin Gfeller <martin.gfeller at swisscom.com> added the comment:

Thanks again Steve. 

I will copy the installation. I require a lot of pip packaged, so the embeddable distro doesn't look right for my case. 

I still think the /targetdir should issue some kind of warning if used with an existing installation, but this is obviously lowest prio.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42192>
_______________________________________

From report at bugs.python.org  Sat Oct 31 13:27:12 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 31 Oct 2020 17:27:12 +0000
Subject: [issue42222] Modernize integer test/conversion in randrange()
Message-ID: <1604165232.15.0.0916383458838.issue42222@roundup.psfhosted.org>


New submission from Raymond Hettinger <raymond.hettinger at gmail.com>:

Move the int(x)==x test and conversion into the C code for operator.index().

----------
components: Library (Lib)
messages: 380082
nosy: rhettinger, serhiy.storchaka, tim.peters
priority: normal
severity: normal
status: open
title: Modernize integer test/conversion in randrange()
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42222>
_______________________________________

From report at bugs.python.org  Sat Oct 31 13:27:39 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 31 Oct 2020 17:27:39 +0000
Subject: [issue42222] Modernize integer test/conversion in randrange()
In-Reply-To: <1604165232.15.0.0916383458838.issue42222@roundup.psfhosted.org>
Message-ID: <1604165259.15.0.220909534159.issue42222@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
keywords: +patch
pull_requests: +21983
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23064

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42222>
_______________________________________

From report at bugs.python.org  Sat Oct 31 13:34:52 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 31 Oct 2020 17:34:52 +0000
Subject: [issue42222] Modernize integer test/conversion in randrange()
In-Reply-To: <1604165232.15.0.0916383458838.issue42222@roundup.psfhosted.org>
Message-ID: <1604165692.85.0.996666993654.issue42222@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

And, if we were willing to correct the exception type from ValueError to TypeError, the code could be made simpler, faster, and more in line with user expectations.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42222>
_______________________________________

From report at bugs.python.org  Sat Oct 31 13:37:43 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 31 Oct 2020 17:37:43 +0000
Subject: [issue40814] Update typing module documentation based on PEP 585
In-Reply-To: <1590755313.42.0.558710518983.issue40814@roundup.psfhosted.org>
Message-ID: <1604165863.37.0.531854156979.issue40814@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40814>
_______________________________________

From report at bugs.python.org  Sat Oct 31 13:40:49 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Sat, 31 Oct 2020 17:40:49 +0000
Subject: [issue42218] SystemError in compile builtin function
In-Reply-To: <1604143002.46.0.930999995617.issue42218@roundup.psfhosted.org>
Message-ID: <1604166049.0.0.136829613221.issue42218@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
nosy: +lys.nikolaou
nosy_count: 3.0 -> 4.0
pull_requests: +21984
pull_request: https://github.com/python/cpython/pull/23065

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42218>
_______________________________________

From report at bugs.python.org  Sat Oct 31 13:54:30 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 31 Oct 2020 17:54:30 +0000
Subject: [issue42222] Modernize integer test/conversion in randrange()
In-Reply-To: <1604165232.15.0.0916383458838.issue42222@roundup.psfhosted.org>
Message-ID: <1604166870.37.0.200214099446.issue42222@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I had forgotten. It looks like float arguments were allowed:

    >>> randrange(10.0, 20.0, 2.0)
    16

Is this worth going through a deprecation cycle to get the code cleaned-up or should we live with it as is?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42222>
_______________________________________

From report at bugs.python.org  Sat Oct 31 14:09:28 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 31 Oct 2020 18:09:28 +0000
Subject: [issue42222] Modernize integer test/conversion in randrange()
In-Reply-To: <1604165232.15.0.0916383458838.issue42222@roundup.psfhosted.org>
Message-ID: <1604167768.58.0.424830153071.issue42222@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It changes the behavior. Currently randrange(10.0) works, but with PR 23064 it would fail.

See issue40046 with a ready PR for increasing coverage for the random module. If it would accepted, some tests would fail with PR 23064.

If you want to deprecate accepting float arguments, there was issue40046 with a ready PR.

These propositions were rejected by you. Have you reconsidered your decision?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42222>
_______________________________________

From report at bugs.python.org  Sat Oct 31 14:19:03 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 31 Oct 2020 18:19:03 +0000
Subject: [issue42222] Modernize integer test/conversion in randrange()
In-Reply-To: <1604165232.15.0.0916383458838.issue42222@roundup.psfhosted.org>
Message-ID: <1604168343.02.0.625172301821.issue42222@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> These propositions were rejected by you. 
> Have you reconsidered your decision?

I was reluctant to break any existing code.
Now, I'm unsure and am inclined to harmonize it with range().

What do you think?
Should we have ever supported float arguments
for an integer domain function?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42222>
_______________________________________

From report at bugs.python.org  Sat Oct 31 14:26:00 2020
From: report at bugs.python.org (Denis Kasak)
Date: Sat, 31 Oct 2020 18:26:00 +0000
Subject: [issue40350] modulefinder chokes on numpy - dereferencing None in
 spec.loader
In-Reply-To: <1587454417.83.0.816569073565.issue40350@roundup.psfhosted.org>
Message-ID: <1604168760.15.0.207459161516.issue40350@roundup.psfhosted.org>


Denis Kasak <denis.kasak at gmail.com> added the comment:

Anything still left to do that is stalling this? I just got bitten by it when trying to use modulefinder.

----------
nosy: +dkasak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40350>
_______________________________________

From report at bugs.python.org  Sat Oct 31 14:31:48 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Sat, 31 Oct 2020 18:31:48 +0000
Subject: [issue42218] SystemError in compile builtin function
In-Reply-To: <1604143002.46.0.930999995617.issue42218@roundup.psfhosted.org>
Message-ID: <1604169108.76.0.136767510761.issue42218@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:


New changeset 02cdfc93f82fecdb7eae97a868d4ee222b9875d9 by Lysandros Nikolaou in branch 'master':
bpo-42218: Correctly handle errors in left-recursive rules (GH-23065)
https://github.com/python/cpython/commit/02cdfc93f82fecdb7eae97a868d4ee222b9875d9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42218>
_______________________________________

From report at bugs.python.org  Sat Oct 31 14:34:20 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 31 Oct 2020 18:34:20 +0000
Subject: [issue31504] Documentation for return value for string.rindex is
 missing when search string is empty
In-Reply-To: <1505721887.17.0.00733091873512.issue31504@psf.upfronthosting.co.za>
Message-ID: <1604169260.15.0.975257040203.issue31504@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> rejected
stage: patch review -> resolved
status: pending -> closed
type: enhancement -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31504>
_______________________________________

From report at bugs.python.org  Sat Oct 31 14:37:31 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Sat, 31 Oct 2020 18:37:31 +0000
Subject: [issue42218] SystemError in compile builtin function
In-Reply-To: <1604143002.46.0.930999995617.issue42218@roundup.psfhosted.org>
Message-ID: <1604169451.36.0.626654856263.issue42218@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
pull_requests: +21985
pull_request: https://github.com/python/cpython/pull/23066

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42218>
_______________________________________

From report at bugs.python.org  Sat Oct 31 15:03:18 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 31 Oct 2020 19:03:18 +0000
Subject: [issue42222] Modernize integer test/conversion in randrange()
In-Reply-To: <1604165232.15.0.0916383458838.issue42222@roundup.psfhosted.org>
Message-ID: <1604170998.4.0.283167945874.issue42222@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I think and always thought that integer domain functions should not accept non-integer arguments even with integer value. This is why I submitted numerous patches for deprecating and finally removing support of non-integer arguments in most of integer domain functions. C implemented functions which use PyArg_Parse("i") or PyLong_AsLong() for parsing arguments use now index() instead of int(). They emit a deprecation warning for non-integers in 3.8 and 3.9 and raise type error since 3.10. math.factorial() emits a warning only in 3.9.

Issue37319 (sorry, I wrote incorrect issue number in msg380085) was initially opened for 3.9, so we could convert warnings into errors in 3.10 or 3.11.

Currently randrange(1e25) can return value larger than 10**25, because int(1e25) == 10000000000000000905969664 > 10**25.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42222>
_______________________________________

From report at bugs.python.org  Sat Oct 31 15:06:11 2020
From: report at bugs.python.org (miss-islington)
Date: Sat, 31 Oct 2020 19:06:11 +0000
Subject: [issue42218] SystemError in compile builtin function
In-Reply-To: <1604143002.46.0.930999995617.issue42218@roundup.psfhosted.org>
Message-ID: <1604171171.85.0.535664970908.issue42218@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset cfcb952e30e01d7cce430829af8edc7afc94e0b1 by Lysandros Nikolaou in branch '3.9':
[3.9] bpo-42218: Correctly handle errors in left-recursive rules (GH-23065) (GH-23066)
https://github.com/python/cpython/commit/cfcb952e30e01d7cce430829af8edc7afc94e0b1


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42218>
_______________________________________

From report at bugs.python.org  Sat Oct 31 15:06:57 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Sat, 31 Oct 2020 19:06:57 +0000
Subject: [issue42218] SystemError in compile builtin function
In-Reply-To: <1604143002.46.0.930999995617.issue42218@roundup.psfhosted.org>
Message-ID: <1604171217.36.0.98212095307.issue42218@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42218>
_______________________________________

From report at bugs.python.org  Sat Oct 31 15:39:25 2020
From: report at bugs.python.org (Daniel Alley)
Date: Sat, 31 Oct 2020 19:39:25 +0000
Subject: [issue42221] Potential memory leak in resize_compact() (for unicode
 objects)
In-Reply-To: <1604161000.37.0.700108867907.issue42221@roundup.psfhosted.org>
Message-ID: <1604173165.83.0.278524146872.issue42221@roundup.psfhosted.org>


Daniel Alley <dalley at redhat.com> added the comment:

A helpful user in the discord was able to point out where the bug was - in our extension, but not directly apparent from the valgrind output.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42221>
_______________________________________

From report at bugs.python.org  Sat Oct 31 15:44:47 2020
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Sat, 31 Oct 2020 19:44:47 +0000
Subject: [issue31504] Documentation for return value for string.rindex is
 missing when search string is empty
In-Reply-To: <1505721887.17.0.00733091873512.issue31504@psf.upfronthosting.co.za>
Message-ID: <1604173487.41.0.805045030205.issue31504@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

Maybe you would use 5, but I would use 7 and get the same result. If the docs say "X.rindex(Y) == i means i is the highest index where Y is found in X", and "Y is found in X at i" is interpreted as "X[i:i+len(Y)] == Y" (as Serhiy said), then there is no such (highest) index.

I understand what _you_'re saying, but please understand that the docs do not say anything like that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31504>
_______________________________________

From report at bugs.python.org  Sat Oct 31 15:55:15 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 31 Oct 2020 19:55:15 +0000
Subject: [issue37319] Deprecate using random.randrange() with non-integers
In-Reply-To: <1560801155.55.0.20318571261.issue37319@roundup.psfhosted.org>
Message-ID: <1604174115.84.0.110649852414.issue37319@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution: rejected -> 
stage: resolved -> patch review
status: closed -> open
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37319>
_______________________________________

From report at bugs.python.org  Sat Oct 31 16:04:07 2020
From: report at bugs.python.org (Neil Schemenauer)
Date: Sat, 31 Oct 2020 20:04:07 +0000
Subject: [issue27377] Add socket.fdtype()
In-Reply-To: <1466706816.6.0.72770597716.issue27377@psf.upfronthosting.co.za>
Message-ID: <1604174647.38.0.0693845289043.issue27377@roundup.psfhosted.org>


Neil Schemenauer <nas-python at arctrix.com> added the comment:

I believe this is not needed anymore.  Closing.

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27377>
_______________________________________

From report at bugs.python.org  Sat Oct 31 16:06:17 2020
From: report at bugs.python.org (Neil Schemenauer)
Date: Sat, 31 Oct 2020 20:06:17 +0000
Subject: [issue34704] Do not access ob_type directly, introduce Py_TP
In-Reply-To: <1537101322.11.0.956365154283.issue34704@psf.upfronthosting.co.za>
Message-ID: <1604174777.45.0.452359753521.issue34704@roundup.psfhosted.org>


Neil Schemenauer <nas-python at arctrix.com> added the comment:

This has been resolved using Py_TYPE() and Py_SET_TYPE().

----------
resolution:  -> out of date
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34704>
_______________________________________

From report at bugs.python.org  Sat Oct 31 16:06:33 2020
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 31 Oct 2020 20:06:33 +0000
Subject: [issue37319] Deprecate using random.randrange() with non-integers
In-Reply-To: <1560801155.55.0.20318571261.issue37319@roundup.psfhosted.org>
Message-ID: <1604174793.58.0.380894092262.issue37319@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

See issue42222.

As a side effect this change provides 10% speed up (which can be lager after the end of the deprecation period).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37319>
_______________________________________

From report at bugs.python.org  Sat Oct 31 16:07:08 2020
From: report at bugs.python.org (Neil Schemenauer)
Date: Sat, 31 Oct 2020 20:07:08 +0000
Subject: [issue34106] Add --with-module-config=<file> to 'configure' script
In-Reply-To: <1531425399.74.0.56676864532.issue34106@psf.upfronthosting.co.za>
Message-ID: <1604174828.36.0.382980041016.issue34106@roundup.psfhosted.org>


Change by Neil Schemenauer <nas-python at arctrix.com>:


----------
resolution:  -> out of date
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34106>
_______________________________________

From report at bugs.python.org  Sat Oct 31 16:25:04 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 31 Oct 2020 20:25:04 +0000
Subject: [issue42222] Modernize integer test/conversion in randrange()
In-Reply-To: <1604165232.15.0.0916383458838.issue42222@roundup.psfhosted.org>
Message-ID: <1604175904.66.0.934958134983.issue42222@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

User feedback concur with making the change:  https://twitter.com/raymondh/status/1322607969754775552

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42222>
_______________________________________

From report at bugs.python.org  Sat Oct 31 16:25:52 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 31 Oct 2020 20:25:52 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604175952.62.0.195628244735.issue42198@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 3bf0d02f2817c48b6ee61a95b52a6d76ad543be9 by kj in branch 'master':
bpo-42198: New section in stdtypes for type annotation types (GH-23063)
https://github.com/python/cpython/commit/3bf0d02f2817c48b6ee61a95b52a6d76ad543be9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Sat Oct 31 16:28:12 2020
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 31 Oct 2020 20:28:12 +0000
Subject: [issue42198] Clean up docs for Union and GenericAlias
In-Reply-To: <1603985984.49.0.749762775371.issue42198@roundup.psfhosted.org>
Message-ID: <1604176092.48.0.593178444241.issue42198@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Thanks Ken Ji for all your help! I'll close this now.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42198>
_______________________________________

From report at bugs.python.org  Sat Oct 31 17:11:58 2020
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Sat, 31 Oct 2020 21:11:58 +0000
Subject: [issue42222] Modernize integer test/conversion in randrange()
In-Reply-To: <1604165232.15.0.0916383458838.issue42222@roundup.psfhosted.org>
Message-ID: <1604178718.45.0.994901739615.issue42222@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

Yes, the ability to write randrange(1e9) is sometimes nice. And the fact that it might give the number outside the intended range with probability 1e-17 is not really an important argument (people have bad intuitions about very small probabilities). But if we intend to be consistent with range, then of course this must go.

----------
nosy: +veky

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42222>
_______________________________________

From report at bugs.python.org  Sat Oct 31 17:13:02 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 21:13:02 +0000
Subject: [issue34704] Do not access ob_type directly, introduce Py_TP
In-Reply-To: <1537101322.11.0.956365154283.issue34704@psf.upfronthosting.co.za>
Message-ID: <1604178782.44.0.632162860182.issue34704@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> This has been resolved using Py_TYPE() and Py_SET_TYPE().

Great!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34704>
_______________________________________

From report at bugs.python.org  Sat Oct 31 17:14:17 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 21:14:17 +0000
Subject: [issue42186] unittest overrides more serious warnings filter added
 before unittest.main()
In-Reply-To: <1603917748.58.0.497118511027.issue42186@roundup.psfhosted.org>
Message-ID: <1604178857.23.0.342746274241.issue42186@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42186>
_______________________________________

From report at bugs.python.org  Sat Oct 31 18:11:50 2020
From: report at bugs.python.org (Austin Green)
Date: Sat, 31 Oct 2020 22:11:50 +0000
Subject: [issue42223] List repetition operator gives unexpected results
Message-ID: <1604182310.98.0.376819106818.issue42223@roundup.psfhosted.org>


New submission from Austin Green <austin.green at orcon.net.nz>:

Not sure if this is a bug, cannot find any clarification in the documentation.  Please reassign it if need be.

Using the * operator to generate a list of lists:
>>> a = [[0]*3]*3
>>> a
[[0, 0, 0], [0, 0, 0], [0, 0, 0]]
gives a list of 3 lists of zeroes, as expected.
But the data values appear to be shared, so e.g.
>>> a[1][1] = 'spam'
>>> a
[[0, 'spam', 0], [0, 'spam', 0], [0, 'spam', 0]]
Not what I was expecting!

A list comprehension gives the results I wanted:
>>> a = [[0 for x in range(3)] for x in range(3)]
>>> a
[[0, 0, 0], [0, 0, 0], [0, 0, 0]]
Looks just the same, but:
>>> a[1][1] = 'spam'
>>> a
[[0, 0, 0], [0, 'spam', 0], [0, 0, 0]]
gives a different result, and is actually what I was expecting from the first example.

----------
components: Interpreter Core
messages: 380101
nosy: austin.green
priority: normal
severity: normal
status: open
title: List repetition operator gives unexpected results
type: behavior
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42223>
_______________________________________

From report at bugs.python.org  Sat Oct 31 18:25:03 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 22:25:03 +0000
Subject: [issue40512] [subinterpreters] Meta issue: per-interpreter GIL
In-Reply-To: <1588683075.13.0.0239787407564.issue40512@roundup.psfhosted.org>
Message-ID: <1604183103.15.0.734661863822.issue40512@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> * _PyLong_Zero and _PyLong_One singletons are shared

Removed by bpo-42161 (commit c310185c081110741fae914c06c7aaf673ad3d0d).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40512>
_______________________________________

From report at bugs.python.org  Sat Oct 31 18:31:49 2020
From: report at bugs.python.org (Steven D'Aprano)
Date: Sat, 31 Oct 2020 22:31:49 +0000
Subject: [issue42223] List repetition operator gives unexpected results
In-Reply-To: <1604182310.98.0.376819106818.issue42223@roundup.psfhosted.org>
Message-ID: <1604183509.16.0.708258535176.issue42223@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

This is not a bug. The sequence repetition operator does not *copy* items, as explained here:

https://docs.python.org/3/library/stdtypes.html#common-sequence-operations

----------
nosy: +steven.daprano
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42223>
_______________________________________

From report at bugs.python.org  Sat Oct 31 18:39:36 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Sat, 31 Oct 2020 22:39:36 +0000
Subject: [issue42224] test_format:test_locale fails when locale does not set
 grouping in thousands
Message-ID: <1604183976.7.0.233218767398.issue42224@roundup.psfhosted.org>


New submission from Lysandros Nikolaou <lisandrosnik at gmail.com>:

test_format:test_locale tests for the existence of the thousands separator in a formatted number.

However, my locale does not expect/enforce (not sure what the correct term is) grouping the number in thousands, which leads to the test (and consequently the whole test suite) failing:

?  cpython git:(test-format-locale-fix) ./python                  
Python 3.10.0a1+ (heads/master:3bf0d02f28, Oct 31 2020, 22:42:09) 
[GCC 9.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import locale
>>> locale.setlocale(locale.LC_ALL, '')
'LC_CTYPE=en_US.UTF-8;LC_NUMERIC=el_GR.UTF-8;LC_TIME=el_GR.UTF-8;LC_COLLATE=en_US.UTF-8;LC_MONETARY=el_GR.UTF-8;LC_MESSAGES=en_US.UTF-8;LC_PAPER=el_GR.UTF-8;LC_NAME=el_GR.UTF-8;LC_ADDRESS=el_GR.UTF-8;LC_TELEPHONE=el_GR.UTF-8;LC_MEASUREMENT=el_GR.UTF-8;LC_IDENTIFICATION=el_GR.UTF-8'
>>> format(123456789, 'n')
'123456789'
>>> locale.localeconv()['grouping']
[]

I guess the fix here is to check whether grouping is empty or not in test_locale.

----------
components: Tests
messages: 380104
nosy: lys.nikolaou
priority: normal
severity: normal
status: open
title: test_format:test_locale fails when locale does not set grouping in thousands
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42224>
_______________________________________

From report at bugs.python.org  Sat Oct 31 18:43:53 2020
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Sat, 31 Oct 2020 22:43:53 +0000
Subject: [issue42224] test_format:test_locale fails when locale does not set
 grouping in thousands
In-Reply-To: <1604183976.7.0.233218767398.issue42224@roundup.psfhosted.org>
Message-ID: <1604184233.91.0.158853530683.issue42224@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
keywords: +patch
pull_requests: +21986
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23067

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42224>
_______________________________________

From report at bugs.python.org  Sat Oct 31 18:59:17 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 22:59:17 +0000
Subject: [issue40514] [subinterpreters] Add
 --experimental-isolated-subinterpreters build option
In-Reply-To: <1588684431.91.0.693668036583.issue40514@roundup.psfhosted.org>
Message-ID: <1604185157.93.0.47315667046.issue40514@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40514>
_______________________________________

From report at bugs.python.org  Sat Oct 31 19:05:40 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 23:05:40 +0000
Subject: [issue40533] [subinterpreters] Don't share Python objects between
 interpreters
In-Reply-To: <1588777895.61.0.395509624257.issue40533@roundup.psfhosted.org>
Message-ID: <1604185540.3.0.29433273995.issue40533@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> For example, PyModule_Type is declared statically and so shared by all interpreters and so PyModule_Type.tp_mro tuple is accessed in parallel by multiple interpreters.

Another example of this issue are parallel Py_INCREF/Py_DECREF calls on the tp_bases member of a type.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40533>
_______________________________________

From report at bugs.python.org  Sat Oct 31 19:10:46 2020
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Sat, 31 Oct 2020 23:10:46 +0000
Subject: [issue40512] [subinterpreters] Meta issue: per-interpreter GIL
In-Reply-To: <1588683075.13.0.0239787407564.issue40512@roundup.psfhosted.org>
Message-ID: <1604185846.24.0.958887508287.issue40512@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
nosy: +erlendaasland

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40512>
_______________________________________

From report at bugs.python.org  Sat Oct 31 19:09:37 2020
From: report at bugs.python.org (Austin Green)
Date: Sat, 31 Oct 2020 23:09:37 +0000
Subject: [issue42223] List repetition operator gives unexpected results
In-Reply-To: <1604182310.98.0.376819106818.issue42223@roundup.psfhosted.org>
Message-ID: <1604185777.09.0.323785054139.issue42223@roundup.psfhosted.org>


Austin Green <austin.green at orcon.net.nz> added the comment:

Thanks for that; I suspected as much.  Could not find anything about it searching the web, so it's a feature not much discussed by the numerous Python tutorials.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42223>
_______________________________________

From report at bugs.python.org  Sat Oct 31 19:24:05 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 31 Oct 2020 23:24:05 +0000
Subject: [issue26377] Tkinter dialogs will not close if root window not packed.
In-Reply-To: <1455721620.42.0.0590186130956.issue26377@psf.upfronthosting.co.za>
Message-ID: <1604186645.2.0.272579946486.issue26377@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Looking at #26376 again, I think Ned's msg260413 identified Sam's problem.  "Also note that installing ActiveTcl 8.6.x has no effect if the tkinter in use was linked with an 8.5 version of Tcl/Tk, as the one you are using apparently was. Make sure you have installed the latest version of ActiveTcl 8.5.x and try again."  Sam's tk 8.5 would have been Apple's buggy 8.5.9 (or earlier).  I should have asked for the 8.y.z version listed in About IDLE.

In any case, I also verified no problem in current Python-Tk-IDLE.

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Tkinter root window won't close if packed.

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26377>
_______________________________________

From report at bugs.python.org  Sat Oct 31 19:45:07 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 31 Oct 2020 23:45:07 +0000
Subject: [issue40512] [subinterpreters] Meta issue: per-interpreter GIL
In-Reply-To: <1588683075.13.0.0239787407564.issue40512@roundup.psfhosted.org>
Message-ID: <1604187907.01.0.0805374944798.issue40512@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

FYI I'm also using https://pythondev.readthedocs.io/subinterpreters.html to track the progress on isolating subinterpreters.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40512>
_______________________________________

From report at bugs.python.org  Sat Oct 31 20:15:42 2020
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 01 Nov 2020 00:15:42 +0000
Subject: [issue40077] Convert static types to heap types: use PyType_FromSpec()
In-Reply-To: <1585238684.65.0.246012172449.issue40077@roundup.psfhosted.org>
Message-ID: <1604189742.82.0.816609743711.issue40077@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Count static types:

grep -E 'static PyTypeObject .* =' $(find -name "*.c"|grep -v Doc/)|wc -l

Count heap types:

grep -E 'PyType_Spec .* =' $(find -name "*.c")|wc -l

Status:

* 3.6: 10 heap (6%) vs 145 static (total: 155)
* 3.7: 10 heap (6%) vs 150 static (total: 160)
* 3.8: 15 heap (9%) vs 157 static (total: 172)
* 3.9: 39 heap (21%) vs 149 static (total: 188) -- 2.6x more heap types than 3.8!
* master: 69 heap (35%) vs 131 static (total: 200) -- 1.8x more heap types than 3.9!

The percentage of heap static is growing in the right direction ;-) The total number of types is also growing at each Python realease!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40077>
_______________________________________

From report at bugs.python.org  Sat Oct 31 20:40:24 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 01 Nov 2020 00:40:24 +0000
Subject: [issue12953] Function calls missing from profiler output
In-Reply-To: <1315607842.02.0.28762981022.issue12953@psf.upfronthosting.co.za>
Message-ID: <1604191224.15.0.350701441161.issue12953@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.9 -Python 3.2, Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12953>
_______________________________________

From report at bugs.python.org  Sat Oct 31 20:47:17 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 01 Nov 2020 00:47:17 +0000
Subject: [issue2604] doctest.DocTestCase fails when run repeatedly
In-Reply-To: <1207798847.15.0.203205049744.issue2604@psf.upfronthosting.co.za>
Message-ID: <1604191637.62.0.392519587966.issue2604@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.9 -Python 2.7, Python 3.1, Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2604>
_______________________________________

From report at bugs.python.org  Sat Oct 31 20:49:59 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sun, 01 Nov 2020 00:49:59 +0000
Subject: [issue41835] Speed up dict vectorcall creation using keywords
In-Reply-To: <1600779404.53.0.758044601526.issue41835@roundup.psfhosted.org>
Message-ID: <1604191799.01.0.168375056406.issue41835@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> It should *not* be affected by the change. Anyway, I run the bench other 10 times, and the lowest value with the CPython code without the PR is not lower than 67.7 ns. With the PR, it reaches 53.5 ns. And I do not understand why.

The benchmark is very affected by code placement.
Even adding dead function affects speeds. Read vstinner's blog and presentation:

* https://vstinner.github.io/journey-to-stable-benchmark-deadcode.html
* https://speakerdeck.com/haypo/how-to-run-a-stable-benchmark?slide=9

That's why we recommend PGO+LTO build for benchmarking.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41835>
_______________________________________

From report at bugs.python.org  Sat Oct 31 21:02:59 2020
From: report at bugs.python.org (Inada Naoki)
Date: Sun, 01 Nov 2020 01:02:59 +0000
Subject: [issue42160] unnecessary overhead in tempfile
In-Reply-To: <1603747164.82.0.214293266524.issue42160@roundup.psfhosted.org>
Message-ID: <1604192579.6.0.322271842179.issue42160@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +21987
pull_request: https://github.com/python/cpython/pull/23068

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42160>
_______________________________________

From report at bugs.python.org  Sat Oct 31 21:07:10 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 01 Nov 2020 01:07:10 +0000
Subject: [issue763043] unable to specify another compiler
Message-ID: <1604192830.74.0.537456542173.issue763043@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.9 -Python 2.7, Python 3.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue763043>
_______________________________________

From report at bugs.python.org  Sat Oct 31 21:09:48 2020
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 01 Nov 2020 01:09:48 +0000
Subject: [issue14219] make the Classes tutorial more gentle
In-Reply-To: <1331111619.2.0.272575522063.issue14219@psf.upfronthosting.co.za>
Message-ID: <1604192988.14.0.424041154222.issue14219@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions: +Python 3.10, Python 3.9 -Python 2.7, Python 3.2, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14219>
_______________________________________

From report at bugs.python.org  Sat Oct 31 21:39:33 2020
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 01 Nov 2020 01:39:33 +0000
Subject: [issue42222] Modernize integer test/conversion in randrange()
In-Reply-To: <1604165232.15.0.0916383458838.issue42222@roundup.psfhosted.org>
Message-ID: <1604194773.06.0.351188993492.issue42222@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

10**9 isn't much harder than 10E9 ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42222>
_______________________________________

From report at bugs.python.org  Sat Oct 31 23:17:12 2020
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 01 Nov 2020 03:17:12 +0000
Subject: [issue42225] Tkinter hangs or crashes when displaying astral chars
Message-ID: <1604200632.47.0.347759375724.issue42225@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

On my macOS Mohave, 3.10, echoing '\U0001####' (# = hex digit) or chr(#####) (decimal digits) in IDLE's shell either prints an error box or hangs.  On #13153, freezing on macOS was reported for 3.7.6.  Until tkinter on Mac works better, we should try to get an error box for all astral chars.

For an SO questioner with Ubuntu 18.04, now updated to 20.04 with python 3.8.6, some chars display (128512-128547; 128549-128555; 128557-128576, example chr(128516)) and some 'crash' (example chr(128077)).  I am trying to get 'crash' narrowed down and the tk version Ubuntu uses.
Serhiy, does >>> chr(128516) echo thumbs up on your Linux?

The SO crash example works for me on Windows.  I should test more codepoints.

----------
components: Tkinter, Unicode, macOS
messages: 380112
nosy: ezio.melotti, ned.deily, ronaldoussoren, serhiy.storchaka, terry.reedy, vstinner
priority: normal
severity: normal
stage: test needed
status: open
title: Tkinter hangs or crashes when displaying astral chars
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42225>
_______________________________________