Mailman 3 May 2009 - Python-Dev

PEP 384: Defining a Stable ABI
by Jim Jewett 22 May '09

22 May '09

Martin v. Löwis wrote: > - PyGetSetDef (name, get, set, doc, closure) Is it fully decided that the generally-unused closure parameter will stay until python 4? > The accessor macros to these fields (Py_REFCNT, Py_TYPE, Py_SIZE) > are also available to applications. There have been several experiments in memory management, ranging from not bothering to change the refcount on permanent objects like None, to proxying objects across multiple threads or processes. I also believe (but don't remember for sure) that some of the proposed Unicode (or String?) optimizations changed the memory layout a bit. So far, these have all been complicated (or slow) enough that they didn't get integrated, but if it ever happens ... I don't think it would justify python 4.0 > New Python > versions may introduce new slot ids, but slot ids will never be > recycled. Slots may get deprecated, but continue to be supported > throughout Python 3.x. Weren't there already a few ready for deprecation? Do you really want to commit to them forever? Even if you aren't willing to settle for less than "3.x from now on", it might make sense to at least start with 3.2, rather than 3.0. -jJ

2 1

Re: [Python-Dev] PEP 376 : Changing the .egg-info structure
by P.J. Eby 22 May '09

22 May '09

At 04:04 PM 5/19/2009 +0200, Tarek Ziadé wrote: >On Sat, May 16, 2009 at 6:55 PM, P.J. Eby <pje(a)telecommunity.com> wrote: > > > > 1. Why ';' separation, instead of tabs as in PEP 262? Aren't semicolons a > > valid character in filenames? > >I am changing this into a <tab>. for now. > >What about Antoine's idea about doing a quote() on the names ? I like the CSV idea better, since the csv module is available in 2.3 and up. We should just pick a dialect with unambiguous quoting rules. > From my point of view <tabs> seems more simple to deal with, if 3rd-party >tools want to work on these files without using pkgutil or Python. True, but then CSV files are still pretty common. One other possibility that might work is using a vertical bar as a separator. My preference rank at the moment is probably tabs, CSV, or vertical bar. But I don't really care all that much, so let the people who care decide. Personally, though, I don't see much point to cross-language manipulation of the file. System packaging tools have their own way of keeping track of this stuff. So unless somebody's using it to *build* system packages (e.g. making an RPM builder), they don't need this. Now, about the APIs... > > 4. There should probably be a way to iterate over the projects in a > > directory, since it's otherwise impossible for an installation tool to find > > out what project(s) "own" a file that conflicts with something being > > installed. Alternatively, reshaping the file API to allow querying by path > > as well as by project might work. > >I am adding a "get_projects" api: > > get_projects() -> iterator > > Provides an iterator that will return (name, path) tuples, where `name` > is the name of a registered project and `path` the path to its `egg-info` > directory. > >But for the use case you are mentioning, what about an explicit API: > > get_owners(paths) -> sequence of project names > > returns a sequence of tuple. For each path in the "paths" list, a >tuple of project names > is returned > > > > > 5. If any cache mechanisms are to be used by the API, the API > *must* make it > > possible to bypass or explicitly manage that cache, as otherwise > > installation tools and tools that manipulate sys.path at runtime may end up > > using incorrect data. > >work in progress - (I am afraid I have to write an advanced prototype >to be able to know >exaclty how the cache might work, and so, what API we should have) I think it would be simpler to have explicit object types representing things like a directory, a collection of directories, and individual projects, and these object types should be part of the API. Any function-oriented API should just be exposed as the methods of a default singleton. Other Python modules follow this pattern -- and it's what I copied for the pkg_resources design. It gives a nice tradeoff between keeping the simple things simple, and complex things possible, as well as keeping mechanism and policy separate. Right now, the API design you're trying to do is being burdened by using strings and tuples to represent things that could just as easily be objects with their own methods, instead of things you have to pass back into other APIs. This also makes caching more complex, because you can't just have one main object with stuff hanging off; you've got to have a bunch of dictionaries, tuples, lists, sets, etc.

2 2

Summary of Python tracker Issues
by Python tracker 22 May '09

22 May '09

ACTIVITY SUMMARY (05/15/09 - 05/22/09) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 2195 open (+35) / 15716 closed (+24) / 17911 total (+59) Open issues with patches: 863 Average duration of open issues: 650 days. Median duration of open issues: 400 days. Open Issues Breakdown open 2168 (+35) pending 27 ( +0) Issues Created Or Reopened (64) _______________________________ bsddb memory leak on ubuntu 05/18/09 CLOSED http://bugs.python.org/issue3541 reopened ajaksu2 idle pydoc et al removed from 3.1 without versioned replacements 05/22/09 http://bugs.python.org/issue5756 reopened nad Dict fails to notice addition and deletion of keys during iterat 05/16/09 CLOSED http://bugs.python.org/issue6017 reopened stevenjd documentation of xml.dom.minidom.parse signature is wrong 05/16/09 CLOSED http://bugs.python.org/issue6025 reopened phihag patch Interpreter crashes when chaining an infinite number of exceptio 05/15/09 http://bugs.python.org/issue6028 reopened amaury.forgeotdarc patch io.BufferedWriter C module missing _write_lock 05/15/09 CLOSED http://bugs.python.org/issue6030 created jroesslein BaseServer.shutdown documentation is incomplete 05/15/09 http://bugs.python.org/issue6031 created gagenellina Fix refleaks in test_urllib2_localnet 05/16/09 CLOSED http://bugs.python.org/issue6032 created collinwinter patch LOOKUP_METHOD and CALL_METHOD optimization 05/16/09 http://bugs.python.org/issue6033 created benjamin.peterson patch Fix object.__reversed__ doc 05/16/09 CLOSED http://bugs.python.org/issue6034 created tjreedy test_poplib Bus error with gcc-4.4 on OS X 05/16/09 CLOSED http://bugs.python.org/issue6035 created marketdickinson Clean up test_posixpath.py 05/16/09 http://bugs.python.org/issue6036 created phihag patch MutableSequence.__iadd__ should return self 05/16/09 CLOSED http://bugs.python.org/issue6037 created amarzal Should collections.Counter check for int? 05/16/09 CLOSED http://bugs.python.org/issue6038 created hagen cygwin compilers should not check compiler versions 05/16/09 http://bugs.python.org/issue6039 created cdavid bdist_msi does not deal with pre-release version 05/16/09 http://bugs.python.org/issue6040 created cdavid change sdist and register command so they use check 05/16/09 CLOSED http://bugs.python.org/issue6041 created tarek Document and slightly simplify lnotab tracing 05/16/09 http://bugs.python.org/issue6042 created jyasskin patch, needs review HTMLParseError derivation 05/16/09 CLOSED http://bugs.python.org/issue6043 created bayerf Exception message in int() when trying to convert a complex 05/17/09 CLOSED http://bugs.python.org/issue6044 created aletornw Fix dbm interfaces 05/17/09 http://bugs.python.org/issue6045 created georg.brandl test_distutils.py fails on VC6(Windows) 05/17/09 CLOSED http://bugs.python.org/issue6046 created ocean-city patch "install" target in python 3.x makefile should be "fullinstall" 05/17/09 http://bugs.python.org/issue6047 created ronaldoussoren make distutils use the tarinfo command 05/17/09 http://bugs.python.org/issue6048 created tarek str.strip() and " behaviour expected? 05/17/09 CLOSED http://bugs.python.org/issue6049 created sholvar zipfile: Extracting a directory that already exists generates an 05/18/09 http://bugs.python.org/issue6050 created joe.amenta patch smtplib docs should link to email module examples 05/18/09 CLOSED http://bugs.python.org/issue6051 created guettli for-loop doesn't work with -c 05/18/09 CLOSED http://bugs.python.org/issue6052 created exe distutils error on windows 05/18/09 CLOSED http://bugs.python.org/issue6053 created ocean-city patch tarfile normalizes arcname 05/18/09 http://bugs.python.org/issue6054 created mkv References to "pysqlite" in documentation of sqlite3 should be c 05/18/09 CLOSED http://bugs.python.org/issue6055 created MLModel socket.setdefaulttimeout affecting multiprocessing Manager 05/18/09 http://bugs.python.org/issue6056 created ryles sqlite3 error classes should be documented 05/18/09 http://bugs.python.org/issue6057 created MLModel Add cp65001 to encodings/aliases.py 05/19/09 http://bugs.python.org/issue6058 created tzot patch uuid.uuid4 cause segfault in emesene 05/19/09 http://bugs.python.org/issue6059 created acevery PYTHONHOME should be more flexible (and controllable by --libdir 05/19/09 http://bugs.python.org/issue6060 created soundmurderer time.clock(): overflow in programs that run for very long 05/19/09 CLOSED http://bugs.python.org/issue6061 created tom65536 build_ext fails to build in the right directory using the packag 05/19/09 CLOSED http://bugs.python.org/issue6062 created tarek pydoc_data package is not installed 05/19/09 CLOSED http://bugs.python.org/issue6063 created ronaldoussoren patch, 26backport Add "daemon" argument to threading.Thread constructor 05/19/09 http://bugs.python.org/issue6064 created tebeka patch, easy bdist_msi.py failed assert when including extension modules 05/19/09 http://bugs.python.org/issue6065 created tim.golden patch POP_MARK was not in pickle protocol 0 05/20/09 CLOSED http://bugs.python.org/issue6066 created collinwinter patch, easy make error 05/20/09 http://bugs.python.org/issue6067 created gast support read/write c_ulonglong type bitfield structures 05/20/09 http://bugs.python.org/issue6068 created higstar casting error from ctypes array to structure 05/20/09 http://bugs.python.org/issue6069 created higstar Pyhon 2.6 makes .pyc/.pyo bytecode files executable 05/20/09 http://bugs.python.org/issue6070 created phd no longer possible to hash arrays 05/20/09 http://bugs.python.org/issue6071 created exarkun unittest.TestCase._result is very likely to collide (and break) 05/20/09 CLOSED http://bugs.python.org/issue6072 created exarkun patch threading.Timer and gtk.main are not compatible 05/20/09 http://bugs.python.org/issue6073 created eric .pyc files created readonly if .py file is readonly, python won' 05/20/09 http://bugs.python.org/issue6074 created pdsimanyi Patch for IDLE/OS X to work with Tk-Cocoa 05/20/09 http://bugs.python.org/issue6075 created wordtech patch Missing title for configDialog.py 05/20/09 http://bugs.python.org/issue6076 created wordtech patch Unicode issue with tempfile on Windows 05/21/09 http://bugs.python.org/issue6077 created daniel.ugra freeze.py doesn't work 05/21/09 http://bugs.python.org/issue6078 created mzalokar SyntaxError in xmlrpc.client examples 05/21/09 http://bugs.python.org/issue6079 created thijs Itertools objects are missing "send" 05/21/09 CLOSED http://bugs.python.org/issue6080 created tebeka str.format_from_mapping() 05/21/09 http://bugs.python.org/issue6081 created rhettinger os.path.sameopenfile reports that standard streams are the same 05/22/09 CLOSED http://bugs.python.org/issue6082 reopened ryles Reference counting bug in setrlimit 05/22/09 http://bugs.python.org/issue6083 created billm patch documentation of zip function is error 05/22/09 CLOSED http://bugs.python.org/issue6084 created bones7456 Logging in BaseHTTPServer.BaseHTTPRequestHandler causes lag 05/22/09 http://bugs.python.org/issue6085 created aerodonkey Correct minor typos in doanddont.rst and urllib2.rst howto docum 05/22/09 CLOSED http://bugs.python.org/issue6086 created vshenoy patch distutils.sysconfig.get_python_lib gives surprising result when 05/22/09 http://bugs.python.org/issue6087 created vsajip easy Python3.0.1.1 is not available when system locale is zh_TW.eucTW 05/22/09 http://bugs.python.org/issue6088 created leeon Issues Now Closed (65) ______________________ weakref copy module interaction 456 days http://bugs.python.org/issue2116 pitrou patch os.listdir doc should mention that Unicode decoding can fail 366 days http://bugs.python.org/issue2856 georg.brandl sys.stdin.fileno() gives attribute error in IDLE 354 days http://bugs.python.org/issue3003 kbk Problem with invalidly-encoded command-line arguments (Unix) 351 days http://bugs.python.org/issue3023 benjamin.peterson incorrect comments for PyObject_ReleaseBuffer 315 days http://bugs.python.org/issue3293 pitrou Py_WIN_WIDE_FILENAMES removal 282 days http://bugs.python.org/issue3527 ocean-city patch bsddb memory leak on ubuntu 4 days http://bugs.python.org/issue3541 jcea remove not decodable environment variables 214 days http://bugs.python.org/issue4126 loewis patch 3 tutorial documentation errors 210 days http://bugs.python.org/issue4144 georg.brandl Running Python 2.6 GUI on Windows Vista 202 days http://bugs.python.org/issue4215 georg.brandl Missing make altframeworkinstall for Mac OS X 165 days http://bugs.python.org/issue4554 ronaldoussoren 2.6.1 breaks many applications that embed Python on Windows 163 days http://bugs.python.org/issue4566 chrisyco patch, needs review Setting font from preference dialog in IDLE on OS X broken 97 days http://bugs.python.org/issue5232 kbk patch OS X Installer: add options to specify universal build type and 93 days http://bugs.python.org/issue5269 ronaldoussoren Scanner class in re module undocumented 87 days http://bugs.python.org/issue5337 rhettinger add a new command called "check" into Distutils 37 days http://bugs.python.org/issue5732 tarek OS X Installer: new make of documentation installs at wrong loca 34 days http://bugs.python.org/issue5769 ronaldoussoren len(reversed( 28 days http://bugs.python.org/issue5786 marketdickinson float('1e500') -> inf, complex('1e500') -> ValueError 26 days http://bugs.python.org/issue5829 marketdickinson patch, easy Better documentation of use of BROWSER environment variable 12 days http://bugs.python.org/issue5935 georg.brandl Problems with dbm documentation 12 days http://bugs.python.org/issue5937 georg.brandl Ambiguity in dbm.open flag documentation 14 days http://bugs.python.org/issue5942 georg.brandl email.message : get_payload args's documentation is confusing 10 days http://bugs.python.org/issue5951 georg.brandl test_distutils fails for Python 3.1b1 on MacOS X 9 days http://bugs.python.org/issue5956 nad WeakSet cmp methods 11 days http://bugs.python.org/issue5964 pitrou patch, needs review Add bug tracker tasks to PEP 101 8 days http://bugs.python.org/issue5980 georg.brandl patch Broken link to "Curses Programming with Python" 6 days http://bugs.python.org/issue5987 georg.brandl Add __bool__ to threading.Event and multiprocessing.Event 4 days http://bugs.python.org/issue5998 benjamin.peterson patch test_urllib2_localnet DigestAuthHandler leaks nonces 7 days http://bugs.python.org/issue6002 collinwinter easy optparse docs say 'default' keyword is deprecated but uses it in 3 days http://bugs.python.org/issue6009 georg.brandl Dict fails to notice addition and deletion of keys during iterat 1 days http://bugs.python.org/issue6017 georg.brandl Fix the output word from "ok" to "OK" when a testcase passes 3 days http://bugs.python.org/issue6018 benjamin.peterson test_distutils leaves a 'foo' file behind in the cwd 5 days http://bugs.python.org/issue6022 r.david.murray Search does not intelligently handle module.function queries on 3 days http://bugs.python.org/issue6023 georg.brandl documentation of xml.dom.minidom.parse signature is wrong 0 days http://bugs.python.org/issue6025 georg.brandl patch io.BufferedWriter C module missing _write_lock 0 days http://bugs.python.org/issue6030 pitrou Fix refleaks in test_urllib2_localnet 3 days http://bugs.python.org/issue6032 collinwinter patch Fix object.__reversed__ doc 0 days http://bugs.python.org/issue6034 georg.brandl test_poplib Bus error with gcc-4.4 on OS X 0 days http://bugs.python.org/issue6035 marketdickinson MutableSequence.__iadd__ should return self 2 days http://bugs.python.org/issue6037 rhettinger Should collections.Counter check for int? 1 days http://bugs.python.org/issue6038 rhettinger change sdist and register command so they use check 0 days http://bugs.python.org/issue6041 tarek HTMLParseError derivation 0 days http://bugs.python.org/issue6043 benjamin.peterson Exception message in int() when trying to convert a complex 0 days http://bugs.python.org/issue6044 marketdickinson test_distutils.py fails on VC6(Windows) 1 days http://bugs.python.org/issue6046 tarek patch str.strip() and " behaviour expected? 0 days http://bugs.python.org/issue6049 loewis smtplib docs should link to email module examples 2 days http://bugs.python.org/issue6051 georg.brandl for-loop doesn't work with -c 0 days http://bugs.python.org/issue6052 r.david.murray distutils error on windows 0 days http://bugs.python.org/issue6053 loewis patch References to "pysqlite" in documentation of sqlite3 should be c 2 days http://bugs.python.org/issue6055 georg.brandl time.clock(): overflow in programs that run for very long 0 days http://bugs.python.org/issue6061 tom65536 build_ext fails to build in the right directory using the packag 0 days http://bugs.python.org/issue6062 tarek pydoc_data package is not installed 0 days http://bugs.python.org/issue6063 georg.brandl patch, 26backport POP_MARK was not in pickle protocol 0 1 days http://bugs.python.org/issue6066 collinwinter patch, easy unittest.TestCase._result is very likely to collide (and break) 1 days http://bugs.python.org/issue6072 michael.foord patch Itertools objects are missing "send" 0 days http://bugs.python.org/issue6080 rhettinger os.path.sameopenfile reports that standard streams are the same 0 days http://bugs.python.org/issue6082 ryles documentation of zip function is error 0 days http://bugs.python.org/issue6084 georg.brandl Correct minor typos in doanddont.rst and urllib2.rst howto docum 0 days http://bugs.python.org/issue6086 georg.brandl patch http libraries throw errors internally in BitTorrent 1884 days http://bugs.python.org/issue920573 rhettinger Documentation for Descriptors in the main docs 1809 days http://bugs.python.org/issue966625 rhettinger pdb unable to jump to first statement 785 days http://bugs.python.org/issue1689458 jyasskin patch, needs review Failure to build on AIX 5.3 773 days http://bugs.python.org/issue1694442 ajaksu2 syslog syscall support for SysLogLogger 749 days http://bugs.python.org/issue1711603 dandrzejewski patch help() can't find right source file 702 days http://bugs.python.org/issue1738179 pitrou patch, easy Top Issues Most Discussed (10) ______________________________ 11 test_distutils.py fails on VC6(Windows) 1 days closed http://bugs.python.org/issue6046 8 Interpreter crashes when chaining an infinite number of excepti 7 days open http://bugs.python.org/issue6028 8 Dict fails to notice addition and deletion of keys during itera 1 days closed http://bugs.python.org/issue6017 7 test_distutils fails for Python 3.1b1 on MacOS X 9 days closed http://bugs.python.org/issue5956 7 urllib/urllib2: HTTPS over (Squid) Proxy fails 1203 days open http://bugs.python.org/issue1424152 6 Enhanced cPython profiler with high-resolution timer 436 days open http://bugs.python.org/issue2281 5 distutils error on windows 0 days closed http://bugs.python.org/issue6053 5 Fix dbm interfaces 5 days open http://bugs.python.org/issue6045 5 Fix refleaks in test_urllib2_localnet 3 days closed http://bugs.python.org/issue6032 5 Embedding into a shared library fails 177 days open http://bugs.python.org/issue4434

1 0

Re: [Python-Dev] [Fwd: Re: PEP 384: Defining a Stable ABI]
by William Reade 22 May '09

22 May '09

My perspective is as follows: 1) If PEP-384 had always been in place, my life would now be a lot easier. 2) Since it hasn't always been in place, its introduction won't help me in the short term: there are an awful lot of extension modules that use excluded functions (for example, all(?) PyCxx modules use PyCode_New and PyFrame_New to get nicer tracebacks), and I'll still have to handle all these cases until everyone is up-to-date with whatever version of Python this gets accepted into. 3) Regardless, this PEP makes me very happy, because I can now look forward to the glorious day when all extension modules are 384-compatible (and even *some* modules becoming compatible will make me pretty happy). However, I'm not sure exactly how we can get there from here; I suspect that certain features of certain extensions already depend critically upon implementation details which will become hidden. The most extreme illustrative example I know is from NumPy (in scalarmathmodule.c), and looks like this: PyInt_Type.tp_as_number = PyLongArrType_Type.tp_as_number; PyInt_Type.tp_compare = PyLongArrType_Type.tp_compare; PyInt_Type.tp_richcompare = PyLongArrType_Type.tp_richcompare; ...and I fear that many many similar (if perhaps less frightening) dependencies exist elsewhere. Regardless, in answer to the two specific questions you ask: a) We don't really have that option. However, I would have a much higher degree of confidence in running PEP-384-compatible modules under Ironclad than I do with current modules, simply because I would no longer need to worry about (say) edge cases in which extension writers suddenly try to directly access op->ob_type->tp_as_number->nb_power. b) I can't think of any more useful restrictions. The PEP would solve my biggest current worry, which is that my current implementation allows managed/unmanaged lists to fall out of sync in certain circumstances (but if every list mutation happened via an API call, it wouldn't be an issue). Best Regards William Michael Foord wrote: > The questions from Martin v. Lowis are in the email below. > > The PEP under discussion is: > > http://www.python.org/dev/peps/pep-0384/ > > I can proxy any replies you want to send, or you can join Python-dev. > > All the best, > > Michael > > -------- Original Message -------- > Subject: Re: [Python-Dev] PEP 384: Defining a Stable ABI > Date: Mon, 18 May 2009 08:00:57 +0200 > From: "Martin v. Löwis" <martin(a)v.loewis.de> > To: Michael Foord <fuzzyman(a)voidspace.org.uk> > CC: Dino Viehland <dinov(a)microsoft.com>, Python-Dev > <python-dev(a)python.org>, Unladen Swallow > <unladen-swallow(a)googlegroups.com>, Python List <python-list(a)python.org> > References: <4A107988.3020202(a)v.loewis.de> > <ea2499da0905171447n5a353b61w1c98a91bf3617e5c(a)mail.gmail.com> > <4A108ABF.9060909(a)v.loewis.de> > <ea2499da0905171534vca080dci473d2ee9f9915668(a)mail.gmail.com> > <1A472770E042064698CB5ADC83A12ACD016E82D6(a)TK5EX14MBXC116.redmond.corp.microsoft.com> > <4A1097F5.2050009(a)v.loewis.de> <4A10A368.1060406(a)voidspace.org.uk> > > > > >>> It also might make it easier for alternate implementations to support > >>> the same API so some modules could work cross implementation - but I > >>> suspect that's a non-goal of this PEP :). > >>> > >> > >> Indeed :-) I'm also skeptical that this would actually allow > >> cross-implementation modules to happen. The list of functions that > >> an alternate implementation would have to provide is fairly long. > >> > >> > > > > Just in case you're unaware of it; the company I work for has an open > > source project called Ironclad. > > I was unaware indeed; thanks for pointing this out. > > IIUC, it's not just an API emulation, but also an ABI emulation. > > > In particular we have had to address the issue of the GIL and extensions > > (IronPython has no GIL) and reference counting (which IronPython also > > doesn't) use. > > I think this somewhat strengthens the point I was trying to make: An > alternate implementation that tries to be API compatible has to consider > so many things that it is questionable whether making Py_INCREF/DECREF > functions would be any simplification. > > So I just ask: > a) Would it help IronClad if it could restrict itself to PEP 384 > compatible modules? > b) Would further restrictions in the PEP help that cause? > > Regards, > Martin > > > -- > http://www.ironpythoninaction.com/ > http://www.voidspace.org.uk/blog > >

2 2

distutils.build_ext path comparison - python 2.5.2
by Sven Schrader 20 May '09

20 May '09

Hi, since our python installation is located on a symlink'ed directory, our variables "sys.exec_prefix" and "sys.executable" can have different paths. Therefore, the respective test in build_ext.py fails (line 202) and a wrong library directory is obtained. To fix this issue, I have attached a patch that uses "os.path.samefile" instead, to see whether two files are identical irrespective of its path. Greetings Sven Schrader ps: please CC answers to me, I'm not on the list :-) pps: I hope the attachment isn't inline...

3 2

Python on PowerPC?
by Chris Plasun 20 May '09

20 May '09

Hi, I'm to develop console apps on a Linux embedded PowerPC board (Freescale MPC8313). Is there a Python release for the PowerPC platform? Thanks, Chris Plasun

4 4

Documenting lnotab
by Jeffrey Yasskin 20 May '09

20 May '09

Hi all. I've got a patch to add some documentation for lnotab and its use in tracing at http://bugs.python.org/issue6042. I think it's correct, but it's complicated so I'm looking for someone who was around when it was designed to check. I'm also proposing a change to the semantics of PyCode_CheckLineNumber and want to know whether I should consider it public. Thanks to anyone who takes a look! Jeffrey

1 0

IronPython specific code in inspect module
by Michael Foord 20 May '09

20 May '09

Hello all, The inspect module (inspect.get_argspec etc) work fine for Python functions and classes in IronPython, but they don't work on .NET types which don't have the Python function attributes like im_func etc. I have IronPython specific versions of several of these functions which use .NET reflection and inspect could fallback to if sys.platform == 'cli'. Would it be ok for me to add these to the inspect module? Obviously the tests would only run on IronPython... The behaviour for CPython would be unaffected. All the best, Michael Foord -- http://www.ironpythoninaction.com/ http://www.voidspace.org.uk/blog

8 9

Re: [Python-Dev] PEP 376 : Changing the .egg-info structure
by P.J. Eby 19 May '09

19 May '09

At 06:06 PM 5/16/2009 +0200, Tarek Ziadé wrote: >Ok I've changed the PEP with all the points you mentioned, if you want >to take a look. Some notes: 1. Why ';' separation, instead of tabs as in PEP 262? Aren't semicolons a valid character in filenames? 2. "if the installed file is located in a directory in site-packages" should refer not to site-packages but to the directory containing the .egg-info directory. 3. get_egg_info_file needs to be specified as using '/'-separated paths and converting to OS paths if appropriate. There's also the problem that the mode it opens the file in (binary or text) is unspecified. 4. There should probably be a way to iterate over the projects in a directory, since it's otherwise impossible for an installation tool to find out what project(s) "own" a file that conflicts with something being installed. Alternatively, reshaping the file API to allow querying by path as well as by project might work. 5. If any cache mechanisms are to be used by the API, the API *must* make it possible to bypass or explicitly manage that cache, as otherwise installation tools and tools that manipulate sys.path at runtime may end up using incorrect data. 6. get_files() doesn't document whether the yielded paths are absolute or relative, local or cross-platform, etc. >I need to find back your comments for this part, I must have missed >them. That's >the last part I didn't work out yet on the current PEP revision. Well, if you can't find them, the EggFormats doc explains how these file/dir structures are currently laid out by setuptools, easy_install, pip, etc., and the PEP should probably reference that. Technically, this PEP doesn't so much propose a change to the EggFormats standard, as simply add a RECORD file to it, and propose stdlib support for reading and writing it. So, the PEP really should reference (i.e. link to) the existing standard. The EggFormats doc in turn cites pkg_resources doc for lower-level format issues, such as name and version normalization, filename escaping, file parsing, etc. This PEP should also probably be framed as a replacement for PEP 262, proposing to extend the de-facto standard for an installation database with uninstall support, and blessing selected portions of the de facto standard as an official standard. (Since that's pretty much exactly what it is.)

9 17

LZW support in tarfile ?
by Tarek Ziadé 18 May '09

18 May '09

Hello, I want to remove the usage of the "tar" command in Distutils in favor or the "tarfile" module. But, there's an option in Distutils.make_archive to create a tarball using the "compress" [1] program rather than gzip or bzip2. Using tar -Z, it will pipe it to the compress program if present. This program implements the LZW algorithm [2]. The LZW used to be patented but this patent seem to be expired in every country now [3]. On Distutils side I can work things out so the tar archive created can be piped to an arbitraty compression program when it is not compressed using bzip2 or gzip; But I was wondering if we should we add a LZW support in tarinfo, besides gzip and bzip2 ? Although this compression standard doesn't seem very used these days, Regards Tarek [1] http://en.wikipedia.org/wiki/Compress [2] http://en.wikipedia.org/wiki/LZW [3] http://www.unisys.com/about__unisys/lzw -- Tarek Ziadé | http://ziade.org

5 5