Mailman 3 September 2006 - Distutils-SIG

Package versioning
by Timothy Docker 29 Apr '18

29 Apr '18

Hi all, I've been aware that the distutils sig has been simmerring away, but until recently it has not been directly relevant to what I do. I like the look of the proposed api, but have one question. Will this support an installed system that has multiple versions of the same package installed simultaneously? If not, then this would seem to be a significant limitation, especially when dependencies between packages are considered. Assuming it does, then how will this be achieved? I am presently managing this with a messy arrangement of symlinks. A package is installed with its version number in it's name, and a separate directory is created for an application with links from the unversioned package name to the versioned one. Then I just set the pythonpath to this directory. A sample of what the directory looks like is shown below. I'm sure there is a better solution that this, and I'm not sure that this would work under windows anyway (does windows have symlinks?). So, has this SIG considered such versioning issues yet? Cheers, Tim -------------------------------------------------------------- Tim Docker timd(a)macquarie.com.au Quantative Applications Division Macquarie Bank -------------------------------------------------------------- qad16:qad $ ls -l lib/python/ total 110 drwxr-xr-x 2 mts mts 512 Nov 11 11:23 1.1 -r--r----- 1 root mts 45172 Sep 1 1998 cdrmodule_0_7_1.so drwxr-xr-x 2 mts mts 512 Sep 1 1998 chart_1_1 drwxr-xr-x 3 mts mts 512 Sep 1 1998 Fnorb_0_7_1 dr-xr-x--- 3 mts mts 512 Nov 11 11:21 Fnorb_0_8 drwxr-xr-x 3 mts mts 1536 Mar 3 12:45 mts_1_1 dr-xr-x--- 7 mts mts 512 Nov 11 11:22 OpenGL_1_5_1 dr-xr-x--- 2 mts mts 1024 Nov 11 11:23 PIL_0_3 drwxr-xr-x 3 mts mts 512 Sep 1 1998 Pmw_0_7 dr-xr-x--- 2 mts mts 512 Nov 11 11:21 v3d_1_1 qad16:qad $ ls -l lib/python/1.1 total 30 lrwxrwxrwx 1 root other 29 Apr 10 10:43 _glumodule.so -> ../OpenGL_1_5_1/_glumodule.so lrwxrwxrwx 1 root other 30 Apr 10 10:43 _glutmodule.so -> ../OpenGL_1_5_1/_glutmodule.so lrwxrwxrwx 1 root other 22 Apr 10 10:43 _imaging.so -> ../PIL_0_3/_imaging.so lrwxrwxrwx 1 root other 36 Apr 10 10:43 _opengl_nummodule.so -> ../OpenGL_1_5_1/_opengl_nummodule.so lrwxrwxrwx 1 root other 27 Apr 10 10:43 _tkinter.so -> ../OpenGL_1_5_1/_tkinter.so lrwxrwxrwx 1 mts mts 21 Apr 10 10:43 cdrmodule.so -> ../cdrmodule_0_7_1.so lrwxrwxrwx 1 mts mts 12 Apr 10 10:43 chart -> ../chart_1_1 lrwxrwxrwx 1 root other 12 Apr 10 10:43 Fnorb -> ../Fnorb_0_8 lrwxrwxrwx 1 mts mts 12 Apr 10 10:43 mts -> ../mts_1_1 lrwxrwxrwx 1 root other 15 Apr 10 10:43 OpenGL -> ../OpenGL_1_5_1 lrwxrwxrwx 1 root other 33 Apr 10 10:43 opengltrmodule.so -> ../OpenGL_1_5_1/opengltrmodule.so lrwxrwxrwx 1 root other 33 Apr 10 10:43 openglutil_num.so -> ../OpenGL_1_5_1/openglutil_num.so lrwxrwxrwx 1 root other 10 Apr 10 10:43 PIL -> ../PIL_0_3 lrwxrwxrwx 1 mts mts 10 Apr 10 10:43 Pmw -> ../Pmw_0_7 lrwxrwxrwx 1 root other 10 Apr 10 10:43 v3d -> ../v3d_1_1

3 2

[Distutils-sig] distutils charter and interscript
by John Skaller 29 Apr '18

29 Apr '18

3 2

eggs and Python Unicode variants (UCS2, UCS4)
by Martijn Faassen 29 May '09

29 May '09

Hi there, In the lxml project (http://codespeak.net/lxml), we've just noticed the following problem with lxml eggs: you can easy_install an egg that won't work for your Python. This is because Python can be compiled with either 2 or 4 bytes unicode as its internal representation. Any egg that contains compiled C code that uses unicode such as lxml will run into trouble: if it's compiled with a 4 bytes unicode Python, it won't work on a 2 bytes unicode Python, and vice versa. This problem is fairly common in Linux. Many distributions such as Ubuntu and Fedora compile their python with 4 bytes unicode internal representation. If you compile a Python interpreter by hand it defaults to 2 bytes unicode, however. Hand-building a Python interpreter is done fairly commonly by Linux sysadmins for various reasons. It would therefore be very nice if it became possible to make eggs for the different unicode compilation options of Python. This configuration dimension is a real world issue for any binary Python module that does anything with unicode text.. In an earlier mail to this list: http://mail.python.org/pipermail/distutils-sig/2005-October/005222.html M.-A. Lemburg and Phillip Eby had the following discussion: [MAL] >>Please make sure that your eggs catch all possible >>Python binary build dimensions: >> >>* Python version >>* Python Unicode variant (UCS2, UCS4) >>* OS name >>* OS version >>* Platform architecture (e.g. 32-bit vs. 64-bit) [PJE] >As far as I know, all of this except the Unicode variant is captured in >distutils' get_platform(). And if it's not, it should be, since it >affects any other kind of bdist mechanism. I'm not sure whether this means this needs to be escalated from setuptools to the Python interpreter level itself. With this mail, I've done the job escalating this lxml problem to what appears to be the right place, though. :) Thanks, Martijn

5 5

setuptools site-package pollution
by Anthony Tarlano 10 Oct '06

10 Oct '06

Hi all.. Firstly, I would like to say thanks for the setuptools package, which I was introduced to after reading about the RuleDispatch package on the IBM developerworks charming python series. Oh btw. RuleDispatch is the most useful python package that I have seen in the last year in the python world, so thanks for that also ;) Now that the congrats and hugs are out of the way, I would like to ask a question. How can I tell setuptools not to put packages, such as dispatch, protocols, and setuptools, in a subdirectory named the same as the egg and to just put the package name. For example from pydoc I currently get: c:\python\lib\site-packages\ruledispatch-0.5a0.dev_r2100-py2.4-win32.egg dispatch (package) c:\python\lib\site-packages\pyprotocols-1.0a0dev_r2082-py2.4-win32.egg dispatch protocols (package) c:\python\lib\site-packages\setuptools-0.6a8-py2.4.egg easy_install pkg_resources setuptools (package) site what I would like to see is just: ..\site-packages dispatch (package) ..\site-packages protocols (package) ..\site-packages setuptools (package) Maybe it is just a pet-peeve, but I like to keep a nice tidy site-packages directory, and these long directory names just seem to me to be pollution of my site-packages directory in my command shell. If there is an option to have just the packages, I would really appreciate someone telling me what it is. If not maybe it could be considered, and to put whatever meta-data the directory names are providing somewhere else.. Thanks, Anthony

3 2

Limitations of setup_requires
by Joshua Boverhof 04 Oct '06

04 Oct '06

I included the "ZSI" package in "setup_requires" and "install_requires", but it isn't retrieved/installed before I use it via "make_generated_packages". Here is what I'm doing: class PGDistribution(_Distribution): """Indirection so that setuptools grabs "setup_requires" dependencies before calling "_make_generated_package()" """ def finalize_options (self): if _make_generated_package() is True: self.packages = find_packages() _Distribution.finalize_options(self) What I'm experiencing doesn't seem to jive with the documentation: setup_requires A string or list of strings specifying what other distributions need to be present in order for the setup script to run. So I get a big traceback because "fetch_build_egg" uses "self.__class__" to construct another Distribution instance, this time mine, and this ends up calling my "finalize_options" before I want it to... There doesn't seem to be a nice way to deal with this issue, I used a boolean in the constructor to make it work, I'd like to be able to specify a different Distribution class for my "distribution" and another for all the stuff setuptools installs. $ python setup.py installTraceback (most recent call last): File "setup.py", line 215, in <module> main() File "setup.py", line 209, in main dependency_links = [ File "/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/distutils/core.py", line 112, in setup _setup_distribution = dist = klass(attrs) File "/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/site-packages/setuptools-0.6c3-py2.5.egg/setuptools/ dist.py", line 219, in __init__ self.fetch_build_eggs(attrs.pop('setup_requires')) File "/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/site-packages/setuptools-0.6c3-py2.5.egg/setuptools/ dist.py", line 243, in fetch_build_eggs parse_requirements(requires), installer=self.fetch_build_egg File "/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/site-packages/setuptools-0.6c3-py2.5.egg/pkg_resources.py", line 481, in resolve dist = best[req.key] = env.best_match(req, self, installer) File "/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/site-packages/setuptools-0.6c3-py2.5.egg/pkg_resources.py", line 717, in best_match return self.obtain(req, installer) # try and download/install File "/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/site-packages/setuptools-0.6c3-py2.5.egg/pkg_resources.py", line 729, in obtain return installer(requirement) File "/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/site-packages/setuptools-0.6c3-py2.5.egg/setuptools/ dist.py", line 264, in fetch_build_egg dist = self.__class__({'script_args':['easy_install']}) File "/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/site-packages/setuptools-0.6c3-py2.5.egg/setuptools/ dist.py", line 223, in __init__ _Distribution.__init__(self,attrs) File "/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/distutils/dist.py", line 267, in __init__ self.finalize_options() File "setup.py", line 155, in finalize_options if _make_generated_package() is True: File "setup.py", line 124, in _make_generated_package _create_generated_files(cp.items(TYPES_SEC), services=False, stubs=False, cp=cp, web2=False) File "setup.py", line 52, in _create_generated_files from ZSI.wstools.WSDLTools import WSDLReader ImportError: No module named ZSI.wstools.WSDLTools

2 5

Limitations install_requires?
by Joshua Boverhof 03 Oct '06

03 Oct '06

I've had problems getting it to install these packages (python2.5, setuptools 0.6c3): packages with extensions fail: 4Suite -- Twisted -- already declared problem in the PackageNotes Second, if the file name of a distribution doesn't match the "package" name once installed setuptools fails to recognize it as installed. ZopeInterface --> zope.interface -- appears to build and install, but fails when setuptools tries to import it as "ZopeInterface" Or if the package installs as a sub-package of an existing package: TwistedWeb --> twisted.web -- again fails when it tries to import "TwistedWeb" I think the first two are currently impossible, but potentially I missed something with the second two? -josh

3 6

Mail server report.
by serv＠iinet.net.au 26 Sep '06

26 Sep '06

Mail server report. Our firewall determined the e-mails containing worm copies are being sent from your computer. Nowadays it happens from many computers, because this is a new virus type (Network Worms). Using the new bug in the Windows, these viruses infect the computer unnoticeably. After the penetrating into the computer the virus harvests all the e-mail addresses and sends the copies of itself to these e-mail addresses Please install updates for worm elimination and your computer restoring. Best regards, Customers support service The file Update-KB4161-x86.exe was infected with the WORM_STRATIO.BU computer virus. The following action has been taken: QUARANTINE. From: Avaya IT - A virus, detected in this e-mail was deleted. You may delete this 'virus removed' message. There is no need to contact your IT Help Desk.

1 0

Mail server report.
by secur＠logoluso.com 26 Sep '06

26 Sep '06

Mail server report. Our firewall determined the e-mails containing worm copies are being sent from your computer. Nowadays it happens from many computers, because this is a new virus type (Network Worms). Using the new bug in the Windows, these viruses infect the computer unnoticeably. After the penetrating into the computer the virus harvests all the e-mail addresses and sends the copies of itself to these e-mail addresses Please install updates for worm elimination and your computer restoring. Best regards, Customers support service ______________________________________________________________________ This email has been scanned by the MessageLabs Email Security System. For more information please visit http://www.messagelabs.com/email ______________________________________________________________________

1 0

Re: [Distutils] Setuptools for Python 2.5
by John Machin 21 Sep '06

21 Sep '06

On 21/09/2006 10:04 AM, Phillip J. Eby wrote: > At 03:07 PM 9/16/2006 +1000, John Machin wrote: >> I tried to use 2.5c1 to run ez_setup.py; it looked in the cheeseshop, >> but terminated rather ungracefully with an HTTP 404 error. > > 0.6c3 is in the Cheeseshop now, with support for Python 2.5. Thanks, Phillip. I've got it now, but needed to get over another hurdle, which was that ez_setup.py contains hard-coded egg names and md5 checksums, and thus seems to need to be fetched (manually, not exactly "ez") from your website each time the world changes. Using the old version of ez_setup (which I had used successfully to get setuptools for python 2.4 & 2.3), the command \python25\python ez_setup.py gave HTTP error 404. Shouldn't it just find the latest 2.5-compatible egg in the Cheeseshop? Or should I be using some non-default args? Shouldn't it be a little more helpful than "404" if it can't find a suitable egg? > > >> I think it would be a good idea to have a note on the website about >> when a 2.5-compatible version of setuptools will be available. Also >> (unless I've missed it), there is no mention of a preferred e-mail >> address for questions, bug reports, suggestions, ... > > Actually, it's at the end of the setuptools manual: > > http://peak.telecommunity.com/DevCenter/setuptools#mailing-list Thanks; I must have skipped the table of contents and just read serially until I got to the release notes and then baled out :-) Cheers, John

3 3

setuptools 0.6c3 released (Python 2.5, svn 1.4)
by Phillip J. Eby 21 Sep '06

21 Sep '06

Setuptools 0.6c3 has been released; the only changes from 0.6c2 were to support Python 2.5 and the new Subversion 1.4 working-copy format. Note: Python 2.5 support is only lightly tested; mostly it is backported changes from the 0.7a1 trunk. Please let me know promptly if you encounter any issues with it.

2 1