Mailman 3 July 2013 - Distutils-SIG

PyPI CDN Updates For Greater Availability
by Donald Stufft 04 Jul '13

04 Jul '13

Several changes were just deployed to PyPI's CDN. The general theme behind the changes is making it so that PyPI appears as functional as possible through a failure of the server hosting it. This should increase the availability of PyPI and enable things such as installation and browsing the site to continue to work through a catastrophic host failure on the PSF infrastructure. The details of what changes are: - Anonymous users will find that /pypi* pages are now cached for a short amount of time (currently 60s). - Objects will be stored in the cache for some time past their expiration date. They will not be used except in two circumstances: - A request is taking longer than 15s to complete, a "stale" object will be returned to prevent a pile up from occurring. - The backend[1] has been deemed unhealthy, in which case stale objects will be served in order to allow some level of functionality until the backend has been restored. - In the advent of an unhealthy backend all requests will be forced to be anonymous, making them eligible for the stale objects that have been cached. - The /mirrors and /security pages will be cached for a week, allowing them to likely be available through a backend failure making it easy to locate mirrors[2] or report a security issue. - Miscellaneous changes to normalize various things so that a single item in the cache will be able to be used for more requests, making it more likely that any particular request will be served from the Cache. [1] Backend in this context means the server hosting PyPI itself, what the CDN itself connects too. [2] Using the mirrors is done so at your own risk. None of the tools currently verify the downloads and they are downloaded over HTTP. This makes it trivial for an attacker to execute arbitrary code on your machine via a MITM. ----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA

1 0

Re: [Distutils] "Python Packaging User Guide"
by Alex Burke 03 Jul '13

03 Jul '13

Hi Marcus, I would very much like to get involved and help with this effort - in fact I was looking to package up some of my own work recently and stumbled on The Hitchhiker’s Guide to Packaging but could tell some of the advice was out of date having followed the discussions for a while now. What I was thinking is it could be useful my documenting exactly what I'm having to do, things to remember etc and it'd help me learn things much more deeply on the way too. My only concern however would be where to go to find the right 'new world' answers. Aside from reading the PEPs etc, are there any other points of contact? Is it ok to ask such questions on this list? Thanks, Alex J Burke.

7 10

Weekly Download Counters Enabled
by Donald Stufft 03 Jul '13

03 Jul '13

Just a quick follow up to last weeks email the download counters for weekly numbers has now been enabled on PyPI. ----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA

1 0

Re: [Distutils] zc.recipe.egg skips script-generation
by Joe Steeve 03 Jul '13

03 Jul '13

On Thu, 2013-07-04 at 03:15 +0530, Joe Steeve wrote: > I have an ipython (0.13.1) installed in my system python's > site-packages. When I run buildout with the above, buildout simply > says "Installing ipython_part" and does not do anything else. If I > remove my system ipython (apt-get purge ipython), then buildout > installs a script locally. > > I tried creating a virtualenv, and bootstrapping with the virtualenv's > python. I have the same effect. Sorry, false alarm. Retried with a virtualenv after clearing out all the buildout directories. Works fine now. Thanks, Joe -- Joe Steeve HiPro IT Solutions Private Limited http://hipro.co.in/

1 0

zc.recipe.egg skips script-generation
by Joe Steeve 03 Jul '13

03 Jul '13

Hello all, If this is not the right place to talk about 'zc.recipe.egg', please be kind and point me to the right place :) I am trying to create a buildout to work with some eggs using ipython. I have a buildout.cfg like this: [buildout] develop = . parts = app ipython_part [app] recipe = zc.recipe.egg:scripts eggs = stool [ipython_part] recipe = zc.recipe.egg:scripts dependent-scripts = true eggs = ${app:eggs} ipython scripts = ipython I have an ipython (0.13.1) installed in my system python's site-packages. When I run buildout with the above, buildout simply says "Installing ipython_part" and does not do anything else. If I remove my system ipython (apt-get purge ipython), then buildout installs a script locally. I tried creating a virtualenv, and bootstrapping with the virtualenv's python. I have the same effect. How do I get an 'ipython' script with my desired eggs in its path? Regards, Joe -- Joe Steeve HiPro IT Solutions Private Limited http://hipro.co.in/

1 0

"python" option in buildout 2.1.1
by Joe Steeve 03 Jul '13

03 Jul '13

From the buildout 2.1.1 docs on pypi: python The name of a section containing information about the default Python interpreter. Recipes that need a installation typically have options to tell them which Python installation to use. By convention, if a section-specific option isn't used, the option is looked for in the buildout section. The option must point to a section with an executable option giving the path to a Python executable. By default, the buildout section defines the default Python as the Python used to run the buildout. Is the above still relevant? I am trying to build a custom python using zc.recipe.cmmi and use the interpreter in other parts, like in: http://goo.gl/ufWwT But, that simply does not work. Regards, Joe -- Joe Steeve HiPro IT Solutions Private Limited http://hipro.co.in/

2 2

$MACOSX_DEPLOYMENT_TARGET mismatch
by Alan 03 Jul '13

03 Jul '13

Hi there, I am trying to install readline and cx_Oracle on my Mac OSX 10.8.4. I've just installed python 2.7.3 standard in my $HOME dir and then I did: export PATH=$HOME/bin:$PATH ~/setuptools-0.7.7 python setup.py install --prefix=$HOME which worked. I tried to installed ipython 0.13.2 which seems to have worked but it fails to start because of readline. easy_install readline Searching for readline Reading https://pypi.python.org/simple/readline/ Best match: readline 6.2.4.1 Downloading https://pypi.python.org/packages/source/r/readline/readline-6.2.4.1.tar.gz#… Processing readline-6.2.4.1.tar.gz Writing /var/folders/0c/n_0by3qj74bg5m68fxrw2kw40000gp/T/easy_install-3WQA6K/readline-6.2.4.1/setup.cfg Running readline-6.2.4.1/setup.py -q bdist_egg --dist-dir /var/folders/0c/n_0by3qj74bg5m68fxrw2kw40000gp/T/easy_install-3WQA6K/readline-6.2.4.1/egg-dist-tmp-eyGcUE error: Setup script exited with error: $MACOSX_DEPLOYMENT_TARGET mismatch: now "10.3" but "10.4" during configure How can solve this problem please? Thanks in advance, Alan -- Alan Wilter SOUSA da SILVA, DSc Bioinformatician, UniProt - PANDA, EMBL-EBI CB10 1SD, Hinxton, Cambridge, UK +44 1223 49 4588

2 3

PyPI upload failed (302): Moved Temporarily
by W. Trevor King 03 Jul '13

03 Jul '13

Hello list! I'm having a bit of trouble getting a new package setup on PyPI. I've done this a few times in the past, but maybe not since the wiki hacking that inspired the HTTPS transition back in February. I did change my password back then, so I don't think that's the problem. Anyhow, with the old URL (still mentioned in the distutils docs [1]): http://www.python.org/pypi in my ~/.pypirc, I get: $ python setup.py register -r pypi running register running check Registering pycalendar to http://www.python.org/pypi Server response (403): You are not allowed to store 'pycalendar' package information With https://pypi.python.org/ in my ~/.pypirc, I get: $ python setup.py register -r pypi running register running check Registering pycalendar to https://pypi.python.org/ Server response (200): OK Ok, how about uploading a tarball? With the https:// URL: $ python setup.py sdist upload -r pypi … running upload Submitting dist/pycalendar-0.1.tar.gz to https://pypi.python.org/ Upload failed (302): Moved Temporarily With the http:// URL: $ python setup.py sdist upload -r pypi … running upload Submitting dist/pycalendar-0.1.tar.gz to http://www.python.org/pypi Upload failed (403): You are not allowed to edit 'pycalendar' package information What am I doing wrong? Thanks, Trevor [1]: http://docs.python.org/3/distutils/packageindex.html#the-pypirc-file -- This email may be signed or encrypted with GnuPG (http://www.gnupg.org). For more information, see http://en.wikipedia.org/wiki/Pretty_Good_Privacy

2 1

Finding modules in an egg / distribution
by Iwan Vosloo 02 Jul '13

02 Jul '13

Hi there, We have been struggling to find a nice way to list all the modules (or packages) that are part of a particular Distribution (or egg). Nice should also mean that it works when the egg is installed. We have a need to do some introspection on the code shipped as an egg. Any ideas? Regards - Iwan

3 4

PyPI mirrors
by David King 02 Jul '13

02 Jul '13

Hi all, Has the relationship between PyPI mirrors changed since PyPI has started being served behind a CDN? I know people have been recommending against using "--use-mirrors" with pip since it doesn't take advantage of the CDN. I've been considering trying to get a public PyPI mirror setup and wanted to know how/if they're still being used. Thanks, Dave,

3 2