Hi, I ran into an error about a month ago caused by a change in the PyPi version of distribute. Thankfully, someone was able to roll back the change. Unfortunately, I'm getting a similar kind of problem now -- and I notice that 0.7.3 was released on 5 July, so... I'm wondering if it might be related. This is being included in a Chef recipe. I'm attaching the pip.log, which shows it uninstalling distribute (which looks like version 0.6.49), and then failing to find it and attempting to install 0.7.3, and subsequent package installs failing. Anyway, I'm not quite sure what to do here! How can I fix this problem? (And also, how can I prevent it from happening in the future by pegging the version to something that works?) The pip recipe includes the following comments, which may be relevant.
# Ubuntu's python-setuptools, python-pip and py thon-virtualenv packages # are broken...this feels like Rubygems! # http://stackoverflow.com/questions/4324558/whats-the-proper-way-to-install-p... # https://bitbucket.org/ianb/pip/issue/104/pip-uninstall-on-ubuntu-linux remote_file "#{Chef::Config[:file_cache_path]}/distribute_setup.py" do source node['python']['distribute_script_url'] mode "0644" not_if { ::File.exists?(pip_binary) } end execute "install-pip" do cwd Chef::Config[:file_cache_path] command <<-EOF #{node['python']['binary']} distribute_setup.py --download-base=#{node['python']['distribute_option']['download_base']} #{::File.dirname(pip_binary)}/easy_install pip EOF not_if { ::File.exists?(pip_binary) } end
Chef run log:
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Recipe: python::virtualenv ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com * python_pip[virtualenv] action install ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com - install package python_pip[virtualenv] version latest ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Recipe: supervisor::default ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com * python_pip[supervisor] action upgrade ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ================================================================================ ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Error executing action `upgrade` on resource 'python_pip[supervisor]' ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ================================================================================ ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Mixlib::ShellOut::ShellCommandFailed ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ------------------------------------ ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Expected process to exit with [0], but received '1' ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---- Begin output of pip install --upgrade supervisor ---- ec2-54-245-36-62.us-west-2.compute.amazonaws.com STDOUT: Downloading/unpacking supervisor ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py egg_info for package supervisor ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking distribute from https://pypi.python.org/packages/source/d/distribute/distribute-0.7.3.zip#md... (from supervisor) ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py egg_info for package distribute ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking meld3>=0.6.5 (from supervisor) ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py egg_info for package meld3 ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking setuptools>=0.7 (from distribute->supervisor) ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py egg_info for package setuptools ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing collected packages: supervisor, distribute, meld3, setuptools ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py install for supervisor ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Skipping installation of /usr/local/lib/python2.7/dist-packages/supervisor/__init__.py (namespace package) ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing /usr/local/lib/python2.7/dist-packages/supervisor-3.0b2-py2.7-nspkg.pth ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing echo_supervisord_conf script to /usr/local/bin ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing pidproxy script to /usr/local/bin ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing supervisorctl script to /usr/local/bin ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing supervisord script to /usr/local/bin ec2-54-245-36-62.us-west-2.compute.amazonaws.com Found existing installation: distribute 0.6.49 ec2-54-245-36-62.us-west-2.compute.amazonaws.com Uninstalling distribute: ec2-54-245-36-62.us-west-2.compute.amazonaws.com Successfully uninstalled distribute ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py install for distribute ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py install for meld3 ec2-54-245-36-62.us-west-2.compute.amazonaws.com Traceback (most recent call last): ec2-54-245-36-62.us-west-2.compute.amazonaws.com File "<string>", line 1, in <module> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ImportError: No module named setuptools ec2-54-245-36-62.us-west-2.compute.amazonaws.com Complete output from command /usr/bin/python -c "import setuptools;__file__='/tmp/pip-build-root/meld3/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-mDCOBa-record/install-record.txt --single-version-externally-managed: ec2-54-245-36-62.us-west-2.compute.amazonaws.com Traceback (most recent call last): ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com File "<string>", line 1, in <module> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ImportError: No module named setuptools ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---------------------------------------- ec2-54-245-36-62.us-west-2.compute.amazonaws.com Command /usr/bin/python -c "import setuptools;__file__='/tmp/pip-build ec2-54-245-36-62.us-west-2.compute.amazonaws.com -root/meld3/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-mDCOBa-record/install-record.txt --single-version-externally-managed failed with error code 1 in /tmp/pip-build-root/meld3 ec2-54-245-36-62.us-west-2.compute.amazonaws.com Storing complete log in /home/ubuntu/.pip/pip.log ec2-54-245-36-62.us-west-2.compute.amazonaws.com STDERR: ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---- End output of pip install --upgrade supervisor ---- ec2-54-245-36-62.us-west-2.compute.amazonaws.com Ran pip install --upgrade supervisor returned 1 ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Cookbook Trace: ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com --------------- ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com /var/chef/cache/cookbooks/python/providers/pip.rb:155:in `pip_cmd' ec2-54-245-36-62.us-west-2.compute.amazonaws.com /var/chef/cache/cookbooks/python/providers/pip.rb:139:in `install_package' ec2-54-245-36-62.us-west-2.compute.amazonaws.com /var/chef/cache/cookbooks/python/providers/pip.rb:144:in `upgrade_package' ec2-54-245-36-62.us-west-2.compute.amazonaws.com /var/chef/cache/cookbooks/python/providers/pip.rb:60:in `block (2 levels) in class_from_file' ec2-54-245-36-62.us-west-2.compute.amazonaws.com /var/chef/cache/cookbooks/python/providers/pip.rb:58:in `block in class_from_file' ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Resource Declaration: ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com --------------------- ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com # In /var/chef/cache/cookbooks/supervisor/recipes/default.rb ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com 29: python_pip "supervisor" do ec2-54-245-36-62.us-west-2.compute.amazonaws.com 30: action :upgrade ec2-54-245-36-62.us-west-2.compute.amazonaws.com 31: version node['supervisor']['version'] if node['supervisor']['version'] ec2-54-245-36-62.us-west-2.compute.amazonaws.com 32: end ec2-54-245-36-62.us-west-2.compute.amazonaws.com 33: ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Compiled Resource: ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ------------------ ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com # Declared in /var/chef/cache/cookbooks/supervisor/recipes/default.rb:29:in `from_file' ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com python_pip("supervisor") do ec2-54-245-36-62.us-west-2.compute.amazonaws.com action [:upgrade] ec2-54-245-36-62.us-west-2.compute.amazonaws.com retries 0 ec2-54-245-36-62.us-west-2.compute.amazonaws.com retry_delay 2 ec2-54-245-36-62.us-west-2.compute.amazonaws.com cookbook_name "supervisor" ec2-54-245-36-62.us-west-2.compute.amazonaws.com recipe_name "default" ec2-54-245-36-62.us-west-2.compute.amazonaws.com package_name "supervisor" ec2-54-245-36-62.us-west-2.compute.amazonaws.com timeout 900 ec2-54-245-36-62.us-west-2.compute.amazonaws.com options " --upgrade" ec2-54-245-36-62.us-west-2.compute.amazonaws.com end ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Recipe: ntp::default ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com * service[ntp] action restart ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com - restart service service[ntp] ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Recipe: rabbitmq::default ec2-54-245-36-62.us-west-2.compute.amazonaws.com * service[rabbitmq-server] action restart ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com - restart service service[rabbitmq-server] ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com [2013-07-16T02:36:50+00:00] ERROR: Running exception handlers ec2-54-245-36-62.us-west-2.compute.amazonaws.com [2013-07-16T02:36:51+00:00] FATAL: Saving node information to /var/chef/cache/failed-run-data.json ec2-54-245-36-62.us-west-2.compute.amazonaws.com [2013-07-16T02:36:51+00:00] ERROR: Exception handlers complete ec2-54-245-36-62.us-west-2.compute.amazonaws.com Chef Client failed. 35 resources updated ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com [2013-07-16T02:36:51+00:00] FATAL: Stacktrace dumped to /var/chef/cache/chef-stacktrace.out ec2-54-245-36-62.us-west-2.compute.amazonaws.com [2013-07-16T02:36:51+00:00] FATAL: Mixlib::ShellOut::ShellCommandFailed: python_pip[supervisor] (supervisor::default line 29) had an error: Mixlib::ShellOut::ShellCommandFailed: Expected process to exit with [0], but received '1' ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---- Begin output of pip install --upgrade supervisor ---- ec2-54-245-36-62.us-west-2.compute.amazonaws.com STDOUT: Downloading/unpacking supervisor ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py egg_info for package supervisor ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking distribute from https://pypi.python.org/packages/source/d/distribute/distribute-0.7.3.zip#md... (from supervisor) ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py egg_info for package distribute ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking meld3>=0.6.5 (from supervisor) ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py egg_info for package meld3 ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking setuptools>=0.7 (from distribute->supervisor) ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py egg_info for package setuptools ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing collected packages: supervisor, distribute, meld3, setuptools ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py install for supervisor ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Skipping installation of /usr/local/lib/python2.7/dist-packages/supervisor/__init__.py (namespace package) ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing /usr/local/lib/python2.7/dist-packages/supervisor-3.0b2-py2.7-nspkg.pth ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing echo_supervisord_conf script to /usr/local/bin ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing pidproxy script to /usr/local/bin ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing supervisorctl script to /usr/local/bin ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing supervisord script to /usr/local/bin ec2-54-245-36-62.us-west-2.compute.amazonaws.com Found existing installation: distribute 0.6.49 ec2-54-245-36-62.us-west-2.compute.amazonaws.com Uninstalling distribute: ec2-54-245-36-62.us-west-2.compute.amazonaws.com Successfully uninstalled distribute ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py install for distribute ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com Running setup.py install for meld3 ec2-54-245-36-62.us-west-2.compute.amazonaws.com Traceback (most recent call last): ec2-54-245-36-62.us-west-2.compute.amazonaws.com File "<string>", line 1, in <module> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ImportError: No module named setuptools ec2-54-245-36-62.us-west-2.compute.amazonaws.com Complete output from command /usr/bin/python -c "import setuptools;__file__='/tmp/pip-build-root/meld3/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-mDCOBa-record/install-record.txt --single-version-externally-managed: ec2-54-245-36-62.us-west-2.compute.amazonaws.com Traceback (most recent call last): ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com File "<strin ec2-54-245-36-62.us-west-2.compute.amazonaws.com g>", line 1, in <module> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ImportError: No module named setuptools ec2-54-245-36-62.us-west-2.compute.amazonaws.com ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---------------------------------------- ec2-54-245-36-62.us-west-2.compute.amazonaws.com Command /usr/bin/python -c "import setuptools;__file__='/tmp/pip-build-root/meld3/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-mDCOBa-record/install-record.txt --single-version-externally-managed failed with error code 1 in /tmp/pip-build-root/meld3 ec2-54-245-36-62.us-west-2.compute.amazonaws.com Storing complete log in /home/ubuntu/.pip/pip.log ec2-54-245-36-62.us-west-2.compute.amazonaws.com STDERR: ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---- End output of pip install --upgrade supervisor ---- ec2-54-245-36-62.us-west-2.compute.amazonaws.com Ran pip install --upgrade supervisor returned 1
-- Liam Kirsher PGP: http://liam.numenet.com/pgp/