Hi,

I ran into an error about a month ago caused by a change in the PyPi version of distribute. Thankfully, someone was able to roll back the change. Unfortunately, I'm getting a similar kind of problem now -- and I notice that 0.7.3 was released on 5 July, so... I'm wondering if it might be related. This is being included in a Chef recipe.

I'm attaching the pip.log, which shows it uninstalling distribute (which looks like version 0.6.49), and then failing to find it and attempting to install 0.7.3, and subsequent package installs failing.

Anyway, I'm not quite sure what to do here! How can I fix this problem? (And also, how can I prevent it from happening in the future by pegging the version to something that works?)

The pip recipe includes the following comments, which may be relevant.

# Ubuntu's python-setuptools, python-p
 ip and py

thon-virtualenv packages
# are broken...this feels like Rubygems!
# http://stackoverflow.com/questions/4324558/whats-the-proper-way-to-install-pip-virtualenv-and-distribute-for-python
# https://bitbucket.org/ianb/pip/issue/104/pip-uninstall-on-ubuntu-linux
remote_file "#{Chef::Config[:file_cache_path]}/distribute_setup.py" do
  source node['python']['distribute_script_url']
  mode "0644"
  not_if { ::File.exists?(pip_binary) }
end

execute "install-pip" do
  cwd Chef::Config[:file_cache_path]
  command <<-EOF
  #{node['python']['binary']} distribute_setup.py --download-base=#{node['python']['distribute_option']['download_base']}
  #{::File.dirname(pip_binary)}/easy_install pip
  EOF
  not_if { ::File.exists?(pip_binary) }
end

Chef run log:

ec2-54-245-36-62.us-west-2.compute.amazonaws.com Recipe: python::virtualenv
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   * python_pip[virtualenv] action install
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     - install package python_pip[virtualenv] version latest
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Recipe: supervisor::default
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   * python_pip[supervisor] action upgrade
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ================================================================================
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Error executing action `upgrade` on resource 'python_pip[supervisor]'
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ================================================================================
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Mixlib::ShellOut::ShellCommandFailed
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ------------------------------------
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Expected process to exit with [0], but received '1'
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---- Begin output of pip install --upgrade supervisor ----
ec2-54-245-36-62.us-west-2.compute.amazonaws.com STDOUT: Downloading/unpacking supervisor
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py egg_info for package supervisor
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking distribute from https://pypi.python.org/packages/source/d/distribute/distribute-0.7.3.zip#md5=c6c59594a7b180af57af8a0cc0cf5b4a (from supervisor)
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py egg_info for package distribute
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking meld3>=0.6.5 (from supervisor)
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py egg_info for package meld3
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking setuptools>=0.7 (from distribute->supervisor)
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py egg_info for package setuptools
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing collected packages: supervisor, distribute, meld3, setuptools
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py install for supervisor
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Skipping installation of /usr/local/lib/python2.7/dist-packages/supervisor/__init__.py (namespace package)
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing /usr/local/lib/python2.7/dist-packages/supervisor-3.0b2-py2.7-nspkg.pth
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing echo_supervisord_conf script to /usr/local/bin
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing pidproxy script to /usr/local/bin
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing supervisorctl script to /usr/local/bin
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing supervisord script to /usr/local/bin
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Found existing installation: distribute 0.6.49
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Uninstalling distribute:
ec2-54-245-36-62.us-west-2.compute.amazonaws.com       Successfully uninstalled distribute
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py install for distribute
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py install for meld3
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Traceback (most recent call last):
ec2-54-245-36-62.us-west-2.compute.amazonaws.com       File "<string>", line 1, in <module>
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     ImportError: No module named setuptools
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Complete output from command /usr/bin/python -c "import setuptools;__file__='/tmp/pip-build-root/meld3/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-mDCOBa-record/install-record.txt --single-version-externally-managed:
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Traceback (most recent call last):
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   File "<string>", line 1, in <module>
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ImportError: No module named setuptools
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ----------------------------------------
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Command /usr/bin/python -c "import setuptools;__file__='/tmp/pip-build
ec2-54-245-36-62.us-west-2.compute.amazonaws.com -root/meld3/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-mDCOBa-record/install-record.txt --single-version-externally-managed failed with error code 1 in /tmp/pip-build-root/meld3
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Storing complete log in /home/ubuntu/.pip/pip.log
ec2-54-245-36-62.us-west-2.compute.amazonaws.com STDERR:
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---- End output of pip install --upgrade supervisor ----
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Ran pip install --upgrade supervisor returned 1
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Cookbook Trace:
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---------------
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com /var/chef/cache/cookbooks/python/providers/pip.rb:155:in `pip_cmd'
ec2-54-245-36-62.us-west-2.compute.amazonaws.com /var/chef/cache/cookbooks/python/providers/pip.rb:139:in `install_package'
ec2-54-245-36-62.us-west-2.compute.amazonaws.com /var/chef/cache/cookbooks/python/providers/pip.rb:144:in `upgrade_package'
ec2-54-245-36-62.us-west-2.compute.amazonaws.com /var/chef/cache/cookbooks/python/providers/pip.rb:60:in `block (2 levels) in class_from_file'
ec2-54-245-36-62.us-west-2.compute.amazonaws.com /var/chef/cache/cookbooks/python/providers/pip.rb:58:in `block in class_from_file'
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Resource Declaration:
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---------------------
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com # In /var/chef/cache/cookbooks/supervisor/recipes/default.rb
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com 29: python_pip "supervisor" do
ec2-54-245-36-62.us-west-2.compute.amazonaws.com 30:   action :upgrade
ec2-54-245-36-62.us-west-2.compute.amazonaws.com 31:   version node['supervisor']['version'] if node['supervisor']['version']
ec2-54-245-36-62.us-west-2.compute.amazonaws.com 32: end
ec2-54-245-36-62.us-west-2.compute.amazonaws.com 33:
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Compiled Resource:
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ------------------
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com # Declared in /var/chef/cache/cookbooks/supervisor/recipes/default.rb:29:in `from_file'
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com python_pip("supervisor") do
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   action [:upgrade]
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   retries 0
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   retry_delay 2
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   cookbook_name "supervisor"
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   recipe_name "default"
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   package_name "supervisor"
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   timeout 900
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   options " --upgrade"
ec2-54-245-36-62.us-west-2.compute.amazonaws.com end
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Recipe: ntp::default
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   * service[ntp] action restart
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     - restart service service[ntp]
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Recipe: rabbitmq::default
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   * service[rabbitmq-server] action restart
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     - restart service service[rabbitmq-server]
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com [2013-07-16T02:36:50+00:00] ERROR: Running exception handlers
ec2-54-245-36-62.us-west-2.compute.amazonaws.com [2013-07-16T02:36:51+00:00] FATAL: Saving node information to /var/chef/cache/failed-run-data.json
ec2-54-245-36-62.us-west-2.compute.amazonaws.com [2013-07-16T02:36:51+00:00] ERROR: Exception handlers complete
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Chef Client failed. 35 resources updated
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com [2013-07-16T02:36:51+00:00] FATAL: Stacktrace dumped to /var/chef/cache/chef-stacktrace.out
ec2-54-245-36-62.us-west-2.compute.amazonaws.com [2013-07-16T02:36:51+00:00] FATAL: Mixlib::ShellOut::ShellCommandFailed: python_pip[supervisor] (supervisor::default line 29) had an error: Mixlib::ShellOut::ShellCommandFailed: Expected process to exit with [0], but received '1'
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---- Begin output of pip install --upgrade supervisor ----
ec2-54-245-36-62.us-west-2.compute.amazonaws.com STDOUT: Downloading/unpacking supervisor
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py egg_info for package supervisor
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking distribute from https://pypi.python.org/packages/source/d/distribute/distribute-0.7.3.zip#md5=c6c59594a7b180af57af8a0cc0cf5b4a (from supervisor)
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py egg_info for package distribute
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking meld3>=0.6.5 (from supervisor)
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py egg_info for package meld3
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking setuptools>=0.7 (from distribute->supervisor)
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py egg_info for package setuptools
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing collected packages: supervisor, distribute, meld3, setuptools
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py install for supervisor
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Skipping installation of /usr/local/lib/python2.7/dist-packages/supervisor/__init__.py (namespace package)
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing /usr/local/lib/python2.7/dist-packages/supervisor-3.0b2-py2.7-nspkg.pth
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing echo_supervisord_conf script to /usr/local/bin
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing pidproxy script to /usr/local/bin
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing supervisorctl script to /usr/local/bin
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing supervisord script to /usr/local/bin
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Found existing installation: distribute 0.6.49
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Uninstalling distribute:
ec2-54-245-36-62.us-west-2.compute.amazonaws.com       Successfully uninstalled distribute
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py install for distribute
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py install for meld3
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Traceback (most recent call last):
ec2-54-245-36-62.us-west-2.compute.amazonaws.com       File "<string>", line 1, in <module>
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     ImportError: No module named setuptools
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Complete output from command /usr/bin/python -c "import setuptools;__file__='/tmp/pip-build-root/meld3/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-mDCOBa-record/install-record.txt --single-version-externally-managed:
ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Traceback (most recent call last):
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com   File "<strin
ec2-54-245-36-62.us-west-2.compute.amazonaws.com g>", line 1, in <module>
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ImportError: No module named setuptools
ec2-54-245-36-62.us-west-2.compute.amazonaws.com
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ----------------------------------------
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Command /usr/bin/python -c "import setuptools;__file__='/tmp/pip-build-root/meld3/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-mDCOBa-record/install-record.txt --single-version-externally-managed failed with error code 1 in /tmp/pip-build-root/meld3
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Storing complete log in /home/ubuntu/.pip/pip.log
ec2-54-245-36-62.us-west-2.compute.amazonaws.com STDERR:
ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---- End output of pip install --upgrade supervisor ----
ec2-54-245-36-62.us-west-2.compute.amazonaws.com Ran pip install --upgrade supervisor returned 1

-- 
Liam Kirsher
PGP: http://liam.numenet.com/pgp/