Mailman 3 July 2014 - scikit-image

Re: Building skimage wheels for OS X using Travis CI
by Jonathan Helmus 01 Jul '14

01 Jul '14

On 07/01/2014 09:42 AM, Matthew Brett wrote: > Hi, > > On Tue, Jul 1, 2014 at 1:08 AM, Stéfan van der Walt <stefan(a)sun.ac.za> wrote: >> On Tue, Jul 1, 2014 at 2:01 AM, Matthew Brett <matthew.brett(a)gmail.com> wrote: >>>> I've forked the repo to the scikit-image organization and added you to >>>> the packaging team with the necessary administrative rights. >>> Oops - sorry - I transferred the repo to scikit-image, but now I don't >>> have admin rights. >> I think you should have those back now. >> >>> I put in a PR to give the right credentials for travis and rackspace - I hope. >> Merged. >> >>> Could you enable travis testing on that repo also? >> It looks like it's activated from my side. > Yup - all working : > https://travis-ci.org/scikit-image/scikit-image-wheels/builds/28845582 > >>> By the way - would you consider uploading the latest built wheels to pypi? >>> >>> http://a365fff413fe338398b6-1c8a9b3114517dc5fe17b7c3f8c63a43.r19.cf2.rackcd… >> Sure, is this the latest wheel 0.10.1 that I pushed out earlier this >> evening? I'm off to bed for now, but I've also given you maintainer >> permission on PyPi so that you don't have to wait on me. > Thanks - I uploaded the automated builds to pypi (using twine). Any > problems - please do let me know. > > Cheers, > > Matthew > Great work Matthew! Thanks for getting the idea integrated scikit-image's framework, I was busy this weekend finishing a poster for SciPy. One though I had was to use Travis CI's PyPI deploy [1] to upload the wheels directly to pypi. I tested this out a bit last night and the PyPI deploy seems to expect a certain layout of the package, Python install, etc which just leads to trouble. Having the files on Rackspace and having to manually push them to pypi for each release seems reasonable. Next up, is to use AppVeyor [2] to build wheel files for Windows. I has able to get a wheel for Python 3.3 built [3] but Python 2.7 looked more difficult. Cheers, - Jonathan Helmus [1] docs.travis-ci.com/user/deployment/pypi/ [2] http://www.appveyor.com/ [3] https://ci.appveyor.com/project/JonathanHelmus/scikit-image-ci-wheel-builde…

3 2

Re: Building skimage wheels for OS X using Travis CI
by Jonathan Helmus 01 Jul '14

01 Jul '14

On 07/01/2014 10:35 AM, Matthew Brett wrote: > Hi, > > On Tue, Jul 1, 2014 at 4:29 PM, Jonathan Helmus <jjhelmus(a)gmail.com> wrote: >> On 07/01/2014 09:42 AM, Matthew Brett wrote: >>> Hi, >>> >>> On Tue, Jul 1, 2014 at 1:08 AM, Stéfan van der Walt <stefan(a)sun.ac.za> >>> wrote: >>>> On Tue, Jul 1, 2014 at 2:01 AM, Matthew Brett <matthew.brett(a)gmail.com> >>>> wrote: >>>>>> I've forked the repo to the scikit-image organization and added you to >>>>>> the packaging team with the necessary administrative rights. >>>>> Oops - sorry - I transferred the repo to scikit-image, but now I don't >>>>> have admin rights. >>>> I think you should have those back now. >>>> >>>>> I put in a PR to give the right credentials for travis and rackspace - I >>>>> hope. >>>> Merged. >>>> >>>>> Could you enable travis testing on that repo also? >>>> It looks like it's activated from my side. >>> Yup - all working : >>> https://travis-ci.org/scikit-image/scikit-image-wheels/builds/28845582 >>> >>>>> By the way - would you consider uploading the latest built wheels to >>>>> pypi? >>>>> >>>>> >>>>> http://a365fff413fe338398b6-1c8a9b3114517dc5fe17b7c3f8c63a43.r19.cf2.rackcd… >>>> Sure, is this the latest wheel 0.10.1 that I pushed out earlier this >>>> evening? I'm off to bed for now, but I've also given you maintainer >>>> permission on PyPi so that you don't have to wait on me. >>> Thanks - I uploaded the automated builds to pypi (using twine). Any >>> problems - please do let me know. >>> >>> Cheers, >>> >>> Matthew >>> >> Great work Matthew! Thanks for getting the idea integrated scikit-image's >> framework, I was busy this weekend finishing a poster for SciPy. One though >> I had was to use Travis CI's PyPI deploy [1] to upload the wheels directly >> to pypi. I tested this out a bit last night and the PyPI deploy seems to >> expect a certain layout of the package, Python install, etc which just leads >> to trouble. Having the files on Rackspace and having to manually push them >> to pypi for each release seems reasonable. >> >> Next up, is to use AppVeyor [2] to build wheel files for Windows. I has >> able to get a wheel for Python 3.3 built [3] but Python 2.7 looked more >> difficult. > Wow - nice discovery, that looks as though it will be very useful. > > Will you run into the same problem with conda, that the wheels aren't > compatible with Python.org python? > > Cheers, > > Matthew > I'm not sure about the conda issue. NumPy doesn't provide wheels for windows (yet) as they are still trying to figure out what BLAS library to include. If they did, it would be possible to use the pre-installed Python on the system which appears to be the official Python.org interpreter. The bigger issue is that only Visual C++ 10.0 is installed (VS 2010) which can only build binaries for Python 3.3 and 3.4. VC++ 9.0 is needed for Python 2.6 and 2.7 but AppVeyor doesn't provide it and installing the SDK seems a bit extreme. I'm hoping to chat with folks at SciPy and see if anyone has any good suggestions for Windows based build VMs. - Jonathan Helmus

2 1

Re: Building skimage wheels for OS X using Travis CI
by Matthew Brett 01 Jul '14

01 Jul '14

Yo, On Tue, Jul 1, 2014 at 4:02 PM, Stéfan van der Walt <stefan(a)sun.ac.za> wrote: > On Tue, Jul 1, 2014 at 4:42 PM, Matthew Brett <matthew.brett(a)gmail.com> wrote: >> Thanks - I uploaded the automated builds to pypi (using twine). Any >> problems - please do let me know. > > Neat. How do we access the built wheels from this system? Also, does > twine automate any part of the process, or do you still have to upload > wheels by hand? The wheels should appear in this directory: http://a365fff413fe338398b6-1c8a9b3114517dc5fe17b7c3f8c63a43.r19.cf2.rackcd… after travis has run. It's obviously possible to automate it more, but what I did was something like: cd scikit-image git co v0.10.1 cd dist curl -O http://a365fff413fe338398b6-1c8a9b3114517dc5fe17b7c3f8c63a43.r19.cf2.rackcd… curl -O http://a365fff413fe338398b6-1c8a9b3114517dc5fe17b7c3f8c63a43.r19.cf2.rackcd… curl -O http://a365fff413fe338398b6-1c8a9b3114517dc5fe17b7c3f8c63a43.r19.cf2.rackcd… cd .. twine upload dist/*.whl Is that what you meant? Cheers, Matthew

1 0

Re: Building skimage wheels for OS X using Travis CI
by Stéfan van der Walt 01 Jul '14

01 Jul '14

On Tue, Jul 1, 2014 at 4:42 PM, Matthew Brett <matthew.brett(a)gmail.com> wrote: > Thanks - I uploaded the automated builds to pypi (using twine). Any > problems - please do let me know. Neat. How do we access the built wheels from this system? Also, does twine automate any part of the process, or do you still have to upload wheels by hand? Stéfan

1 0

Re: Building skimage wheels for OS X using Travis CI
by Matthew Brett 01 Jul '14

01 Jul '14

Hi, On Tue, Jul 1, 2014 at 1:08 AM, Stéfan van der Walt <stefan(a)sun.ac.za> wrote: > On Tue, Jul 1, 2014 at 2:01 AM, Matthew Brett <matthew.brett(a)gmail.com> wrote: >>> I've forked the repo to the scikit-image organization and added you to >>> the packaging team with the necessary administrative rights. >> >> Oops - sorry - I transferred the repo to scikit-image, but now I don't >> have admin rights. > > I think you should have those back now. > >> I put in a PR to give the right credentials for travis and rackspace - I hope. > > Merged. > >> Could you enable travis testing on that repo also? > > It looks like it's activated from my side. Yup - all working : https://travis-ci.org/scikit-image/scikit-image-wheels/builds/28845582 >> By the way - would you consider uploading the latest built wheels to pypi? >> >> http://a365fff413fe338398b6-1c8a9b3114517dc5fe17b7c3f8c63a43.r19.cf2.rackcd… > > Sure, is this the latest wheel 0.10.1 that I pushed out earlier this > evening? I'm off to bed for now, but I've also given you maintainer > permission on PyPi so that you don't have to wait on me. Thanks - I uploaded the automated builds to pypi (using twine). Any problems - please do let me know. Cheers, Matthew

1 0

Re: Doctest failures
by Stéfan van der Walt 01 Jul '14

01 Jul '14

On Tue, Jul 1, 2014 at 5:34 AM, Juan Nunez-Iglesias <jni.soma(a)gmail.com> wrote: > I did not, nor do I think I will until post-SciPy. (Or at the sprint itself, > really.) No problem--just file it for us somewhere, please. I will try to help during the sprints where possible. Regards Stéfan

1 0

Re: Doctest failures
by Juan Nunez-Iglesias 01 Jul '14

01 Jul '14

I did not, nor do I think I will until post-SciPy. (Or at the sprint itself, really.) On Tue, Jul 1, 2014 at 6:48 AM, Stéfan van der Walt <stefan(a)sun.ac.za> wrote: > On Sat, Jun 21, 2014 at 1:27 AM, Josh Warner <silvertrumpet999(a)gmail.com> > wrote: > > The second to last error, in skimage.measure._label.label, looks like a > real > > error / malformed example to me. > > Juan, did you have another look at this? If this is a bug, we should > file it so we don't forget. > > Stéfan > > -- > You received this message because you are subscribed to the Google Groups > "scikit-image" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to scikit-image+unsubscribe(a)googlegroups.com. > For more options, visit https://groups.google.com/d/optout. >

1 0

Re: Building skimage wheels for OS X using Travis CI
by Stéfan van der Walt 01 Jul '14

01 Jul '14

On Tue, Jul 1, 2014 at 2:01 AM, Matthew Brett <matthew.brett(a)gmail.com> wrote: >> I've forked the repo to the scikit-image organization and added you to >> the packaging team with the necessary administrative rights. > > Oops - sorry - I transferred the repo to scikit-image, but now I don't > have admin rights. I think you should have those back now. > I put in a PR to give the right credentials for travis and rackspace - I hope. Merged. > Could you enable travis testing on that repo also? It looks like it's activated from my side. > By the way - would you consider uploading the latest built wheels to pypi? > > http://a365fff413fe338398b6-1c8a9b3114517dc5fe17b7c3f8c63a43.r19.cf2.rackcd… Sure, is this the latest wheel 0.10.1 that I pushed out earlier this evening? I'm off to bed for now, but I've also given you maintainer permission on PyPi so that you don't have to wait on me. Stéfan

1 0

Re: Building skimage wheels for OS X using Travis CI
by Matthew Brett 01 Jul '14

01 Jul '14

Hi, On Tue, Jul 1, 2014 at 12:44 AM, Stéfan van der Walt <stefan(a)sun.ac.za> wrote: > Hi Matthew > > On Tue, Jul 1, 2014 at 1:20 AM, Matthew Brett <matthew.brett(a)gmail.com> wrote: >> This repo is now working; it builds the wheels, runs the tests and >> then uploads to a rackspace container: > > This is absolutely fantastic--thank you! No problem. >> Any interest in taking this over to the scikit-image organization? If >> you make me a member even temporarily, I can set you up with the >> encrypted API key to upload to the rackspace container. > > I've forked the repo to the scikit-image organization and added you to > the packaging team with the necessary administrative rights. Oops - sorry - I transferred the repo to scikit-image, but now I don't have admin rights. I put in a PR to give the right credentials for travis and rackspace - I hope. Could you enable travis testing on that repo also? By the way - would you consider uploading the latest built wheels to pypi? http://a365fff413fe338398b6-1c8a9b3114517dc5fe17b7c3f8c63a43.r19.cf2.rackcd… They have better backward compatibility with previous numpies - I didn't understand that properly until I started doing tests a few days ago.... Cheers, Matthew

1 0