Re: [Cython] Manylinux wheels for Cython

2016-03-28 Thread Matthew Brett
Hi,

On Fri, Mar 25, 2016 at 11:46 AM, Matthew Brett  wrote:
> Hi,
>
> On Tue, Mar 15, 2016 at 2:58 PM, Matthew Brett  
> wrote:
>> Hi,
>>
>> On Mon, Mar 7, 2016 at 5:47 PM, Matthew Brett  
>> wrote:
>>> Hi,
>>>
>>> I don't know whether y'all have been following over at distutils-sig,
>>> but there's a new distutils PEP that defines a `manylinux` format for
>>> Linux wheels that work on many different x86 Linux distributions:
>>>
>>> https://www.python.org/dev/peps/pep-0513/
>>> https://github.com/pypa/manylinux
>>>
>>> The latest version of pip will install these, if the client Linux
>>> system is compatible with the manylinux spec:
>>>
>>> https://pip.pypa.io/en/stable/news/
>>>
>>> I've already built and used manylinux Cython wheels, which y'all are
>>> welcome to test with:
>>>
>>> pip install -f https://nipy.bic.berkeley.edu/manylinux cython
>>>
>>> (The wheels there don't have the right manylinux filenames yet, but
>>> they have the same contents as the ones that would go up to pypi).
>>>
>>> I've already had good use from these wheels in speeding up project
>>> builds into docker containers and virtualenvs, and I'd love to upload
>>> these to pypi.   I have permissions on pypi to do this, but I wanted
>>> to check in with y'all first...
>>
>> There is now a test wheel for Cython 0.23.4 and Python 3.5 on the
>> testpypi server.
>>
>> This is me downloading and installing - a matter of a few seconds:
>>
>> $ python -m pip install -U pip
>> Downloading/unpacking pip from
>> https://pypi.python.org/packages/py2.py3/p/pip/pip-8.1.0-py2.py3-none-any.whl#md5=c6eca6736b2b8f7280fb25e44be7c51b
>>   Downloading pip-8.1.0-py2.py3-none-any.whl (1.2MB): 1.2MB downloaded
>> Installing collected packages: pip
>>   Found existing installation: pip 1.5.6
>> Uninstalling pip:
>>   Successfully uninstalled pip
>> Successfully installed pip
>> Cleaning up...
>> $ pip install -i https://testpypi.python.org/pypi/ cython
>> Collecting cython
>>   Using cached 
>> https://testpypi.python.org/packages/cp35/C/Cython/Cython-0.23.4-cp35-cp35m-manylinux1_x86_64.whl
>> Installing collected packages: cython
>> Successfully installed cython-0.23.4
>> $ cython --version
>> Cython version 0.23.4
>>
>> The installed Cython version compiles all the Demo *.pyx files OK.
>>
>> See also : 
>> https://mail.python.org/pipermail/wheel-builders/2016-March/50.html
>
> A manylinux wheel (gevent) is already the current most-downloaded
> binary wheel from pypi.
>
> A reminder that y'all can test the Cython wheels with:
>
> python -m pip install --upgrade pip  # You need latest pip
> pip install -f https://nipy.bic.berkeley.edu/manylinux cython
>
> If I don't hear any objections, I plan to upload the Cython manylinux
> wheels on Monday 28th.

I uploaded manylinux wheels for Cython 0.23.5.

If you're on Linux, and you upgrade pip to 8.1.1 (current) you should
now get Cython via a manylinux wheel by default.

Please do test and let me know of any problems.

Cheers,

Matthew
___
cython-devel mailing list
cython-devel@python.org
https://mail.python.org/mailman/listinfo/cython-devel


Re: [Cython] Manylinux wheels for Cython

2016-03-28 Thread Emmanuel Gil Peyrot
On Mon, Mar 28, 2016 at 10:54:21AM -0700, Matthew Brett wrote:
[…]
> I uploaded manylinux wheels for Cython 0.23.5.
> 
> If you're on Linux, and you upgrade pip to 8.1.1 (current) you should
> now get Cython via a manylinux wheel by default.
> 
> Please do test and let me know of any problems.

Thanks, this significantly improves the install-time required for
poezio for people who don’t already have cython installed.

Do you plan on publishing AArch64 and ARMv7h wheels as well?  Those are
the systems most impacted by the compile time of cython.

> 
> Cheers,
> 
> Matthew
> ___
> cython-devel mailing list
> cython-devel@python.org
> https://mail.python.org/mailman/listinfo/cython-devel

-- 
Emmanuel Gil Peyrot
___
cython-devel mailing list
cython-devel@python.org
https://mail.python.org/mailman/listinfo/cython-devel


Re: [Cython] Manylinux wheels for Cython

2016-03-28 Thread Nathaniel Smith
On Mon, Mar 28, 2016 at 4:04 PM, Emmanuel Gil Peyrot
 wrote:
> On Mon, Mar 28, 2016 at 10:54:21AM -0700, Matthew Brett wrote:
> […]
>> I uploaded manylinux wheels for Cython 0.23.5.
>>
>> If you're on Linux, and you upgrade pip to 8.1.1 (current) you should
>> now get Cython via a manylinux wheel by default.
>>
>> Please do test and let me know of any problems.
>
> Thanks, this significantly improves the install-time required for
> poezio for people who don’t already have cython installed.
>
> Do you plan on publishing AArch64 and ARMv7h wheels as well?  Those are
> the systems most impacted by the compile time of cython.

PEP 513 only standardizes linux wheels for x86-{32,64}, because its
strategy is to say "hey, in practice everyone is careful to maintain
backwards ABI compatibility with RHEL-cough-I-mean-CentOS 5, so let's
use that as our standard ABI". But CentOS 5 is only available for
x86-{32,64}.

It would be great if there's some way to standardize an ABI that lets
us distribute ARM wheels -- I just don't know enough about ARM to have
any idea how to do that :-). One possibility would be to standardize a
way to distribute wheels that target particular distributions, so you
could have e.g. a wheel for Raspbian specifically -- Nate Coraor was
interested in working on this. If you send an email to distutils-sig
volunteering to help then you might get some takers :-). Alternatively
maybe there is some minimum baseline ABI that most/all ARM
distributions actually do agree on in practice, similar to CentOS 5
for x86 variants... that could also be used to standardize something.
But either way it would need someone with the appropriate expertise
(or willingness to fake it) to step up and make a proposal on
distutils-sig.

-n

-- 
Nathaniel J. Smith -- https://vorpus.org
___
cython-devel mailing list
cython-devel@python.org
https://mail.python.org/mailman/listinfo/cython-devel