Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-21 Thread Robert McGibbon
Hi all, Just as a heads up: Nathaniel and I wrote a draft PEP on binary linux wheels that is now being discussed on distutils-sig, so you can check that out and participate in the conversation if you're interested. - PEP on python.org: https://www.python.org/dev/peps/pep-0513/ - PEP on github wit

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-15 Thread Robert McGibbon
On Fri, Jan 15, 2016 at 11:56 AM, Travis Oliphant wrote: > > > I still submit that this is not the best use of time. Conda *already* solves the problem.My sadness is that people keep working to create an ultimately inferior solution rather than just help make a better solution more accessibl

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-11 Thread Robert McGibbon
> And in any case we have lots of users who don't use conda and are thus doomed to support both ecosystems regardless, so we might as well make the best of it :-). Yes, this is the key. Conda is a great tool for a lot of users / use cases, but it's not for everyone. Anyways, I think I've made a p

Re: [Numpy-discussion] Defining a base linux-64 environment [was: Should I use pip install numpy in linux?]

2016-01-11 Thread Robert McGibbon
enuts, is here: https://github.com/rmcgibbo/deloc8. It's currently fairly modest and can only list non-whitelisted external shared library dependencies, and verify that sufficiently old versioned symbols for glibc and its ilk are used. -Robert On Sun, Jan 10, 2016 at 1:19 AM, Robert McGibbo

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-10 Thread Robert McGibbon
> > Right. There's a small problem which is that the base linux system >> isn't just "CentOS 5", it's "CentOS 5 and here's the list of libraries > > that you're allowed to link to: ...", where that list is empirically > > chosen to include only stuff that really is installed on ~all linux >> machin

Re: [Numpy-discussion] Defining a base linux-64 environment [was: Should I use pip install numpy in linux?]

2016-01-10 Thread Robert McGibbon
out how to filter > this based on using debian popularity-contests and the package graph. I > will report back when I have more info. > > -Robert > > On Sat, Jan 9, 2016 at 3:04 PM, Nathaniel Smith wrote: > >> On Sat, Jan 9, 2016 at 3:52 AM, Robert McGibbon >> wrote:

Re: [Numpy-discussion] Defining a base linux-64 environment [was: Should I use pip install numpy in linux?]

2016-01-09 Thread Robert McGibbon
pularity-contests and the package graph. I will report back when I have more info. -Robert On Sat, Jan 9, 2016 at 3:04 PM, Nathaniel Smith wrote: > On Sat, Jan 9, 2016 at 3:52 AM, Robert McGibbon > wrote: > > Hi all, > > > > I went ahead and tried to collect a list of all of t

Re: [Numpy-discussion] Defining a base linux-64 environment [was: Should I use pip install numpy in linux?]

2016-01-09 Thread Robert McGibbon
or dlopen to dynamically load shared libraries that are actually just optional (and catch the error and recover gracefully if the library can't be loaded). -Robert On Sat, Jan 9, 2016 at 4:20 AM, Julian Taylor wrote: > On 09.01.2016 12:52, Robert McGibbon wrote: > > Hi all, > &

[Numpy-discussion] Defining a base linux-64 environment [was: Should I use pip install numpy in linux?]

2016-01-09 Thread Robert McGibbon
Hi all, I went ahead and tried to collect a list of all of the libraries that could be considered to constitute the "base" system for linux-64. The strategy I used was to leverage off the work done by the folks at Continuum by searching through their pre-compiled binaries from https://repo.continu

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-08 Thread Robert McGibbon
#x27;t be that hard... right? -Robert On Fri, Jan 8, 2016 at 8:03 PM, Nathaniel Smith wrote: > On Fri, Jan 8, 2016 at 7:41 PM, Robert McGibbon > wrote: > >> Doesn't building on CentOS 5 also mean using a quite old version of gcc? > > > > I have had pretty good luc

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-08 Thread Robert McGibbon
> Doesn't building on CentOS 5 also mean using a quite old version of gcc? I have had pretty good luck using the (awesomely named) Holy Build Box , which is a CentOS 5 docker image with a newer gcc version installed (but I guess the same old libc). I'm not

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-08 Thread Robert McGibbon
2016 at 3:50 PM, Matthew Brett wrote: > Hi, > > On Fri, Jan 8, 2016 at 11:27 PM, Chris Barker > wrote: > > On Fri, Jan 8, 2016 at 1:58 PM, Robert McGibbon > wrote: > >> > >> I'm not sure if this is the right path for numpy or not, > > > > &

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-08 Thread Robert McGibbon
h compiled extensions. But it's categorically ruled out by the PyPI policy, IIUC. Perhaps this is OT for this thread, and I should ask on distutils-sig. -Robert On Fri, Jan 8, 2016 at 12:12 PM, Oscar Benjamin wrote: > > On 8 Jan 2016 19:07, "Robert McGibbon" wrote: > > >

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-08 Thread Robert McGibbon
Does anyone know if there's been any movements with the PyPI folks on allowing linux wheels to be uploaded? I know you can never be certain what's provided by the distro, but it seems like if Anaconda can solve the cross-distro-binary-distribution-of-compiled-python-extensions problem, there shoul

Re: [Numpy-discussion] numpy-1.11.0.dev0 windows wheels compiled with mingwpy available

2015-10-22 Thread Robert McGibbon
Got it. Thanks, Nathaniel -- this is really good information. -Robert On Mon, Oct 19, 2015 at 6:55 PM, Nathaniel Smith wrote: > On Mon, Oct 19, 2015 at 2:26 AM, Olivier Grisel > wrote: > >> Is it possible to test this with py35 as well? > > > > Unfortunately not yet. > > > >> For MSVC, py35 re

Re: [Numpy-discussion] numpy-1.11.0.dev0 windows wheels compiled with mingwpy available

2015-10-18 Thread Robert McGibbon
Hi, Is it possible to test this with py35 as well? For MSVC, py35 requires a new compiler toolchain (VS2015) -- is that something mingwpy/mingw-w64 can handle? -Robert On Fri, Oct 9, 2015 at 3:29 PM, Carl Kleffner wrote: > I made numpy master (numpy-1.11.0.dev0 , > https://github.com/numpy/num

Re: [Numpy-discussion] Rewrite np.histogram in c?

2015-03-16 Thread Robert McGibbon
Hi, It sounds like putting together a PR makes sense then. I'll try hacking on this a bit. -Robert On Mar 16, 2015 11:20 AM, "Jaime Fernández del Río" wrote: > On Mon, Mar 16, 2015 at 9:28 AM, Jerome Kieffer > wrote: > >> On Mon, 16 Mar 2015 06:56:58 -0700 >> Jaime Fernández del Río wrote: >>

Re: [Numpy-discussion] Rewrite np.histogram in c?

2015-03-15 Thread Robert McGibbon
My apologies for the typo: 'implements' -> 'implementations' -Robert On Sun, Mar 15, 2015 at 11:06 PM, Robert McGibbon wrote: > It might make sense to dispatch to difference c implements if the bins are > equally spaced (as created by using an integer for the np.h

Re: [Numpy-discussion] Rewrite np.histogram in c?

2015-03-15 Thread Robert McGibbon
, Mar 15, 2015 at 11:00 PM, Jaime Fernández del Río < jaime.f...@gmail.com> wrote: > On Sun, Mar 15, 2015 at 9:32 PM, Robert McGibbon > wrote: > >> Hi, >> >> Numpy.histogram is implemented in python, and is a little sluggish. This >> has been discussed previous

[Numpy-discussion] Rewrite np.histogram in c?

2015-03-15 Thread Robert McGibbon
Hi, Numpy.histogram is implemented in python, and is a little sluggish. This has been discussed previously on the mailing list, [1, 2]. It came up in a project that I maintain, where a new feature is bottlenecked by numpy.histogram, and one developer suggested a faster implementation in cython [3]

Re: [Numpy-discussion] appveyor CI

2015-03-05 Thread Robert McGibbon
I develop on linux and osx, and I haven't experienced any Appveyor problems related to line endings, so I assume it's normalized somehow. -Robert On Mar 5, 2015 5:08 PM, "Charles R Harris" wrote: > > > On Thu, Mar 5, 2015 at 5:38 PM, Robert McGibbon > wrot

Re: [Numpy-discussion] appveyor CI

2015-03-05 Thread Robert McGibbon
>From my experience, it's pretty easy, assuming you're prepared to pick up some powershell. Some useful resources are - Olivier Grisel's example. https://github.com/ogrisel/python-appveyor-demo - I made a similar example, using conda. https://github.com/rmcgibbo/python-appveyor-conda-example On

Re: [Numpy-discussion] Fast sizes for FFT

2014-12-23 Thread Robert McGibbon
Alex Griffing pointed out on github that this feature was recently added to scipy in https://github.com/scipy/scipy/pull/3144. Sweet! -Robert On Tue, Dec 23, 2014 at 6:47 PM, Charles R Harris wrote: > > > On Tue, Dec 23, 2014 at 7:32 PM, Robert McGibbon > wrote: > &g

[Numpy-discussion] Fast sizes for FFT

2014-12-23 Thread Robert McGibbon
Hey, The performance of fftpack depends very strongly on the array size -- sizes that are powers of two are good, but also powers of three, five and seven, or numbers whose only prime factors are from (2,3,5,7). For problems that can use padding, rounding up the size (using np.fft.fft(x, n=size_wi

Re: [Numpy-discussion] Initializing array from buffer

2014-11-17 Thread Robert McGibbon
The np.ndarray constructor takes a strides argument argument, and a buffer. Is it not sufficiently flexible? -Robert On Sun, Nov 16, 2014 at 4:27 PM, Sturla Molden wrote: > Andrea Arteaga wrote: > > > My use case is the f

Re: [Numpy-discussion] 64-bit windows numpy / scipy wheels for testing

2014-07-27 Thread Robert McGibbon
I forked Olivier's example project to use the same infrastructure for building conda binaries and deploying them to binstar, which might also be useful for some projects. https://github.com/rmcgibbo/python-appveyor-conda-example -Robert On Wed, Jul 9, 2014 at 3:53 PM, Robert McGibbon

Re: [Numpy-discussion] 64-bit windows numpy / scipy wheels for testing

2014-07-10 Thread Robert McGibbon
This is an awesome resource for tons of projects. Thanks Olivier! -Robert On Wed, Jul 9, 2014 at 7:00 AM, Olivier Grisel wrote: > Feodor updated the AppVeyor nodes to have the Windows SDK matching > MSVC 2008 Express for Python 2. I have updated my sample scripts and > we now have a working e

Re: [Numpy-discussion] BLAS and LAPACK ABI questions (mostly OSX related)

2014-06-08 Thread Robert McGibbon
a's observation about the _umath_linalg ABI issues is separate. -Robert [1] https://github.com/numpy/numpy/issues/4007#issuecomment-27708193 On Sun, Jun 8, 2014 at 9:25 PM, Matthew Brett wrote: > On Mon, Jun 9, 2014 at 5:08 AM, Robert McGibbon > wrote: > > But I can't repr

Re: [Numpy-discussion] BLAS and LAPACK ABI questions (mostly OSX related)

2014-06-08 Thread Robert McGibbon
But I can't reproduce #4007 on my machine, so I'm not totally sure. -Robert On Sun, Jun 8, 2014 at 9:07 PM, Robert McGibbon wrote: > #4776 is definitely a separate issue. #4007 could be related similar f2c > ABI issues, but I don't think so. The difference between the

Re: [Numpy-discussion] BLAS and LAPACK ABI questions (mostly OSX related)

2014-06-08 Thread Robert McGibbon
27;t think there is any difference in how float32 parameters are passed *in*, so I'm not sure that these issues are related to subroutines like SGEMV which is presumably behind #4007. -Robert On Sun, Jun 8, 2014 at 8:33 PM, Matthew Brett wrote: > Hi, > > On Mon, Jun 9, 2014 at

Re: [Numpy-discussion] BLAS and LAPACK ABI questions (mostly OSX related)

2014-06-08 Thread Robert McGibbon
Yeah, that's definitely not the right signature for sdot when linked against the Accelerate framework. But what's the purpose of those wrappers in _umath_linalg? The one for sdot, for example, doesn't appear to be used internally, and it isn't available from the python side. While scipy has all of

Re: [Numpy-discussion] Distutils - way to check validity of compiler flag?

2014-05-12 Thread Robert McGibbon
In a couple of my projects, we check for flags by compiling little test files -- autotools style -- to check for SSE, OpenMP, etc. See e.g. https://github.com/rmcgibbo/mdtraj/blob/master/setup.py#L215 If anyone has a better solution, I'm all ears. -Robert On Mon, May 12, 2014 at 12:24 PM, Matth

[Numpy-discussion] segfault from scipy.io.netcdf with scipy-0.14 numpy-0.18

2014-05-08 Thread Robert McGibbon
Hey all, The travis tests for a library I work on just stopped working, and I tracked down the bug to the following test case. The file "MDTraj/testing/reference/mdcrd.nc" is a netcdf3 file in our repository ( https://github.com/rmcgibbo/mdtraj/tree/master/MDTraj/testing/reference). this script:

[Numpy-discussion] Any numpy core devs on gittip (or similar)?

2014-03-25 Thread Robert McGibbon
Hey, I've just been reading the discussionon python-dev about PEP466, the meta-theme of which is that building and maintaining mission-critical software is just really tough. I don't really use SSL from python (the major topic of that discussio