Re: [Cython] Upcoming cython/numpy breakage with stride checking

2013-04-08 Thread Dag Sverre Seljebotn
On 04/08/2013 09:59 AM, Sebastian Berg wrote: On Mon, 2013-04-08 at 08:42 +0200, Dag Sverre Seljebotn wrote: On 04/06/2013 04:19 PM, Nathaniel Smith wrote: Hi all, If you build current numpy master with NPY_RELAXED_STRIDES_CHECKING=1 python setup.py install then Cython code using ndarrays

Re: [Cython] Upcoming cython/numpy breakage with stride checking

2013-04-08 Thread Dag Sverre Seljebotn
On 04/06/2013 04:19 PM, Nathaniel Smith wrote: Hi all, If you build current numpy master with NPY_RELAXED_STRIDES_CHECKING=1 python setup.py install then Cython code using ndarrays starts blowing up, e.g.: # foo.pyx def add_one(array): cdef double[::1] a = array a[0] += 1. ret

[Cython] cldoc

2013-02-13 Thread Dag Sverre Seljebotn
Just a heads up about this project; there's bound to be something useful there for auto-wrapping. http://jessevdk.github.com/cldoc/ Dag Sverre ___ cython-devel mailing list cython-devel@python.org http://mail.python.org/mailman/listinfo/cython-devel

Re: [Cython] analyse_types() refactoring

2013-02-07 Thread Dag Sverre Seljebotn
On 02/07/2013 06:32 PM, Stefan Behnel wrote: Hi, I finally found the time to refactor the analysis phase. https://github.com/cython/cython/commit/f9c385e08401ed96b5b0afb8411480037dc772b9 The methods now return a node, which allows them to replace themselves with a different implementation. No

Re: [Cython] Feature Request: expand list/tuple in 'if (... in ...):' ...

2013-01-24 Thread Dag Sverre Seljebotn
On 01/24/2013 03:13 PM, Christian Inci wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Subject: Feature Request: expand list/tuple in 'if (... in ...):' ... expand list/tuple in 'if (... in ...):' on compile-time if the list/tuple contains only static values. test1: list is expanded manu

[Cython] Fwd: Re: [Python-Dev] Python 3.3 vs. Python 2.7 benchmark results (again, but this time more solid numbers)

2012-10-27 Thread Dag Sverre Seljebotn
Original Message Subject:Re: [Python-Dev] Python 3.3 vs. Python 2.7 benchmark results (again, but this time more solid numbers) Date: Sun, 28 Oct 2012 07:53:42 +1100 From: Tim Delaney To: python-...@python.org On 28 October 2012 07:40, Mark Shannon mailto:m

Re: [Cython] array expressions

2012-10-14 Thread Dag Sverre Seljebotn
On 10/14/2012 03:05 PM, Stefan Behnel wrote: mark florisson, 14.10.2012 13:59: The problem with minivect as a package is that it caters to different projects, which have different requirements. Cython and minivect are quite closely coupled, and any future change, or in the future any older versi

Re: [Cython] array expressions

2012-10-14 Thread Dag Sverre Seljebotn
On 10/14/2012 12:23 PM, Stefan Behnel wrote: Dag Sverre Seljebotn, 14.10.2012 11:03: On 10/14/2012 10:32 AM, Stefan Behnel wrote: Dag Sverre Seljebotn, 14.10.2012 10:18: On 10/14/2012 08:18 AM, Stefan Behnel wrote: mark florisson, 13.10.2012 20:30: On 12 October 2012 20:01, Dag Sverre

Re: [Cython] array expressions

2012-10-14 Thread Dag Sverre Seljebotn
On 10/14/2012 10:32 AM, Stefan Behnel wrote: Dag Sverre Seljebotn, 14.10.2012 10:18: On 10/14/2012 08:18 AM, Stefan Behnel wrote: mark florisson, 13.10.2012 20:30: On 12 October 2012 20:01, Dag Sverre Seljebotn wrote: On 10/12/2012 05:50 PM, Robert Bradshaw wrote: On Fri, Oct 12, 2012 at 3

Re: [Cython] array expressions

2012-10-14 Thread Dag Sverre Seljebotn
On 10/14/2012 10:18 AM, Dag Sverre Seljebotn wrote: On 10/14/2012 08:18 AM, Stefan Behnel wrote: mark florisson, 13.10.2012 20:30: On 12 October 2012 20:01, Dag Sverre Seljebotn wrote: On 10/12/2012 05:50 PM, Robert Bradshaw wrote: On Fri, Oct 12, 2012 at 3:14 AM, mark florisson wrote: On

Re: [Cython] array expressions

2012-10-14 Thread Dag Sverre Seljebotn
On 10/14/2012 08:18 AM, Stefan Behnel wrote: mark florisson, 13.10.2012 20:30: On 12 October 2012 20:01, Dag Sverre Seljebotn wrote: On 10/12/2012 05:50 PM, Robert Bradshaw wrote: On Fri, Oct 12, 2012 at 3:14 AM, mark florisson wrote: On 12 October 2012 08:36, Stefan Behnel wrote: mark

Re: [Cython] array expressions

2012-10-12 Thread Dag Sverre Seljebotn
On 10/12/2012 05:50 PM, Robert Bradshaw wrote: On Fri, Oct 12, 2012 at 3:14 AM, mark florisson wrote: On 12 October 2012 08:36, Stefan Behnel wrote: mark florisson, 24.08.2012 20:40: Here a pull request for element-wise array expressions for Cython: https://github.com/cython/cython/pull/144

Re: [Cython] new FFI library for Python

2012-09-17 Thread Dag Sverre Seljebotn
Saravanan Shanmugham wrote: >I have been using CFFI for wrapping a whole bunch of C libraries and I >can >tell you its way easier than Cython. > >And a couple of clarifications of misconceptions mentioned on this >list. >1. It does not "require" GCC at run time. The extension can be compiled >a

Re: [Cython] Fwd: [cython-users] can pointers be stored in Python's dict or list?

2012-09-14 Thread Dag Sverre Seljebotn
Isn't there a case for converting to/from ctypes pointers rather than capsules? And if capsules, what would the secret word be? Hmm... (sorry for the top post) DS -- Sent from my Android phone with K-9 Mail. Please excuse my brevity. Robert Bradshaw wrote: Given the CObject vs Capsule differ

Re: [Cython] Fwd: [numpy] MAINT: silence Cython warnings about changes dtype/ufunc size. (#432)

2012-09-08 Thread Dag Sverre Seljebotn
Nathaniel Smith wrote: >Hi Cythoneers, > >Ralf just proposed this pull request for numpy, to unconditionally >install >a warning filter to silence all "numpy.dtype size changed", >"numpy.ufunc >size changed" warnings that Cython likes to spit out. See the links >below >for details. Figured you

Re: [Cython] Non-profit 501(c)(1) Cython foundation

2012-09-05 Thread Dag Sverre Seljebotn
On 09/05/2012 02:51 AM, Robert Bradshaw wrote: NumFOCUS has graciously offered to help Cython get non-profit US tax status as part of their application as a part of a "Group Exception." Basically, this gives us all the benefits of a non-profit (including being able to receive and spend tax-favore

Re: [Cython] array expressions

2012-08-27 Thread Dag Sverre Seljebotn
On 08/27/2012 08:07 PM, Robert Bradshaw wrote: On Mon, Aug 27, 2012 at 5:47 AM, Dag Sverre Seljebotn wrote: On 08/27/2012 02:45 PM, Dag Sverre Seljebotn wrote: On 08/27/2012 02:05 PM, Stefan Behnel wrote: mark florisson, 27.08.2012 13:52: On 27 August 2012 12:40, Stefan Behnel wrote

Re: [Cython] array expressions

2012-08-27 Thread Dag Sverre Seljebotn
On 08/27/2012 02:45 PM, Dag Sverre Seljebotn wrote: On 08/27/2012 02:05 PM, Stefan Behnel wrote: mark florisson, 27.08.2012 13:52: On 27 August 2012 12:40, Stefan Behnel wrote: mark florisson, 27.08.2012 13:13: On 27 August 2012 12:06, Stefan Behnel wrote: My experience with lxml tells me

Re: [Cython] array expressions

2012-08-27 Thread Dag Sverre Seljebotn
On 08/27/2012 02:05 PM, Stefan Behnel wrote: mark florisson, 27.08.2012 13:52: On 27 August 2012 12:40, Stefan Behnel wrote: mark florisson, 27.08.2012 13:13: On 27 August 2012 12:06, Stefan Behnel wrote: My experience with lxml tells me that it's often better to keep things separate but int

Re: [Cython] array expressions

2012-08-27 Thread Dag Sverre Seljebotn
On 08/24/2012 08:40 PM, mark florisson wrote: Hey, Here a pull request for element-wise array expressions for Cython: https://github.com/cython/cython/pull/144 It includes the IndexNode refactoring branch as well. This has been the work this last summer for the gsoc, with great supervision from

Re: [Cython] array expressions

2012-08-27 Thread Dag Sverre Seljebotn
On 08/27/2012 11:53 AM, Dag Sverre Seljebotn wrote: On 08/24/2012 08:40 PM, mark florisson wrote: Hey, Here a pull request for element-wise array expressions for Cython: https://github.com/cython/cython/pull/144 It includes the IndexNode refactoring branch as well. This has been the work this

Re: [Cython] remaining open issues for 0.17

2012-08-10 Thread Dag Sverre Seljebotn
I agree. Non-transitive type comparisons seems like very fishy business (it will be *very* surprising to whoever runs across it); I think there's a strong case for just breaking backwards compatability: ERROR: 'char' is illegal as a buffer dtype due to being underspecified in the C standard, pl

[Cython] Bitey

2012-08-09 Thread Dag Sverre Seljebotn
https://github.com/dabeaz/bitey Dag -- Sent from my Android phone with K-9 Mail. Please excuse my brevity.___ cython-devel mailing list cython-devel@python.org http://mail.python.org/mailman/listinfo/cython-devel

Re: [Cython] 2d buffer interface with aligned data

2012-07-18 Thread Dag Sverre Seljebotn
If the image will always be 2D, you can add cdef Py_ssize_t shape[2] To your cdef class and assign self.shape to the Py_buffer. This is a bit more efficient. Dag -- Sent from my Android phone with K-9 Mail. Please excuse my brevity. Christian Heimes wrote: Am 17.07.2012 22:55, schrieb Chris

Re: [Cython] 2d buffer interface with aligned data

2012-07-17 Thread Dag Sverre Seljebotn
On 07/17/2012 05:38 PM, Christian Heimes wrote: Hello, I'm the author of https://bitbucket.org/tiran/smc.freeimage , a Cython wrapper of the FreeImage and LCMS libraries. FreeImage supports a broad variety of image formats and pixel formats from standard RGB up to RGBAF and complex numbers. Now

Re: [Cython] 2d buffer interface with aligned data

2012-07-17 Thread Dag Sverre Seljebotn
On 07/17/2012 06:55 PM, Dag Sverre Seljebotn wrote: On 07/17/2012 05:38 PM, Christian Heimes wrote: Hello, I'm the author of https://bitbucket.org/tiran/smc.freeimage , a Cython wrapper of the FreeImage and LCMS libraries. FreeImage supports a broad variety of image formats and pixel fo

Re: [Cython] Higher fidelity translations from C++ exception to Python exception?

2012-07-06 Thread Dag Sverre Seljebotn
Barry Warsaw wrote: >So if you have code like the following: > >cdef class Database: >cdef open(self, path) except +raise_py_error: >something_that_can_throw_a_cpp_exception(path) > >you can write > >cdef int raise_py_error(): >raise Something > >to kind of turn a C++ exception

Re: [Cython] [cython-users] C++: how to handle failures of 'new'?

2012-07-05 Thread Dag Sverre Seljebotn
mark florisson wrote: >On 5 July 2012 21:46, Dag Sverre Seljebotn >wrote: >> >> >> mark florisson wrote: >> >>>On 3 July 2012 20:15, Robert Bradshaw wrote: >>>> On Tue, Jul 3, 2012 at 11:43 AM, Dag Sverre Seljebotn >>>&

Re: [Cython] [cython-users] C++: how to handle failures of 'new'?

2012-07-05 Thread Dag Sverre Seljebotn
mark florisson wrote: >On 3 July 2012 20:15, Robert Bradshaw wrote: >> On Tue, Jul 3, 2012 at 11:43 AM, Dag Sverre Seljebotn >> wrote: >>> On 07/03/2012 08:23 PM, Robert Bradshaw wrote: >>>> >>>> On Tue, Jul 3, 2012 at 11:11 AM, Stefa

Re: [Cython] [cython-users] C++: how to handle failures of 'new'?

2012-07-04 Thread Dag Sverre Seljebotn
Sturla Molden wrote: > > >Sendt fra min iPad > >Den 4. juli 2012 kl. 14:33 skrev Stefan Behnel : > >>> >>> Indeed. But how to tell? malloc a small buffer and see if it works? >> >> In the worst case, you'd get another memory error during cleanup and >it >> would keep rippling up the stack. >>

Re: [Cython] [cython-users] C++: how to handle failures of 'new'?

2012-07-03 Thread Dag Sverre Seljebotn
On 07/03/2012 10:39 PM, Dag Sverre Seljebotn wrote: On 07/03/2012 09:15 PM, Robert Bradshaw wrote: On Tue, Jul 3, 2012 at 11:43 AM, Dag Sverre Seljebotn wrote: On 07/03/2012 08:23 PM, Robert Bradshaw wrote: On Tue, Jul 3, 2012 at 11:11 AM, Stefan Behnel wrote: Robert Bradshaw, 03.07.2012

Re: [Cython] [cython-users] C++: how to handle failures of 'new'?

2012-07-03 Thread Dag Sverre Seljebotn
On 07/03/2012 09:15 PM, Robert Bradshaw wrote: On Tue, Jul 3, 2012 at 11:43 AM, Dag Sverre Seljebotn wrote: On 07/03/2012 08:23 PM, Robert Bradshaw wrote: On Tue, Jul 3, 2012 at 11:11 AM, Stefan Behnel wrote: Robert Bradshaw, 03.07.2012 19:58: On Tue, Jul 3, 2012 at 9:38 AM, Stefan

Re: [Cython] [cython-users] C++: how to handle failures of 'new'?

2012-07-03 Thread Dag Sverre Seljebotn
On 07/03/2012 08:23 PM, Robert Bradshaw wrote: On Tue, Jul 3, 2012 at 11:11 AM, Stefan Behnel wrote: Robert Bradshaw, 03.07.2012 19:58: On Tue, Jul 3, 2012 at 9:38 AM, Stefan Behnel wrote: Dag Sverre Seljebotn, 03.07.2012 18:11: On 07/03/2012 09:14 AM, Stefan Behnel wrote: I don't

Re: [Cython] [cython-users] C++: how to handle failures of 'new'?

2012-07-03 Thread Dag Sverre Seljebotn
On 07/03/2012 08:23 PM, Robert Bradshaw wrote: On Tue, Jul 3, 2012 at 11:11 AM, Stefan Behnel wrote: Robert Bradshaw, 03.07.2012 19:58: On Tue, Jul 3, 2012 at 9:38 AM, Stefan Behnel wrote: Dag Sverre Seljebotn, 03.07.2012 18:11: On 07/03/2012 09:14 AM, Stefan Behnel wrote: I don't

Re: [Cython] [cython-users] C++: how to handle failures of 'new'?

2012-07-03 Thread Dag Sverre Seljebotn
On 07/03/2012 09:14 AM, Stefan Behnel wrote: Robert Bradshaw, 29.06.2012 11:08: On Thu, Jun 28, 2012 at 10:45 PM, Stefan Behnel wrote: Robert Bradshaw, 28.06.2012 21:46: On Thu, Jun 28, 2012 at 11:38 AM, Stefan Behnel wrote: currently, when I write "new CppClass()" in Cython, it generates a s

Re: [Cython] Hash-based vtables

2012-06-30 Thread Dag Sverre Seljebotn
On 06/30/2012 01:01 PM, Dag Sverre Seljebotn wrote: On 06/30/2012 12:57 PM, Dag Sverre Seljebotn wrote: My time is rather limited but I'm slowly trying to get another SEP 200 in place. Something that hit me, when I tried to make up my mind about whether to have (key, ptr) entries or

Re: [Cython] Hash-based vtables

2012-06-30 Thread Dag Sverre Seljebotn
On 06/30/2012 12:57 PM, Dag Sverre Seljebotn wrote: My time is rather limited but I'm slowly trying to get another SEP 200 in place. Something that hit me, when I tried to make up my mind about whether to have (key, ptr) entries or (key, flags, ptr), is that the fast hash table entrie

Re: [Cython] Hash-based vtables

2012-06-30 Thread Dag Sverre Seljebotn
My time is rather limited but I'm slowly trying to get another SEP 200 in place. Something that hit me, when I tried to make up my mind about whether to have (key, ptr) entries or (key, flags, ptr), is that the fast hash table entries can actually be arbitrary size. So we could make the table

Re: [Cython] buffer shape incompatible with memoryview shape

2012-06-21 Thread Dag Sverre Seljebotn
On 06/21/2012 02:59 PM, Stefan Behnel wrote: Dag Sverre Seljebotn, 21.06.2012 14:05: On 06/21/2012 01:36 PM, Stefan Behnel wrote: On 06/21/2012 10:59 AM, Stefan Behnel wrote: I find this worth fixing for 0.17: http://trac.cython.org/cython_trac/ticket/780 I ran into this when I gave a

Re: [Cython] buffer shape incompatible with memoryview shape

2012-06-21 Thread Dag Sverre Seljebotn
On 06/21/2012 01:36 PM, Stefan Behnel wrote: Dag Sverre Seljebotn, 21.06.2012 13:10: On 06/21/2012 10:59 AM, Stefan Behnel wrote: I find this worth fixing for 0.17: http://trac.cython.org/cython_trac/ticket/780 I'm not sure about the timeline here. The object<->memoryview semant

Re: [Cython] buffer shape incompatible with memoryview shape

2012-06-21 Thread Dag Sverre Seljebotn
On 06/21/2012 10:59 AM, Stefan Behnel wrote: Hi, I find this worth fixing for 0.17: http://trac.cython.org/cython_trac/ticket/780 I'm not sure about the timeline here. The object<->memoryview semantics haven't even been hammered down yet; does "mview.customattr" trigger an AttributeError,

Re: [Cython] Hash-based vtables

2012-06-12 Thread Dag Sverre Seljebotn
On 06/12/2012 09:46 PM, Dag Sverre Seljebotn wrote: On 06/12/2012 08:12 PM, Robert Bradshaw wrote: On Tue, Jun 12, 2012 at 10:21 AM, Dag Sverre Seljebotn wrote: On 06/12/2012 01:01 PM, Dag Sverre Seljebotn wrote: On 06/10/2012 11:53 AM, Robert Bradshaw wrote: On Sun, Jun 10, 2012 at 1:43

Re: [Cython] Hash-based vtables

2012-06-12 Thread Dag Sverre Seljebotn
On 06/12/2012 08:12 PM, Robert Bradshaw wrote: On Tue, Jun 12, 2012 at 10:21 AM, Dag Sverre Seljebotn wrote: On 06/12/2012 01:01 PM, Dag Sverre Seljebotn wrote: On 06/10/2012 11:53 AM, Robert Bradshaw wrote: On Sun, Jun 10, 2012 at 1:43 AM, Dag Sverre Seljebotn About signatures, a

Re: [Cython] Hash-based vtables

2012-06-12 Thread Dag Sverre Seljebotn
On 06/12/2012 01:01 PM, Dag Sverre Seljebotn wrote: On 06/10/2012 11:53 AM, Robert Bradshaw wrote: On Sun, Jun 10, 2012 at 1:43 AM, Dag Sverre Seljebotn About signatures, a problem I see with following the C typing is that the signature "ill" wouldn't hash the same as "ii

Re: [Cython] Hash-based vtables

2012-06-12 Thread Dag Sverre Seljebotn
On 06/10/2012 11:53 AM, Robert Bradshaw wrote: On Sun, Jun 10, 2012 at 1:43 AM, Dag Sverre Seljebotn About signatures, a problem I see with following the C typing is that the signature "ill" wouldn't hash the same as "iii" on 32-bit Windows and "iqq" on 32

Re: [Cython] Hash-based vtables

2012-06-10 Thread Dag Sverre Seljebotn
On 06/10/2012 10:23 AM, Robert Bradshaw wrote: On Sun, Jun 10, 2012 at 1:00 AM, Dag Sverre Seljebotn wrote: On 06/10/2012 09:34 AM, Robert Bradshaw wrote: On Sun, Jun 10, 2012 at 12:14 AM, Dag Sverre Seljebotn wrote: Robert Bradshawwrote: On Fri, Jun 8, 2012 at 10:45 PM, Dag

Re: [Cython] Hash-based vtables

2012-06-10 Thread Dag Sverre Seljebotn
Dag Sverre Seljebotn wrote: >On 06/10/2012 09:34 AM, Robert Bradshaw wrote: >> On Sun, Jun 10, 2012 at 12:14 AM, Dag Sverre Seljebotn >> wrote: >>> >>> >>> Robert Bradshaw wrote: >>> >>>> On Fri, Jun 8, 2012 at 10:45 PM, Dag Sv

Re: [Cython] Hash-based vtables

2012-06-10 Thread Dag Sverre Seljebotn
On 06/10/2012 09:34 AM, Robert Bradshaw wrote: On Sun, Jun 10, 2012 at 12:14 AM, Dag Sverre Seljebotn wrote: Robert Bradshaw wrote: On Fri, Jun 8, 2012 at 10:45 PM, Dag Sverre Seljebotn wrote: I'd love to not do interning, but I see no way around it. No, I want to use the low

Re: [Cython] Hash-based vtables

2012-06-10 Thread Dag Sverre Seljebotn
Robert Bradshaw wrote: >On Fri, Jun 8, 2012 at 10:45 PM, Dag Sverre Seljebotn > wrote: >> On 06/09/2012 03:21 AM, Robert Bradshaw wrote: >>> >>> On Fri, Jun 8, 2012 at 2:12 PM, Dag Sverre Seljebotn >>>> There's still the indirection through SEP 20

Re: [Cython] Hash-based vtables

2012-06-08 Thread Dag Sverre Seljebotn
On 06/09/2012 08:00 AM, Dag Sverre Seljebotn wrote: On 06/09/2012 07:45 AM, Dag Sverre Seljebotn wrote: On 06/09/2012 03:21 AM, Robert Bradshaw wrote: On Fri, Jun 8, 2012 at 2:12 PM, Dag Sverre Seljebotn There's still the indirection through SEP 200 (extensibletype slots). We can get r

Re: [Cython] Hash-based vtables

2012-06-08 Thread Dag Sverre Seljebotn
On 06/09/2012 07:45 AM, Dag Sverre Seljebotn wrote: On 06/09/2012 03:21 AM, Robert Bradshaw wrote: On Fri, Jun 8, 2012 at 2:12 PM, Dag Sverre Seljebotn There's still the indirection through SEP 200 (extensibletype slots). We can get rid of that very easily by just making that table an

Re: [Cython] Hash-based vtables

2012-06-08 Thread Dag Sverre Seljebotn
On 06/09/2012 03:21 AM, Robert Bradshaw wrote: On Fri, Jun 8, 2012 at 2:12 PM, Dag Sverre Seljebotn wrote: On 06/07/2012 12:35 PM, Dag Sverre Seljebotn wrote: On 06/07/2012 12:20 PM, Dag Sverre Seljebotn wrote: On 06/07/2012 12:26 AM, Robert Bradshaw wrote: On Wed, Jun 6, 2012 at 2:36

Re: [Cython] Hash-based vtables

2012-06-08 Thread Dag Sverre Seljebotn
On 06/07/2012 12:35 PM, Dag Sverre Seljebotn wrote: On 06/07/2012 12:20 PM, Dag Sverre Seljebotn wrote: On 06/07/2012 12:26 AM, Robert Bradshaw wrote: On Wed, Jun 6, 2012 at 2:36 PM, Dag Sverre Seljebotn wrote: On 06/06/2012 11:16 PM, Robert Bradshaw wrote: On Wed, Jun 6, 2012 at 1:57 PM

Re: [Cython] Hash-based vtables

2012-06-07 Thread Dag Sverre Seljebotn
On 06/07/2012 12:20 PM, Dag Sverre Seljebotn wrote: On 06/07/2012 12:26 AM, Robert Bradshaw wrote: On Wed, Jun 6, 2012 at 2:36 PM, Dag Sverre Seljebotn wrote: On 06/06/2012 11:16 PM, Robert Bradshaw wrote: On Wed, Jun 6, 2012 at 1:57 PM, Dag Sverre Seljebotn wrote: On 06/06/2012 10:41 PM

Re: [Cython] Hash-based vtables

2012-06-07 Thread Dag Sverre Seljebotn
On 06/07/2012 12:45 PM, Dag Sverre Seljebotn wrote: On 06/06/2012 11:00 PM, Robert Bradshaw wrote: On Tue, Jun 5, 2012 at 2:41 PM, Dag Sverre Seljebotn wrote: Is the goal then to avoid having to have an interning registry? Yes, and to avoid invoking an expensive hash function at runtime in

Re: [Cython] Hash-based vtables

2012-06-07 Thread Dag Sverre Seljebotn
On 06/06/2012 11:00 PM, Robert Bradshaw wrote: On Tue, Jun 5, 2012 at 2:41 PM, Dag Sverre Seljebotn wrote: Is the goal then to avoid having to have an interning registry? Yes, and to avoid invoking an expensive hash function at runtime in order to achieve good distribution. I don&#

Re: [Cython] Hash-based vtables

2012-06-07 Thread Dag Sverre Seljebotn
On 06/07/2012 12:20 PM, Dag Sverre Seljebotn wrote: On 06/07/2012 12:26 AM, Robert Bradshaw wrote: On Wed, Jun 6, 2012 at 2:36 PM, Dag Sverre Seljebotn wrote: On 06/06/2012 11:16 PM, Robert Bradshaw wrote: On Wed, Jun 6, 2012 at 1:57 PM, Dag Sverre Seljebotn wrote: On 06/06/2012 10:41 PM

Re: [Cython] Hash-based vtables

2012-06-07 Thread Dag Sverre Seljebotn
On 06/07/2012 12:26 AM, Robert Bradshaw wrote: On Wed, Jun 6, 2012 at 2:36 PM, Dag Sverre Seljebotn wrote: On 06/06/2012 11:16 PM, Robert Bradshaw wrote: On Wed, Jun 6, 2012 at 1:57 PM, Dag Sverre Seljebotn wrote: On 06/06/2012 10:41 PM, Dag Sverre Seljebotn wrote: On 06/05/2012 12

Re: [Cython] Hash-based vtables

2012-06-06 Thread Dag Sverre Seljebotn
Dag Sverre Seljebotn wrote: >On 06/06/2012 11:16 PM, Robert Bradshaw wrote: >> On Wed, Jun 6, 2012 at 1:57 PM, Dag Sverre Seljebotn >> wrote: >>> On 06/06/2012 10:41 PM, Dag Sverre Seljebotn wrote: >>>> >>>> On 06/05/2012 12:30 AM, Robe

Re: [Cython] Hash-based vtables

2012-06-06 Thread Dag Sverre Seljebotn
On 06/06/2012 11:16 PM, Robert Bradshaw wrote: On Wed, Jun 6, 2012 at 1:57 PM, Dag Sverre Seljebotn wrote: On 06/06/2012 10:41 PM, Dag Sverre Seljebotn wrote: On 06/05/2012 12:30 AM, Robert Bradshaw wrote: I just found http://cmph.sourceforge.net/ which looks quite interesting. Though the

Re: [Cython] Hash-based vtables

2012-06-06 Thread Dag Sverre Seljebotn
On 06/06/2012 10:41 PM, Dag Sverre Seljebotn wrote: On 06/05/2012 12:30 AM, Robert Bradshaw wrote: I just found http://cmph.sourceforge.net/ which looks quite interesting. Though the resulting hash functions are supposedly cheap, I have the feeling that branching is considered cheap in this

Re: [Cython] Hash-based vtables

2012-06-06 Thread Dag Sverre Seljebotn
On 06/05/2012 12:30 AM, Robert Bradshaw wrote: I just found http://cmph.sourceforge.net/ which looks quite interesting. Though the resulting hash functions are supposedly cheap, I have the feeling that branching is considered cheap in this context. Actually, this lead was *very* promising. I be

Re: [Cython] Hash-based vtables

2012-06-06 Thread Dag Sverre Seljebotn
On 06/06/2012 11:11 AM, Dag Sverre Seljebotn wrote: Stefan Behnel wrote: mark florisson, 05.06.2012 22:33: It doesn't even necessarily have to be about running user code, a user could craft data input which causes such a situation. For instance, let's say we have a ju

Re: [Cython] Hash-based vtables

2012-06-06 Thread Dag Sverre Seljebotn
Stefan Behnel wrote: >mark florisson, 05.06.2012 22:33: >> It doesn't even necessarily have to be about running user code, a >user >> could craft data input which causes such a situation. For instance, >> let's say we have a just-in-time specializer which specializes a >> function for the runti

Re: [Cython] Hash-based vtables

2012-06-05 Thread Dag Sverre Seljebotn
On 06/05/2012 10:50 PM, Robert Bradshaw wrote: On Tue, Jun 5, 2012 at 1:10 PM, Dag Sverre Seljebotn wrote: On 06/04/2012 11:43 PM, Robert Bradshaw wrote: On Mon, Jun 4, 2012 at 1:55 PM, Dag Sverre Seljebotn wrote: On 06/04/2012 09:44 PM, Dag Sverre Seljebotn wrote: Me and Robert

Re: [Cython] Hash-based vtables

2012-06-05 Thread Dag Sverre Seljebotn
On 06/04/2012 11:43 PM, Robert Bradshaw wrote: On Mon, Jun 4, 2012 at 1:55 PM, Dag Sverre Seljebotn wrote: On 06/04/2012 09:44 PM, Dag Sverre Seljebotn wrote: Me and Robert had a long discussion on the NumFOCUS list about this already, but I figured it was better to continue it and provide

Re: [Cython] Hash-based vtables

2012-06-05 Thread Dag Sverre Seljebotn
On 06/05/2012 08:02 PM, mark florisson wrote: On 5 June 2012 18:09, Dag Sverre Seljebotn wrote: On 06/05/2012 07:01 PM, Dag Sverre Seljebotn wrote: On 06/05/2012 09:25 AM, Stefan Behnel wrote: Dag Sverre Seljebotn, 04.06.2012 21:44: This can cause crashes/stack smashes etc. if there&#

Re: [Cython] Hash-based vtables

2012-06-05 Thread Dag Sverre Seljebotn
On 06/05/2012 07:01 PM, Dag Sverre Seljebotn wrote: On 06/05/2012 09:25 AM, Stefan Behnel wrote: Dag Sverre Seljebotn, 04.06.2012 21:44: This can cause crashes/stack smashes etc. if there's lower-64bit-of-md5 collisions, but a) the probability is incredibly small, b) it would only matt

Re: [Cython] Hash-based vtables

2012-06-05 Thread Dag Sverre Seljebotn
On 06/05/2012 09:25 AM, Stefan Behnel wrote: Dag Sverre Seljebotn, 04.06.2012 21:44: This can cause crashes/stack smashes etc. if there's lower-64bit-of-md5 collisions, but a) the probability is incredibly small, b) it would only matter in situations that should cau

Re: [Cython] Hash-based vtables

2012-06-05 Thread Dag Sverre Seljebotn
On 06/05/2012 11:16 AM, Robert Bradshaw wrote: On Tue, Jun 5, 2012 at 1:07 AM, Stefan Behnel wrote: Dag Sverre Seljebotn, 05.06.2012 00:07: The C FAQ says 'if you know the contents of your hash table up front you can devise a perfect hash', but no details, probably just hand-wa

Re: [Cython] Hash-based vtables

2012-06-04 Thread Dag Sverre Seljebotn
Robert Bradshaw wrote: >On Mon, Jun 4, 2012 at 1:55 PM, Dag Sverre Seljebotn > wrote: >> On 06/04/2012 09:44 PM, Dag Sverre Seljebotn wrote: >>> >>> Me and Robert had a long discussion on the NumFOCUS list about this >>> already, but I figured it was

Re: [Cython] Hash-based vtables

2012-06-04 Thread Dag Sverre Seljebotn
On 06/04/2012 09:44 PM, Dag Sverre Seljebotn wrote: Me and Robert had a long discussion on the NumFOCUS list about this already, but I figured it was better to continue it and provide more in-depth benchmark results here. It's basically a new idea of how to provide a vtable based on pe

[Cython] Hash-based vtables

2012-06-04 Thread Dag Sverre Seljebotn
Me and Robert had a long discussion on the NumFOCUS list about this already, but I figured it was better to continue it and provide more in-depth benchmark results here. It's basically a new idea of how to provide a vtable based on perfect hashing, which should be a lot simpler to implement than

Re: [Cython] SEP 201 draft: Native callable objects

2012-06-01 Thread Dag Sverre Seljebotn
On 06/01/2012 03:49 PM, Dag Sverre Seljebotn wrote: On 05/31/2012 10:13 PM, Robert Bradshaw wrote: On Thu, May 31, 2012 at 12:29 PM, Dag Sverre Seljebotn wrote: On 05/31/2012 08:50 PM, Robert Bradshaw wrote: On Thu, May 31, 2012 at 7:04 AM, Dag Sverre Seljebotn wrote: [Discussion on

Re: [Cython] SEP 201 draft: Native callable objects

2012-06-01 Thread Dag Sverre Seljebotn
On 05/31/2012 10:13 PM, Robert Bradshaw wrote: On Thu, May 31, 2012 at 12:29 PM, Dag Sverre Seljebotn wrote: On 05/31/2012 08:50 PM, Robert Bradshaw wrote: On Thu, May 31, 2012 at 7:04 AM, Dag Sverre Seljebotn wrote: [Discussion on numfo...@googlegroups.com please] I've uploa

[Cython] Fwd: Re: SEP 201 draft: Native callable objects

2012-05-31 Thread Dag Sverre Seljebotn
Forgot to CC this list... Original Message Subject: Re: [Cython] SEP 201 draft: Native callable objects Date: Thu, 31 May 2012 22:06:02 +0200 From: Dag Sverre Seljebotn Reply-To: numfo...@googlegroups.com To: numfo...@googlegroups.com On 05/31/2012 09:29 PM, Dag Sverre

Re: [Cython] SEP 201 draft: Native callable objects

2012-05-31 Thread Dag Sverre Seljebotn
On 05/31/2012 08:50 PM, Robert Bradshaw wrote: On Thu, May 31, 2012 at 7:04 AM, Dag Sverre Seljebotn wrote: [Discussion on numfo...@googlegroups.com please] I've uploaded a draft-state SEP 201 (previously CEP 1000): https://github.com/numfocus/sep/blob/master/sep201.rst ""

Re: [Cython] [Python-Dev] C-level duck typing

2012-05-31 Thread Dag Sverre Seljebotn
On 05/28/2012 05:59 PM, Dag Sverre Seljebotn wrote: Dag Sverre Seljebotn wrote: On 05/28/2012 01:24 PM, Nathaniel Smith wrote: On Mon, May 28, 2012 at 12:09 PM, mark florisson wrote: On 28 May 2012 12:01, Nathaniel Smith wrote: On Mon, May 28, 2012 at 11:55 AM, mark florisson

[Cython] SEP 201 draft: Native callable objects

2012-05-31 Thread Dag Sverre Seljebotn
[Discussion on numfo...@googlegroups.com please] I've uploaded a draft-state SEP 201 (previously CEP 1000): https://github.com/numfocus/sep/blob/master/sep201.rst """ Many callable objects are simply wrappers around native code. This holds for any Cython function, f2py functions, manually writ

[Cython] NumFOCUS and continuous integration

2012-05-28 Thread Dag Sverre Seljebotn
mfo...@googlegroups.com On May 28, 2012, at 1:27 PM, Dag Sverre Seljebotn wrote: On 05/28/2012 05:55 PM, David wrote: On Sunday, May 27, 2012 3:05:06 AM UTC+9, Dag Sverre Seljebotn wrote: That Other Thread contained some references to CI. So I'm mainly wondering what the current

Re: [Cython] [Python-Dev] C-level duck typing

2012-05-28 Thread Dag Sverre Seljebotn
Dag Sverre Seljebotn wrote: >On 05/28/2012 01:24 PM, Nathaniel Smith wrote: >> On Mon, May 28, 2012 at 12:09 PM, mark florisson >> wrote: >>> On 28 May 2012 12:01, Nathaniel Smith wrote: >>>> On Mon, May 28, 2012 at 11:55 AM, mark florisson >

Re: [Cython] [Python-Dev] C-level duck typing

2012-05-28 Thread Dag Sverre Seljebotn
, mark florisson wrote: On 28 May 2012 09:54, mark florisson wrote: On 27 May 2012 23:12, Nathaniel Smith wrote: On Sun, May 27, 2012 at 10:24 PM, Dag Sverre Seljebotn wrote: On 05/18/2012 10:30 AM, Dag Sverre Seljebotn wrote: On 05/18/2012 12:57 AM, Nick Coghlan wrote: I think the main

Re: [Cython] [Python-Dev] C-level duck typing

2012-05-27 Thread Dag Sverre Seljebotn
On 05/18/2012 10:30 AM, Dag Sverre Seljebotn wrote: On 05/18/2012 12:57 AM, Nick Coghlan wrote: I think the main things we'd be looking for would be: - a clear explanation of why a new metaclass is considered too complex a solution - what the implications are for classes that have nothing

Re: [Cython] gsoc: array expressions

2012-05-22 Thread Dag Sverre Seljebotn
On 05/22/2012 09:06 AM, Robert Bradshaw wrote: On Mon, May 21, 2012 at 11:57 PM, Dag Sverre Seljebotn wrote: On 05/22/2012 08:48 AM, Robert Bradshaw wrote: On Mon, May 21, 2012 at 11:36 PM, Dag Sverre Seljebotn wrote: On 05/22/2012 08:11 AM, Robert Bradshaw wrote: On Mon, May 21

Re: [Cython] gsoc: array expressions

2012-05-21 Thread Dag Sverre Seljebotn
On 05/22/2012 08:57 AM, Dag Sverre Seljebotn wrote: On 05/22/2012 08:48 AM, Robert Bradshaw wrote: On Mon, May 21, 2012 at 11:36 PM, Dag Sverre Seljebotn wrote: On 05/22/2012 08:11 AM, Robert Bradshaw wrote: On Mon, May 21, 2012 at 3:34 AM, Dag Sverre Seljebotn wrote: On 05/20/2012 04:03

Re: [Cython] gsoc: array expressions

2012-05-21 Thread Dag Sverre Seljebotn
On 05/22/2012 08:48 AM, Robert Bradshaw wrote: On Mon, May 21, 2012 at 11:36 PM, Dag Sverre Seljebotn wrote: On 05/22/2012 08:11 AM, Robert Bradshaw wrote: On Mon, May 21, 2012 at 3:34 AM, Dag Sverre Seljebotn wrote: On 05/20/2012 04:03 PM, mark florisson wrote: Hey, For my gsoc

Re: [Cython] gsoc: array expressions

2012-05-21 Thread Dag Sverre Seljebotn
On 05/22/2012 08:11 AM, Robert Bradshaw wrote: On Mon, May 21, 2012 at 3:34 AM, Dag Sverre Seljebotn wrote: On 05/20/2012 04:03 PM, mark florisson wrote: Hey, For my gsoc we already have some simple initial ideas, i.e. elementwise vector expressions (a + b with a and b arrays with

Re: [Cython] gsoc: array expressions

2012-05-21 Thread Dag Sverre Seljebotn
On 05/21/2012 12:56 PM, mark florisson wrote: On 21 May 2012 11:34, Dag Sverre Seljebotn wrote: On 05/20/2012 04:03 PM, mark florisson wrote: Hey, For my gsoc we already have some simple initial ideas, i.e. elementwise vector expressions (a + b with a and b arrays with arbitrary rank), I

Re: [Cython] gsoc: array expressions

2012-05-21 Thread Dag Sverre Seljebotn
On 05/20/2012 04:03 PM, mark florisson wrote: Hey, For my gsoc we already have some simple initial ideas, i.e. elementwise vector expressions (a + b with a and b arrays with arbitrary rank), I don't think these need any discussion. However, there are a lot of things that haven't been formally di

Re: [Cython] [Python-Dev] C-level duck typing

2012-05-18 Thread Dag Sverre Seljebotn
On 05/18/2012 12:57 AM, Nick Coghlan wrote: I think the main things we'd be looking for would be: - a clear explanation of why a new metaclass is considered too complex a solution - what the implications are for classes that have nothing to do with the SciPy/NumPy ecosystem - how subclassing woul

Re: [Cython] [Python-Dev] C-level duck typing

2012-05-17 Thread Dag Sverre Seljebotn
I don't know where to put this so I put it up top: I think this talk about implementing caching went a bit overboard myself. Here's a performance ladder for you: Alternative A) Focus on fast lookup; go from 100 ns function call to 5 ns function call Alternative B) Focus on caching a 20 ns l

Re: [Cython] [Python-Dev] C-level duck typing

2012-05-17 Thread Dag Sverre Seljebotn
Stefan Behnel wrote: >mark florisson, 16.05.2012 21:49: >> On 16 May 2012 20:15, Stefan Behnel wrote: >>> "Martin v. Löwis", 16.05.2012 20:33: > Does this use case make sense to everyone? > > The reason why we are discussing this on python-dev is that we are >looking > for a ge

Re: [Cython] [Python-Dev] C-level duck typing

2012-05-16 Thread Dag Sverre Seljebotn
On Wed, 16 May 2012 20:49:18 +0100, mark florisson wrote: On 16 May 2012 20:15, Stefan Behnel wrote: "Martin v. Löwis", 16.05.2012 20:33: Does this use case make sense to everyone? The reason why we are discussing this on python-dev is that we are looking for a general way to expose these C

Re: [Cython] CEP 1001 - Custom PyTypeObject extensions

2012-05-16 Thread Dag Sverre Seljebotn
On 05/14/2012 08:01 PM, Robert Bradshaw wrote: On Mon, May 14, 2012 at 10:05 AM, Nathaniel Smith wrote: On Mon, May 14, 2012 at 3:23 PM, Dag Sverre Seljebotn wrote: On 05/14/2012 01:34 PM, Stefan Behnel wrote: Dag Sverre Seljebotn, 13.05.2012 21:37: Anyway, thanks for the heads up, this

Re: [Cython] CEP 1001 - Custom PyTypeObject extensions

2012-05-14 Thread Dag Sverre Seljebotn
On 05/14/2012 01:34 PM, Stefan Behnel wrote: Dag Sverre Seljebotn, 13.05.2012 21:37: Anyway, thanks for the heads up, this seems to need a bit more work. Input from somebody more familiar with this corner of the CPython API very welcome. Wouldn't you consider python-dev an appropriate

Re: [Cython] CEP 1001 - Custom PyTypeObject extensions

2012-05-13 Thread Dag Sverre Seljebotn
On 05/13/2012 09:35 PM, Dag Sverre Seljebotn wrote: On 05/12/2012 08:44 PM, Nathaniel Smith wrote: On Fri, May 11, 2012 at 2:25 PM, Dag Sverre Seljebotn wrote: This comes from a refactor of the work on CEP 1000: A PEP proposal, with a hack for use in current Python versions and in the case of

Re: [Cython] CEP 1001 - Custom PyTypeObject extensions

2012-05-13 Thread Dag Sverre Seljebotn
On 05/12/2012 08:44 PM, Nathaniel Smith wrote: On Fri, May 11, 2012 at 2:25 PM, Dag Sverre Seljebotn wrote: This comes from a refactor of the work on CEP 1000: A PEP proposal, with a hack for use in current Python versions and in the case of PEP rejection, that allows 3rd party libraries to

[Cython] CEP 1001 - Custom PyTypeObject extensions

2012-05-11 Thread Dag Sverre Seljebotn
This comes from a refactor of the work on CEP 1000: A PEP proposal, with a hack for use in current Python versions and in the case of PEP rejection, that allows 3rd party libraries to agree on extensions to PyTypeObject. http://wiki.cython.org/enhancements/cep1001 If this makes it as a PEP, I

Re: [Cython] buffer syntax vs. memory view syntax

2012-05-10 Thread Dag Sverre Seljebotn
On 05/09/2012 09:08 PM, mark florisson wrote: On 9 May 2012 19:56, Robert Bradshaw wrote: On Tue, May 8, 2012 at 3:35 AM, mark florisson wrote: On 8 May 2012 10:47, Dag Sverre Seljebotn wrote: After some thinking I believe I can see more clearly where Mark is coming from. To sum up, it&#

Re: [Cython] CF based type inference

2012-05-09 Thread Dag Sverre Seljebotn
On 05/09/2012 05:13 PM, Stefan Behnel wrote: Dag Sverre Seljebotn, 08.05.2012 18:52: Vitja Makarov wrote: def partial_validity(): """ >>> partial_validity() ('str object', 'double', 'str object') """ a_1

  1   2   3   4   >