Re: [Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-12 Thread Isaac Gerg
It looks like some of the problem I was seeing has to do with reading in hdf5 files from matlab that contain strings for column types. when they are read in using h5py the type is reported as 'O' which is object. The problem is I can't reproduce the problem in small script because I can't get hdf

Re: [Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-12 Thread Isaac Gerg
I was able to fix my problem. One of the types in the recarray was of type object when it should have been S27. Type object was the result of reading in a matlab generated hdf5 file which had a string for one of the matrix columns. I converted this column manually to a S27. I am reverting my cod

Re: [Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-11 Thread Isaac Gerg
Will do. I'm working on my side to get a solution that works. It seems that when i use append_field i dont get a recarray back and when i call asrecarray=True, i get an error. once i fix this. i will replicate the error and post to github. On Thu, May 11, 2017 at 5:07 PM, Eric Wieser wrote: >

Re: [Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-11 Thread Eric Wieser
Even if you solve your own problem, please do - a SystemError is 100% a mistake in numpy, and should never be raised from python code, even if you call a numpy function with the wrong inputs. Eric On Thu, 11 May 2017 at 19:35 Isaac Gerg wrote: > Sure. > > On Thu, May 11, 2017 at 2:31 PM, Eric W

Re: [Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-11 Thread Derek Homeier
On 11 May 2017, at 8:52 pm, Isaac Gerg wrote: > > Looking at the code, i think merge and stack take in ndarrays, not recarrays > is that correct? It should accept either; however if your a and b are two recarrays with all uniquely named columns to get the 10-column recarray in your original exa

Re: [Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-11 Thread Isaac Gerg
Looking at the code, i think merge and stack take in ndarrays, not recarrays is that correct? On Thu, May 11, 2017 at 2:34 PM, Isaac Gerg wrote: > Sure. > > On Thu, May 11, 2017 at 2:31 PM, Eric Wieser > wrote: > >> If that's the case, can you file an issue on github along with a minimal >> exa

Re: [Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-11 Thread Isaac Gerg
Sure. On Thu, May 11, 2017 at 2:31 PM, Eric Wieser wrote: > If that's the case, can you file an issue on github along with a minimal > example that produces the error, and the full stack trace? > > On Thu, 11 May 2017 at 19:29 Isaac Gerg wrote: > >> newtable = np.lib.recfunctions.merge_arrays([

Re: [Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-11 Thread Eric Wieser
If that's the case, can you file an issue on github along with a minimal example that produces the error, and the full stack trace? On Thu, 11 May 2017 at 19:29 Isaac Gerg wrote: > newtable = np.lib.recfunctions.merge_arrays([a, b], asrecarray=True) > > yeilds: > > builtins.SystemError: ..\Objec

Re: [Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-11 Thread Isaac Gerg
newtable = np.lib.recfunctions.merge_arrays([a, b], asrecarray=True) yeilds: builtins.SystemError: ..\Objects\dictobject.c:2054: bad argument to internal function On Thu, May 11, 2017 at 2:02 PM, Benjamin Root wrote: > Check in numpy.recfunctions. I know there is merge_arrays() and > stack_arr

Re: [Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-11 Thread Benjamin Root
Check in numpy.recfunctions. I know there is merge_arrays() and stack_arrays(). I forget which one does what. Cheers! Ben Root On Thu, May 11, 2017 at 1:51 PM, Isaac Gerg wrote: > I'd prefer to stay in numpy land if possible. > > On Thu, May 11, 2017 at 1:17 PM, Isaac Xin Pei wrote: > >> Chec

Re: [Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-11 Thread Isaac Gerg
I'd prefer to stay in numpy land if possible. On Thu, May 11, 2017 at 1:17 PM, Isaac Xin Pei wrote: > Check Pandas pd.concate ? > On Thu, May 11, 2017 at 12:45 PM Isaac Gerg > wrote: > >> I have 2 arrays, a and b which are rec arrays of length 10. Each array >> has 5 columns. >> >> I would lik

Re: [Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-11 Thread Isaac Xin Pei
Check Pandas pd.concate ? On Thu, May 11, 2017 at 12:45 PM Isaac Gerg wrote: > I have 2 arrays, a and b which are rec arrays of length 10. Each array > has 5 columns. > > I would like to combine all the columns into a single recarray with 10 > columns and length 10. > > Thanks, > Isaac > ___

[Numpy-discussion] How to concatenate 2 recarrays into a single recarray

2017-05-11 Thread Isaac Gerg
I have 2 arrays, a and b which are rec arrays of length 10. Each array has 5 columns. I would like to combine all the columns into a single recarray with 10 columns and length 10. Thanks, Isaac ___ NumPy-Discussion mailing list NumPy-Discussion@python.