[Rd] RSQLite indexing: summary

2007-10-23 Thread Thomas Lumley
I asked about slow indexing in RSQLite for a genetic database. Seth Falcon's suggestion of making sure that the identifiers were stored as integer rather than string made a big difference. SNPs come from the factory as "rs100092" and stripping the "rs" off the front is easy. Other advice abo

Re: [Rd] RSQLite indexing

2007-10-23 Thread Kasper Daniel Hansen
On Oct 22, 2007, at 6:07 PM, Kasper Daniel Hansen wrote: > On Oct 22, 2007, at 2:54 PM, Thomas Lumley wrote: > >> >> I am trying to use RSQLite for storing data and I need to create >> indexes on >> two variables in the table. It appears from searching the web that >> the CREATE >> INDEX operati

Re: [Rd] RSQLite indexing

2007-10-22 Thread Seth Falcon
Jeffrey Horner <[EMAIL PROTECTED]> writes: > Thomas Lumley wrote on 10/22/2007 04:54 PM: >> I am trying to use RSQLite for storing data and I need to create indexes on >> two variables in the table. It appears from searching the web that the >> CREATE >> INDEX operation in SQLite is relatively

Re: [Rd] RSQLite indexing

2007-10-22 Thread Kasper Daniel Hansen
On Oct 22, 2007, at 2:54 PM, Thomas Lumley wrote: > > I am trying to use RSQLite for storing data and I need to create > indexes on > two variables in the table. It appears from searching the web that > the CREATE > INDEX operation in SQLite is relatively slow for large files, and > this ha

Re: [Rd] RSQLite indexing

2007-10-22 Thread Marcus G. Daniels
Thomas Lumley wrote: >> How big is your dataset? SQLite can be slow, but I didn't think it >> was that slow. >> > > 35x100 entries on 12 variables > I had a similar problem a while back and took the opportunity to test various RDBMS. I found that a product called TimesTen from Oracl

Re: [Rd] RSQLite indexing

2007-10-22 Thread Jeffrey Horner
Thomas Lumley wrote on 10/22/2007 04:54 PM: > I am trying to use RSQLite for storing data and I need to create indexes on > two variables in the table. It appears from searching the web that the CREATE > INDEX operation in SQLite is relatively slow for large files, and this has > been > my exp

Re: [Rd] RSQLite indexing

2007-10-22 Thread Thomas Lumley
On Mon, 22 Oct 2007, hadley wickham wrote: > On 10/22/07, Thomas Lumley <[EMAIL PROTECTED]> wrote: >> >> I am trying to use RSQLite for storing data and I need to create indexes on >> two variables in the table. It appears from searching the web that the CREATE >> INDEX operation in SQLite is rel

Re: [Rd] RSQLite indexing

2007-10-22 Thread hadley wickham
On 10/22/07, Thomas Lumley <[EMAIL PROTECTED]> wrote: > > I am trying to use RSQLite for storing data and I need to create indexes on > two variables in the table. It appears from searching the web that the CREATE > INDEX operation in SQLite is relatively slow for large files, and this has > been

[Rd] RSQLite indexing

2007-10-22 Thread Thomas Lumley
I am trying to use RSQLite for storing data and I need to create indexes on two variables in the table. It appears from searching the web that the CREATE INDEX operation in SQLite is relatively slow for large files, and this has been my experience as well. The two index variables are crossed.