I asked about slow indexing in RSQLite for a genetic database. Seth Falcon's
suggestion of making sure that the identifiers were stored as integer rather
than string made a big difference. SNPs come from the factory as "rs100092"
and stripping the "rs" off the front is easy.
Other advice abo
On Oct 22, 2007, at 6:07 PM, Kasper Daniel Hansen wrote:
> On Oct 22, 2007, at 2:54 PM, Thomas Lumley wrote:
>
>>
>> I am trying to use RSQLite for storing data and I need to create
>> indexes on
>> two variables in the table. It appears from searching the web that
>> the CREATE
>> INDEX operati
Jeffrey Horner <[EMAIL PROTECTED]> writes:
> Thomas Lumley wrote on 10/22/2007 04:54 PM:
>> I am trying to use RSQLite for storing data and I need to create indexes on
>> two variables in the table. It appears from searching the web that the
>> CREATE
>> INDEX operation in SQLite is relatively
On Oct 22, 2007, at 2:54 PM, Thomas Lumley wrote:
>
> I am trying to use RSQLite for storing data and I need to create
> indexes on
> two variables in the table. It appears from searching the web that
> the CREATE
> INDEX operation in SQLite is relatively slow for large files, and
> this ha
Thomas Lumley wrote:
>> How big is your dataset? SQLite can be slow, but I didn't think it
>> was that slow.
>>
>
> 35x100 entries on 12 variables
>
I had a similar problem a while back and took the opportunity to test
various RDBMS. I found that a product called TimesTen from Oracl
Thomas Lumley wrote on 10/22/2007 04:54 PM:
> I am trying to use RSQLite for storing data and I need to create indexes on
> two variables in the table. It appears from searching the web that the CREATE
> INDEX operation in SQLite is relatively slow for large files, and this has
> been
> my exp
On Mon, 22 Oct 2007, hadley wickham wrote:
> On 10/22/07, Thomas Lumley <[EMAIL PROTECTED]> wrote:
>>
>> I am trying to use RSQLite for storing data and I need to create indexes on
>> two variables in the table. It appears from searching the web that the CREATE
>> INDEX operation in SQLite is rel
On 10/22/07, Thomas Lumley <[EMAIL PROTECTED]> wrote:
>
> I am trying to use RSQLite for storing data and I need to create indexes on
> two variables in the table. It appears from searching the web that the CREATE
> INDEX operation in SQLite is relatively slow for large files, and this has
> been
I am trying to use RSQLite for storing data and I need to create indexes on
two variables in the table. It appears from searching the web that the CREATE
INDEX operation in SQLite is relatively slow for large files, and this has been
my experience as well.
The two index variables are crossed.