On 2/20/2012 6:49 AM, v_shan wrote:
DIH still running out of memory for me, with Full Import on a database of
size 1.5 GB.
Solr version: 3_5_0
Note that I have already added batchSize="-1" but getting same error.
A few questions:
- How much memory have you given to the JVM running this Solr
0, 2012 7:07:45 PM org.apache.solr.update.DirectUpdateHandler2 rollback
--
View this message in context:
http://lucene.472066.n3.nabble.com/DataImportHandler-running-out-of-memory-tp490797p3760755.html
Sent from the Solr - User mailing list archive at Nabble.com.
a chance
>>> to play w/ ms sql server
>>> --Noble
>>>
>>> On Thu, Jun 26, 2008 at 12:38 AM, wojtekpia <[EMAIL PROTECTED]>
>>> wrote:
>>>>
>>>> It looks like that was the problem. With responseBuffering=adaptive,
>>>> I&
x27;m
>>> able
>>> to load all my data using the sqljdbc driver.
>>> --
>>> View this message in context:
>>> http://www.nabble.com/DataImportHandler-running-out-of-memory-tp18102644p18119732.html
>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>
>>>
>>
>>
>>
>> --
>> --Noble Paul
>>
>
>
>
> --
> Regards,
> Shalin Shekhar Mangar.
>
--
--Noble Paul
GB of memory. I have set the dataSource
>>> batchSize to
>>> 1. My SQL query is "select top XXX field1, ... from table1". I
>>> have
>>> about 40 fields in my Solr schema.
>>>
>>> I thought the DataImportHandler would stream
7;m able
>> to load all my data using the sqljdbc driver.
>> --
>> View this message in context:
>> http://www.nabble.com/DataImportHandler-running-out-of-memory-tp18102644p18119732.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
>
> --
> --Noble Paul
>
--
Regards,
Shalin Shekhar Mangar.
ta using the sqljdbc driver.
> --
> View this message in context:
> http://www.nabble.com/DataImportHandler-running-out-of-memory-tp18102644p18119732.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
--
--Noble Paul
It looks like that was the problem. With responseBuffering=adaptive, I'm able
to load all my data using the sqljdbc driver.
--
View this message in context:
http://www.nabble.com/DataImportHandler-running-out-of-memory-tp18102644p18119732.html
Sent from the Solr - User mailing list archi
; >>> Here's my configuration:
> >>> I'm connecting to a SQL Server database using the sqljdbc driver. I've
> >>> given
> >>> my Solr instance 1.5 GB of memory. I have set the dataSource batchSize
> >>> to
> >>>
n my Solr schema.
>>>
>>> I thought the DataImportHandler would stream data from the DB rather
>>> than
>>> loading it all into memory at once. Is that not the case? Any thoughts
>>> on
>>> how to get around this (aside from getting a machine with m
>> about 40 fields in my Solr schema.
>>>
>>> I thought the DataImportHandler would stream data from the DB rather than
>>> loading it all into memory at once. Is that not the case? Any thoughts on
>>> how to get around this (aside from getting a machin
my configuration:
>>>> I'm connecting to a SQL Server database using the sqljdbc driver. I've
>>>> given
>>>> my Solr instance 1.5 GB of memory. I have set the dataSource batchSize
>>>> to
>>>> 1. My SQL query is "sele
tion:
>>>> I'm connecting to a SQL Server database using the sqljdbc driver. I've
>>>> given
>>>> my Solr instance 1.5 GB of memory. I have set the dataSource batchSize
>>>> to
>>>> 1. My SQL query is "select top
s in my Solr schema.
I thought the DataImportHandler would stream data from the DB
rather than
loading it all into memory at once. Is that not the case? Any
thoughts on
how to get around this (aside from getting a machine with more
memory)?
--
View this message in context:
http://www.nabb
(aside from getting a machine with more
memory)?
--
View this message in context:
http://www.nabble.com/DataImportHandler-running-out-of-memory-tp18102644p18102644.html
Sent from the Solr - User mailing list archive at Nabble.com.
--
Regards,
Shalin Shekhar Mangar.
-
My SQL query is "select top XXX field1, ... from table1". I have
>>> about 40 fields in my Solr schema.
>>>
>>> I thought the DataImportHandler would stream data from the DB rather than
>>> loading it all into memory at once. Is that
uot;select top XXX field1, ... from table1". I have
>> about 40 fields in my Solr schema.
>>
>> I thought the DataImportHandler would stream data from the DB rather than
>> loading it all into memory at once. Is that not the case? Any thoughts on
>> how to get aro
rtHandler would stream data from the DB rather than
> loading it all into memory at once. Is that not the case? Any thoughts on
> how to get around this (aside from getting a machine with more memory)?
>
> --
> View this message in context:
> http://www.nabble.com/DataImportHandl
at once. Is that not the case? Any
thoughts on
how to get around this (aside from getting a machine with more
memory)?
--
View this message in context:
http://www.nabble.com/DataImportHandler-running-out-of-memory-tp18102644p18102644.html
Sent from the Solr - User mailing list archive at Na
her than
loading it all into memory at once. Is that not the case? Any thoughts on
how to get around this (aside from getting a machine with more memory)?
--
View this message in context:
http://www.nabble.com/DataImportHandler-running-out-of-memory-tp18102644p18102644.html
Sent from the
20 matches
Mail list logo
