The attribute name is batchSize="-1" (it is case sensitive) . Tjis
ensures that Mysql driver fetcches row by row
http://wiki.apache.org/solr/DataImportHandlerFaq
On Mon, Nov 3, 2008 at 9:17 PM, sunnyfr <[EMAIL PROTECTED]> wrote:
>
> Hi Shalin,
> *
> I would like to know if you just used batchsize
Hi Shalin,
*
I would like to know if you just used batchsize = -1.
When I do that I use all Mysql's memory and it's a problem for the database
and other process on it like update insert ...
It will keep my database busy for 10hours, it's too much, is there a way to
manage it differently ?
Thank
No. DataImportHandler runs inside of Solr itself so it does not need to use
HTTP. It reads databases using Jdbc and uses API calls to create and load
documents into Solr. Benefits over custom solutions would include speed (no
HTTP/XML parsing overhead) and ofcourse all benefits of open source softw
Does the DataImportHandler use HTTP to load documents into Solr?
Is there any (run-time) performance benefit to using it rather than a custom
MySQL -> XML solution?
Shalin Shekhar Mangar wrote:
>
> Hi Rusli,
>
> Without going into specifics, I can tell you that we're using
> DataImportHandl
That sounds great!
I'm not launching for the next few of months so I'll wait and hope
that 1.3 comes out before that and just use XML while I develop the
rest of the site.
Thank you!
On Tue, Jun 10, 2008 at 12:57 PM, Shalin Shekhar Mangar
<[EMAIL PROTECTED]> wrote:
> Hi Rusli,
>
> Without going
Hi Rusli,
Without going into specifics, I can tell you that we're using
DataImportHandler successfully in production with many millions of documents
being imported from databases. Try it out and let us know if you face any
problems. DataImportHandler will be part of Solr 1.3 (the next release) and
