Wow, I'm in awe of the uptake of solrb already! Answers now being
provided before I even get a chance to chime in. And we haven't even
published a gem yet (though I did get it building successfully on a
nightly build server, and will get the gems published sometime soon).
I've indexed 50k runs in around 10 minutes, with one document per
POST. I'll surely start using the multiple per post feature soon.
Erik
On Jan 29, 2007, at 7:37 PM, Antonio Eggberg wrote:
Thanks Coda and Yonik! for the prompt answer..
I will give Solr-121 a try.. Cool
Cheers
Coda Hale <[EMAIL PROTECTED]> skrev: SOLR-121 just got applied to
the Solrb library, which allows
Solr::Connection#add to accept arrays of documents:
connection.add([doc1, doc2, doc3])
Which means you can do something like this:
connection.add(records.map { |r| make_solr_doc(r) })
Posting more than a single document in a request speeds things up by
quite a bit -- I've got a batch job which adds 250K+ documents to an
index in less than an hour -- about 10 fields, only the doc id stored.
On 1/29/07, Yonik Seeley wrote:
On 1/29/07, Antonio Eggberg wrote:
Is it a good practice to do after every insert .. is this what
is taking the time.. are there any general rule of thumb.
Definitely don't do a commit after every insert. Do a single one
at the end.
-Yonik
--
Coda Hale
http://blog.codahale.com
---------------------------------
Stava rätt! Stava lätt! Yahoo! Mails stavkontroll tar hand om
tryckfelen och mycket mer! Få den på http://se.mail.yahoo.com
