On Jun 2, 2010, at 10:30 PM, Blargy wrote: > Whats more efficient a batch size of 1000 or -1 for MySQL? Is this why its > so slow because I am using 2 different datasources? >
By batch size, I meant the number of docs sent from the client to Solr. MySQL Batch Size is broken. The only thing that will work is -1 or not specifying it at all. If you don't specify it, it materializes all rows into memory. Does your data really need to be in two different databases? That is undoubtedly your bottleneck. -------------------------- Grant Ingersoll http://www.lucidimagination.com/ Search the Lucene ecosystem using Solr/Lucene: http://www.lucidimagination.com/search
