Well, 10million rows is a bunch of rows, it'll take some time. But you haven't given us any clue what that means. Is it taking 5 minutes? 5 hours? 5 days? Without some dimension on the problem it's really hard to provide any suggestions, you might be seeing entirely reasonable times, we just don't know.
MySql (depending on version) likes to load the entire results set into memory, which may be related. See: http://search.lucidimagination.com/search/out?u=http://wiki.apache.org/solr/DataImportHandlerFaq%23head-149779b72761ab071c841879545256bdbbdc15d2 <http://search.lucidimagination.com/search/out?u=http://wiki.apache.org/solr/DataImportHandlerFaq%23head-149779b72761ab071c841879545256bdbbdc15d2> HTH Erick On Fri, Oct 8, 2010 at 2:59 PM, sivaprasad <sivaprasa...@echidnainc.com>wrote: > > Hi, > I am indexing the data using DIH.Data coming from mysql.Each document > contains 30 fields.Some of the fields are multi valued.When i am trying to > index 10 million records it taking more time to index. > > Any body has suggestions to speed up indexing process?Any suggestions on > solr admin level configurations? > > > Thanks, > JS > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Speeding-up-solr-indexing-tp1667054p1667054.html > Sent from the Solr - User mailing list archive at Nabble.com. >
