Hi I am indexing our website using solr. After crawling the website I am adding the contents to the solr server and committing. My slor server is on 3.6 version.
I observed that initially the indexing is very fast. It added around 33 docs/sec; making 2000 / minute. But then after the 30 mins or so the performance reduces drastically. Within an hour of indexing it is adding 200 docs/min which is 1/10 times what it used to add. Here is the details the time and the total docs in slor. Time Docs in solr (min) 3.48 0 3.54 10,000 3.58 16,000 4.03 24,000 4:08 30,000 4:15 38,000 4:18 41,000 4:25 42,230 4:31 43,140 4:38 44,410 This is after making the name field stored="false". Otherwise the same behavior can be duplicated much before. My doc has 3 fields and the name field is the extracted text from the webpages. Others are too small Not sure what is wrong. I am using a win 7 machine dual core and 4 GB ram. Thanks Amit -- View this message in context: http://lucene.472066.n3.nabble.com/solr-indexing-slows-down-after-few-minutes-tp4004337.html Sent from the Solr - User mailing list archive at Nabble.com.
