Hi Edwin,
Indexing speed depends on multiple factors: HW, Solr configurations and
load, documents, indexing client: More complex documents, more CPU time
to process each document before indexing structure is written down to
disk. Bigger the index, more heap is used, more frequent GCs. Maybe you
are just not sending enough doc to Solr to have such throughput.
The best way to pinpoint bottleneck is to use some monitoring tool. One
such tool is our SPM (http://sematext.com/spm) - it allows you to
monitor both Solr and OS metrics.
HTH,
Emir
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On 14.04.2016 05:29, Zheng Lin Edwin Yeo wrote:
Hi,
Would like to find out, what is the optimal indexing speed in Solr?
Previously, I managed to get more than 3GB/hour, but now the speed has drop
to 0.7GB/hr. What could be the potential reason behind this?
Besides the index size getting bigger, I have only added in more
collections into the core and added another field. Other than that nothing
else has been changed..
Could the source file which I'm indexing made a difference in the indexing
speed?
I'm using Solr 5.4.0 for now, but will be planning to migrate to Solr 6.0.0.
Regards,
Edwin
