Hello all,
We have a solr instance with around 40MLN docs.
In the bulk import phase we noticed a high IO and CPU load and it looks
like it's related to autocommit because if I disable autocommit the load
of the system is very low.
I know that disabling autocommit is not recommended, but I'm wondering
if there is a minimum hardware requirement to make this suggestion
effective.
Our system is not very powerful in terms of IO read/write speed (around
100 Mbyte/s) is it possible that this relatively low IO performance
combined with
autocommit will slow down incredibly our solr instance to the point of
making it not responsive?
The same can be true also for the merge policy? how the IO speed can
affect the merge policy parameters?
I kept the default merge policy configuration but it looks like it never
merges segments. How can I know if a merge is happening?
Thank you
Danilo
--
Danilo Tomasoni
Fondazione The Microsoft Research - University of Trento Centre for
Computational and Systems Biology (COSBI)
Piazza Manifattura 1, 38068 Rovereto (TN), Italy
tomas...@cosbi.eu
http://www.cosbi.eu
As for the European General Data Protection Regulation 2016/679 on the protection of natural persons with regard to the processing of personal data, we inform you that all the data we possess are object of treatment in the respect of the normative provided for by the cited GDPR.
It is your right to be informed on which of your data are used and how; you may
ask for their correction, cancellation or you may oppose to their use by
written request sent by recorded delivery to The Microsoft Research –
University of Trento Centre for Computational and Systems Biology Scarl, Piazza
Manifattura 1, 38068 Rovereto (TN), Italy.
P Please don't print this e-mail unless you really need to
