Thanks Erick!
Yes, most likely I'll have to do sharing soon before the index size grows
too big.
Regards,
Edwin
On 21 December 2015 at 13:18, Rahul Ramesh wrote:
> Thanks Erick!
>
> Rahul
>
> On Mon, Dec 21, 2015 at 10:07 AM, Erick Erickson
> wrote:
>
> > Rahul:
> >
> > bq: we dont want the
Thanks Erick!
Rahul
On Mon, Dec 21, 2015 at 10:07 AM, Erick Erickson
wrote:
> Rahul:
>
> bq: we dont want the index sizes to grow too large and auto optimzie to
> kick in
>
> Not what quite what's going on. There is no "auto optimize". What
> there is is background merging that will take _some
Rahul:
bq: we dont want the index sizes to grow too large and auto optimzie to kick in
Not what quite what's going on. There is no "auto optimize". What
there is is background merging that will take _some_ segments and
merge them together. Very occasionally this will be the same as a full
optimi
Hi Erick,
We index around several million documents/ day and we optimize everyday
when the relative load is low. The reason we optimize is, we dont want the
index sizes to grow too large and auto optimzie to kick in. When auto
optimize kicks in, it results in unpredictable performance as it is CPU
You'll probably have to shard before you get to the TB range. At that
point, all the optimization is done individually on each shard so it
really doesn't matter how many shards you have.
Just issuing
http://solr:port/solr/collection/update?optimize=true
is sufficient, that'll forward the optimize
Thanks for your information Erick.
We have yet to decide how often we will update the index to include new
documents that came in. Let's say we update the index once a day, then when
the indexed is updated, we do the optimization (this will be done at night
when there are not many users using the
Much depends on how often the index is updated. If your index only
changes, say, once a day then it's probably a good idea. If you're
constantly updating your index, then I'd recommend that you do _not_
optimize.
Optimizing will create one large segment. That segment will be
unlikely to be merged
Hi,
I would like to find out, will it be good to do write a script to do an
auto-opitmization of the indexes at a certain time every day? Is there any
advantage to do so?
I found that optimization can reduce the index size by quite a
signification amount, and allow the searching of the index to r
