Hi all,
Before doing a splitshard - Is there a way to figure out optimal hash ranges
for the shard that will evenly split the documents on the new sub-shards
that get created? Sort of a dry-run to the actual split shard command with
ranges parameter specified with it that just shows the number of
Looks like its not possible to find out the optimal hash ranges for a split
before you actually split it. So the only way out is to keep splitting out
the large subshards?
--
View this message in context:
http://lucene.472066.n3.nabble.com/Finding-out-optimal-hash-ranges-for-shard-split-tp42036
Okay - Thanks for the confirmation Shalin. Could this be a feature request
in the Collections API - that we have a Split shard dry run API that accepts
sub-shards count as a request param and returns the optimal shard ranges for
the number of sub-shards requested to be created along with the respe
Yes - I'm using 2 level composite ids and that has caused the imbalance for
some shards.
Its cars data and the composite ids are of the form year-make!model-and
couple of other specifications. e.g. 2013Ford!Edge!123456 - but there are
just far too many Ford 2013 or 2011 cars that go and occupy the
Hello all,
Struggling to get this going with SolrCloud -
Requirement in brief :
- Ingest about 4M Used Cars listings a day and track all unique cars for
changes
- 4M automated searches a day (during the ingestion phase to check if a doc
exists in the index (based on values of 4-5 key fields) o
Oops - my bad - Its autoSoftCommit that is set after every doc and not an
autoCommit.
Following snippet from the solrconfig -
1
true
1
Shall I increase the autoCommit time as well? But would that mean more RAM
is consumed by all instances running on the box?
Thanks for the reply Shalin.
1. I'll try increasing the softCommit interval and the autoSoftCommit too.
One mistake I made that I realized just now is that I am using /solr/select
and expecting it to do an NRT - for NRT search its got to be /select/get
handler that needs to be used. Please confirm
Thank you everyone for your responses. Increased the hard commit to 10mins
and autoSoftCommit to 10 secs. (I wont really need a real time get - tweaked
the app code to cache the doc and use the app side cached version instead of
fetching it from Solr) Will watch it for a day or two and clock the
th
Thanks Shawn. I'm using 2 level composite id routing right now. These are all
Used Cars listings and all search queries always have car year and make in
the search criteria - hence that made sense to have Year+Make as level 1 in
the composite id. Beyond that the second level composite id is based o
Hello all,
Thank you for your suggestions. With the autoCommit (every 10 mins) and
softCommit (every 10 secs) frequencies reduced things work much better now.
The CPU usages has gone down considerably too (by about 60%) and the
read/write throughput is showing considerable improvements too.
Ther
Hello all,
Hosted a SolrCloud - 6 Nodes - 36 Shards x 3 Replica each -> 108 cores
across 6 servers. Moved in about 250M documents in this cluster. When I
restart this cluster - only the leaders per shard comes up live instantly
(within a minute) and all the replicas are shown as Recovering on the
1. I've hosted it with Helios v 0.07 that ships with Solr 4.10
2. Change to solrconfig.xml -
a. commits every 10 mins
b. soft commits every 10 secs
c. disabled all caches as the usage is very random (no end users only
services doing the searches) and mostly single requests
d. use cold
Hi all,I have a cluster with 36 Shards and 3 replica per shard. I had to
recently restart the entire cluster - most of the shards & replica are back
up - but a few shards have not had any leaders for a long long time (close
to 18 hours now) - I tried reloading these cores and even the servlet
conta
Hi all,
I have a cluster with 36 Shards and 3 replica per shard. I had to recently
restart the entire cluster - most of the shards & replica are back up - but
a few shards have not had any leaders for a long long time (close to 18
hours now) - I tried reloading these cores and even the servlet co
Erick Erickson gmail.com> writes:
>
> What version of Solr?
>
> On Tue, Jan 20, 2015 at 7:07 AM, anand.mahajan zerebral.co.in>
> wrote:
> > Hi all,
> >
> >
> > I have a cluster with 36 Shards and 3 replica per shard. I had to
> recently
>
Hi,
I needed to delete a couple replica for a shard and used the Async
Collections API calls to do that. I see all my requests in the 'submitted'
state but none have been processed yet. (been 4 hours or so)
How do I know whether these requests are under process at all? And if
required how could I
16 matches
Mail list logo
