I don't seem to be seeing a signifigant slowdown over time when I use the old
defaults for merge threads and max merges.
- Mark
On Jul 25, 2013, at 10:17 AM, Mark Miller wrote:
> I'm looking into some possible slow down after long indexing issues when I
> get back from vacation. This could be
I'm looking into some possible slow down after long indexing issues when I get
back from vacation. This could be related. Very early guess though.
Another thing you might try - Lucene recently changed the merge scheduler
policy defaults (in 4.1) - it used to use up 3 threads to merge and have a
Forgot to attach server and solr configurations:
SolrCloud 4.1, internal Zookeeper, 16 shards, custom java importer.
Server: Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz, 32 cores, 192gb RAM, 10tb
SSD and 50tb SAS memory
On Thu, Jul 25, 2013 at 3:20 PM, Radu Ghita wrote:
>
> Hi,
>
> We are having
.
-- Jack Krupansky
-Original Message-
From: Radu Ghita
Sent: Thursday, July 25, 2013 8:20 AM
To: solr-user@lucene.apache.org
Subject: SolrCloud commit process is too time consuming, even if documents
are light
Hi,
We are having a client with business model that requires indexing each
Hi,
We are having a client with business model that requires indexing each
month billion rows into solr from mysql in a small time-frame. The
documents are very light, but the number is very high and we need to
achieve speeds of around 80-100k/s. The built in solr indexer goes to
40-50k tops, but
