Re: NRT vs TLOG bulk indexing performances

Hi, Thank you Erick for your response. My documents are small. Here is a sample csv file http://gofile.me/2dlpH/66hv2NPhJ In the TLOG case, the CPU is not hot and not idling on leaders : - 1m load average between 1.5 and 2.5 (4 cpu cores) - CPU % between

Re: NRT vs TLOG bulk indexing performances

"I understand that while non leader TLOG is copying the index from leader, the leader stop indexing” This _better_ not be happening. If you can demonstrate this let’s open a JIRA. > On Oct 25, 2019, at 8:28 AM, Dominique Bejean > wrote: > > I understand that while non leader TLOG is copying th

Re: NRT vs TLOG bulk indexing performances

I’m also surpised that you see a slowdown, it’s worth investigating. Let’s take the NRT case with only a leader. I’ve seen the NRT indexing time increase when even a single follower was added (30-40% in this case). We believed that the issue was the time the leader sat waiting around for the fo

Re: NRT vs TLOG bulk indexing performances

Shawn Heisey kirjoitti 25.10.2019 klo 14.54: > With newer Solr versions, you can ask SolrCloud to prefer PULL replicas > for querying, so queries will be targeted to those replicas, unless they > all go down, in which case it will go to non-preferred replica types.  I > do not know how to do this,

Re: NRT vs TLOG bulk indexing performances

Shawn, So, I understand that while non leader TLOG is copying the index from leader, the leader stop indexing. One shot large heavy bulk indexing should be very much more impacted than continus ligth indexing. Regards. Dominique Le ven. 25 oct. 2019 à 13:54, Shawn Heisey a écrit : > On 10/25

Re: NRT vs TLOG bulk indexing performances

On 10/25/2019 1:16 AM, Dominique Bejean wrote: For collection created with all replicas as NRT * Indexing time : 22 minutes For collection created with all replicas as TLOG * Indexing time : 34 minutes NRT indexes simultaneously on all replicas. So when indexing is done on one, it is a

Re: NRT vs TLOG bulk indexing performances

Hi Jörn , I am using version 8.2. I repeated the test twice for each mode. I restarted solr nodes and deleted / created empty collection each time. Regards. Dominique Le ven. 25 oct. 2019 à 09:20, Jörn Franke a écrit : > Which Solr version are you using and how often you repeated the test? >

Re: NRT vs TLOG bulk indexing performances

Which Solr version are you using and how often you repeated the test? > Am 25.10.2019 um 09:16 schrieb Dominique Bejean : > > Hi, > > I made some benchmarks for bulk indexing in order to compare performances > and ressources usage for NRT versus TLOG replica. > > Environnent : > * Solrcloud wi

NRT vs TLOG bulk indexing performances

Hi, I made some benchmarks for bulk indexing in order to compare performances and ressources usage for NRT versus TLOG replica. Environnent : * Solrcloud with 4 Solr nodes (8 Gb RAM, 4 Gb Heap) * 1 collection with 2 shards x 2 replicas (all NRT or all TLOG) * 1 core per Solr Server Indexing of a