Re: Solr replication threads blocking each other causing large delays

2024-06-27 Thread Chris Hostetter
Everything you are describing smells like some kind of Disk/IO throttling behavior external to Solr. Nothing you've identified below should be particularly "slow" and it certainly shouldn't get orders of magnitude slower for subsequent SolrCores in rapid succession, even as those cores are sm

Re: Solr replication threads blocking each other causing large delays

2024-06-27 Thread Marcus Bergner
Hi again, After digging through Solr and Lucene code some more and instrumenting it with lots of timing I can see three main culprits when it comes to replicating data from 3 cores around the same time: Lucene IndexWriter's getFieldNumberMap Have often seen times up around 30 seconds but what is

Re: Solr replication threads blocking each other causing large delays

2024-06-26 Thread Mark Miller
probably the easiest way to get input on this one is to find what seems to be the cause of what looks like global lock behavior and then mention that cause here. No, you wouldn't expect replication to take turns and go one at a time, but you're more likely to get relevant feedback if you can point

Solr replication threads blocking each other causing large delays

2024-06-25 Thread Marcus Bergner
Hi, Before I proceed to create a Solr Jira issue I'll ask for some feedback here first. I did start a thread on the users mailing list a few days ago about this topic without any relevant feedback (https://lists.apache.org/thread/yv5d869tzckdgp6py83lqrgtpqz0xqvv) and I have done some more inves