DivyanshIITB commented on PR #14335:
URL: https://github.com/apache/lucene/pull/14335#issuecomment-2710583795

   Thank you for the review, @jpountz!
   
   I see your concern regarding equal resource distribution across IndexWriter 
instances potentially leading to inefficiencies when some writers have a 
significantly heavier workload than others. My initial goal was to ensure 
fairness in multi-tenant environments, but I agree that a static 1/N allocation 
might not be ideal.
   
   To address this, I’m considering an adaptive resource allocation approach, 
where:
   
   - Recent Merge Activity Tracking: Each IndexWriter's recent merge activity 
is monitored.
   - Dynamic Thread Allocation: Instead of an equal split, threads are assigned 
based on recent workload.
   - Merge Throttling Balance: Prevents a single heavy writer from starving 
others while ensuring underutilized writers don’t hold 
      excessive resources.
   
   Would this approach align better with Lucene’s design goals?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to