RS146BIJAY commented on issue #13387:
URL: https://github.com/apache/lucene/issues/13387#issuecomment-2360651201
## Summary
In summary the problem can be broken down into three sub problems.
1. Having abstraction to write the data into different groups (Multiple
Writers)
2. Having a single interface/entity for multiple groups for client
(OpenSearch) interaction (for Sequence id generation, segment replication, etc)
with Lucene.
3. Merging the segments belonging to the same group.
With the different approaches we investigated, none of them satisfies/solves
the above 3 sub problems cleanly with decent complexity. That leaves us with
the originally suggested approach of using different DWPTs to represent
different groups. The original approach:
1. Uses single IndexWriter and different DWPT which provides clear
abstraction for different groups.
2. With single IndexWriter performs updates, at any given time, only a
single SegmentInfos, generation and version were associated with a Lucene index.
3. Does require a new merge policy to merge the segments belonging to the
same group.
Open for thoughts and suggestions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
