Re: [DISCUSS] SIP-20: Separation of Compute and Storage in SolrCloud

I have created a Jira, the branch with the current code and documentation and updated the SIP-20 page: Jira: SOLR-17125 Branch: jira/solr-

Re: [DISCUSS] SIP-20: Separation of Compute and Storage in SolrCloud

> > To clarify - since you mentioned durability, I'm assuming the commit that > happens on each update batch is a "hard commit"? > Yes. If the user made an explicit hard-commit or had an autoCommit configured, > would that be a no-op for ZERO collections? > Yes. > How do soft-commits behave - I

Re: [DISCUSS] SIP-20: Separation of Compute and Storage in SolrCloud

Thanks for the detailed response! I've got a few follow-ups that I'll ask in line, but I think I've got the core idea now, thanks! > With the implementation in its current state, an indexing batch (as sent > by the client) is processed by the leader replica, committed to local disk > then written

Re: [DISCUSS] SIP-20: Separation of Compute and Storage in SolrCloud

Hi Jason, Good questions! Note there is a related question on the users list, see thread Node roles vs SIP-20 Separation of Compute and Storage When I share the code (later this week in all likelihood) I will share a detailed writ

Re: [DISCUSS] SIP-20: Separation of Compute and Storage in SolrCloud

Hey Ilan, Thanks for putting together this writeup. I think I understand the goal conceptually, and it sounds like a good one for Solr! But I'm still having trouble understanding how this all would actually work. So a few questions, inline: > A fourth replica type called ZERO is introduced Wh

Re: [DISCUSS] SIP-20: Separation of Compute and Storage in SolrCloud

+1, thanks for the contribution Ilan! Looking forward to seeing this coming to fruition. On Sun, 14 Jan 2024 at 03:40, Ilan Ginzburg wrote: > I have created SIP-20 > > https://cwiki.apache.org/confluence/display/SOLR/SIP-20%3A+Separation+of+Compute+and+Storage+in+SolrCloud > > In the next few da

[DISCUSS] SIP-20: Separation of Compute and Storage in SolrCloud

I have created SIP-20 https://cwiki.apache.org/confluence/display/SOLR/SIP-20%3A+Separation+of+Compute+and+Storage+in+SolrCloud In the next few days I will create a Jira + a branch that implements the SIP proposal and that includes documentation on how to approach that branch and what's in it. Th