Re: Future of the cross-dc work

2023-09-11 Thread Mark Miller
; >>>> main Solr repo.Or, be promoted to some repo that doesn’t have > >>> “sandbox” > >>>> in the name, like the Solr-operator project…. > >>>> > >>>> > >>>> > >>>>> On Sep 8, 2023, at 4:50 PM, David Smil

Re: Future of the cross-dc work

2023-09-11 Thread Mark Miller
The only real complexity around it is properly dealing with the queue in a large scale production environment, and none of that is code complexity. CrossDC is a critical feature for many, the problem with the previous iteration was it tried to be the queuing system and was obviously never going to

Re: Future of the cross-dc work

2023-09-10 Thread Andrzej Białecki
t;>>> wrote: >>>>> >>>>> Hi Houston, >>>>> >>>>> Can you please elaborate on the purpose: >>>>>> and moving it into Solr would allow others to use and collaborate on >>> it >>>>> easier. >

Re: Future of the cross-dc work

2023-09-09 Thread Mark Miller
It has integration tests, Kafka has an embedded version for tests, just no CI setup currently. If it comes into Solr, it will just pick up Solr’s CI. The design can work with any queuing system, but due to the various intricacies involved in the different queue implementations, adding support is b

Re: Future of the cross-dc work

2023-09-09 Thread Ishan Chattopadhyaya
Hi Anshum, I mostly agree with you. My point is that we shouldn't *release* it until broader community has had a chance to weigh in, both development and testing. Towards that, I like Jan's idea of using PRs etc for more code reviews, before merging it to some official branch. I'm not comfortable

Re: Future of the cross-dc work

2023-09-09 Thread Jan Høydahl
Hi, There has for sure been interest since CDCR disappeared. Given the close integration with Solr and its small footprint, I’m supportive of this becoming a Solr module with URP and a standalone app in the main repo. So the code can be cleaned up, documented and migrated over in a few PRs as a

Re: Future of the cross-dc work

2023-09-09 Thread Anshum Gupta
I wouldn't term people who work at a particular company as committers. I'm reasonably sure when folks contribute to the project they wear their ASF hat. If they don't, they should. Like most other features, this one also is a result of the need by users of the project. I completely agree it's bee

Re: Future of the cross-dc work

2023-09-09 Thread Ishan Chattopadhyaya
rate on > > it > > > > easier. > > > > > > > > How is that? > > > > > > > > I am guessing another motivation may be visibility / awareness. If > > that > > > is > > > > a motivation, I think that can be add

Re: Future of the cross-dc work

2023-09-08 Thread Mark Miller
; is > > > a motivation, I think that can be addressed with prominent references > in > > > the Solr Reference Guide and website news updates. > > > > > > ~ David > > > > > > > > > On Thu, Sep 7, 2023 at 12:33 PM Houston Putman > >

Re: Future of the cross-dc work

2023-09-08 Thread Houston Putman
e Solr Reference Guide and website news updates. > > > > ~ David > > > > > > On Thu, Sep 7, 2023 at 12:33 PM Houston Putman > wrote: > > > >> Hey everyone, > >> > >> I think it's a good time to talk about the future of

Re: Future of the cross-dc work

2023-09-08 Thread Eric Pugh
with prominent references in > the Solr Reference Guide and website news updates. > > ~ David > > > On Thu, Sep 7, 2023 at 12:33 PM Houston Putman wrote: > >> Hey everyone, >> >> I think it's a good time to talk about the future of the cross DC work >>

Re: Future of the cross-dc work

2023-09-08 Thread David Smiley
ces in the Solr Reference Guide and website news updates. ~ David On Thu, Sep 7, 2023 at 12:33 PM Houston Putman wrote: > Hey everyone, > > I think it's a good time to talk about the future of the cross DC work > that's been going on in the Solr Sandbox repo. > > Ma

Future of the cross-dc work

2023-09-07 Thread Houston Putman
Hey everyone, I think it's a good time to talk about the future of the cross DC work that's been going on in the Solr Sandbox repo. Mark (and others) have been doing amazing work there, and I think it's close to a state that we can bring it out of the sandbox and into Solr it