Re: Future of the cross-dc work

2023-09-11 Thread Mark Miller
The only real complexity around it is properly dealing with the queue in a large scale production environment, and none of that is code complexity. CrossDC is a critical feature for many, the problem with the previous iteration was it tried to be the queuing system and was obviously never going to

Re: Discuss SIP-14 Embedded Zookeeper

2023-09-11 Thread Ilan Ginzburg
Getting rid of standalone Solr mode is not part of SIP-14, I suggest we discuss it separately from the effort to make SolrCloud easier to deploy or the default. On Sat, Sep 9, 2023 at 4:11 PM Ishan Chattopadhyaya < ichattopadhy...@gmail.com> wrote: > +1 fully support this, also support the move f

Re: updateLog tlog directory config silently ignored (SOLR-16962)

2023-09-11 Thread Michael Gibney
Thanks Ilan, this seems good. In addition to addressing practical concerns, this could also be an opportunity to clarify the semantics around updateLog/tlog configuration: In looking closely at this code, my understanding is that the `${solr.ulog.dir:}` setting in solrconfig.xml currently defines

Re: Discuss SIP-14 Embedded Zookeeper

2023-09-11 Thread Eric Pugh
Agreed (though SIP-14 helps towards that end)… Thoughts on what the commands might look like? What do you think will be the road blocks? Do we have any JIRA tickets that layout the path forward? In the SIP there is some discussion of starting with a ZookeeperServerEmbedded, and even a PR by

Re: updateLog tlog directory config silently ignored (SOLR-16962)

2023-09-11 Thread David Smiley
FWIW I've never heard of anyone customizing that. I suppose it might be useful to separate the location to use some fast local SSDs vs slower but larger storage for the main index? I've noticed an annoying duplicity in nomenclature here -- is it the Update Log or the Transaction Log? And further

Re: updateLog tlog directory config silently ignored (SOLR-16962)

2023-09-11 Thread Michael Gibney
> useful to separate the location to use some fast local SSDs vs slower but > larger storage for the main index Exactly. And yes, the duplicity of nomenclature is a large part of what I'm suggesting to deal with here ... it's very confusing. But having recently been pretty deep in this part of t

[DISCUSS] Community Virtual Meetup, September 2023

2023-09-11 Thread Jason Gerlowski
Hey all, It's time once again to start thinking ahead to our Virtual Meetup for September. As always, there's two main questions to answer in terms of planning: 1. Any volunteers to organize? Organizer duties are pretty light and are summarized here: https://cwiki.apache.org/confluence/display/

Re: [DISCUSS] Community Virtual Meetup, September 2023

2023-09-11 Thread raghavan m
Hello Jason I can volunteer but I am a beginner to Solr and have no significant contribution yet. Looking to use this opportunity to be more connected with the community. Please let me know if that works. If yes, i can volunteer to organize. thanks, *Raghavan* On Mon, Sep 11, 2023 at 11:03 AM J

Re: Future of the cross-dc work

2023-09-11 Thread Mark Miller
FYI, there are two branches that we have used. The crossdc-wip branch has a fully single threaded polling loop, and batches updates to the queue, and those batches are then also batched by the queue. This branch has been used on clusters of billion document scale and in a production environment f

NullPointerException in ReRankScaler.explain

2023-09-11 Thread Anna Ruggero
Hi, I encountered an issue with the re-rank query when setting the scale and debug=true parameters with Solr 9.3. When both the scale and the debug are set, a NullPointerException arises from the ReRankScaler.explain method. Without the scaling factors, the debug part works. In both cases (with and