Re: Looking for final review of SOLR-16842

2024-06-28 Thread Eric Pugh
Hi all…. Quick update that I merged SOLR-16842 into main. I wanted to confirm that our Jenkins builds are still happy, and while our normal Jenkins boxes are busted, I see that we have “Solr-Check-main-s390x”? Looking at it, it appears that recent code merges are fine, that the one test that

Re: Looking for final review of SOLR-16842

2024-06-28 Thread David Smiley
I don’t care if this is 10x only; that’s the easiest path ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Fri, Jun 28, 2024 at 1:18 PM Eric Pugh wrote: > Hi all…. Quick update that I merged SOLR-16842 into main. > > I wanted to confirm that our Je

Re: Looking for final review of SOLR-16842

2024-06-28 Thread Jan Høydahl
From an upgrade 9->10 perspective, it would be good to start getting deprecation warnings in 9.x for old options and change scripts etc so you don't have a big-bang moment in 10.0. A potential option 5) is to introduce the new options and deprecate old in 10.0, meaning they won't be removed unt

Solr "benchmark", wikipedia

2024-06-28 Thread David Smiley
I was thinking of using Solr's "benchmark" module/thing to benchmark parallel segment search (coming to Solr 9.7 but needs more love). I don't notice any substantial data to query for in this module, however. Has anyone considered adding wikipedia, like how Lucene's "luceneutil" does? Or somethi

Re: Looking for final review of SOLR-16842

2024-06-28 Thread Jason Gerlowski
> I wanted to confirm that our Jenkins builds are still happy, and while our > normal Jenkins boxes are busted The boxes are fixed! Or, lucene-solr-1 should be at least. I'm still looking into lucene-solr-2. So any failures at this point are legitimate issues. Case in point, it looks like our

Re: Looking for final review of SOLR-16842

2024-06-28 Thread David Smiley
Thanks so much Jason for investing your time to fix the build machines! RE timeout -- we ought to explicitly set a timeout so as to not hog the machine indefinitely. For Bats, I don't know where that is. I've done changes in the recent past for normal / JUnit tests. On Fri, Jun 28, 2024 at 5:42

Re: Solr "benchmark", wikipedia

2024-06-28 Thread Gus Heck
Yes. In fact I have an example in JesterJ of indexing the luceneutil data... (but it's still in early stages, I think it's still against _default schema, perhaps... (need to look again, haven't had time to work on it recently) https://github.com/nsoft/jesterj/tree/master/code/examples/wikidocs On

Re: Solr "benchmark", wikipedia

2024-06-28 Thread Gus Heck
To comment further, I think it would be good if we had query benchmarks that tried to map directly to the queries benchmarked for lucene, against the same data. This would give us a notion of which half of the equation any slow down comes from (or speed up!) On Fri, Jun 28, 2024 at 2:42 PM Gus Hec

Re: Solr "benchmark", wikipedia

2024-06-28 Thread Ishan Chattopadhyaya
Hi David, I'll publish benchmarks and steps to reproduce tests we are doing using solr-bench. Let's collaborate a bit more to make sure we can extract maximum performance out of the feature. Right now, I'm not seeing good numbers and it is a bit worrisome. Thanks and regards, Ishan On Sat, 29 Jun,

Re: Solr "benchmark", wikipedia

2024-06-28 Thread Ishan Chattopadhyaya
Off the top of my head: git clone https://GitHub.com/fullstorydev/solr-bench cd solr-bench git checkout ishan/local-mode-fixes mvn clean compile assembly:single ./cleanup.sh && ./stress.sh -c suites/stress-facets-local.json (Replace commit with the commit id hash of the latest tip of branch_9x)

Re: Solr "benchmark", wikipedia

2024-06-28 Thread Ishan Chattopadhyaya
Might need to install the prerequisites on Linux as follows: apt install wget unzip zip ant ivy lsof git netcat make openjdk-11-jdk maven jq Something similar for MacOS can be installed using homebrew etc. The jq and maven are important. On Sat, 29 Jun, 2024, 1:04 am Ishan Chattopadhyaya, < icha