Re: Deduplicating/Modularizing Our Jenkins Jobs

2024-10-15 Thread David Smiley
+1 Sure; seems like a simple solution. On Tue, Oct 15, 2024 at 7:27 AM Jason Gerlowski wrote: > Hi all, > > While cleaning up our Jenkins agents, I noticed that we trigger a lot > of long-running (> 1 hr) jobs on a nightly basis. Each family of jobs > differs slightly in the gradle task it runs

Community Virtual Meetup, October 23rd

2024-10-15 Thread David Smiley
10-23+Meeting+notes Please add any issues you’d like to discuss to the agenda. If you don’t have a Confluence account/access, feel free to send the topic(s) to me and I will add them. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Web Socket?

2024-10-14 Thread David Smiley
e old page that leads to a 404 on the > "status of this migration" > > So stability is a primary concern if we let someone else write the > interfaces. > > But breaking things into more small interfaces with fewer methods might be > a pattern to follow regardles

Re: Problem with GeoJSON field in SOLR 8.11.1

2024-10-14 Thread David Smiley
Hi, This is a known limitation, inside a dependency of Solr's: https://github.com/locationtech/spatial4j/issues/227 But as indicated in that issue, you might be able to work-around by using the JTS spatial context, which uses a different GeoJSON Reader. I think, anyway; it's been a long time. ~

Re: New Solr Admin UI - POC Presentation

2024-10-05 Thread David Smiley
Looking forward to it! On Mon, Sep 30, 2024 at 2:02 AM Christos Malliaridis < c.malliari...@gmail.com> wrote: > Hello everyone, > > I would like to invite you all to the presentation about the proposal for a > new Solr Admin UI. > > The presentation is about the content of the current proof-of-co

Re: Moving to bin/solr start defaulting to SolrCloud mode?

2024-10-05 Thread David Smiley
rywhere? > bin/cluster > bin/cloud <-- cloud is not a great name these days and we need to get rid > of it. > > I don't know, lots of bikeshedding here.I think I can live with > bin/solr start --not-distributed-mode. > >On Thursday, October 3, 2024 at 11:26:29

Welcome Christos Malliaridis as Solr Committer

2024-10-18 Thread David Smiley
The Project Management Committee (PMC) for Apache Solr has invited Christos Malliaridis to become a committer and we are pleased to announce that Christos has accepted. Christos, the tradition is that new committers introduce themselves with a brief bio. Congratulations and welcome! ~ David

Re: Missing Docs for the cross-dc module?

2024-10-18 Thread David Smiley
We needn't repeat ourselves. It's adequate to have a README with a brief summary and then point to the ref guide for further info. On Fri, Oct 18, 2024 at 8:21 PM Houston Putman wrote: > Hmmm that is not great. I think I converted that MD file into a ref guide > page instead. But the module sho

Moving away from Zookeeper in SolrJ

2024-10-18 Thread David Smiley
years ago when HttpCSP came into existence. I'm just trying to see this through to a conclusion. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Problem with GeoJSON field in SOLR 8.11.1

2024-10-20 Thread David Smiley
ly our fieldType configuration to > use suggested work-around with different GeoJSON Reader? > > > > Best regards, > > Beatrycze > > > > *Von:* David Smiley > *Gesendet:* Dienstag, 15. Oktober 2024 00:00 > *An:* dev@solr.apache.org; Volk, Beatrycze > > *B

Re: [DISCUSS] Time to thank Hadoop for it's service and remove it?

2024-10-21 Thread David Smiley
Let's not confuse different modules in the same thread. The two modules you speak of have "Hadoop" in the name but IMO they don't *really* have anything to do with each other unless you count some general utility and test JARs. Even the HDFS one doesn't even require HDFS (go fig!). It includes a

Re: HELP wanted: Dependency upgrades

2024-10-17 Thread David Smiley
Indeed, please no JIRAs for these unless it's a bigger non-trivial upgrade for some reason. Like for Lucene. On Thu, Oct 17, 2024 at 5:46 PM Jan Høydahl wrote: > I'm happy to just track the progress in each PR without additional JIRAs > for each dependency. Perhaps an umbrella JIRA can be helpf

Re: Moving to bin/solr start defaulting to SolrCloud mode?

2024-10-03 Thread David Smiley
Pluggability of ZK is a separate topic and you'll find it contentious since IMO it's a complete fantasy -- a massive effort for so little payoff. So let's not bring that up in this thread. Anyway, your last paragraph is the key part, and I agree but we're not there yet. Changing the default is c

Re: Some tests failing 100%

2024-10-03 Thread David Smiley
Relying on people to go look at CI out of the goodness of our hearts is a losing strategy. Our contributors don't even know where that is! There needs to be a trigger to do so ideally something personalized -- a build failure with recent changes that *you* included. Or instead a post/comment on

SolrDispatchFilter vs SolrServlet

2024-10-22 Thread David Smiley
27;s a 500 (see ResponseUtils). Shouldn't we want at least one *Solr* log message for every request to Solr and no matter the HTTP status? I'm aware Jetty has logs but it's a patchwork between looking at both. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: SolrDispatchFilter vs SolrServlet

2024-10-22 Thread David Smiley
ct that > likely will take me a very long time to work through on my own unless I get > lucky and find a sponsor that allows me to work on it full time... > > -Gus > > On Tue, Oct 22, 2024 at 4:51 PM David Smiley wrote: > > > I suspect the choice of a ServletFilter vs Ser

Re: [JENKINS] Solr » Solr-Docker-Nightly-main - Build # 1038 - Still Failing!

2024-10-29 Thread David Smiley
Do you know what to make of this one Sanjay? On Tue, Oct 29, 2024 at 7:01 AM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > Build: > https://ci-builds.apache.org/job/Solr/job/Solr-Docker-Nightly-main/1038/ > > Log: > Started by timer > Running as SYSTEM > [EnvInject] - Loading node e

Re: What to do about https://cwiki.apache.org/confluence/display/SOLR/Deprecations ?

2024-10-22 Thread David Smiley
Officially, such information would be in our "major changes in" Solr Ref Guide pages. It was probably a working/temporary one useful as we approached 9.0. After all, it's way easier to edit a wiki page than to do all the steps involved in updating our Ref Guide or any other part of our Git repo.

Re: [PR] Bump up Java version to 21 [solr]

2024-10-25 Thread David Smiley
I've seen that error too from IntelliJ (or maybe just viewed in IntelliJ but "from Gradle") at an earlier iteration of the JDK 21 PR when it was using toolchains. But not since. On Thu, Oct 24, 2024 at 1:41 PM Christos Malliaridis wrote: > That makes sense, thanks for the details. I looked into

Re: [ANNOUNCE] JDK 21 now needed to build Solr main

2024-10-25 Thread David Smiley
Clarification: We only use JDK 21 for the build. SolrJ related modules (includes "api") is compiled to Java Language 17. On Thu, Oct 24, 2024 at 11:22 AM sanjay dutt wrote: > Hey everyone, > We have successfully bumped up the main branch to JDK 21 and SolrJ to JDK > 17. All test packages are n

Re: [PR] Bump up Java version to 21 [solr]

2024-10-24 Thread David Smiley
GUS, I think your comment is best placed for the ANNOUNCE dev list thread, not Christos's PR. Also our "build tool" is Gradle, and it hasn't changed. You meant an IDE but I'm using IntelliJ just fine, and I can say IntelliJ compatibility was a critical concern and evaluation I did as a reviewer.

Re: Moving away from Zookeeper in SolrJ

2024-10-24 Thread David Smiley
On Thu, Oct 24, 2024 at 9:07 AM Jason Gerlowski wrote: > Hi! > > I'm all for (eventually) nudging folks towards HttpCSP. It's a "Good > Thing", conceptually, to hide ZK! > > But it sounds like there are still some significant (if few) downsides > to using HttpCSP (the "all live nodes disappear"

Re: Release 9.7.1

2024-10-30 Thread David Smiley
Agreed, Jan. Also, I don't like talk of 9.whatever being the last minor version. Granted, few of us may be motivated to do additional backports from main to 10x and an additional 9x but if some of us became motivated to do so, all it takes is 3 +1 votes to officiate a release of whatever version.

Re: Community Virtual Meetup, October 23rd

2024-10-23 Thread David Smiley
Reminder: starting in 18min. Hoping to get a number of us to discuss Solr Roadmap / Solr 10. On Tue, Oct 15, 2024 at 8:58 AM David Smiley wrote: > Hi Everyone, > > I'm volunteering to run the community virtual meetup next week. > > What: Community Virtual Meetup, S

Re: SolrDispatchFilter vs SolrServlet

2024-10-23 Thread David Smiley
rote: > > > >> Absolutely one step at a time. We've seen in the past how an enormous > >> change is just too hard to work back into the mainline, and I'd hate to > put > >> in the effort only to suffer that fate. Review is always welcome of > course! &g

Re: HELP wanted: Dependency upgrades

2024-10-27 Thread David Smiley
I also agree with it being fine to just defer to the next release. They can mostly be done all at once at that time. I read the dev-docs on this; it's pretty clear. The backports can be done in one fell swoop with dev-tools/scripts/cherrypick.sh Christos, as I understand it, you want to get thro

Re: [PR] Bump up Java version to 21 [solr]

2024-10-27 Thread David Smiley
FWIW I didn't change my IntelliJ installation setup on macOS for this Gradle / Solr build change. In the project settings for Solr, I chose JDK 21 and that's all. I was also able to build branch_9x with JDK 21 just fine. On Sat, Oct 26, 2024 at 10:58 AM Gus Heck wrote: > That's far more polite

Re: HELP wanted: Dependency upgrades

2024-10-27 Thread David Smiley
On Sun, Oct 27, 2024 at 3:47 PM Christos Malliaridis < c.malliari...@gmail.com> wrote: > I have read the dev-docs multiple times before I started working on a few > updates. One of the blockers some dependencies have is the upgrade to Jetty > 11 /12, which is a complex blocker. Bummer. Also, I

Re: [PR] Bump up Java version to 21 [solr]

2024-10-27 Thread David Smiley
Gradle -> "Gradle JVM" field) > > On Sun, Oct 27, 2024 at 8:27 PM David Smiley wrote: > > > FWIW I didn't change my IntelliJ installation setup on macOS for this > > Gradle / Solr build change. In the project settings for Solr, I chose > JDK > >

S3-Directory

2024-10-27 Thread David Smiley
roposal somewhere on how Solr might use a remote Directory (be it HDFS or S3 or whatever; doesn't matter) for indexing but use a standard MMapDirectory PULL replica for query. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: HELP wanted: Dependency upgrades

2024-10-24 Thread David Smiley
I haven't either and I have the same doubts/questions. Hopefully there's a developer docs page we can maintain on this and that which is linked to from those PRs. On Thu, Oct 24, 2024 at 10:15 AM Christos Malliaridis < malliari...@apache.org> wrote: > I got a few questions before interacting wit

Re: Deduplicating/Modularizing Our Jenkins Jobs

2024-10-24 Thread David Smiley
57b7hohqsy5 > > On Tue, Oct 15, 2024 at 12:40 PM Jan Høydahl > wrote: > > > > +1. cleanups always good. Also, do we need to keep the smoke test 9.7 > running if we don’t think there will be a 9.7.1 release? > > > > Jan Høydahl > > > > > On 15 Oc

Re: Introducing Gradle Version Catalogs

2024-11-13 Thread David Smiley
Thanks again for this modernization effort, Christos! A lot of work, clearly. Do you imagine the "Renovate" bot will need updates to work in this new world? I suppose we shall deal with that when we get to the other side. On Wed, Nov 13, 2024 at 10:12 AM Christos Malliaridis < malliari...@apach

Re: [JENKINS] Solr » Solr-Docker-Nightly-main - Build # 1038 - Still Failing!

2024-10-29 Thread David Smiley
: > Not able to reproduce, Can we add a flag (info or debug) to get more logs > for few days. > > — Sanjay > > On 29-Oct-2024, at 7:21 PM, David Smiley wrote: > > Do you know what to make of this one Sanjay? > > On Tue, Oct 29, 2024 at 7:01 AM Apache Jenkins Server

Re: [DISCUSS] Time to thank Hadoop for it's service and remove it?

2024-11-12 Thread David Smiley
Thanks to source control history, it's always resurrectable by whomever cares enough to resurrect it. I don't think we should feel compelled to do anything more than remove it. If someone cares -- hey go for it. But I don't think we need a convention/process that includes this. On Tue, Nov 12,

Re: [DISCUSS] Time to thank Hadoop for it's service and remove it?

2024-11-12 Thread David Smiley
line with our backcompat requirements, as > > > long as hadoop-auth remains on branch_9x. But still - "dig the code > > > up yourself if you want it" might come off as a bit callous to > > > hadoop-auth users looking to upgrade to 10. > > > > >

Re: PR labeling

2024-09-23 Thread David Smiley
t from my iPhone > > > >> On Sep 20, 2024, at 3:02 PM, Jan Høydahl wrote: > >> > >> Any commit or comment on a stale PR will make it un-stale for 60 more > days too. > >> > >> Jan Høydahl > >> > >>>> On 19 Sep 2024, at 23:

Re: multiThreaded and RejectedExecutionException

2024-09-27 Thread David Smiley
This is an experimental feature, after all. On Wed, Aug 21, 2024 at 10:12 AM David Smiley wrote: > Thanks; I filed https://issues.apache.org/jira/browse/SOLR-17414 > > On Tue, Aug 20, 2024 at 2:56 PM Ishan Chattopadhyaya > wrote: > > > > Thanks, I'll take a look.

Re: PR labeling

2024-09-19 Thread David Smiley
erge > conflicts so who’d want to anyway? 😉 > > Jan Høydahl > > > On 19 Sep 2024, at 20:07, David Smiley wrote: > > > > I don't see in the dev list here a discussion on auto-closing old PRs > but > > FWIW I'm in favor of that provided we could somehow

Re: PR labeling

2024-09-19 Thread David Smiley
I don't see in the dev list here a discussion on auto-closing old PRs but FWIW I'm in favor of that provided we could somehow choose to keep a PR open that we're still passionate about, that we don't want to be forgotten. This was discussed in the meetup yesterday. On Fri, Jan 26, 2024 at 10:56 A

Re: Community Virtual Meetup, October 23rd

2024-10-23 Thread David Smiley
email/DM me directly for it. On Wed, Oct 23, 2024 at 11:42 AM David Smiley wrote: > Reminder: starting in 18min. Hoping to get a number of us to discuss Solr > Roadmap / Solr 10. > > On Tue, Oct 15, 2024 at 8:58 AM David Smiley wrote: > >> Hi Everyone, >> >

Re: Community Virtual Meetup, October 23rd

2024-10-23 Thread David Smiley
ribed. I saw this feature during a client call and was impressed with > the quality. > > On Thu, 24 Oct, 2024, 9:56 am David Smiley, wrote: > > > I finished updating the post meeting notes and attendees. This is > > definitely a task we may want to make optional

Fwd: Undelivered Mail Returned to Sender

2024-10-25 Thread David Smiley
Uwe, can you please upgrade your build server accordingly for JDK 21? -- Forwarded message -- From: David Smiley To: sanjaydutt.in...@yahoo.com Cc: "dev@solr.apache.org" Bcc: Date: Thu, 24 Oct 2024 13:13:34 -0400 Subject: Re: [ANNOUNCE] JDK 21 now needed to build

Re: [VOTE] End support for 8.x at 8.11.4

2024-10-15 Thread David Smiley
+1 On Tue, Oct 15, 2024 at 5:47 PM Anshum Gupta wrote: > +1 (binding) > > Anshum Gupta > > > On Tue, Oct 15, 2024 at 14:42 Houston Putman wrote: > > > Hey everyone, > > > > A little while back, I made a thread asking opinions on cutting the 8.x > > Solr support after 8.11.4 was released. Since

Re: [DISCUSS] Support of time zone mappings in ParseDateFieldUpdateProcessorFactory

2024-11-07 Thread David Smiley
Yes; Kevin points out the existing/known issue. In general, search JIRA first. I don't recommend adding a feature that nobody actually needs/asked-for. On Tue, Nov 5, 2024 at 5:16 PM Christos Malliaridis wrote: > Looking into the recent JENKINS jobs, one of the failing tests is > > java.time.f

Re: [JENKINS] Solr-main-Linux (64bit/hotspot/jdk-21.0.1) - Build # 21082 - Still Unstable!

2024-11-07 Thread David Smiley
Looks like we've got a number of repeatable seed test failures on main -- https://jenkins.thetaphi.de/job/Solr-main-Linux/21082/#showFailuresLink If someone's looking into one/more of these, let me know; I may examine one of the others On Thu, Nov 7, 2024 at 9:06 AM Policeman Jenkins Server wrote

Re: [JENKINS] Solr-main-Linux (64bit/hotspot/jdk-21.0.1) - Build # 21082 - Still Unstable!

2024-11-07 Thread David Smiley
2024 at 11:33 AM Houston Putman wrote: > Thanks for taking a look David. These are all generally because of Curator, > and I'm going to fix them. They are just taking a bit longer than expected. > > - Houston > > On Thu, Nov 7, 2024 at 8:16 AM David Smiley wrote: >

Re: [DISCUSS] Community Virtual Meetup, November 2024

2024-11-19 Thread David Smiley
After, last meeting, I wanted to create some kind of Google-Calendar public recurring calendar event/invite thing that could be subscribed to. Not having this has been a pain point as folks don't even notice there's a meeting coming up. Even I forgot about the meeting too. On Tue, Nov 12, 2024 a

Sharing a post: "How to fork: Best practices and guide"

2024-11-26 Thread David Smiley
/ Obviously, if you don't need a fork then count yourself lucky! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Design question about Collection operations

2024-12-04 Thread David Smiley
suming the latterAFAIK "node" level (i.e. solr.xml) is just as > pluggable as core-level (solrconfig.xml), if not more. Both places > support defining request handlers, but only solr.xml will support > adding jars going forward. > > On Tue, Dec 3, 2024 at 5:55 PM D

Re: Solr 9.8.0 - branching and releasing plan

2024-12-04 Thread David Smiley
SOLR-17381: Once resolved then reopened for an important bug fix. A simple PR exists; I think it'll get merged this week. https://github.com/apache/solr/pull/2853 On Wed, Dec 4, 2024 at 8:51 PM Anshum Gupta wrote: > Hi everyone, > > We are in a good place to kick off the 9.8.0 release. > > I p

Re: Design question about Collection operations

2024-12-03 Thread David Smiley
BTW when I speak of "core level", it's core/configSet since the configuration applies to all cores of that type and they literally run in the context of a core. On Tue, Dec 3, 2024 at 11:53 PM David Smiley wrote: > No encryption isn't different from one core to the nex

Welcome Pierre Salagnac as Solr Committer!

2024-12-06 Thread David Smiley
The Project Management Committee (PMC) for Apache Solr has invited Pierre Salagnac to become a committer and we are pleased to announce that Pierre has accepted. Pierre, the tradition is that new committers introduce themselves with a brief bio. Congratulations and welcome! ~ David Smiley

Re: Solr 9.8.0 - branching and releasing plan

2024-12-09 Thread David Smiley
Anshum, I'd like to deprecate some methods that I will be removing in main: https://github.com/apache/solr/pull/2898 for some ClusterState/DocCollection/Replica methods https://github.com/apache/solr/pull/2856 for SimpleMap and more: SOLR-14680: NamedList, deprecating methods: forEachEntry, forE

Re: Major proposal: NamedList in Solr 10

2025-01-06 Thread David Smiley
An additional / complementary proposal concerning *reducing* NamedList usage would be to identify where we are using NamedList for where NamedList was a very poor choice. Probably the most fertile area would be any configuration -- NamedListInitializedPlugin. But there's no real replacement. Not

Removing deprecated things

2025-01-02 Thread David Smiley
loose policies/guidelines[**] [**] as committers, we can actually commit at will; guidelines be damned. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Major proposal: NamedList in Solr 10

2025-01-01 Thread David Smiley
In retrospect I proposed two things here that should be separated. (1) NamedList becoming abstract and having some factory methods to make the type being constructed super explicit instead of accidental. Basically, make it clear if the keys may repeat by putting that into the name of the factory m

Re: Storing application metadata for a collection? / APIs to read properties and configuration

2025-01-07 Thread David Smiley
at 10:33 AM David Smiley wrote: > Where I work, we've used collection properties (collectionprops.json) to > store collection specific synonyms & query-elevation configuration. We > have custom plugins for those features to read/expire this information in > addition to

Re: Storing application metadata for a collection? / APIs to read properties and configuration

2025-01-07 Thread David Smiley
Where I work, we've used collection properties (collectionprops.json) to store collection specific synonyms & query-elevation configuration. We have custom plugins for those features to read/expire this information in addition to implementing other custom requirements. It's somewhat of a hack but

Re: Major proposal: NamedList in Solr 10

2025-02-03 Thread David Smiley
As this is definitely SIP-worthy, I created "SIP-22 NamedList Reduction" with an implementation plan that has already started (SimpleOrderedMap is now a Map). https://cwiki.apache.org/confluence/display/SOLR/SIP-22%3A+NamedList+Reduction Please take a look everyone! At the moment, I leave open th

Re: SIP-7: Merging the new Admin UI (experimental)

2025-01-30 Thread David Smiley
Very exciting! I'm hoping one day to run the UI independently from Solr, as an option. In this way, those of us not yet on Solr 10 could still take advantage of it on our desktops. Maybe this is what you were getting at in your last paragraph. On Thu, Jan 30, 2025 at 2:01 AM Christos Malliaridi

Re: Support for Java 24

2025-02-03 Thread David Smiley
The SecurityManager has been *very* useful for tests to ensure they don't write to the file system outside the build or temp directories. It's very easy to indirectly do this since tests commonly point to template configurations. So for now, I'd like to see us continue to run tests with the Secur

Re: How about using JDK 21 in the official docker image?

2025-02-04 Thread David Smiley
Solr isn't stopping users from choosing the JDK they want to use. JDK 21 works with Solr 9x; I have experience running this and certainly others do too. FYI Solr's official Docker image has been JDK 17 throughout the 9x release (I'm glad I pushed for this back then). Suddenly changing from JDK 1

Use of SPI/ServiceLoader

2025-02-09 Thread David Smiley
ck risk. There's at least a decision to make on how to name the plugins. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Identifying performance issues in Solr 9.7/9.8

2025-02-10 Thread David Smiley
Hi Jude, I love the data-driven approach here! Let’s be explicit about the change that brought this about: it’s multiThreaded=true https://issues.apache.org/jira/browse/SOLR-13350 Can you try setting https://solr.apache.org/guide/solr/latest/configuration-guide/configuring-solr-xml.html#indexS

Re: Major proposal: NamedList in Solr 10

2025-02-10 Thread David Smiley
onger term it's a combination of Map (often LinkedHashMap) and POJOs with annotations to aid Jackson as necessary. I thought you would be opinionated on this given its tight relationship with the V2 API. > Best, > > Jason > > On Mon, Feb 3, 2025 at 2:49 PM David Smiley wrote: > &

Re: [DISCUSS] SIP-16: Polish and Prepare v2 APIs for v1 Deprecation

2025-02-10 Thread David Smiley
(An aside: discussion around a particular endpoint or even category of endpoints deserves its own thread IMO) > On Feb 10, 2025, at 4:40 PM, Christos Malliaridis > wrote: > - If this assumption is correct, can one update the log level of all nodes > with a single request? I can say Solr suppo

Re: Identifying performance issues in Solr 9.7/9.8

2025-02-11 Thread David Smiley
I filed a JIRA: https://issues.apache.org/jira/browse/SOLR-17665

Re: Value of the Solr Blog

2025-02-02 Thread David Smiley
I have no problem with our so-called "blog" being more of an aggregation of posts hosted elsewhere. We could rename it to better reflect this, like maybe "the Solr Ecosystem Feed"? Not so short & sweet... but whatever. Ultimately, I think the point is to bring more visibility across the Solr ecos

Re: [JENKINS] Solr-main-Linux (64bit/hotspot/jdk-11.0.21) - Build # 19896 - Still Unstable!

2025-01-30 Thread David Smiley
BTW, I must compliment you on your great investigative skills to identify that as the root cause! Truly impressive! On Wed, Jan 29, 2025 at 3:01 PM Houston Putman wrote: > So after looking into this a bit, it looks like the versions are being > returned in a different order. > > This reproduces

Re: [JENKINS] Solr-main-Linux (64bit/hotspot/jdk-11.0.21) - Build # 19896 - Still Unstable!

2025-01-30 Thread David Smiley
Disclaimer: update ordering is not something I know much about. But... I wish there was a total order of all updates, so that all updates to the log were ordered by design. If that were so, this wouldn't be a bug here and other complexities would likely go away. I'm thinking of this: https://gi

Re: Some tests failing 100%

2024-12-11 Thread David Smiley
... maybe back in september? > > Some random googling suggests the sysprop below might be useful to disable > this watchdog -- can you try setting this in your jenkins gradle > command options? > > -Dcom.ibm.tools.attach.useFileLockWatchdog=false > > > https://github.com/e

Re: SolrCloud request routing URL structure

2024-12-10 Thread David Smiley
On Tue, Dec 10, 2024 at 5:36 PM Chris Hostetter wrote: > > I don't disagree with any of your points. If anything i think the problem > is more egregious then you characterize it (especially in the case of > requests for specific replicas that have been (re)moved -- IIRC not only > does the Solr

SolrCloud request routing URL structure

2024-12-09 Thread David Smiley
likely exactly one or zero replicas for the shard. If there's more than one, either will do (they are replicas). It could be interesting if the client could detect the redundancy and then be more specific only then but that's probably unnecessary. I bet tests overload replicas per shard o

Re: DELETEREPLICA / Core-UNLOAD blocks/hangs

2024-12-10 Thread David Smiley
There is good testing that Solr closes most things that should be closed including cores. Still... I could see UNLOAD being enhanced to insist the core be closed after a few minutes. On Tue, Dec 10, 2024 at 2:17 PM Zack Kendall wrote: > We have scripts that use the Solr Replica management APIs.

Re: Commits somehow "hidden" by point-in-time merges

2024-12-15 Thread David Smiley
Hi Cedric, On Fri, Dec 13, 2024 at 6:38 PM Cédric Damioli wrote: > Could you tell me if the observed behaviour is definitely normal and > that I should learn to deal with it ? Yes. > Is there a way to listen to such > behaviour or to have a callback called ? > On this point I'm unclear what

Re: Commits somehow "hidden" by point-in-time merges

2024-12-16 Thread David Smiley
Not sure if the segment metadata contains merge info on what segments it merged. I suppose that's what you'd like. You might be able to add such metadata; not sure. On Mon, Dec 16, 2024 at 8:50 AM Cédric Damioli wrote: > Hi David, > > > Le 15/12/2024 à 18:50, David S

Re: branch_9_8 created

2024-12-17 Thread David Smiley
+1 to the LLM module for 9.8 if Anshum hasn’t started yet but it’s his call of course On Tue, Dec 17, 2024 at 11:27 AM Alessandro Benedetti wrote: > I assume it's too late to add: https://github.com/apache/solr/pull/2809 to > 9.8? > I'm ready to merge and wanted to adjust the CHANGES.txt and the

Re: JDK 24 Feature Freeze | Permanently Disabling the Security Manager

2024-12-13 Thread David Smiley
I'd advocate disable-by-default in 10x. But we use it to tame tests, which I appreciate. That will take more time to come up with another substitute. Let's pay attention to what the Lucene project does. On Fri, Dec 13, 2024 at 1:37 PM Eric Pugh wrote: > What does this mean for us? Time to r

Deprecating ".system" collection

2024-12-13 Thread David Smiley
tem" collection, which I think has a suitable replacement -- the file-store (same thing that replaced the "blob store"). AFAIK, Solr internally only uses this collection for the "schema designer", which could switch to it. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Solr 9.8.0 - branching and releasing plan

2024-12-19 Thread David Smiley
Jason; at the meetup, you mentioned Anshum was on vacation. Would it make sense for us to make decisions (using our best judgement) instead of waiting on a response?

CloudSolrClient / stale state detection

2024-12-19 Thread David Smiley
The *stateVer* parameter and potentially failing with HTTP 510 may be > obsolete? > ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: CHANGES.txt, process improvement solicitation

2024-12-19 Thread David Smiley
On Wed, Dec 18, 2024 at 7:30 PM Jan Høydahl wrote: > This tool does what is proposed here and looks promising: > https://github.com/logchange/logchange?tab=readme-ov-file > > It requires us to switch to CHANGES.md and it lacks a gradle plugin. But > we could probably contribute some changes to fi

Major proposal: NamedList in Solr 10

2024-12-20 Thread David Smiley
D%20resolution%20is%20EMPTY%20ORDER%20BY%20created%20DESC ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Moving away from Zookeeper in SolrJ

2024-12-19 Thread David Smiley
en being useful to catalog major decisions / directions. Albeit again that's somewhat redundant with the Roadmap. On Sat, Oct 19, 2024 at 1:47 AM David Smiley wrote: > I strongly believe that we need to get ZooKeeper out of our clients (that > use CloudSolrClient), and use Solr U

Re: SolrDispatchFilter vs SolrServlet

2024-11-22 Thread David Smiley
I don't mind Solr being a "webapp" in Jetty. I don't recall it constraining us or being interfering. Jetty is very customizable so we can tweak the Jetty-Solr relationship to our liking. A webapp makes it straightforward (no code!) for other users to add a CORS Filter in Solr or to add another w

Re: Admin UI Review Meeting - Feedback Requested

2024-11-22 Thread David Smiley
26thor 27th with a slight preference to the 27th. BTW I suggest ruling out 28th as it's a major US holiday (Thanksgiving). On Fri, Nov 22, 2024 at 10:57 AM Jason Gerlowski wrote: > Hey Christos, > > The 26th works best for me personally. > > Though you and I have talked a good bit about the UI

Re: Give a user to introduce new facet types in JSON Facet

2024-11-22 Thread David Smiley
On Thu, Nov 21, 2024 at 9:05 AM Mikhail Khludnev wrote: > Hello > This question is a spin off from > https://github.com/apache/solr/pull/2742/. > PR#2742 is about > deploying custom AggValueSource parsers and invoke it via > { >type:func, >

Re: Design question about Collection operations

2024-12-03 Thread David Smiley
When Bruno said a "Core level handler", he meant a RequestHandler registered in solrconfig.xml and thus accessible as /solr/coreName/admin/encrypt as seen here: https://github.com/apache/solr-sandbox/blob/4e1819ff8a3758becca19bf337ecd1b352dba805/encryption/src/test/resources/configs/collection1/sol

Re: Design question about Collection operations

2024-12-03 Thread David Smiley
behave differently depending on the core. > Different default params, only having the API for some cores, etc. > > So that'd be the first question I'd try to think through for the > encryption case: is there a compelling need for encryption to only be > available

Ending "javabin" format for "V2 API" ?

2024-12-22 Thread David Smiley
possibilities [2] https://solr.apache.org/guide/solr/latest/query-guide/response-writers.html#cbor-response-writer [3] https://solr.apache.org/guide/solr/latest/query-guide/response-writers.html#smile-response-writer ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: [DISCUSS] Time to thank HDFS module for it's service and remove it?

2024-12-21 Thread David Smiley
Any such proposal should start with an attempt to solicit user input. I do wonder if we are doing enough to communicate important decisions like this to our users (to solicit this feedback). I worded that poorly maybe; I don't mean to suggest inadequacy on us necessarily as I have a greater conce

Re: [DISCUSS] Time to thank HDFS module for it's service and remove it?

2024-12-21 Thread David Smiley
Local FS" for best performance. So it may be that > they can continue to use SolrCloud without HDFS. > > > > > On Saturday, December 21, 2024 at 10:03:49 AM EST, David Smiley < > dsmi...@apache.org> wrote: > > Any such proposal should start with an attem

[DISCUSS] Deprecating Result Grouping

2025-01-09 Thread David Smiley
nctionality that is used that has no equivalent. [1] https://solr.apache.org/guide/solr/latest/query-guide/result-grouping.html [2] https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: [DISCUSS] Deprecating Result Grouping

2025-01-11 Thread David Smiley
use via our DeprecationLog mechanism. It's > premature > > to discuss deleting the code. I'm worried that there's functionality > that > > is used that has no equivalent. > > > > [1] > > > https://solr.apache.org/guide/solr/latest/query-guide/r

Re: [RESULT] [VOTE] Release Solr 9.8.0 RC1

2025-01-21 Thread David Smiley
Great. Please remember to update the release notes with the list of contributors using the newly committed script dev-tools/scripts/parseContributorsFromChanges.py ; it's not yet integrated into the release wizard. If you'd like, I could do this. On Tue, Jan 21, 2025 at 12:05 PM Anshum Gupta wr

Re: Solr Visibility on LinkedIn

2025-01-24 Thread David Smiley
tely think we should do). Nazerke, I'll try and add you as an admin; thank you for your initiative here! ~ David On Fri, Jan 17, 2025 at 2:10 PM David Smiley wrote: > Shane Curcuru shared the following advice, > > This is partly a branding question (in terms of what name to

Re: [DISCUSS] Time to thank HDFS module for it's service and remove it?

2025-01-17 Thread David Smiley
nerally > correct. That does not mean a distributed file system is no longer used or > has advantages in specific scenarios, like indexers, mentioned later in the > documentation. > > Now, back below my rock. > Happy holidays to all. > > Alejandro Arrieta > > On Sat, De

Re: [VOTE] Release Solr 9.8.0 RC1

2025-01-17 Thread David Smiley
I edited most entries, removed a few lines and added one. I'm tempted to remove V2 API stuff until we actually want to encourage users to use it. That time may be Solr 10. Or at least remind users that the V2 API continues to be more subject to change. On Fri, Jan 17, 2025 at 2:01 PM Anshum Gupt

Fwd: Seeking Best Practices for External File Fields in Solr Cloud

2025-01-28 Thread David Smiley
Any concerns with deprecating ExternalFileField in Solr 9, remove in 10? -- Forwarded message - From: Matthias Krüger Date: Tue, Jan 28, 2025 at 5:00 AM Subject: Re: Seeking Best Practices for External File Fields in Solr Cloud To: Hi, As David recently ( https://lists.apache.

<    2   3   4   5   6   7   8   >