Re: [DISCUSS] SIP-24 Java Security Manager replacement

2025-07-01 Thread David Eric Pugh
gt; >> SecurityManager > >>> is not Solr's front-line protection mechanism -- that's authentication > & > >>> authorization plugins.  The SM was always an auxiliary nice-to-have > >>> secondary to that.  It's also well within th

Remove Security Manager in 10?

2025-06-26 Thread David Eric Pugh
Considering all the discussions back and forth about the Java Security Manager, I was pleasantly surprised to see how few files it actually touched.  I was also kind of sad that it was never once mentioned in our Ref Guide! https://github.com/apache/solr/pull/3406 is a first pass at removing it.

Re: [DISCUSS] SIP-24 Java Security Manager replacement

2025-06-05 Thread David Eric Pugh
Ten is the perfect time to rip it out.   Let's separate ripping it out from "whatever else we decide"... Otherwise we'll bike shed it to death! I know you have under "Rejected Alternatives" the statement "Leaving Solr unprotected", but honestly, I think that is just too broad of a statement.   

Remove AbstractEnumField as part of removing deprecated EnumField

2025-04-05 Thread David Eric Pugh
I stripped out the AbstractEnumField as part of removing the deprecated EnumField in favour of EnumFieldType in https://github.com/apache/solr/pull/3256. This simplifies our class hierarchy, and I don't think we expect other folks to be extending it?   Specific commit: https://github.com/

Haystack US 2025 is coming! I want you there!

2025-03-20 Thread David Eric Pugh
My fellow Solr community members, I'd like to invite you to MY conference in MY home town of Charlottesvile Virginia, Haystack ;-).    Haystack is focused on the value side of search.  It's where we talk about how to meet those business goals that our companies set for us!  It's where we talk ab

Re: New UI (Kotlin) module: maybe separate repo/build but included as dependency?

2025-03-17 Thread David Eric Pugh
Yeah, I am a bit suss of having it be in it's own repo.  If it's in it's own repo, folks won't know about it, and it'll struggle to gain traction.   We've gone down the separate repo path with some other efforts, like the Yet Another Solr Admin UI project.   Having it not build on various arc

Pair of deprecated code removal pr's...

2025-03-07 Thread David Eric Pugh
Devs, just wanted to draw attention to the upcoming removal of CurrencyField and ExternalFileField: https://github.com/apache/solr/pull/3244https://github.com/apache/solr/pull/3212 I also looked a bit at removing the Trie field support, and that may be a bit more controversial...    Though it IS

Environment Variables in the Solr CLI...

2025-03-06 Thread David Eric Pugh
I've been thinking about the use of environment variables in the Solr CLI, and trying to figure out why it feels like a bad thing...    I think that the reason I don't like them is that it feels like we are injecting "magic" into our CLI, and this makes them actually more brittle and difficult t

Re: [DISCUSS] Time to thank HDFS module for it's service and remove it?

2025-01-23 Thread David Eric Pugh
back below my rock. > Happy holidays to all. > > Alejandro Arrieta > > On Sat, Dec 21, 2024 at 5:46 PM David Smiley wrote: > > > +1 to LinkedIn.  As I said, let's see if they even notice without you > > finding a POC to tell them.  At least for a month, if you

Re: v2 COLLECTIONPROP API - HK2 service reification failed for [org.apache.solr.handler.admin.api.CollectionProperty] with an exception

2025-01-10 Thread David Eric Pugh
While I like BATs test a lot..  maybe too much, I wonder if we could have a single Java based test that hits all the V2 APIs and verifies them?  Versus a whole ton of curl commands in the bats style?  Is there some way to programmatically look up each v2 API and then issue a request?    For som

Re: Making 3rd party plugins more discoverable

2025-01-06 Thread David Eric Pugh
I think that is a great idea.   A few years ago there was a bit of concern about referencing a non Apache website, so that is why I didn't do more to embed Solr.cool when I was working with it actively.    I'd love to see it have more visibility.   For me at least, it would spur me to be more a

Re: [DISCUSS] Time to thank HDFS module for it's service and remove it?

2024-12-21 Thread David Eric Pugh
made a hard pass on this because, of course, they don't have and don't want to run HDFS. On Sat, Dec 21, 2024 at 8:36 AM David Eric Pugh wrote: > Should we remove the hdfs module from Solr 10?  Inspired by some of the > discussions in > https://lists.apache.org/thread/lltc0wj

Re: What I want for Solr 10...

2024-12-21 Thread David Eric Pugh
I'd like to keep the simplicity of the extraction module, but without the in process aspect that it has today.   I can imagine some interesting use cases of the extraction module plus the new LLM module plus some streaming to build all my vectors inside my Solr ecosystem. On Friday, De

[DISCUSS] Time to thank HDFS module for it's service and remove it?

2024-12-21 Thread David Eric Pugh
Should we remove the hdfs module from Solr 10?   Inspired by some of the discussions in https://lists.apache.org/thread/lltc0wjdghq18tt37zlrsd8ty35qsytl around removing the hadoop-auth module, I think that this is a real possiblity. I found some earlier work in https://issues.apache.org/jira/brow

Re: branch_9_8 created

2024-12-12 Thread David Eric Pugh
I just merged a fix for the bin/solr auth command echoing the command line to the conole to branch_9_8.   On Monday, December 9, 2024 at 02:26:11 PM EST, Anshum Gupta wrote: As a reminder, please observe the normal rules: * No new features may be committed to the branch. * Documenta

Re: [DISCUSS] Time to thank Hadoop for it's service and remove it?

2024-11-06 Thread David Eric Pugh
enses gradle task does not complain about unused files in licenses/ folder... Jan > 2. nov. 2024 kl. 12:27 skrev David Eric Pugh : > > I did reach out to the user list about hadoop-auth and haven't heard anything > back.  I may do another "bump" to see if

Re: [DISCUSS] Time to thank Hadoop for it's service and remove it?

2024-11-02 Thread David Eric Pugh
one uses this integration anymore. This probably however should be posed to the user list as well. If we can't drum up a response there, I'm definitely +1 to lightening the load via options 1 or 4. On Mon, Oct 21, 2024 at 5:05 PM David Eric Pugh wrote: > I just re-read my copy of Marie K

Re: Release 9.7.1

2024-10-29 Thread David Eric Pugh
Would it make more sense to do a 9.8?   There are lots of CLI deprecation in 9.8 that would be nice to see the light of day before 10.0 is shipped!  On Tuesday, October 29, 2024 at 09:58:18 AM EDT, Jan Høydahl wrote: Thanks Anshum. We have 11 bugs fixed for 9.8

What to do about https://cwiki.apache.org/confluence/display/SOLR/Deprecations ?

2024-10-22 Thread David Eric Pugh
I think this wiki page is rather out of date, and maybe has served it's purpose?   Do we want to maintain it?  https://cwiki.apache.org/confluence/display/SOLR/Deprecations I think it came out of the last big effort to deprecate stuff. Eric

[DISCUSS] Time to thank Hadoop for it's service and remove it?

2024-10-21 Thread David Eric Pugh
I just re-read my copy of Marie Kondo's book The Life-Changing Magic of Tidying Up[1]  and it brought to mind the state of our Hadoop integrations with Solr.   I'd like to gauge the community's thoughts on how we move forward with Hadoop in Solr 10. My perspective is that Hadoop is no longer a k

Re: Missing Docs for the cross-dc module?

2024-10-19 Thread David Eric Pugh
o not looking to take a new project on! On Saturday, October 19, 2024 at 10:44:18 AM EDT, David Eric Pugh wrote: Also, do we want to keep the old code in https://github.com/apache/solr-sandbox/?    Seems like if this code has "graduated" the Sandbox, we should either remove it, o

Re: Missing Docs for the cross-dc module?

2024-10-19 Thread David Eric Pugh
Hmmm that is not great. I think I converted that MD file into a ref guide > page instead. But the module should have a Readme for sure. > > - Houston > > On Fri, Oct 18, 2024 at 7:10 PM David Eric Pugh > wrote: > > > I noticed the README.md is empty.  I did spot the >

Missing Docs for the cross-dc module?

2024-10-18 Thread David Eric Pugh
I noticed the README.md is empty.   I did spot the https://github.com/apache/solr-sandbox/blob/main/CROSSDC.md document that looks like it could be the basis...    Would be nice to have this potentially really useful feature properly documented! Eric

Re: [VOTE] End support for 8.x at 8.11.4

2024-10-16 Thread David Eric Pugh
+1 (binding) On Tuesday, October 15, 2024 at 06:43:32 PM EDT, Jan Høydahl wrote: +1 (binding) Jan > 15. okt. 2024 kl. 23:42 skrev Houston Putman : > > Hey everyone, > > A little while back, I made a thread asking opinions on cutting the 8.x > Solr support after 8.11.4 was released.

Re: Moving to bin/solr start defaulting to SolrCloud mode?

2024-10-07 Thread David Eric Pugh
if you didn't know.  And Solr has supported "distributed search" years before SolrCloud!  Lets not forget that. On Sat, Oct 5, 2024 at 7:11 AM David Eric Pugh wrote: > To get the default change done...    Is there another way to tell Solr > that it's starting in a non solr

Re: Overlapping arguments (SOLR-17383)

2024-10-07 Thread David Eric Pugh
I've created PR's for all these tickets, https://github.com/apache/solr/pulls/epugh to see them.    I'd love some review, and am hoping to merge them on my way to C/C NA tomorrow! On Saturday, October 5, 2024 at 04:37:59 PM EDT, Christos Malliaridis wrote: We are almost done addressin

Re: Moving to bin/solr start defaulting to SolrCloud mode?

2024-10-05 Thread David Eric Pugh
To get the default change done...    Is there another way to tell Solr that it's starting in a non solrcloud mode that would be a way to avoid wading into "standalone" and "user-managed".    To get the default swap done, I need a flag I think!   Unless someone has a creative idea of how to start

Re: A trio of tickets to make Cloud mode the default mode!

2024-10-02 Thread David Eric Pugh
Thanks Cassandra for commenting on https://issues.apache.org/jira/browse/SOLR-17465. For some reason the JIRA tickets didn't get connected to the individual PR's, so I've added the link as a comment. On Monday, September 30, 2024 at 07:56:07 AM EDT, David Eric Pugh wrote

A trio of tickets to make Cloud mode the default mode!

2024-09-30 Thread David Eric Pugh
Had some time on a plane the other week to start on some tickets for moving towards cloud mode the default mode. https://issues.apache.org/jira/browse/SOLR-17465 is the parent ticket with subtasks under it. https://github.com/apache/solr/pull/2728 is to let 9x users know about this change. http

Update on Solr CLI bugs

2024-09-29 Thread David Eric Pugh
I wanted to share a couple of updates: 1) After the 9.7 release folks found some bugs in the Solr CLI.   I’ve fixed them in branch_9_7, branch_9x, and main.    Thanks folks for posting in Slack and DM'ing me about them. 2) The migration of parsing options for the various bin/solr zk commands ha

Re: Overlapping arguments (SOLR-17383)

2024-09-28 Thread David Eric Pugh
"verbose" argument and type in --verbose ;-). On Wednesday, September 25, 2024 at 12:21:05 AM EDT, David Eric Pugh wrote: Here is a candidate PR for resolving the various -v flavours of verbose, value, and version by moving to --debug in place of -v and --verbose.   https://

Re: PR labeling

2024-09-28 Thread David Eric Pugh
I haven't touch the labeling/workflow stuff, so I'd prefer not to make this change.  Jan, would this be up your alley?   I think we have agreement to try this! On Tuesday, September 24, 2024 at 10:36:05 AM EDT, Mike Drob wrote: I think this is a common sense of false optimism, that w

Re: Overlapping arguments (SOLR-17383)

2024-09-24 Thread David Eric Pugh
Here is a candidate PR for resolving the various -v flavours of verbose, value, and version by moving to --debug in place of -v and --verbose.   https://github.com/apache/solr/pull/2721 On Tuesday, September 24, 2024 at 01:25:57 AM PDT, Christos Malliaridis wrote: I see. I didn't kn

Re: PR labeling

2024-09-20 Thread David Eric Pugh
It looks like you can have a label that specifies that a PR is exempt from being marked Stale: https://github.com/actions/stale?tab=readme-ov-file#exempt-pr-labels We currently mark stale as 60 days, and if we were to choose 120 days before closing, well, that gives you half a year before you n

Re: Overlapping arguments (SOLR-17383)

2024-09-12 Thread David Eric Pugh
In the section on "Arguments and Flags" in https://clig.dev/#arguments-and-flags, they suggestion that --version is for Version.  And that due to the confusion of -v for Version or Verbose, to use -d and --debug and skip the verbose concept completely.  I think the --version would only apply t

Re: [Draft] Release notes for Apache Solr 9.7.0

2024-09-07 Thread David Eric Pugh
I've added two references to CLI changes. On Thursday, September 5, 2024 at 10:03:27 PM EDT, David Smiley wrote: I finished editing / cutting it down.  And I added a sentence at the end reminding the reader that this is an editorialized summary that doesn't list everything. Eric, please

Re: [VOTE] Release Solr 9.7.0 RC1

2024-08-29 Thread David Eric Pugh
Houston, could you open a JIRA for the API tool, and/or just provide a bit more detail on the error?   (A bats test would be amazing!)   I suspected we would run into a CLI related issue as we have been changing so much there.  This one though is new to me! On Wednesday, August 28, 2024 a

Looking to merge deprecation of snapshotscli.sh in favour of bin/solr sub commands

2024-08-16 Thread David Eric Pugh
I'd like to merge SOLR-17180: Deprecate snapshotscli.sh in favour of bin/solr sub commands next week.   https://github.com/apache/solr/pull/2381 I've emailed the user list for additional eyes, but with no luck.  https://lists.apache.org/thread/l6wyx5yvw8nqxlm1wyw45hld34blvyov I'm thinking this

Making sure updates to v2 APIs happen as v1 changes happen

2024-08-14 Thread David Eric Pugh
Hi all, it's been great to see some of the new improvements to the APIs recently.   One thing that jumped to mind is that we need to make sure that any changes/improvements to a V1 API are also made to the corresponding V2 API. We're in that awkward world where we have two apis that are maintaine

Re: Introducing Gradle Version Catalogs

2024-08-14 Thread David Eric Pugh
My understanding is that Lucene 10 is likely to be released this fall, and I know I'd like to see Solr 10 come out close to when Lucene 10 comes out so we don't fall behind   So maybe there won't be many more releases of 9?  9.8 maybe?  but not a 9x line that gets into the double digits on

Re: Updating Dependencies - Apache Tika

2024-08-12 Thread David Eric Pugh
Their "Pipes" stuff is what we need to integrate ;-). On Monday, August 12, 2024 at 01:15:11 PM EDT, Christos Malliaridis wrote: I tried to find a java client for tika, but with no success so far. The version upgrade would reduce the vulnerabilities from about 21 CVEs to 6, so it would d

Anyone familiar with HDFS and Solr and snapshotcli.sh?

2024-08-05 Thread David Eric Pugh
Hey all,  so https://github.com/apache/solr/pull/2381 moves the various commands for doing a snapshot from the /solr/server/cloud-scripts/snapshotcli.sh script into the bin/solr overall structure!  I had no idea that we had CLI tooling for managing snapshots! The one slightly icky/weird thing is

subscribe

2024-08-05 Thread David Eric Pugh