Re: Should the Ref Guide Page on Reindexing mention the REINDEXCOLLECTION command?

2022-08-03 Thread David Smiley
It's a crying shame REINDEXCOLLECTION isn't documented on the reindexing.html page :-( I could have sworn I observed this and said something somewhere but I don't see where. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Aug 3,

Re: [Docker] Full migration to apache/solr-docker

2022-08-05 Thread David Smiley
Thanks for the update, and for your work on this! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Fri, Aug 5, 2022 at 3:17 PM Houston Putman wrote: > Hello everyone, > > Just wanted to announce that the official Solr Docker image mainte

Re: JAX-RS APIs in Solr

2022-08-08 Thread David Smiley
I'm excited to see what this looks like! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Aug 8, 2022 at 12:11 PM Jason Gerlowski wrote: > Hey all, > > I spent some time last week digging into OpenAPI and spiking out how

Re: Cleaning up IntelliJ warnings in code base

2022-08-24 Thread David Smiley
Do other projects do that? FWIW I tailor an IDE-wide inspection profile to my liking, tweaking what's enabled and also the severity level to reduce red-ness when I don't think it's warranted. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmile

Re: Cleaning up IntelliJ warnings in code base

2022-08-25 Thread David Smiley
's okay; it's just a suggested configuration. After all, contributors are permitted to use whatever tooling they wish. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Aug 25, 2022 at 8:06 AM Eric Pugh wrote: > I did a bit of poking

Re: Cleaning up IntelliJ warnings in code base

2022-08-25 Thread David Smiley
Here it is.

Going to ApacheCon 2022

2022-08-25 Thread David Smiley
nts to share their intent to go, please chime in! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Build issue

2022-08-30 Thread David Smiley
On Fri, Jun 24, 2022 at 4:56 PM Guse, Jimmy wrote: > The reason I’ve been in this swamp is that I use solr from within an > application (both via the web and in cron scripts) running only as a single > instance on localhost, never with direct user access. To avoid having to > deal with accounts

Re: Release 9.1?

2022-09-15 Thread David Smiley
Thanks for volunteering! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Sep 15, 2022 at 12:56 PM Ishan Chattopadhyaya < ichattopadhy...@gmail.com> wrote: > Hi devs, > > It has been long since 9.0 release and we have quit

ANN: ApacheCON "BoaF" for Solr

2022-09-19 Thread David Smiley
FYI I arranged for a Solr Birds of a Feather (BoaF) session at ApacheCon, on Wednesday October 5th, 5:50-6:30 pm. You will see it in the Expo Pass app. I expect it'll be relatively informal; a good time to meet 'n greet, and make dinner arrangements with community members. ~ David Smi

Re: Focusing on single implementations of core logic

2022-09-21 Thread David Smiley
I think we should have separate threads for these two topics. I'll start a new thread for Distributed State Updates vs Overseer. If they become related for certain points then they can be raised here? On Wed, Sep 21, 2022 at 11:44 AM Houston Putman wrote: > Hey everyone, > > We've seen some i

Distributed State Updates vs Overseer

2022-09-21 Thread David Smiley
ee), it would lead to a way to do many changes efficiently? ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley Houston said: > We've seen some interesting developments over the last 2 years in the way > that Solr state and distributed logic is handled.

preferredLeader

2022-09-21 Thread David Smiley
ow some users manage their clusters? [1] https://solr.apache.org/guide/solr/latest/deployment-guide/collection-management.html#rebalanceleaders ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: preferredLeader

2022-09-23 Thread David Smiley
s would respect preferredLeader already? If it doesn't, then the solution, I think, would be to fix it so that it does respect it? We'll see. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Sep 22, 2022 at 7:02 AM Jan Høydahl wrote: > We ha

Http2SolrClient (Jetty), and feature gaps with our legacy HttpSolrClient (Apache)

2022-09-23 Thread David Smiley
e probably hard-fought discoveries. I can't find this in the Jetty one except for a one-off implementation in LBHttp2SolrClient. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Going to ApacheCon 2022

2022-10-02 Thread David Smiley
> > > > On Tue, Aug 30, 2022 at 5:45 PM Eric Pugh < > > > ep...@opensourceconnections.com > > > > > > > > > > > wrote: > > > > > > > > > > > I’m going to be there as well, along with another colleague Jeff &g

Re: Outreachy Internships with Apache

2022-10-08 Thread David Smiley
Welcome Joshua! I'm glad you are interested. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Sat, Oct 8, 2022 at 1:41 PM Joshua Ouma wrote: > Hello All, > I am Joshua Ouma, an Outreachy internship applicant. It's a pleasure to b

Outreachy

2022-10-09 Thread David Smiley
;ve never seen/heard of before. I think the JAX-RS conversion should have particularly good "newdev" issues now that the infrastructure is in place. [1]: https://issues.apache.org/jira/browse/SOLR-11872 "Refactor test infra to work with a managed SolrClient; ditch TestHarness"

Re: Outreachy

2022-10-11 Thread David Smiley
e been its own additional project. Ah well; there's next season for new projects :-) ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Oct 10, 2022 at 12:55 AM David Smiley wrote: > Hey everyone, > > I am registered as an ASF men

JIT Shard leader design/proposal

2022-10-11 Thread David Smiley
ghts? [1] https://lists.apache.org/list?dev@solr.apache.org:2021-10:MILLER%20leader “ZkCmdExecutor” thread with Mark Miller, and referencing https://www.solrdev.io/leader-election-adventure.html which no longer resolves ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.co

Re: JIT Shard leader design/proposal

2022-10-13 Thread David Smiley
oudSolrClient. I think it might only be used to tell the client to get more up to date but ideally it'd be bidirectional. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Oct 11, 2022 at 6:34 PM David Smiley wrote: > At work, I’

Re: New branch and feature freeze for Solr 9.1.0

2022-10-13 Thread David Smiley
Looks like we need to downgrade the Docker image to JDK 11 :-(. Or one in between maybe. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Oct 13, 2022 at 4:58 PM Jan Høydahl wrote: > On the users list we see several solr 9.0.0 users

Fwd: [jira] [Created] (SOLR-16455) Migrate Jira to Github Issues and Github Projects, and migrate mailing lists to Github Discussions

2022-10-13 Thread David Smiley
Sharing for visibility. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley -- Forwarded message - From: Jeb Nix (Jira) Date: Mon, Oct 10, 2022 at 7:11 PM Subject: [jira] [Created] (SOLR-16455) Migrate Jira to Github Issues and Github

Re: JIT Shard leader design/proposal

2022-10-13 Thread David Smiley
aps slowly) if its use of ZK > Watchers > > stopped working. Today, CloudSolrClient passes _stateVer_ and it's > parsed > > on the server by > > org.apache.solr.servlet.HttpSolrCall#checkStateVersionsAreValid. This > > should be used more pervasively in m

Re: JIT Shard leader design/proposal

2022-10-14 Thread David Smiley
On Fri, Oct 14, 2022 at 6:11 AM Mark Miller wrote: > I don’t have much to say about the proposal, other than to say that if an > election ever ends up involving syncing up and exchanging data, doing that > just in time is probably less than ideal for most of the more common uses > cases. > I sho

Re: JIT Shard leader design/proposal

2022-10-14 Thread David Smiley
And to emphasize the brilliance of ZkShardTerms (in turn, on RAFT which is it's basis/genesis), we might not even need replica states. ZkShardTerms + live_nodes is probably enough. Credit to Dat on this; we were just in an email exchange about this stuff. ~ David Smiley Apache Lucene

Re: JIT Shard leader design/proposal

2022-10-16 Thread David Smiley
r is up to date, certainly for RTG at least. The algorithm I listed could be changed such that the chosen replica is informed so that it can do the needful itself. This also acts as an implicit extra liveness check that the chosen leader is reachable. ~ David Smiley Apache Lucene/Solr Search

Re: JIT Shard leader design/proposal

2022-10-17 Thread David Smiley
ased on my recollection of some replay challenges with document versions & locks that Dat & I worked on, I could see how increasing it would be helpful. There is no cap on the number of replays happening, which I could see us wanting to do in order to speed up how soon a replica that is already

Re: [jira] [Created] (SOLR-16455) Migrate Jira to Github Issues and Github Projects, and migrate mailing lists to Github Discussions

2022-10-17 Thread David Smiley
+1 to migrate. Yeah. Maybe Tomoko could validate the steps required? (CC'ed) Jeb listed them in JIRA; the steps/mechanics can be discussed there while we leave this thread as voting on the major decision. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.c

SolrClient should be immutable?

2022-11-01 Thread David Smiley
ewdev", by the way. Eric Pugh (unaware of SOLR-8975) started pulling a thread on this sweater, and we've been chatting a bit about it. Anyway, I'm just posting here for general awareness of the direction we're going in with SolrJ. Changes to SolrJ are a high touch-point f

Re: LISTSNAPSHOT response format: bug or intentional?

2022-11-04 Thread David Smiley
For 9.0, a major release, a little break like this is fine (even bigger ones!). I know I mentioned this in the release notes too "major-changes-in-solr-9.adoc" (I see this in the commit) but somebody (!) removed it. Ugh. ~ David Smiley Apache Lucene/Solr Search Developer http://www.li

Re: [DISCUSS] SIP-16: Polish and Prepare v2 APIs for v1 Deprecation

2022-11-08 Thread David Smiley
Yeah I agree; no need to make a prediction on timing/versions at this point. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Nov 8, 2022 at 10:32 AM Jason Gerlowski wrote: > > removing v1 completely on 10.0 should depend on how soon 1

Re: Continuous performance testing and regressions

2022-11-09 Thread David Smiley
A big THANK YOU for working on this Ishan! Can we add regular benchmarks based on /solr/benchmark that Mark contributed not too long ago? ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Nov 9, 2022 at 1:39 AM Ishan Chattopadhyaya

Re: Review SOLR-15955: Update Jetty dependency to 10

2022-11-11 Thread David Smiley
Eric, the flakiness is a bug about Http2 in Jetty. But Http2 can be disabled (thus use Http1) and we still use the Jetty client. It's discussed on this work item in the comments: https://issues.apache.org/jira/browse/SOLR-16503 ~ David Smiley Apache Lucene/Solr Search Developer

Re: SolrEventListener configuration in solr 8 vs solr 9

2022-11-11 Thread David Smiley
grade notes. I suspect this change happened when we moved away from XPath processing of this file. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Nov 9, 2022 at 4:21 PM Nazerke S wrote: > Hi All, > > I was trying to configure event listen

Apache Solr is vulnerable to CVE-2022-39135 via /sql handler

2022-11-21 Thread David Smiley
Vendor: The Apache Software Foundation Versions Affected: Solr 6.5 to 8.11.2 Solr 9.0 Description: Apache Calcite has a vulnerability, CVE-2022-39135, that is exploitable in Apache Solr in SolrCloud mode. If an untrusted user can supply SQL queries to Solr’s “/sql” handler (even in

Re: SolrClient should be immutable?

2022-11-28 Thread David Smiley
On Fri, Nov 25, 2022 at 12:02 PM Eric Pugh wrote: > > Once this is in, I'd like to tackle removing the deprecated methods on our > various SolrClients, and if we can get that done, then those classes will > be a lot shorter and easier to read. Is removing the deprecated methods > something that

Re: Info dump, small heap comparison, G1GC vs. ZGC

2022-11-29 Thread David Smiley
Thanks for sharing your analysis! For setups where users do indexing on certain nodes and querying on other nodes, I could imagine choosing different collectors on these nodes. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Sat, Nov 26, 2022 at 5

Re: Replication opens new SegmentReader for all segments which deem unnecessary

2022-11-29 Thread David Smiley
all seeing some index data path shuffling going on. ReplicationHandler etc. is overly complex. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Nov 23, 2022 at 1:50 PM Patson Luk wrote: > Hi all! > > We are testing multiple replica setup h

Re: Replication opens new SegmentReader for all segments which deem unnecessary

2022-11-30 Thread David Smiley
I know that. The question is if a new directory is populated sourced from the current/live directory for existing segments... OR is it populated in-place (same directory). ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Nov 30, 2022 at 12:37

Re: Publishing dependency vulnerability information

2022-12-04 Thread David Smiley
Yeah, we want to maintain this in as few places as possible -- ideally one place. But I think it's *adequate* albeit not ideal to have our more pretty/user-consumably documentation refer to a raw file that a user would have to search. We shouldn't let the ideal be the enemy of progress

Re: Outreachy

2022-12-06 Thread David Smiley
Welcome Joshua! I'm looking forward to these changes coming to fruition finally! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Dec 6, 2022 at 7:38 AM Joshua Ouma wrote: > Hi Everyone, > > I'm Joshua and have been acce

Re: Creation of CloudSolrClient with httpClient is faling

2022-12-20 Thread David Smiley
Client based CloudSolrClient now holds the name that the former one had. I wish this was more explicitly declared in the notes. Preferably, you'd see how Jetty's HttpClient works to accomplish the same as you were doing with Apache's HttpClient. ~ David Smiley Apache Lucene

Re: Welcome Michael Gibney to the Solr PMC

2022-12-21 Thread David Smiley
Welcome Michael! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Dec 21, 2022 at 12:11 PM Houston Putman wrote: > I am pleased to announce that Michael Gibney has accepted the PMC's > invitation to join. > > Congratula

Re: Solr 9.1.1 bugfix release

2022-12-23 Thread David Smiley
Thanks for volunteering! I'd like to propose that the upgrades to dependencies due to CVEs be back-ported to 9.1.1. I can help with this. One example I see is woodstox-core. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Dec 22, 2022

Re: Solr 9.1.1 bugfix release

2022-12-26 Thread David Smiley
hus going back to a vulnerable version in main. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Fri, Dec 23, 2022 at 8:16 AM David Smiley wrote: > Thanks for volunteering! > > I'd like to propose that the upgrades to dependencies due to C

Re: Solr 9.1.1 bugfix release

2022-12-30 Thread David Smiley
Still looking for a PR approval for the protobuf upgrade: https://github.com/apache/solr/pull/1252

Re: Refactoring ZkStateReader

2022-12-31 Thread David Smiley
Makes sense -- thanks for tackling this! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Fri, Dec 30, 2022 at 5:37 PM Justin Sweeney wrote: > Hi all, > > ZkStateReader ( > > https://github.com/apache/solr/blob/main/solr/solrj-zoo

Progress on SOLR-16573 EmbeddedSolrServerTestRule

2023-01-02 Thread David Smiley
post-construction for the initialization. After Joshua converts some more tests, the PR will be ready. Maybe EmbeddedSolrServerTestBase should be removed here as well, as it'll do nothing other than declare this rule and a delegating method to get the client. After this issue, we should do an

Re: Solr 9.1.1 bugfix release

2023-01-03 Thread David Smiley
+1. Don't add a Lucene upgrade though :-) ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Jan 3, 2023 at 10:05 AM Michael Gibney wrote: > Wondering what folks think of backporting some classloading > deadlock-related fix

Re: Naming builder methods?

2023-01-03 Thread David Smiley
()" which I think is clear. There is a "withParallelUpdates(boolean)" right next to that. Arguably, a pair of methods "sendUpdatesInParallel()" and "sendUpdatesSerially()" would read more naturally. ~ David Smiley Apache Lucene/Solr Search Developer http://www.link

Re: Naming builder methods?

2023-01-04 Thread David Smiley
True; I have no strong preference. Sometimes we only need one side of the boolean. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Jan 4, 2023 at 1:26 PM Jason Gerlowski wrote: > +1 to "with" over "set" where it make

Re: [VOTE] Release Solr 9.1.1 RC2

2023-01-18 Thread David Smiley
trace, I reported it against an existing JIRA issue that seemed pertinent: https://issues.apache.org/jira/browse/SOLR-16336?focusedCommentId=17678323&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17678323 ~ David Smiley Apache Lucene/Solr Search Devel

Running tests faster; use more machine CPU

2023-01-19 Thread David Smiley
chart, the utilization gets to maybe 65% quickly and then lowers down to nothing by the end of the build. I am aware Gradle "test" isn't intelligently sharing the test load across the workers, and that it's apparently hard for them to address this. Do folks have ideas / recommend

Re: Recurring (Virtual) Community "Meetups"

2023-01-23 Thread David Smiley
not be inclusive enough by picking a timezone convenient to me... but this doesn't stop someone from hosting a similar event at a time convenient to them. It'd be great to see contributors as well. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Enable different schemas per shard based on core.properties

2023-01-23 Thread David Smiley
docValues being desirable. I wish the FieldCache was explicitly opt-in. Hossman made inroads into this by adding a feature where you can disable it on a per-field basis but I think we overall forgot to set this as a new default in a major release. ~ David Smiley Apache Lucene/Solr Search

Re: Recurring (Virtual) Community "Meetups"

2023-01-24 Thread David Smiley
h means this may not happen. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Jan 24, 2023 at 11:13 AM Jason Gerlowski wrote: > Awesome - sounds there's definitely some general interest. (Though the > details need some hashing out.) >

Running all tests via Crave.io

2023-01-25 Thread David Smiley
proposal). I should also be able to configure crave with a default run configuration with this baked in. I'll post an update when I'm able to do that. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Fwd: Build Lucene/Solr in cloud

2023-01-25 Thread David Smiley
n branch_9_1; one failing test. And my old machine was unphased because it wasn't doing the work :-). It's nice to kick off such a build in the background and be productive doing development / whatever while it runs. ~ David Smiley Apache Lucene/Solr Search Developer http

Re: Recurring (Virtual) Community "Meetups"

2023-01-27 Thread David Smiley
Looking forward to it! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Fri, Jan 27, 2023 at 1:08 PM Anshum Gupta wrote: > Great idea, Jason! Keeping it lightweight is going to be useful in > organizing these. > > On Mon, Jan 23, 2023

Re: Running all tests via Crave.io

2023-01-27 Thread David Smiley
Solr tests. The answer is 96 minutes. No failures / timeouts; it really took that long. [1] https://github.com/apache/solr/actions/runs/4028015923/jobs/6924417956 ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Jan 25, 2023 at 5:22 PM David Smi

Re: localSettings no longer needed

2023-02-06 Thread David Smiley
Woohoo! Thanks Calvin for implementing my proposal :-) ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Feb 6, 2023 at 11:33 AM Kevin Risden wrote: > Thanks to Calvin Cowie and SOLR-16641 - `./gradlew localSettings` is no > longer needed

Re: Welcome Justin Sweeney as Solr committer

2023-02-10 Thread David Smiley
-> ME). ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Fri, Feb 10, 2023 at 2:31 PM Justin Sweeney wrote: > Hi everyone, > > Thank you Ishan for the announcement. I'm excited to be joining as a > committer and continuing to be involved

Re: Welcome Colvin Cowie as Solr committer

2023-02-14 Thread David Smiley
Welcome Colvin! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Feb 14, 2023 at 4:57 AM Colvin Cowie wrote: > Thanks everyone, > > I'm based in Cambridge (UK). I've been a software engineer for about 10 > years, mos

Re: [DISCUSS] Rebrand the JSON Request/Facet APIs

2023-02-16 Thread David Smiley
V2 shouldn't be overloaded then *that* is a problem. Can we just call the new JAX-RS stuff V3 and then voila, we call this V3 faceting API? ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Feb 16, 2023 at 11:42 AM Houston Putman

Re: Shard (slice) leader replica and state.json

2023-02-17 Thread David Smiley
e it's fine. I suspect the PRS stuff (something I haven't looked at closely) is similar. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Feb 16, 2023 at 11:52 AM Ilan Ginzburg wrote: > Hi, > > We're testing SolrClo

Re: [DISCUSS] Rebrand the JSON Request/Facet APIs

2023-02-17 Thread David Smiley
+1 to Ishan's proposal. Make it *the* Faceting API, and rebrand the old one to legacy or classic. The surface of the API might live on for simple/trivial faceting; so maybe the word "classic" could be used if it continues. ~ David Smiley Apache Lucene/Solr Search

Re: [DISCUSS] Solr 9.2 Release

2023-02-17 Thread David Smiley
Thanks Houston! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Fri, Feb 17, 2023 at 1:05 PM Houston Putman wrote: > Hey everyone, > > It's been a while since Solr 9.1 was released, and we have a ton of great > things t

Varying dependency versions? Or sacrifice Hadoop-Auth module

2023-02-19 Thread David Smiley
ource in-place, which is nicer for source control history when it returns, which we expect it to. Of course the other way is outright removal. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: preferredLeader is useless during election or node restart

2023-02-20 Thread David Smiley
Seems like a bug to me! Recommended reading: https://issues.apache.org/jira/browse/SOLR-6491 There's a treasure trove of information in JIRA to learn about how code comes to be; what were the intentions behind features; what alternatives were explored; pros & cons. ~ David Smiley Apac

Crave client install how-to

2023-02-21 Thread David Smiley
Uv, This is a basic question but how does a new Solr contributor learn how to install & configure the "crave" executable? I did this so long ago that I don't remember. And it wasn't obvious to a contributor I'm working with from his browsing of the crave.io we

Re: Varying dependency versions? Or sacrifice Hadoop-Auth module

2023-02-22 Thread David Smiley
I suppose all code can wait till some future big version unless it's some sort of bug fix applicable to the present. It's just a shame that a module I perceive to be less used, delaying things. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmile

Re: Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-02-26 Thread David Smiley
pagination-of-results.html On the other hand if you have only one Solr core, then maybe it doesn't matter relative to a massive rows param. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Fri, Feb 24, 2023 at 10:34 AM Fikavec F wrote: >

Re: preferredLeader is useless during election or node restart

2023-02-27 Thread David Smiley
I found this existing issue: https://issues.apache.org/jira/browse/SOLR-8238 I commented on it just now. Erick isn't around anymore but I'd appreciate input from anyone using "preferredLeader". ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/d

Re: [DISCUSS] Community Virtual Meetup, March 2023

2023-02-27 Thread David Smiley
I'm looking forward to it as well! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Feb 27, 2023 at 9:48 AM Jason Gerlowski wrote: > Hey all, > > As we get towards the end of February it's time to start thinking > about

Re: Renovate dependency update PRs enabled

2023-02-28 Thread David Smiley
I like the idea of a consolidated / organized list of dependency changes per release in the CHANGES.txt. If it could be automated -- awesome! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Feb 27, 2023 at 11:33 AM Jan Høydahl wrote: >

ShardHandler; why does it exist? Should it be used less?

2023-03-01 Thread David Smiley
lr-to-Solr communication. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Google Java Style: shall we declare intent to follow?

2023-03-01 Thread David Smiley
omewhat unsatisfying that acronyms aren't cased as would be done in a natural (non-code) written form. But such forms have space as a delimiter, unlike code. [1] https://google.github.io/styleguide/javaguide.html#s5-naming ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Google Java Style: shall we declare intent to follow?

2023-03-02 Thread David Smiley
On Thu, Mar 2, 2023 at 6:23 AM Ishan Chattopadhyaya < ichattopadhy...@gmail.com> wrote: > Can you please shed some light on what problem we'll solve by doing all > this or what motivates us to go there? > I suppose any of us could google such a generic question and find a bunch of reasonable answ

Re: Varying dependency versions? Or sacrifice Hadoop-Auth module

2023-03-02 Thread David Smiley
bunch of work. And I suspect if we look at the tests for it (I haven't) we'll see its testing details that may be impossible at an integration level. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Feb 23, 2023 at 2:44 AM Jan Høydahl wr

Re: Varying dependency versions? Or sacrifice Hadoop-Auth module

2023-03-02 Thread David Smiley
in Solr. The bigger question on my mind is, can this change happen in the 9x codeline. With fewer users/maintainers than in the past, I would prefer we not rigidly stick to continuing to include a feature for all of 9x if we believe it's not getting much use. ~ David Smiley Apache Lucene/S

Search timeouts; recent Lucene changes

2023-03-06 Thread David Smiley
/lucene/core/src/java/org/apache/lucene/search/TimeLimitingBulkScorer.java ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

Re: Welcome Andy Webb as Solr committer

2023-03-06 Thread David Smiley
Thanks for your contributions Andy; keep'em coming! ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Mar 6, 2023 at 2:54 PM Andy Webb wrote: > hi all, thank you for the invitation and welcome messages - this has been > an unexpe

Re: Re: Re: Re: Re: Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-03-06 Thread David Smiley
Fantastic! I really appreciate you working with the community on this one. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Mar 6, 2023 at 6:32 PM Fikavec F wrote: > Thank you, you are very kind. I took measurements on two physical serv

Re: Search timeouts; recent Lucene changes

2023-03-07 Thread David Smiley
On Tue, Mar 7, 2023 at 10:44 AM Houston Putman wrote: > The only issue I see is that the IndexSearcher timeout isn't per-query, its > a setting on the searcher itself. > Since timeAllowed is a query param, this seems like an issue. > Am I reading that incorrectly? > Yes but we can override: prot

Re: Google Java Style: shall we declare intent to follow?

2023-03-08 Thread David Smiley
BTW, I believe a rename of a file/class should *not* appear to git blame as happening on every line. Not something you said but maybe implied and not something I want to bring about with my proposal either. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in

Re: Search timeouts; recent Lucene changes

2023-03-10 Thread David Smiley
FYI JIRA issue & PR: https://issues.apache.org/jira/browse/SOLR-16693 ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Mar 7, 2023 at 11:15 AM David Smiley wrote: > > On Tue, Mar 7, 2023 at 10:44 AM Houston Putman wrote: > >&g

Re: Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-03-12 Thread David Smiley
e may not be so great. Solr users want top-X documents sorted by something, and/or maybe some facets/stats summarizing fields. Not all docs. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Sun, Mar 12, 2023 at 5:57 PM Fikavec F wrote: >C

Re: Re: Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-03-14 Thread David Smiley
fore so I'm familiar with the mechanics of it. There is more integration work to do of course. Ultimately Solr would have to be configured to use a custom Codec. At work, I like to say "we've plugged all the pluggables and created our own" LOL. ~ David Smiley Apache Lucene/Solr

Re: Google Java Style: shall we declare intent to follow?

2023-03-15 Thread David Smiley
ow the Google Java Style Guide[1]. We don't follow all aspects strictly; much code was written before this style guide was selected. Some aspects of this guide are automatically enforced by the build. I can raise a PR where the specifics can be further debated. ~ David Smiley Apache Lucen

Re: Proposal of an encryption module in solr-sandbox

2023-03-15 Thread David Smiley
I've also observed that HDFS supports client provided encryption... or so I recall when I looked many months ago. Someone ought to do a blog/write-up on that. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Mar 15, 2023 at 5:28 AM

Re: Proposal of an encryption module in solr-sandbox

2023-03-15 Thread David Smiley
something I want to kick-start). ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Mar 15, 2023 at 5:23 AM Ishan Chattopadhyaya < ichattopadhy...@gmail.com> wrote: > Does it need to be a first party project? > > On Wed, 15 Mar, 202

Re: Proposal of an encryption module in solr-sandbox

2023-03-15 Thread David Smiley
On Wed, Mar 15, 2023 at 5:23 AM Ishan Chattopadhyaya < ichattopadhy...@gmail.com> wrote: > Does it need to be a first party project? > If there is a maintainer then, I think yes. When there isn't, then it's a difficult question.

Re: Alias property deletion confusion

2023-03-15 Thread David Smiley
Interestingly, the part of that test which you commented on doesn't appear to assert/validate anything; it just does stuff. I suspect Gus may know the answer to your question. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Mar 15, 2023

Re: Result Grouping on alias collection

2023-03-15 Thread David Smiley
uld be detected in some cases but that isn't a substitute for truly working/supported. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Mar 7, 2023 at 5:34 AM Vinayak Hegde wrote: > Hello everyone, > I hope this email finds you

Re: Google Java Style: shall we declare intent to follow?

2023-03-16 Thread David Smiley
https://github.com/apache/solr/pull/1468 ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Mar 15, 2023 at 4:11 PM Justin Sweeney wrote: > +1 Could also be useful to link common IDE plugins in the dev docs to help: > https://github.com/

Re: Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-03-19 Thread David Smiley
On Sun, Mar 19, 2023 at 8:39 AM Fikavec F wrote: >I was able to create a collection with "solr.SimpleTextCodecFactory" > codecFactory and solr can proces (return) only 2x more documents per second > from it (214 410 documents per second vs 115 000 "solr.SchemaCodecFactory" > with compression)

Re: Google Java Style: shall we declare intent to follow?

2023-03-20 Thread David Smiley
plugin doesn't. It's fine. If you see lots of changes then tag me; I'd be curious to see. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Mar 20, 2023 at 2:05 PM Eric Pugh wrote: > Thanks for moving this along! This is a g

Re: Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-03-20 Thread David Smiley
Ah, Solr wants a Codec*Factory* whereas you supplied the class name of the Codec. And of course your codec is a WIP I assume; you didn't customize the stored fields to not use compression yet. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon

Notice of tests failing often

2023-03-22 Thread David Smiley
y 7 runs whereas everything else is out of hundreds. Weird) ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley

<    1   2   3   4   5   6   7   8   >