Re: SolrJ: SolrInputDocument.addField()

2021-02-16 Thread Shawn Heisey
On 2/15/2021 10:17 AM, Steven White wrote: Yes, I have managed schema enabled like so: true cp-schema.xml The reason why I enabled it is so that I can dynamically customize the schema based on what's in the DB. So that I can add fields to the schema dynamically. A managed/m

Re: SolrJ: SolrInputDocument.addField()

2021-02-16 Thread Jimi Hullegård
Hi Steven, Just a thought, from someone who never have used schema-less mode: Have you considered using a regular schema file, with a bunch of dynamicField definitions? Then you can for example define a dynamic boolean field like this: Then, when you index the data, you can append "_b" to the

Re: SolrJ: SolrInputDocument.addField()

2021-02-15 Thread Steven White
Hi Shawn, Yes, I have managed schema enabled like so: true cp-schema.xml The reason why I enabled it is so that I can dynamically customize the schema based on what's in the DB. So that I can add fields to the schema dynamically. I didn't know about the field "guessing" part. No

Re: SolrJ: SolrInputDocument.addField()

2021-02-15 Thread Shawn Heisey
On 2/15/2021 6:52 AM, Steven White wrote: It looks to me that SolrInputDocument.addField() is either missnamed or isn't well implemented. When it is called on a field that doesn't exist in the schema, it will create that field and give it a type based on the data. Not only that, it will set def

Re: SolrJ: SolrInputDocument.addField()

2021-02-15 Thread Steven White
Thanks Shawn. It looks to me that SolrInputDocument.addField() is either missnamed or isn't well implemented. When it is called on a field that doesn't exist in the schema, it will create that field and give it a type based on the data. Not only that, it will set default values. For example, th

Re: SolrJ: SolrInputDocument.addField()

2021-02-14 Thread Shawn Heisey
On 2/14/2021 9:00 AM, Steven White wrote: It looks like I'm misusing SolrJ API SolrInputDocument.addField() thus I need clarification. Here is an example of what I have in my code: SolrInputDocument doc = new SolrInputDocument(); doc.addField("MyFieldOne", "some data"); doc.addF

Re: Solrj supporting term vector component ?

2020-12-04 Thread Erick Erickson
To expand on Shawn’s comment. There are a lot of built-in helper methods in SolrJ, but they all amount to setting a value in the underlying map of params, which you can do yourself for any parameter you could specify on a URL or cURL command. For instance, SolrQuery.setStart(start) is just: thi

Re: Solrj supporting term vector component ?

2020-12-03 Thread Shawn Heisey
On 12/3/2020 10:20 AM, Deepu wrote: I am planning to use Term vector component for one of the use cases, as per below solr documentation link solrj not supporting Term Vector Component, do you have any other suggestions to use TVC in java application? https://lucene.apache.org/solr/guide/8_4/the

Re: SolrJ NestableJsonFacet ordering of query facet

2020-11-19 Thread Jason Gerlowski
Hi Shivram, I think the short answer is "no". At least, not without sub-classing some of the JSON-Facet classes in SolrJ. But it's hard for me to understand your particular concern without seeing a concrete example. If you provide an example (maybe in the form of a JUnit test snippet showing th

Re: SolrJ NestableJsonFacet ordering of query facet

2020-10-29 Thread Shivam Jha
Hi folks, Does anyone have any advice on this issue? Thanks, Shivam On Tue, Oct 27, 2020 at 1:20 PM Shivam Jha wrote: > Hi folks, > > Doing some faceted queries using 'facet.json' param and SolrJ, the results > of which I am processing using SolrJ NestableJsonFacet class. > basically as *que

Re: Solrj client 8.6.0 issue special characters in query

2020-08-07 Thread Chris Hostetter
: Hmm, setting -Dfile.encoding=UTF-8 solves the problem. I have to now check : which component of the application screws it up, but at the moment I do NOT : believe it is related to Solrj. You can use the "forbidden-apis" project to analyze your code and look for uses of APIs that depend on the

Re: Solrj client 8.6.0 issue special characters in query

2020-08-07 Thread Andy Webb
hi Jörn - something's decoding a UTF8 sequence using the legacy iso-8859-1 character set: Jörn is J%C3%B6rn in UTF8 J%C3%B6rn misinterpreted as iso-8859-1 is Jörn Jörn is J%C3%83%C2%B6rn in UTF8 I hope this helps track down the problem! Andy On Fri, 7 Aug 2020 at 12:08, Jörn Franke wrote: >

Re: Solrj client 8.6.0 issue special characters in query

2020-08-07 Thread Jörn Franke
Hmm, setting -Dfile.encoding=UTF-8 solves the problem. I have to now check which component of the application screws it up, but at the moment I do NOT believe it is related to Solrj. On Fri, Aug 7, 2020 at 11:53 AM Jörn Franke wrote: > Dear all, > > I have the following issues. I have a Solrj Cl

Re: solrj - get metrics from all nodes

2020-07-02 Thread ChienHuaWang
Thanks for Jan's response. I tried to set this "nodes" parameter by ModifiableSolrParams. But the null is return from GenericSolrRequest. Could anyone advise the best approach to setup this parameter for multiple nodes? Thanks, Chien -- Sent from: https://lucene.472066.n3.nabble.com/Solr-Us

Re: solrj - get metrics from all nodes

2020-06-30 Thread Jan Høydahl
Use nodes=, not node= > 30. jun. 2020 kl. 02:02 skrev ChienHuaWang : > > Hi Jan, > > Thanks for the response. > Could you please share more detail how you request the metric with multiple > nodes same time? > I do something as below, but only get one node info, the data I'm interested > most is,

Re: solrj - get metrics from all nodes

2020-06-30 Thread ChienHuaWang
Hi Jan, Thanks for the response. Could you please share more detail how you request the metric with multiple nodes same time? I do something as below, but only get one node info, the data I'm interested most is, ex: CONTAINER.fs.totalSpace, CONTAINER.fs.usableSpace. etc.. solr/admin/metrics?grou

Re: solrj - get metrics from all nodes

2020-06-29 Thread Jan Høydahl
The admin UI does this my requesting &nodes=,,… You will get a master response with each sub response as key:value pairs. The list of node_names can be found in live_nodes in CLUSTERSTATUS api. Jan > 27. jun. 2020 kl. 02:09 skrev ChienHuaWang : > > For people who is also looking for the solution

Re: solrj - get metrics from all nodes

2020-06-27 Thread ChienHuaWang
For people who is also looking for the solution - you can append "node=node_name" in metrics request to get specific data of node. If anyone know how to get the data if all the nodes together, please kindly share, thanks. Regards, Chien -- Sent from: https://lucene.472066.n3.nabble.com/Solr-U

Re: solrj - get metrics from all nodes

2020-06-25 Thread ChienHuaWang
I observed the exactly same thing - the metrics for only one node. Looking for the solution to get the metrics of all the nodes. Could anyone advice? Thanks, Chien -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: SolrJ connection leak with SolrCloud and Jetty Gzip compression enabled

2020-05-02 Thread Samuel Garcia Martinez
/SOLR-14457 From: Jason Gerlowski Sent: Wednesday, April 22, 2020 4:43 PM To: solr-user@lucene.apache.org Subject: Re: SolrJ connection leak with SolrCloud and Jetty Gzip compression enabled Hi Samuel, Thanks for the very detailed description of the problem here

Re: SolrJ connection leak with SolrCloud and Jetty Gzip compression enabled

2020-04-22 Thread Jason Gerlowski
Hi Samuel, Thanks for the very detailed description of the problem here. Very thorough! I don't think you're missing anything obvious, please file the jira tickets if you haven't already. Best, Jason On Mon, Apr 13, 2020 at 6:12 PM Samuel Garcia Martinez < samuel...@inditex.com> wrote: > Rea

Re: SolrJ connection leak with SolrCloud and Jetty Gzip compression enabled

2020-04-13 Thread Samuel Garcia Martinez
Reading again the last two paragraphs I realized that, those two specially, are very poorly worded (grammar 😓). I tried to rephrase them and correct some of the errors below. Here I can see three different problems: * HttpSolrCall should not use HttpServletResponse#setCharacterEncoding to set

Antw: Re: SolrJ 8.2: Too many Connection evictor threads

2020-02-11 Thread Andreas Kahl
Erick, Thanks, that's why we want to upgrade our clients to the same Solr(J) version as the server has. But I am still fighting the uncontrolled creation of those Connection evictor threads in my tomcat. Best Regards Andreas >>> Erick Erickson 11.02.20 15.06 Uhr >>> Are you running a 5x

Re: SolrJ 8.2: Too many Connection evictor threads

2020-02-11 Thread Erick Erickson
Are you running a 5x SolrJ client against an 8x server? There’s no guarantee at all that that would work (or vice-versa for that matter). Most generally, SolrJ clients should be able to work with version X-1, but X-3 is unsupported. Best, Erick > On Feb 11, 2020, at 6:36 AM, Andreas Kahl wrote:

Re: SolrJ, CloudSolrClient and basic authentication

2019-06-03 Thread Kevin Risden
Chris - not sure if what you are seeing is related to basic auth credentials not being sent until a 401. There was report of this behavior with Apache Knox in front of Solr. https://issues.apache.org/jira/browse/KNOX-1066 The jira above has an example of how to preemptively send basic auth instea

Re: SolrJ, CloudSolrClient and basic authentication

2019-05-31 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Dimitris, On 6/1/18 02:46, Dimitris Kardarakos wrote: > Thanks a lot Shawn. I had tried with the documented approach, but > since I use SolrClient.add to add documents to the index, I could > not "port" the documented approach to my case (probably I

Re: SolrJ - CoreAdminRequest / PingRequest and HttpSolrClient baseUrl

2019-03-18 Thread Jörn Franke
Depends what you want to achieve. You can also have two different beans with two different clients and one accesses a core and another accesses without. You may also want depending on your use case get all cores and ping each core individually to check if they are reachable. > Am 18.03.2019 um

Re: SolrJ - CoreAdminRequest / PingRequest and HttpSolrClient baseUrl

2019-03-18 Thread Shawn Heisey
On 3/18/2019 2:04 PM, Markus Schuch wrote: * CoreAdminRequest - is only working when no particular core is given * PingRequest - is only working when a particular core is given That sounds like what I would expect to happen. Using HTTP (not SolrJ), the CoreAdmin API is accessed throu

Re: Solrj, Json Facets, (Date) stats facets

2019-03-11 Thread Jason Gerlowski
Hi Andrea, It looks like you've stumbled on a bug in NestableJsonFacet. I clearly wasn't thinking about Date stats when I first wrote it; it looks like it doesn't detect/parse them correctly in the current iteration. I'll try to fix this in a subsequent release. But in the meantime, unfortunate

Re: solrj - Batching and Optimistic Concurrency

2018-12-04 Thread lstusr 5u93n4
Hi Erick, Looks like TolerantUpdateProcessor is exactly what I need. Thanks! Kyle. P.S. I can find the doc for TolerantUpdateProcessorFactory here: http://lucene.apache.org/solr/7_5_0/solr-core/org/apache/solr/update/processor/TolerantUpdateProcessor.html , but it seems to be missing from the gu

Re: solrj - Batching and Optimistic Concurrency

2018-12-03 Thread Erick Erickson
You can add, say, a ScriptUpdateProcessor that checks this for you pretty easily. Have you looked at the Overwrite=false option (assuming you're not assigning _version_ yourself)? Best, Erick On Mon, Dec 3, 2018 at 11:57 AM lstusr 5u93n4 wrote: > > Hi All, > > I have a scenario where I'm trying

Re: solrj - Batching and Optimistic Concurrency

2018-12-03 Thread Erick Erickson
And I forgot to mention TolerantUpdateProcessor, might be another approach. On Mon, Dec 3, 2018 at 12:57 PM Erick Erickson wrote: > > You can add, say, a ScriptUpdateProcessor that checks this for you > pretty easily. > > Have you looked at the Overwrite=false option (assuming you're not > assign

Re: SolrJ does not use HTTP proxy anymore in 7.5.0 after update from 6.6.5

2018-10-15 Thread Andreas Hubold
Hi Michael, sure. The important call is HttpClientBuilder#useSystemProperties which is also what Shawn added in his patch to https://issues.apache.org/jira/browse/SOLR-12848 For my workaround, I've just followed the code from method org.apache.solr.client.solrj.impl.HttpClientUtil#createClie

Re: SolrJ does not use HTTP proxy anymore in 7.5.0 after update from 6.6.5

2018-10-12 Thread Michael Joyner
Would you supply the snippet for the custom HttpClient to get it to honor/use proxy? Thanks! On 10/10/2018 10:50 AM, Andreas Hubold wrote: Thank you, Shawn. I'm now using a custom HttpClient that I create in a similar manner as SolrJ, and it works quite well. Of course, a fix in a future rel

Re: SolrJ does not use HTTP proxy anymore in 7.5.0 after update from 6.6.5

2018-10-10 Thread Andreas Hubold
Thank you, Shawn. I'm now using a custom HttpClient that I create in a similar manner as SolrJ, and it works quite well. Of course, a fix in a future release would be great, so that we can remove the workaround eventually. Thanks, Andreas Shawn Heisey schrieb am 10.10.2018 um 16:31: On 10/1

Re: SolrJ does not use HTTP proxy anymore in 7.5.0 after update from 6.6.5

2018-10-10 Thread Shawn Heisey
On 10/1/2018 6:54 AM, Andreas Hubold wrote: Is there some other way to configure an HTTP proxy, e.g. with HttpSolrClient.Builder? I don't want to create an Apache HttpClient instance myself but the builder from Solrj (HttpSolrClient.Builder). Unless you want to wait for a fix for SOLR-12848, y

Re: SolrJ does not use HTTP proxy anymore in 7.5.0 after update from 6.6.5

2018-10-10 Thread ahubold
I've now created https://issues.apache.org/jira/browse/SOLR-12848 for this problem. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: SolrJ cannot get actual cause of error

2018-09-30 Thread Shawn Heisey
On 9/29/2018 3:08 AM, Ryan Qin wrote: I’m working on a project which uses solr as search engine. I found I cannot get the root cause of error from SolrJ. CloudSolrClient uses LBHttpSolrClient internally.  This client has a tendency to wrap all exceptions in the "No live SolrServers" message. 

Re: SolrJ cannot get actual cause of error

2018-09-29 Thread Alexandre Rafalovitch
If you can still see the same behavior in 7.5 (some things were rewritten), this could be a reasonable enhancement Jira with suggested patch attached. Regards, Alex. On Sat, 29 Sep 2018 at 07:25, Ryan Qin wrote: > Hi there, > > > > I’m working on a project which uses solr as search engine. I

Re: [SolrJ Client] Error calling add: connection is still allocated

2018-09-21 Thread Shawn Heisey
On 9/21/2018 10:31 AM, Christopher Schultz wrote: For those interested, it looks like I was naïvely using BasicHttpClientConnectionManager, which is totally inappropriate in a multi-user threaded environment. I switched to PooledHttpClientConnectionManager and that seems to be working much bette

Re: [SolrJ Client] Error calling add: connection is still allocated

2018-09-21 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 All, On 9/18/18 11:10, Christopher Schultz wrote: > All, > > Our single-instance Solr server is just getting its first taste of > production load, and I'm seeing this periodically: > > java.lang.IllegalStateException: Connection is still allocate

Re: SOLRJ 7.x library fails ejb deployment with weblogic

2018-08-21 Thread Shawn Heisey
On 8/21/2018 7:29 AM, Ganesh Kumar J wrote: Thank you so much for your reply. Unfortunately our production weblogic cluster runs in java 1.7 we are unable to upgrade to java 1.8 In this case do you have any idea how we can use solrj version below 7.x which can authenticate with kerberozied sol

RE: SOLRJ 7.x library fails ejb deployment with weblogic

2018-08-21 Thread Ganesh Kumar J
cluster. Since keberozied authentication classes are available only from solrj7.x Thanks & Regards, J.Ganesh Kumar. From: Jan Høydahl [mailto:jan@cominvent.com] Sent: 21 August 2018 17:12 To: solr-user Cc: Ganesh Kumar J Subject: Re: SOLRJ 7.x library fails ejb deployment with weblogic

Re: SOLRJ 7.x library fails ejb deployment with weblogic

2018-08-21 Thread Jan Høydahl
Hi, I don't know what version of Weblogic and Java you use, but note that Solr, even SolrJ 7.x requires Java 8, while 5.x required Java 7. There seems to be several discussion on stackoverflow and elsewhere about similar issues: https://stackoverflow.com/questions/19152655/java-lang-arrayindexo

Re: SolrJ: build a SolrClient(-connection) with HttpClientUtil

2018-08-13 Thread Shawn Heisey
On 8/13/2018 12:39 PM, Clemens Wyss DEV wrote: What is the proposed way to get/build a SolrClient(-connection) via HttpClientUtil - respecting a given connection and response (socket) timeout (ROP_SO_TIMEOUT, PROP_CONNECTION_TIMEOUT) - making reuse of underlying http client (pooling?) - what el

Re: SolrJ: build a SolrClient(-connection) with HttpClientUtil

2018-08-13 Thread ☼ R Nair
Or HttpSolrClient.builder as well On Mon, Aug 13, 2018, 2:50 PM ☼ R Nair wrote: > Pls use CloudSolrClient.builder(...).withHttpClient(...). > Best, Ravion > > On Mon, Aug 13, 2018, 2:40 PM Clemens Wyss DEV > wrote: > >> What is the proposed way to get/build a SolrClient(-connection) via >> Http

Re: SolrJ: build a SolrClient(-connection) with HttpClientUtil

2018-08-13 Thread ☼ R Nair
Pls use CloudSolrClient.builder(...).withHttpClient(...). Best, Ravion On Mon, Aug 13, 2018, 2:40 PM Clemens Wyss DEV wrote: > What is the proposed way to get/build a SolrClient(-connection) via > HttpClientUtil > - respecting a given connection and response (socket) timeout > (ROP_SO_TIMEOUT, P

Re: SolrJ Kerberos Client API

2018-06-29 Thread Jason Gerlowski
Hi Tushar, You're right; the docs are a little out of date there. Krb5HttpClientConfigurer underwent some refactoring recently and came out with a different name: Krb5HttpClientBuilder. The ref-guide should update the snippet you were referencing to something more like: System.setProperty("java.

Re: Solrj does not support ltr ?

2018-06-19 Thread Alessandro Benedetti
Pretty sure you can't. As far as I know there is no client side implementation to help with managed resourced in general. Any contribution is welcome! - --- Alessandro Benedetti Search Consultant, R&D Software Engineer, Director Sease Ltd. - www.sease.io -- Sent from: http://luce

Re: Solrj does not support ltr ?

2018-06-18 Thread shreck
i am not sure if i can do this "curl -XPUT 'http://localhost:8983/solr/techproducts/schema/model-store' --data-binary "@/path/myModel.json" -H 'Content-type:application/json'" by solrj . -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: SolrJ and autoscaling

2018-06-07 Thread Hendrik Haddorp
I opened a Jira for it: https://issues.apache.org/jira/browse/SOLR-12467 On 08.06.2018 07:24, Shalin Shekhar Mangar wrote: Yes, we don't have Solrj support for changing autoscaling configuration today. It'd be nice to have for sure. Can you please file a Jira? Patches are welcome too! On Wed, J

Re: SolrJ and autoscaling

2018-06-07 Thread Shalin Shekhar Mangar
Yes, we don't have Solrj support for changing autoscaling configuration today. It'd be nice to have for sure. Can you please file a Jira? Patches are welcome too! On Wed, Jun 6, 2018 at 8:33 PM, Hendrik Haddorp wrote: > Hi, > > I'm trying to read and modify the autoscaling config. The API on > h

Re: SolrJ, CloudSolrClient and basic authentication

2018-05-31 Thread Dimitris Kardarakos
Thanks a lot Shawn. I had tried with the documented approach, but since I use SolrClient.add to add documents to the index, I could not "port" the documented approach to my case (probably I do miss something). The custom HttpClient suggestion worked as expected! On 31/05/2018 06:16 μμ, Shawn

Re: SolrJ, CloudSolrClient and basic authentication

2018-05-31 Thread Shawn Heisey
On 5/31/2018 8:03 AM, Dimitris Kardarakos wrote: > Following the feedback in the "Index protected zip" thread, I am > trying to add documents to the index using SolrJ API. > > The server is in SolrCloud mode with BasicAuthPlugin for authentication. > > I have not managed to figure out how to pass u

Re: solrj (admin) requests

2018-05-04 Thread Arturas Mazeika
Hi Erick, Shawn, et al, Thanks a lot for a piece of wisdom Especially for unit tests, findRecursive, as well as ideas how to get to infos that one is looking for. Good job indeed. Cheers, Arturas On Fri, May 4, 2018 at 12:22 AM, Shawn Heisey wrote: > On 5/3/2018 9:07 AM, Arturas Mazeika wrote:

Re: solrj (admin) requests

2018-05-03 Thread Shawn Heisey
On 5/3/2018 9:07 AM, Arturas Mazeika wrote: > Short question: > > How can I systematically explore the solrj functionality/API? As Erick said, there is not an extensive programming guide.  The javadocs for SolrJ classes are pretty decent, but figuring out precisely what the response objects actual

Re: solrj (admin) requests

2018-05-03 Thread Erick Erickson
Yeah, that can be a pain. Unfortunately there's no official "programming guide" for instance. What there is, however, is an extensive suite of unit tests in /Users/Erick/apache/solrJiras/master/solr/solrj/src/test/org/apache/solr/client/solrj. >From there it's often a hunt though. Best, Erick On

Re: solrj question

2018-03-26 Thread Shawn Heisey
On 3/26/2018 11:19 AM, Webster Homer wrote: > You may say that the String in the constructor is "meant to be query > syntax", nothing in the Javadoc says anything about the expected syntax. > Since there is also a method to set the query, it seemed reasonable to > expect that it would take the outp

Re: solrj question

2018-03-26 Thread Webster Homer
You may say that the String in the constructor is "meant to be query syntax", nothing in the Javadoc says anything about the expected syntax. Since there is also a method to set the query, it seemed reasonable to expect that it would take the output of the toString method. (or some other serializat

Re: solrj question

2018-03-23 Thread Shawn Heisey
On 3/23/2018 3:24 PM, Webster Homer wrote: > I see this in the output: > Lexical error at line 1, column 1759. Encountered: after : > "/select?defType=edismax&start=0&rows=25&... > It has basically the entire solr query which it obviously couldn't parse. > > solrQuery = new SolrQuery(log.getQuery

Re: Solrj Analytics component

2018-03-20 Thread Jason Gerlowski
Hi Asmaa, As far as I know, there aren't any SolrJ classes built expressly for Analytics component requests like what exists for the Collection Admin APIs, etc. (https://lucene.apache.org/solr/7_2_0/solr-solrj/org/apache/solr/client/solrj/request/CollectionAdminRequest.html). But it should still

Re: Solrj : ConcurrentUpdateSolrClient based on QueueSize and Time

2018-02-23 Thread Santosh Narayan
Thanks Jason. Hope this can be fixed in the next update of SolrJ. On Thu, Feb 22, 2018 at 10:49 AM, Jason Gerlowski wrote: > My apologies Santosh. I added that comment a few releases back based > on a misunderstanding I've only recently been disabused of. I will > correct it. > > Anyway, Sha

Re: Solrj : ConcurrentUpdateSolrClient based on QueueSize and Time

2018-02-21 Thread Jason Gerlowski
My apologies Santosh. I added that comment a few releases back based on a misunderstanding I've only recently been disabused of. I will correct it. Anyway, Shawn's explanation above is correct. The queueSize parameter doesn't control batching, as he clarified. Sorry for the trouble. Best, Ja

Re: Solrj : ConcurrentUpdateSolrClient based on QueueSize and Time

2018-02-21 Thread Santosh Narayan
Thanks for the explanation Shawn. Very helpful. I think I got misled by the JavaDoc text for *ConcurrentUpdateSolrClient.Builder.withQueueSize* /** * The number of documents to batch together before sending to Solr. If not set, this defaults to 10. */ public Builder withQueueSize(

Re: Solrj : ConcurrentUpdateSolrClient based on QueueSize and Time

2018-02-21 Thread Shawn Heisey
On 2/21/2018 7:41 AM, Santosh Narayan wrote: > May be it is my understanding of the documentation. As per the > JavaDoc, ConcurrentUpdateSolrClient > buffers all added documents and writes them into open HTTP connections. > > So I thought that this class would buffer documents in the client side >

Re: Solrj : ConcurrentUpdateSolrClient based on QueueSize and Time

2018-02-21 Thread Santosh Narayan
Hi Shawn, May be it is my understanding of the documentation. As per the JavaDoc, ConcurrentUpdateSolrClient buffers all added documents and writes them into open HTTP connections. So I thought that this class would buffer documents in the client side itself till the QueueSize is reached and then

Re: Solrj : ConcurrentUpdateSolrClient based on QueueSize and Time

2018-02-21 Thread Shawn Heisey
On 2/21/2018 1:21 AM, Santosh Narayan wrote: I'm using ConcurrentUpdateSolrClient to push data into Solr. Currently, I'm initializing it as follows: ConcurrentUpdateSolrClientclient = new ConcurrentUpdateSolrClient.Builder(serverUrl).withThreadCount(100).withQueueSize(50).build(); This works fi

Re: SolrJ with Async Http Client

2018-01-08 Thread Emir Arnautović
Not sure if alilgns with your expectations, but here is something that is declared as “async solr client”: https://github.com/inoio/solrs HTH, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - ht

Re: SolrJ with Async Http Client

2018-01-05 Thread Erick Erickson
re: upgrade Jetty: See SOLR-11810 On Fri, Jan 5, 2018 at 2:08 PM, Shawn Heisey wrote: > On 1/5/2018 11:35 AM, Gus Heck wrote: > > IIRC http2 allows for multiple (non blocking) requests over a single > > connection, so this Jira might be relevant: > > https://issues.apache.org/jira/browse/SOLR-7

Re: SolrJ with Async Http Client

2018-01-05 Thread Shawn Heisey
On 1/5/2018 11:35 AM, Gus Heck wrote: > IIRC http2 allows for multiple (non blocking) requests over a single > connection, so this Jira might be relevant: > https://issues.apache.org/jira/browse/SOLR-7442 HTTPClient will have http/2 support in version 5.0 -- but only in the async client, not the c

Re: SolrJ with Async Http Client

2018-01-05 Thread Gus Heck
IIRC http2 allows for multiple (non blocking) requests over a single connection, so this Jira might be relevant: https://issues.apache.org/jira/browse/SOLR-7442 -Gus On Wed, Jan 3, 2018 at 10:22 AM, Walter Underwood wrote: > HTTPClient is non-blocking. Send the request, then the client gets con

Re: SolrJ with Async Http Client

2018-01-03 Thread Walter Underwood
HTTPClient is non-blocking. Send the request, then the client gets control back. It only blocks when you do the read. So one thread can send multiple requests then check for each response. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Jan 3, 2018

Re: SolrJ with Async Http Client

2018-01-03 Thread Joel Bernstein
Streaming expressions has an event driven architecture built in. There are two blogs that describe how it works. This describes the message queues: http://joelsolr.blogspot.com/2016/10/solr-63-batch-jobs-parallel-etl-and.html This describes an async model of execution: http://joelsolr.blogspot.

Re: SolrJ with Async Http Client

2018-01-03 Thread RAUNAK AGRAWAL
Yes, I am talking about event driven way of calling solr, so that I can write pure async web service. Does SolrJ provides support for non-blocking calls? On Wed, Jan 3, 2018 at 6:22 PM, Hendrik Haddorp wrote: > There is asynchronous and non-blocking. If I use 100 threads to perform > calls to So

Re: SolrJ with Async Http Client

2018-01-03 Thread Hendrik Haddorp
There is asynchronous and non-blocking. If I use 100 threads to perform calls to Solr using the standard Java HTTP client or SolrJ I block 100 threads even if I don't block my program logic threads by using async calls. However if I perform those HTTP calls using a non-blocking HTTP client, lik

Re: SolrJ with Async Http Client

2018-01-02 Thread Rick Leir
Agrawal There is good reading on the topic at https://wiki.apache.org/solr/IntegratingSolr Cheers -- Rick On January 2, 2018 10:31:28 AM EST, RAUNAK AGRAWAL wrote: >Hi Guys, > >I am trying to write fully async service where solr calls are also >async. >Just wondering did anyone tried calling sol

Re: SolrJ with Async Http Client

2018-01-02 Thread Gus Heck
It's not very clear (to me) what your use case is, but generally speaking, asynchronous requests can be achieved by using threads/executors/futures (java) or ajax (javascript). The link seems to be a scala project, I'm sure scala has analogous facilities. On Tue, Jan 2, 2018 at 10:31 AM, RAUNAK AG

Re: SolrJ DocCollection is missing config name

2017-11-12 Thread Hendrik Haddorp
An option is actually to do an explicit ClusterStatus.getClusterStatus().process(solr, collectionName) request and then get the config set name out of the result. This is a bit cumbersome but works. On 12.11.2017 19:54, Hendrik Haddorp wrote: Hi, the SolrJ DocCollection object seems to conta

RE: SolrJ 6.6.0 Connection pool shutdown now with stack trace

2017-10-19 Thread Markus Jelsma
> Sent: Thursday 19th October 2017 13:45 > To: solr-user@lucene.apache.org > Subject: RE: SolrJ 6.6.0 Connection pool shutdown now with stack trace > > Hello, > > We are having this problem again, now it affects the front-end too, the logs > are littered with Zookeeper co

RE: SolrJ 6.6.0 Connection pool shutdown now with stack trace

2017-10-19 Thread Markus Jelsma
.org > Subject: Re: SolrJ 6.6.0 Connection pool shutdown now with stack trace > > On 7/18/2017 5:10 AM, Markus Jelsma wrote: > > The problem was never resolved but Shawn asked for the stack trace, here it > > is: > > > Caused by: java.lang.IllegalState

Re: solrj howto update documents with expungeDeletes

2017-10-04 Thread Emir Arnautović
Hi Bernd, I guess it is not exposed in Solrj. Maybe for good reason - it is rarely good to call it. You might better set reclaimDeletesWeight in your merge config and keep number of deleted docs under control that way. Regards, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection S

Re: solrj howto update documents with expungeDeletes

2017-10-04 Thread Erick Erickson
Do not use expungedeletes even if you find a way to call it in the scenario you're talking about. First of all I think you'll run into the issue here: https://issues.apache.org/jira/browse/LUCENE-7976 Second it is a very heavy weight operation. It potentially rewrites _all_ of your index and it so

Re: solrj howto update documents with expungeDeletes

2017-10-04 Thread Bernd Fehling
Hi Emir, can you point out which commit you are using for expungeDeletes true/false? My commit has only commit(String collection, boolean waitFlush, boolean waitSearcher, boolean softCommit) Or is expungeDeletes true/false a special combination of the boolean parameters? Regards, Bernd Am 04.

Re: solrj howto update documents with expungeDeletes

2017-10-04 Thread Emir Arnautović
Hi Bernd, When it comes to updating, it does not exist because indexed documents are not updatable - you can add new document with the same id and old one will be flagged as deleted. No need to delete explicitly. When it comes to expungeDeletes - that is a flag that can be set when committing.

Re: SolrJ Java API examples

2017-09-17 Thread Furkan KAMACI
Hi Vishal, You can also check here: https://lucene.apache.org/solr/guide/6_6/using-solrj.html#using-solrj You can get enough information about how to use it. Kind Regards, Furkan KAMACI On Thu, Sep 14, 2017 at 1:25 PM, Leonardo Perez Pulido < leoperezpul...@gmail.com> wrote: > Hi, > This may he

Re: SolrJ Java API examples

2017-09-14 Thread Leonardo Perez Pulido
Hi, This may help: https://github.com/leoperezpulido/lucene-solr/tree/master/solr/solrj/src/test/org/apache/solr/client/solrj Regards. On Thu, Sep 14, 2017 at 4:21 AM, Vishal Srivastava wrote: > Hi, > I'm a beginner at SolrJ , and am currently looking to implement and > integrate the same at m

Re: SolrJ 6.6.0 Connection pool shutdown now with stack trace

2017-07-18 Thread Shawn Heisey
On 7/18/2017 5:10 AM, Markus Jelsma wrote: > The problem was never resolved but Shawn asked for the stack trace, here it > is: > Caused by: java.lang.IllegalStateException: Connection pool shut down > at org.apache.http.util.Asserts.check(Asserts.java:34) As I suspected, it is the connection p

RE: SolrJ 6.6.0 Connection pool shutdown now with stack trace

2017-07-18 Thread Markus Jelsma
times, briefly, very high. Usually very low. These specific checks are executed in order, not concurrently. Thanks, Markus -Original message- > From:Susheel Kumar > Sent: Tuesday 18th July 2017 15:17 > To: solr-user@lucene.apache.org > Subject: Re: SolrJ 6.6.0 Connection pool

Re: SolrJ 6.6.0 Connection pool shutdown now with stack trace

2017-07-18 Thread Susheel Kumar
24 more > > > > > > So, to summarize, we have a program checking presence of documents in > Solr > > > using getById() and we don't want this exception to bubble up, we want > > > SolrJ to restore the connection pool just as CloudSolrClient would > m

RE: SolrJ 6.6.0 Connection pool shutdown now with stack trace

2017-07-18 Thread Markus Jelsma
Hello Susheel, No, nothing at all. I've check all six nodes, they are clean. Thanks, Markus -Original message- > From:Susheel Kumar > Sent: Tuesday 18th July 2017 14:30 > To: solr-user@lucene.apache.org > Subject: Re: SolrJ 6.6.0 Connection pool shutdown now

Re: SolrJ 6.6.0 Connection pool shutdown now with stack trace

2017-07-18 Thread Susheel Kumar
n't want this exception to bubble up, we want > SolrJ to restore the connection pool just as CloudSolrClient would move on > to another node if one went down in the mean time. > > Is this possible? How? > > Many thanks, > Markus > > -Original message- > >

RE: SolrJ 6.6.0 Connection pool shutdown now with stack trace

2017-07-18 Thread Markus Jelsma
> To: solr-user@lucene.apache.org > Subject: RE: SolrJ 6.6.0 Connection pool shutdown > > Thanks. I probably should have mentioned there is no firewall limiting > connections between those hosts. Actually, the processes run on the same > hosts as the Solr cluster is runn

RE: SolrJ 6.6.0 Connection pool shutdown

2017-06-29 Thread Markus Jelsma
e 2017 15:38 > To: solr-user > Subject: Re: SolrJ 6.6.0 Connection pool shutdown > > One thing to check is whether there is a firewall between the client > and the server. They - sometimes - cut the silent connections in the > _middle_ (at the firewall). The usual solution is kee

Re: SolrJ 6.6.0 Connection pool shutdown

2017-06-29 Thread Alexandre Rafalovitch
#x27;ll let it print the stack trace and get back if it happens again. > > Thanks, > Markus > > -Original message- >> From:Shawn Heisey >> Sent: Tuesday 27th June 2017 23:02 >> To: solr-user@lucene.apache.org >> Subject: Re: SolrJ 6.6.0 Connection pool shutdown &

RE: SolrJ 6.6.0 Connection pool shutdown

2017-06-29 Thread Markus Jelsma
t; Sent: Tuesday 27th June 2017 23:02 > To: solr-user@lucene.apache.org > Subject: Re: SolrJ 6.6.0 Connection pool shutdown > > On 6/27/2017 6:50 AM, Markus Jelsma wrote: > > We have a proces checking presence of many documents in a collection, just > > a simple client.g

Re: SolrJ 6.6.0 Connection pool shutdown

2017-06-27 Thread Shawn Heisey
On 6/27/2017 6:50 AM, Markus Jelsma wrote: > We have a proces checking presence of many documents in a collection, just a > simple client.getById(id). It sometimes begins throwing lots of these > exceptions in a row: > > org.apache.solr.client.solrj.SolrServerException: > java.lang.IllegalState

Re: SolrJ - How to add a blocked document without child documents

2017-06-20 Thread Jeffery Yuan
Mikhail Khludnev provided the workaround in https://issues.apache.org/jira/browse/SOLR-6096: So, far the workaround is to nest empty child w/o fields or with id only field. -- It works -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-How-to-add-a-blocked-document-withou

Re: SolrJ - How to add a blocked document without child documents

2017-05-16 Thread Jeffery Yuan
Yes, the id is the unique key. I think maybe this is because the first one (a parent doc(Parent1) without any children) is not a block (I don't really know what's the term), so later when we add same parent (Parent2) with some children, the first one is somehow left alone. - If we update the pare

Re: SolrJ - How to add a blocked document without child documents

2017-05-16 Thread Zheng Lin Edwin Yeo
Is the id your unique key in the collections? By right if your id is the unique key, it will be overwritten automatically if the id is the same, when you add the same parent documents with child documents. Regards, Edwin On 16 May 2017 at 08:25, Jeffery Yuan wrote: > Hi, Damien Kamerman > >

Re: SolrJ - How to add a blocked document without child documents

2017-05-15 Thread Jeffery Yuan
Hi, Damien Kamerman Thanks for your reply. The problem is when we add a parent documents which doesn't contain child info yet. Later we will add same parent documents with child documents. But this would cause 2 parent documents with same id in the solr index. I workaround this issue by

  1   2   3   4   5   6   7   8   9   >