Re: sort by score in join with geodist()

Wow, it's working as expected, thank you very much. I spent three weeks to define Solr structure and build a query with expected results. Thanks again because I am almost lost a hope to get what I want. On Fri, Nov 15, 2019 at 6:05 AM Mikhail Khludnev wrote: > Hm... > q={!join param=param.. v=$g

Re: 2 Async exceptions during distributed update

Do you use a updateprocess factory? How does it look like? What is the physical memory size and CPU? What do you mean by “there are 64 cores sending concurrently?” An application has 64 threats that send concurrently those updates? > Am 15.11.2019 um 02:14 schrieb Fiz N : > > Hi Solr Experts,

Re: When search term has two stopwords ('and' and 'a') together, it doesn't work

Hi Paras No worries. No I didn’t find anything. This is annoying now... Yes! They do contain dbId. Absolutely all my docs contains dbId and it is actually my key, if you check again the schema.xml Cheers Guilherme > On 15 Nov 2019, at 05:37, Paras Lehana wrote: > >  > Hey Guilherme, > > I w

Re: daily SolrCloud collection wipes

Hi, > Currently logging is disabled due to performance on the live setup. But > tonight, bevor > this happens, we'll enable logging an we'll hopefully see something to track > down the > source for the documents deletion in the collection. tcpdump and the logs revealed the source of the pro

Re: Grouping and sorting Together

Hi Neo, Please mention the expected result as well. Do you want to sort "item sold" group wise or result wise? Use sort for the former while group.sort

Re: When search term has two stopwords ('and' and 'a') together, it doesn't work

Hey Guilherme, I was a bit busy for the past few days and couldn't read your mail. So, did you find anything? Anyways, as I had expected, the culprit is definitely among the qfs. Do the documents in concern contain dbId? I suggest you to cross check the fields in your document with those impacting

Re: sort by score in join with geodist()

Hm... q={!join param=param.. v=$g}&q={!bool must='{!geofilt}' should='{!func}geodist()'} ? On Thu, Nov 14, 2019 at 10:11 PM Vasily Ogar wrote: > I tried and this way also, but here is another error. > { "responseHeader":{ "status":400, "QTime":6, "params":{ "hl":"on", "pt": > "54.6973867999,

2 Async exceptions during distributed update

Hi Solr Experts, SOLR Version : 6.6.2 OS – Linux 3.1.2 JDK – 1.8 Shard – 16 – All are active. Xms – 16 gb Xmx – 16 gb Schema fields count – 91 Dynamic fields – 83. There are multiple threads sending products to solr. tested with batch size per thread 50 & 100, it worked fine without

Re: NPE during spell checking when result collapsing is activated and local parameters are used

I believe your syntax is incorrect. I believe local params must all be included in between the same {!...}, and "{!" can only be at the beginning have you tried: &fq={!collapse tag=collapser field=productId sort='merchantOrder asc, price asc, id asc'} On Thu, Nov 14, 2019 at 4:54 AM Stefan Wal

Re: Issues with the handling of NULLs in Streaming Expressions

I am facing exactly the same issue right now. There is no way to check if a particular field is not present in tuple or is null. Was there any development related to this issue? Is there a work around? In my case, I have an incoming stream of tuples and I want to filter out all the tuples which d

Re: Anyway to encrypt admin user plain text password in Solr

Use Kerberos or JWT token. > Am 11.11.2019 um 11:41 schrieb Kommu, Vinodh K. : > > Hi, > > After creating admin user in Solr when security is enabled, we have to store > the admin user's credentials in plain text format. Is there any option or a > way to encrypt the plain text password? > >

Re: Anyway to encrypt admin user plain text password in Solr

Hi Vinodh, I don't know of any way to encrypt the credentials in "basicAuth.conf", and looking at the code that loads that file I don't see any logic to handle that sort of thing. So I'm near positive there's no way to avoid plaintext here. But, that said, I don't think this should really be tha

Re: sort by score in join with geodist()

I tried and this way also, but here is another error. { "responseHeader":{ "status":400, "QTime":6, "params":{ "hl":"on", "pt": "54.6973867999,25.22481530046", "fl":"score,*,store:[subquery fromIndex=stores]", "store.rows":"1", "fq":"{!edismax qf=\"title description\" v=\"iphone xr 64gb\" m

Re: sort by score in join with geodist()

Space matters. Check my snippet once again please. On Thu, Nov 14, 2019 at 9:56 PM Vasily Ogar wrote: > I tried today with plus but always got same error. > { "responseHeader":{ "status":400, "QTime":2, "params":{ "hl":"on", "pt": > "54.6973867999,25.22481530046", "fl":"score,*,store:[su

Re: using gt and lt in a query

On Thu, Nov 14, 2019 at 1:28 PM Erick Erickson wrote: > You might be able to make this work with function queries…. > > > I managed to decipher something along the lines of this: http://10.40.10.14:8983/solr/debt/select?q=orig_princ_amt: 0 TO

Re: sort by score in join with geodist()

I tried today with plus but always got same error. { "responseHeader":{ "status":400, "QTime":2, "params":{ "hl":"on", "pt": "54.6973867999,25.22481530046", "fl":"score,*,store:[subquery fromIndex=stores]", "store.rows":"1", "fq":"{!edismax qf=\"title description\" v=\"iphone xr 64gb\" mm=3

Re: sort by score in join with geodist()

It should be like "q":"{!join from=site_id to=site_id fromIndex=stores score=max}+{!geofilt} {!func}geodist() ", post debugQuery On Thu, Nov 14, 2019 at 4:44 PM Vasily Ogar wrote: > I was glad too early because it can only sort or only filter, but can't do > together :(. It takes the only first

Re: using gt and lt in a query

You might be able to make this work with function queries…. Best, Erick > On Nov 14, 2019, at 1:26 PM, Shawn Heisey wrote: > > On 11/14/2019 11:09 AM, rhys J wrote: >> But I'm not doing a range, I'm doing a query on whether one field is >> greater than another field. Or am I missing something h

Re: using gt and lt in a query

On 11/14/2019 11:09 AM, rhys J wrote: But I'm not doing a range, I'm doing a query on whether one field is greater than another field. Or am I missing something here? I am unaware of any way to do that with simple query syntax. Sometimes there is capability that I do not know about, though.

Re: using gt and lt in a query

> Range queries are done with brackets and/or braces. A square bracket > indicates that the range should include the precise value mentioned, and > a curly brace indicates that the range should exclude the precise value > mentioned. > > > https://lucene.apache.org/solr/guide/8_2/the-standard-query

Re: using gt and lt in a query

On 11/14/2019 10:49 AM, rhys J wrote: I am trying to duplicate this line from a db query: (debt.orig_princ_amt > 0 AND debt.princ_paid > 0 AND debt.orig_princ_amt > debt.princ_paid) I have the following, but it returns no results: Range queries are done with brackets and/or braces. A square

using gt and lt in a query

I am trying to duplicate this line from a db query: (debt.orig_princ_amt > 0 AND debt.princ_paid > 0 AND debt.orig_princ_amt > debt.princ_paid) I have the following, but it returns no results: http://localhost:8983/solr/debt/select?q=orig_princ_amt

Re: daily SolrCloud collection wipes

On 11/14/2019 9:17 AM, Werner Detter wrote: first, thanks for your response. By "reset" I mean: collection still exists but documents have been dropped (from actually round 50k to 0). It happened twice within the same timeframe early in the morning the last two days so I was wondering if somethin

Re: daily SolrCloud collection wipes

Hi Shawn, > There is only one thing I know of that can delete data from an index > without an external trigger.  It is the document expiration feature. > > https://lucidworks.com/post/document-expiration/ > > Without some kind of action or intentional config, Solr will never > delete anything a

Re: Question about startup memory usage

On 11/14/2019 1:46 AM, Hongxu Ma wrote: Thank you @Shawn Heisey , you help me many times. My -xms=1G When restart solr, I can see the progress of memory increasing (from 1G to 9G, took near 10s). I have a guess: maybe solr is loading some needed files into heap memo

Re: daily SolrCloud collection wipes

On 11/14/2019 12:28 AM, Werner Detter wrote: I've got a SolrCloud instance with two collections running (Solr 7.7.2) on Debian Stretch VMs. Every morning round about 03:3* am the collection gets reset by $something and I have no clue what causes this and how to prevent it as there areeven no log

Re: 8.3.0: Invalid UUID String while indexing document with a UUID field

Last thing to note, that doesn't happen on the standalone 8.3.0 version of solr, as this is where I did my preliminary testing without any problem. On Thu, 14 Nov 2019 at 15:25, Boris Chazalet wrote: > Thanks both for the advice. > > Erick, which message were you referring to when you said "But

Re: Anyway to encrypt admin user plain text password in Solr

On Thu, Nov 14, 2019 at 11:35:47AM +, Kommu, Vinodh K. wrote: > We store the plain text password in basicAuth.conf file. This is a normal > file & we are securing it only with 600 file permissions so that others > cannot read it. We also run various solr APIs in our custom script for > vario

Re: 8.3.0: Invalid UUID String while indexing document with a UUID field

Thanks both for the advice. Erick, which message were you referring to when you said "But now your uuid fields will look like this, right?"? I finished indexing my 45 millions documents successfully by casting the UUID in the SQL itself like this (that's for a postgres db): SELECT myuuidfield::te

Grouping and sorting Together

Hi List I need your help to resolve a problem for which i had been struggling for days. Lets take an example of Shoes which are grouped on basis of size and Price With first group as size and price as "7 and 7000" i have 2 documents as below {id:1,color:blue,item sold:10} {id:5,price:yellow,item

Re: sort by score in join with geodist()

I was glad too early because it can only sort or only filter, but can't do together :(. It takes the only first argument, in my case it geodist or geofilt On Thu, Nov 14, 2019 at 11:11 AM Vasily Ogar wrote: > Hello, > I fixed it. If I need to sort by price: > "q":"{!join from=site_id to=site_id

Re: 8.3.0: Invalid UUID String while indexing document with a UUID field

But now your uuid fields will look like this, right? java.util.UUID:4ee3992e-0b2d-e811-89a7-0025900429ba This looks like somewhere in DIH it’s doing a cast from an object…. Which will be a real head-scratcher for anyone looking at these. There are three other alternatives I can think of: 1> ma

Re: 8.3.0: Invalid UUID String while indexing document with a UUID field

I'm currently re-indexing with the cast to string in the sql statement. It looks good so far. On Thu, 14 Nov 2019 at 14:13, Jörn Franke wrote: > You can use an updateScript handler to do this kind of postprocessing or > you can cast it in your sql Statement as string. > > > > Am 14.11.2019 um 14

Re: daily SolrCloud collection wipes

There’s nothing in Solr that will wipe collections by itself outside of Time Routed Aliases, and there’s no indication that you’re using them. Even if you were, those should only delete collections past their expiration date, they’re pretty well tested to behave correctly. This really looks lik

Re: 8.3.0: Invalid UUID String while indexing document with a UUID field

You can use an updateScript handler to do this kind of postprocessing or you can cast it in your sql Statement as string. > Am 14.11.2019 um 14:09 schrieb Boris Chazalet : > >  > I dug a little in the dataimport code, and there's a special case for > BigDecimal in the JdbcDataSource class, he

Re: 8.3.0: Invalid UUID String while indexing document with a UUID field

If that's right, I'd be happy to try to provide a bug fix, although do not know the first about contributing to the solr project. On Thu, 14 Nov 2019 at 14:09, Boris Chazalet wrote: > I dug a little in the dataimport code, and there's a special case for > BigDecimal in the JdbcDataSource class,

Re: 8.3.0: Invalid UUID String while indexing document with a UUID field

I dug a little in the dataimport code, and there's a special case for BigDecimal in the JdbcDataSource class, here exactly: https://github.com/apache/lucene-solr/blob/faaee86efb01fa6e431fcb129cfb956c7d62d514/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.j

NPE during spell checking when result collapsing is activated and local parameters are used

Hi! I have an issue with Solr 7.3.1 in the spell checking component: java.lang.NullPointerException at org.apache.solr.search.CollapsingQParserPlugin$OrdFieldValueCollector.finish(CollapsingQParserPlugin.java:1021) at org.apache.solr.search.CollapsingQParserPlugin$OrdFieldValueCollector.finish(Co

Re: 8.3.0: Invalid UUID String while indexing document with a UUID field

Thanks for your response Jörn. Yes, I saw the prefix and I suspect this is the problem. But I'm not doing anything special in the DIH config, this is a minimalized version of it: The field is a UUID in the database, so it's definitely v

Re: 8.3.0: Invalid UUID String while indexing document with a UUID field

It seems there is a prefix java.util.UUID: in front of your UUID. Any idea where it comes from? Is it also like this in the database? Is your import handler maybe receiving a java object java.util.UUID and it is not converted correctly to string? > Am 14.11.2019 um 11:52 schrieb Boris Chazalet

Re: 8.3.0: Invalid UUID String while indexing document with a UUID field

Also, if I manually add the document from collection's document tab in the UI (using /update handler with CSV Document Type), I just works. On Thu, 14 Nov 2019 at 12:08, Boris Chazalet wrote: > Few things I forgot to mention: > - I'm running on java 8 > - the collection where the problem happen

Re: Solr 8.2 indexing issues

Hi Sujatha, Apologies that I am not addressing your bug directly but have you tried 8.3 that has just been released? On Wed, 13 Nov 2019 at 02:12, Sujatha Arun wrote: > We recently migrated from 6.6.2 to 8.2. We are seeing issues with indexing > w

RE: Anyway to encrypt admin user plain text password in Solr

Thank you @Jason for responding. We store the plain text password in basicAuth.conf file. This is a normal file & we are securing it only with 600 file permissions so that others cannot read it. We also run various solr APIs in our custom script for various purposes using curl commands which ne

Re: 8.3.0: Invalid UUID String while indexing document with a UUID field

Few things I forgot to mention: - I'm running on java 8 - the collection where the problem happens is made of 3 shards with 3 NRT replicas each. On Thu, 14 Nov 2019 at 11:52, Boris Chazalet wrote: > > Hi, > > I'm running into an issue with Solr 8.3.0: it fails at indexing a schema > with UUID f

8.3.0: Invalid UUID String while indexing document with a UUID field

Hi, I'm running into an issue with Solr 8.3.0: it fails at indexing a schema with UUID field. I'm using a SolrCloud setup with 3 instances, and I'm using the DIH to fetch and index the data from a postgres database. In schema.xml I have: The data-config is a simple select, the uuid f

daily SolrCloud collection wipes

Hi, I've got a SolrCloud instance with two collections running (Solr 7.7.2) on Debian Stretch VMs. Every morning round about 03:30 the collection gets reset by $something and I have no clue what causes this and how to prevent it as there are even no log entries in SolrCloud (even with increas

Re: sort by score in join with geodist()

Hello, I fixed it. If I need to sort by price: "q":"{!join from=site_id to=site_id fromIndex=stores}*:*", "fq":"{!edismax qf=\"title description\" v=\"iphone xr 64gb\" mm=3<90%}", " fl":"score,*,store:[subquery fromIndex=stores]", "store.q":"{!terms f=site_id v=$row.site_id}", "store.rows":"1", "st

Re: Question about startup memory usage

Thank you @Shawn Heisey , you help me many times. My -xms=1G When restart solr, I can see the progress of memory increasing (from 1G to 9G, took near 10s). I have a guess: maybe solr is loading some needed files into heap memory, e.g. *.tip : term index file. What's