Latency in updates.

2018-10-12 Thread root23
Hi all, We are having an issue where we are seeing latency in updates. We are on solr 6. The new documents are reflected right away but updates to existing document take sometime from 30 seconds to couple of minutes. This is some relevant things from our solrconfig. Our autosoft commit time is 50

Default merge policy

2018-10-12 Thread root23
Hi all, I am little bit confused. We are on solr 6. and as per the documentation i think solr 6 uses TieredMergePolicyFactory. However we have not specified it in the following way 10 10 We still use 25. which i understand is not used by TieredMergePolicyFactory. So my confusion is that w

Re: Sorting on ip address

2018-06-18 Thread root23
I am sorry i am not sure what you mean by store as atom. Is that an fieldType in solr ? I couldnt find it in here https://lucene.apache.org/solr/guide/6_6/field-types-included-with-solr.html -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Sorting on ip address

2018-06-18 Thread root23
Hi all, is there a built in data type which i can use for ip address which can provide me sorting ip address based on the class? if not then what is the best way to sort based on ip address ? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Cost of enabling doc values

2018-06-14 Thread root23
Thanks for the detailed explanation erick. I did a little math as you suggested. Just wanted to see if i am doing it right. So we have around 4 billion docs in production and around 70 nodes. To support the business use case we have around 18 fields on which we have to enable docvalues for sorting

Cost of enabling doc values

2018-06-13 Thread root23
Hi all, Does anyone know how much typically index size increments when we enable doc value on a field. Our business side want to enable sorting fields on most of our fields. I am trying to push back saying that it will increase the index size, since enabling docvalues will create the univerted inde

How to avoid join queries

2018-06-13 Thread root23
Hi all, I have a following use case. lets say my document is like this. doc={ name:abc, status:def, store_id:store_1 parent:nike } Now lets say in our use case at some point of time store_1 moved under a different parent. lets say adidas. Our business use c

how to configure LastFieldValueUpdateProcessorFactory

2018-06-08 Thread root23
HI all, I am trying to configure LastFieldValueUpdateProcessorFactory for my multivalued fields so that i only take the last value. I did the following in my solrconfig file. transcation_type I reloaded the core but got an error 500 12492 org.apach

Query a particular index from a multivalued field.

2018-06-07 Thread root23
Hi all, is there a way i can query a particular index of a multivalued field. e.g lets say i have a document like this doc 1= { "id": "1", "status": [ "b", "a" ] } doc2= { "id": "1", "status": [ "c", "b" ] }

Re: Field list vs getting everything

2018-05-29 Thread root23
Yes i meant fl. So essentially if i ask in the fl list for 10 fields vs all the fields have no effect in terms of the amount of work solr has to do ? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Field list vs getting everything

2018-05-29 Thread root23
Hi all , We have in our solr schema around 110 fields and then around 200 dynamic fields. Untill now whenever we query solr we will just blindly get everything. Even if our calling application dont need all the fields to send back to the client. So i thought that may be if i ask only a subset of

Getting more documents from resultsSet

2018-05-18 Thread root23
Hi all, I am working on Solr 6. Our business requirement is that we need to return 2000 docs for every query we execute. Now normally if i execute the same set to query with start=0 to rows=10. It returns very fast(event for our most complex queries in like less then 3 seconds). however the moment

Re: Must clause with filter queries

2018-05-11 Thread root23
hey shawn i tried debugging actual solr code in local with the following two different forms for frange. So to see if solr is somehow parsing it wrong. But i seed the parsed query that gets put in the filter query pretty much same. query1 -> +_val_:{!frange cost=200 l=30 u=100 incl=true incu=false

FilterQueries with NRT

2018-05-11 Thread root23
Hi all, We have a requirement for NRT search. Our autosoft commit time is set to 500 ms(i know its low.But that's another story). We use filter queries extensively for most of our queries. But i am trying to understand how filter query caching works with NRT. Now as i understand we use fq for quer

Re: Must clause with filter queries

2018-05-09 Thread root23
Thanks for the explanation shawn. I will look at our autowarming time. Looking at your response i am thinking i might be doing few more things wrong 1. Does Must clause with any of the filter query makes any sense or is automatically implied. e.g if i want all the docs with firstName:michael and

Re: Must clause with filter queries

2018-05-08 Thread root23
Hi Shawn, Thanks for the repsonse. We have multiple clauses. I was just giving an bare bone example. Usually all our queries will have more then one clause. In case of frange query how do we specify the Must clause ? the reason we are using frange instead of the normal syntax is that we need to a