Re: how to update billions of docs

2016-03-24 Thread Mohsin Beg Beg
the field, you might be able to create another > > > core/container with that one field (plus the key field), and use join > > > support. > > > > > > Note that https://issues.apache.org/jira/browse/LUCENE-6352 is an > > > improvement, which looks like i

how to update billions of docs

2016-03-19 Thread Mohsin Beg Beg
Hi, I have a requirement to replace a value of a field in 100B's of docs in 100's of cores. The field is multiValued=false docValues=true type=StrField stored=true indexed=true. Atomic Updates performance is on the order of 5K docs per sec per core in solr 5.3 (other fields are quite big). An

Re: Dealing with bad apples in a SolrCloud cluster

2014-11-21 Thread Mohsin Beg Beg
How about dynamic loading/unloading of some shards (cores) similar to the transient cores feature. Should be ok if the unloaded shard has a replica. If no replica then extending shards.tolerant concept to use some timeout/acceptable-latency value sounds interesting. -Mohsin - Original Mes

Re: OutOfMemory on 28 docs with facet.method=fc/fcs

2014-11-18 Thread Mohsin Beg Beg
Sent: Tuesday, November 18, 2014 2:45:46 PM GMT -08:00 US/Canada Pacific Subject: Re: OutOfMemory on 28 docs with facet.method=fc/fcs On 11/18/2014 3:06 PM, Mohsin Beg Beg wrote: > Looking at SimpleFacets.java, doesn't fc/fcs iterate only over the DocSet for > the fields. So assuming eac

Re: OutOfMemory on 28 docs with facet.method=fc/fcs

2014-11-18 Thread Mohsin Beg Beg
t...@statsbiblioteket.dk To: solr-user@lucene.apache.org Sent: Tuesday, November 18, 2014 12:34:08 PM GMT -08:00 US/Canada Pacific Subject: RE: OutOfMemory on 28 docs with facet.method=fc/fcs Mohsin Beg Beg [mohsin@oracle.com] wrote: > I am getting OOM when faceting on numFound=28.

OutOfMemory on 28 docs with facet.method=fc/fcs

2014-11-18 Thread Mohsin Beg Beg
Hi, I am getting OOM when faceting on numFound=28. The receiving solr node throws the OutOfMemoryError even though there is 7gb available heap before the faceting request was submitted. If a different solr node is selected that one fails too. Any suggestions ? 1) Test setup is:- 100 collecti

Re: DocSet getting cached in filterCache for facet request with {!cache=false}

2014-11-11 Thread Mohsin Beg Beg
field=inStock&facet.method=enum not an fq clause in sight.. Best, Erick On Tue, Nov 11, 2014 at 9:31 AM, Shawn Heisey wrote: > On 11/11/2014 1:22 AM, Mohsin Beg Beg wrote: >> It seems Solr is caching when facting even with fq={!cache=false}*:* >> specified. This is what I am

DocSet getting cached in filterCache for facet request with {!cache=false}

2014-11-11 Thread Mohsin Beg Beg
Hello, It seems Solr is caching when facting even with fq={!cache=false}*:* specified. This is what I am doing on Solr 4.10.0 on jre 1.7.0_51. Query 1) No cache in filterCache as expected http://localhost:8983/solr/collection1/select?q=*:*&rows=0&fq={!cache=false}*:* http://localhost:8983/solr/