Search with very large boolean filter

2015-11-20 Thread jichi
Hi, I am using Solr 4.7.0 to search text with an id filter, like this: id:(100 OR 2 OR 5 OR 81 OR 10 ...) The number of IDs in the boolean filter are usually less than 100, but could sometimes be very large (around 30k IDs). We currently set maxBooleanClauses to 1024, partitioned the IDs

Re: Search with very large boolean filter

2015-11-20 Thread jichi
ng to perform against each > specific filter set of IDs? > > 3. How often does the set of IDs change? > > 4. Is there more than one filter set of IDs in use during a particular > interval of time? > > > > -- Jack Krupansky > > On Fri, Nov 20, 2015 at 4:50 PM, jic

Re: Search with very large boolean filter

2015-11-20 Thread jichi
Hi Shawn, We have already switched the request method to POST. I am going to try the term query parser soon. I will post the performance difference against the IN syntax here later. Thanks! 2015-11-20 15:23 GMT-08:00 Shawn Heisey : > On 11/20/2015 4:09 PM, jichi wrote: > > Thanks for

How to speed up field collapsing on large number of groups

2016-06-28 Thread jichi
ough parallelization or extra caching. For example, is it possible to parallelize collapsing collector by different lucene index segments? Thanks! -- jichi

Re: How to speed up field collapsing on large number of groups

2016-06-28 Thread Jichi Guo
> > > > > > Joel Bernstein > > [http://joelsolr.blogspot.com/](http://joelsolr.blogspot.com/&r=c29sci11c2VyQGx1Y2VuZS5hcGFjaGUub3Jn) > > > > > > On Tue, Jun 28, 2016 at 4:08 PM, jichi <[jichi...@gmail.com](mailto:jichi...@gmail.com)> wrote:

Re: How to speed up field collapsing on large number of groups

2016-07-13 Thread Jichi Guo
ocal- ff801f29-31d8?r=c29sci11c2VyQGx1Y2VuZS5hcGFjaGUub3Jn) On Jun 28 2016, at 1:08 pm, jichi <jichi...@gmail.com> wrote: > Hi everyone, > > > > > I am using Solr 4.10 to index 20 million documents without sharding. > > Each document has a groupId field, and there a

Restarting SolrCloud that is taking realtime updates

2016-11-25 Thread Jichi Guo
Hi, I am seeking for the best practice to restart a sharded SolrCloud that taking search traffic as well as realtime updates without downtime. When I deploy new customized Solr plugins,for example, it will require restarting the whole SolrCloud cluster. I am testing Solr 6.2.1 with 4 shards.

Re: Restarting SolrCloud that is taking realtime updates

2016-11-25 Thread Jichi Guo
ollections so you can manipulate the current cold one and, when you're satisfied, switch the alias. > > Best, Erick > > On Fri, Nov 25, 2016 at 1:40 PM, Jichi Guo wrote: > Hi, > > > > I am seeking for the best practice to restart a sharded SolrCloud

Best practices to debug Solr search in production without all fields stored

2016-12-30 Thread Jichi Guo
Hi everyone, I found it convenient to debug Solr search results if I mark all fields to be "stored=true" in schema. For example, given a document, I could check why it is not returned in a query with debug=true. But in production, most of the fields have "stored=false" for performance re