Re: Micro-Sharding

2011-12-03 Thread Ted Dunning
On Sat, Dec 3, 2011 at 6:36 PM, Shawn Heisey wrote: > On 12/3/2011 2:25 PM, Ted Dunning wrote: > >> Things have changed since I last did this sort of thing seriously. My >> guess is that this is a relatively small amount of memory to devote to >> search. It used to be that the only way to do this

How to specify dismax boost based on rating

2011-12-03 Thread Zac Smith
Hi, I think this is a pretty common requirement so hoping someone can easily point out the solution: I have an average rating field defined in my schema that is a tdouble and can be anything from 0 - 5 (including decimals). I am using dismax so I want to define a boost based on the average rat

Re: less search results in prod

2011-12-03 Thread Jayendra Patil
enable debugQuery and compare the queries evaluated in the development and production environment. Regards, Jayendra On Sun, Dec 4, 2011 at 5:18 AM, wrote: > Hello, > > I have build solr-3.4.0 data folder in dev server and copied it to prod > server. Made a search for a keyword, then modified

Re: Solr cache size information

2011-12-03 Thread Erick Erickson
See below: On Thu, Dec 1, 2011 at 10:57 AM, elisabeth benoit wrote: > Hello, > > If anybody can help, I'd like to confirm a few things about Solr's caches > configuration. > > If I want to calculate cache size in memory relativly to cache size in > solrconfig.xml > > For Document cache > > size i

Re: Micro-Sharding

2011-12-03 Thread Shawn Heisey
On 12/3/2011 2:25 PM, Ted Dunning wrote: Things have changed since I last did this sort of thing seriously. My guess is that this is a relatively small amount of memory to devote to search. It used to be that the only way to do this effectively with Lucene based systems was to keep the heap rel

Re: Configuring the Distributed

2011-12-03 Thread Mark Miller
On Sat, Dec 3, 2011 at 1:31 PM, Jamie Johnson wrote: > Again great stuff. Once distributed update/delete works (sounds like > it's not far off) Yeah, I only realized it was not working with the Version code on Friday as I started adding tests for it - the work to fix it is not too difficult.

Re: two word phrase search using dismax

2011-12-03 Thread alxsss
Hello, Here is my request handler edismax explicit 0.01 site^1.5 content^0.5 title^1.2 site^1.5 content^0.5 title^1.2 id,title, site 2<-1 5<-2 6<90% 300 true *:* content 0 165 title 0 url regex I have made a few tests with debugQuery and realised that for two word phrases, solr takes the fi

less search results in prod

2011-12-03 Thread alxsss
Hello, I have build solr-3.4.0 data folder in dev server and copied it to prod server. Made a search for a keyword, then modified qf and pf params in solrconfig.xml. Made search for the same keywords, then restored qf and pf params to their original value. Now, solr returns very less number of

Re: &(fq=field1:val1 AND field2:val2) VS &fq=field1:val1&fq=field2:val2 and filterCache

2011-12-03 Thread Antoine LE FLOC'H
Thank you for your answers. Antoine. On Fri, Dec 2, 2011 at 2:08 AM, Shawn Heisey wrote: > On 12/1/2011 8:01 AM, Antoine LE FLOC'H wrote: > >> Is there any difference in the way things are stored in the filterCache if >> I do >> >> &(fq=field1:val1 AND field2:val2) >> or >> &fq=field1:val&fq=fi

Re: Micro-Sharding

2011-12-03 Thread Ted Dunning
On Sat, Dec 3, 2011 at 10:54 AM, Shawn Heisey wrote: > In another thread, something was said that sparked my interest: > > On 12/1/2011 7:17 PM, Ted Dunning wrote: > >> Of course, resharding is almost never necessary if you use micro-shards. >> Micro-shards are shards small enough that you can f

Re: SolR for time-series data

2011-12-03 Thread Óscar Marín Miró
Hi Alan, at my job we had a really succesful implementation similar to what you are proposing. With a classic RDBM, we hit serious performance issues so, we moved to solr to display time series of data. The 'trick' was to facet on a date field, to get 'counts' of data for a time series on a specifi

Using more than one search component in a requestHandler

2011-12-03 Thread Jithin
Hi, Is it possible to use have more than one search handler invoked as part of a requestHandler. I find that I am restricted in using only one spellcheck.dictionary per query. I want to use more than one dictionary for one query. Kindly let me know how I can do this. -- View this message in conte

Micro-Sharding

2011-12-03 Thread Shawn Heisey
In another thread, something was said that sparked my interest: On 12/1/2011 7:17 PM, Ted Dunning wrote: Of course, resharding is almost never necessary if you use micro-shards. Micro-shards are shards small enough that you can fit 20 or more on a node. If you have that many on each node, the

Re: Configuring the Distributed

2011-12-03 Thread Jamie Johnson
Again great stuff. Once distributed update/delete works (sounds like it's not far off) I'll have to reevaluate our current stack. You had mentioned storing the shad hash assignments in ZK, is there a JIRA around this? I'll keep my eyes on the JIRA tickets. Right now the distirbuted updated/dele

SolR for time-series data

2011-12-03 Thread Alan Miller
Hi, I have a webapp that plots a bunch of time series data which is just a series of doubles coupled with a timestamp. Every chart in my webapp has a chart_id in my db and i am wondering if it would be effective to usr solr to serve the data to my app instead of keeping the data in my rdbms. Cur

Re: Configuring the Distributed

2011-12-03 Thread Mark Miller
bq. A few questions if a master goes down does a replica get promoted? Right - if the leader goes down there is a leader election and one of the replicas takes over. bq. If a new shard needs to be added is it just a matter of starting a new solr instance with a higher numShards? Eventually, tha

Grouping or Facet ?

2011-12-03 Thread Juan Pablo Mora
I need to do some counts on a StrField field to suggest options from two different categories, and I don´t know what option is the best: My schema looks: - id - name - category: XX or YY with Grouping I do: http://localhost:8983/?q=name:prefix*&group=true&group.field=category But I can change

Re: How to reindex in solr

2011-12-03 Thread RT
Hi, production servers these indexing is getting failed because of the out of memory swap space. Please suggest some good method to reindex using lucene indexes with even stored=false. It is not possible to reindex fields which were not stored. You will need to go back to the original data sour

Re: How to reindex in solr

2011-12-03 Thread Gora Mohanty
On Thu, Dec 1, 2011 at 2:00 PM, Kashif Khan wrote: > Hi all, > > I have my solr indexed completely and now i have added a new field in the > schema which is a copyfield of another field. Please suggest me how can i > reindex solr without going through formal process which i did for the first > tim