Re: Re: Can set a boost function as a default within requesthandler?

2014-02-20 Thread Ahmet Arslan
Hi Peter, Yes you are correct. Send qq=connectivity with the following defaults section   explicit   *,score   {!type=boost b=product(answeredStatus, articleType) v=$qq}   Alternatively, you can switch to edismax query parser. It has native/built in boost and bf parameters. Former is multipl

Re: how many shards required to search data

2014-02-20 Thread Shawn Heisey
On 2/20/2014 9:24 PM, search engn dev wrote: > Data size is 250 GB of small records. each record is of around 0.3kb size. It > consists around 1 billion records. my index has 20 different fields. . > Majorly queries will be very simple or spacial queries mainly on on 2-3 > fields. > all 20 fields

Re: Converting solrdocument response into pojo

2014-02-20 Thread Alexandre Rafalovitch
Looks like at least one of your documents has multiple values in ID field (all valued as 6...) , but your POJO is expecting one. You may want to check your schema definition to ensure it does not allow multiples and also your indexing process to identify why one got through. Regards, Alex. Pers

Converting solrdocument response into pojo

2014-02-20 Thread Navaa
hi, I m using solr for searching... here I used for search names on the basis of their locations so i get response in docs list containing solrdocument like response = {docs =[{SolrDocument[name="abcd" id=[6,6,],..},{SolrDocument[name="xyz" id=435,..},]} at the time of get

Re: Setting up solr on production server

2014-02-20 Thread Shawn Heisey
On 2/20/2014 10:40 PM, Jay Potharaju wrote: > I 'm looking for some tips or guidelines to installing solr on the > production server. I am currently using jetty in my dev environment. > Is it recommended to use tomcat on the production server? Are there are > major advantages of using one over ano

Setting up solr with IBM Websphere 7

2014-02-20 Thread Prasi S
Hi, I have a requirement to setup solr in IBM websphere server 7.x. Has anybody done the same in your project? Is there any blog/ link with the set of instructions for doing the same? Please advice. Thanks, Prasi

RE: Setting up solr on production server

2014-02-20 Thread Suresh Soundararajan
You can go ahead with Tomcat by deploying the solr war in it. It is highly scalable. Thanks, SureshKumar.S From: Jay Potharaju Sent: Friday, February 21, 2014 11:10 AM To: solr-user@lucene.apache.org Subject: Setting up solr on production server Hi, I '

Setting up solr on production server

2014-02-20 Thread Jay Potharaju
Hi, I 'm looking for some tips or guidelines to installing solr on the production server. I am currently using jetty in my dev environment. Is it recommended to use tomcat on the production server? Are there are major advantages of using one over another. Thanks J

SolrCloud can't correctly create collection after zookeeper ensemble recovery

2014-02-20 Thread Chia-Chun Shih
Hi all, This is my test procedure: 1. start a Zookeeper ensemble and a SolrCloud node 2. stop Zookeeper ensemble 3. start Zookeeper ensemble 4. fail to create a collection (with 1 shard and 1 replica) because of timeout 5. restart the SolrCloud node 6. fail to create a collection with the same na

Re: how many shards required to search data

2014-02-20 Thread search engn dev
Shard1 config : Config: 32GB RAM, 4 core Shard2 config : Config: 32GB RAM, 4 core -- View this message in context: http://lucene.472066.n3.nabble.com/how-many-shards-required-to-search-data-tp4118715p4118717.html Sent from the Solr - User mailing list archive at Nabble.com.

how many shards required to search data

2014-02-20 Thread search engn dev
Data size is 250 GB of small records. each record is of around 0.3kb size. It consists around 1 billion records. my index has 20 different fields. . Majorly queries will be very simple or spacial queries mainly on on 2-3 fields. all 20 fields will be stored. Any suggestions on how many shards will

Re: Re: Can set a boost function as a default within requesthandler?

2014-02-20 Thread Peter Dodd
So I'd need to change the query syntax to load and pass *qq *(qq=connectivity) instead of *q* (q=connectivity) ? -- View this message in context: http://lucene.472066.n3.nabble.com/Can-set-a-boost-function-as-a-default-within-requesthandler-tp4118647p4118703.html Sent from the Solr - User maili

Re: Tweaking Solr Query Result Cache

2014-02-20 Thread Erick Erickson
What you _do_ want to do is add replicas so you distribute the CPU load across a bunch of machines. The QueryResultCache isn't very useful unless you have multiple queries that 1> reference the _exact_ same query, q, fq, sorting and all 2> don't page very far. This cache really only holds the doc

Clearing the suggestion dictionary

2014-02-20 Thread Hamish Campbell
Hi all, Given an Suggester SpellCheckComponent how do I clear it? I have a curious issue where suggestion terms are appearing in the dictionary from an unknown source. I've carefully checked that the source fields don't contain the terms but it's not obvious how the dictionary is reset. Restartin

RE: Solr4 performance

2014-02-20 Thread Michael Della Bitta
Hi, As for your first question, setting openSearcher to true means you will see the new docs after every hard commit. Soft and hard commits only become isolated from one another with that set to false. Your second problem might be explained by your large heap and garbage collection. Walking a hea

Tweaking Solr Query Result Cache

2014-02-20 Thread KNitin
Hello I have a 4 node cluster running Solr cloud 4.3.1. I have a few large collections sharded 8 ways across all the 4 nodes (with 2 shards per node). The size of the shard for the large collections is around 600-700Mb containing around 250K+ documents. Currently the size of the query cache is

Re: Caching Solr boost functions?

2014-02-20 Thread Chris Hostetter
: I'd like to tell Solr to cache those boost queries for the life of the : Searcher so they don't get recomputed every time. Is there any way to do : that out of the box? if the functions never change, you could just index the computed value up front and save cycles at query time -- but that's t

RE: Solr4 performance

2014-02-20 Thread Joshi, Shital
Hi! I have few other questions regarding Solr4 performance issue we're facing. We're committing data to Solr4 every ~30 seconds (up to 20K rows). We use commit=false in update URL. We have only hard commit setting in Solr4 config. ${solr.autoCommit.maxTime:60} 10

Re: Re: Can set a boost function as a default within requesthandler?

2014-02-20 Thread rainfall83
Hi Ahmet, you are right, I have forgotten to mention the necessity of query parser change in my case. So just like you wrote previously something like: _query_:"{!boost b=product(answeredStatus, articleType) v=$qq}" added to the defaults section of request handler definition and referrencing qq

Re: Can set a boost function as a default within requesthandler?

2014-02-20 Thread Ahmet Arslan
Hi rainfall, bf is a (e)dismax query parser specific parameter. It seems that Peter is using default lucene query parser. Ahmet On Thursday, February 20, 2014 10:15 PM, rainfall83 wrote: Hi Peter, how about:   explicit   *,score   product(answeredStatus, articleType)   collapse   facet  

Re: Can set a boost function as a default within requesthandler?

2014-02-20 Thread rainfall83
Hi Peter, how about: explicit *,score product(answeredStatus, articleType) collapse facet mlt highlight stats debug ? W dniu 2014-02-20 20:20:08 użytkownik Peter Dodd napisał: > For my search I’ve established a boost function which enhances result > ranking. In a query

Re: CloudServer 4.2.1 and SolrCloud 4.3.1

2014-02-20 Thread KNitin
Thanks, Shawn. On Thu, Feb 20, 2014 at 11:29 AM, Shawn Heisey wrote: > On 2/20/2014 12:09 PM, KNitin wrote: > >> I have a question on CloudServer client for solrcloud. How does >> CloudServer route requests to solr? Does it use round robin internally or >> does it take into account any other

Re: Can set a boost function as a default within requesthandler?

2014-02-20 Thread Ahmet Arslan
Hi Peter, According to http://wiki.apache.org/solr/LocalParams#Parameter_dereferencing if     q={!dismax qf=myfield}solr rocks is equivalent to     q={!type=dismax qf=myfield v=$qq}&qq=solr rocks     then   q={!boost b=product(answeredStatus, articleType)}connectivity   is equivale

Can set a boost function as a default within requesthandler?

2014-02-20 Thread Peter Dodd
For my search I’ve established a boost function which enhances result ranking. In a query it looks something like: q={!boost b=product(answeredStatus, articleType)}connectivity I’d like to make this boost function a default for all others who use the search. My default search handler is confi

Re: CloudServer 4.2.1 and SolrCloud 4.3.1

2014-02-20 Thread Shawn Heisey
On 2/20/2014 12:09 PM, KNitin wrote: I have a question on CloudServer client for solrcloud. How does CloudServer route requests to solr? Does it use round robin internally or does it take into account any other parameter for the node (example how many replicas it has, etc) ? Mixing SolrJ and

No suggestions when I set spellcheck.q

2014-02-20 Thread Hakim Benoudjit
Hi guys, Suppose that a user is browsing a webpage where he has already filtered its articles. I want to get suggestions only in the filtered content (i.e. current category). To achieve this I have set `spellcheck.q` to the current query or category, but by doing this the query no longer returns

Re: org.eclipse.jetty.io.EofException: early EOF

2014-02-20 Thread Shawn Heisey
On 2/20/2014 1:41 AM, lalitjangra wrote: I am using solr 4.6 along with Apache Manifold CF 1.4.1 to index alfresco cms repository. While indexing alfresco i am getting below error in solr logs while indexing media content such as image or video. ERROR - 2014-02-20 12:50:45.108; org.apache.solr.c

CloudServer 4.2.1 and SolrCloud 4.3.1

2014-02-20 Thread KNitin
Hi I have a question on CloudServer client for solrcloud. How does CloudServer route requests to solr? Does it use round robin internally or does it take into account any other parameter for the node (example how many replicas it has, etc) ? Thanks Nitin

Contract JOB** Austin TX-- SOLR/Zookeeper expert

2014-02-20 Thread FiservBrian
We are looking for a expert in SOLR with Zookeeper architecture. This gig will be to review current architecture and implementation, look for and fix issue with ingestion or search. Provide recommendations for future evolution of the stack. If you are interested, please contact Brian, VP of Solutio

RE: Grouping performance improvement

2014-02-20 Thread Alexey Kozhemiakin
You can think of using facets by category field instead of grouping. It will be faster and categorization can be done against multiple category fields. Try different facet methods. If you don't need number of documents in each category and number of unique categories is relatively low, you mig

Grouping performance improvement

2014-02-20 Thread soodyogesh
Im facing slow performance for query where im grouping on a field while querying. Size of index 57 million records, and we would be targeting 100 million + Im using grouping to create category based autosuggest. so when user press "a" I go and search for "a" and group by field say products. No

Re: Additive boost function

2014-02-20 Thread Zwer
Jack, Could you, please, suggest how to use SOLR query functions to make all fields boosts added on such query as I specified in the topic ? -- View this message in context: http://lucene.472066.n3.nabble.com/Additive-boost-function-tp4118066p4118537.html Sent from the Solr - User mailing lis

Group on multiple fields in a sharded environment

2014-02-20 Thread lboutros
Dear all, I would like to group my query results on two different fields (not at the same time). I also would like to get the exact group count. And I'm working with a sharded index. I know that to get the exact group count, all documents from a group must be indexed in a unique shard. Now, is t

org.eclipse.jetty.io.EofException: early EOF

2014-02-20 Thread lalitjangra
Hi, I am using solr 4.6 along with Apache Manifold CF 1.4.1 to index alfresco cms repository. While indexing alfresco i am getting below error in solr logs while indexing media content such as image or video. ERROR - 2014-02-20 12:50:45.108; org.apache.solr.common.SolrException; null:org.apache