SOLR online reference document - WIKI

2013-06-25 Thread Learner
I just came across a wonderful online reference wiki for SOLR and thought of sharing it with the community.. https://cwiki.apache.org/confluence/display/solr/Apache+Solr+Reference+Guide -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-online-reference-document-WIKI-tp40

Re: Name of the couple of popular app/web sites using solar as search engine

2013-06-25 Thread Learner
Check the list here.. http://wiki.apache.org/solr/PublicServers -- View this message in context: http://lucene.472066.n3.nabble.com/Name-of-the-couple-of-popular-app-web-sites-using-solar-as-search-engine-tp4073157p4073160.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Varnish

2013-06-25 Thread Learner
Check this link.. http://lucene.472066.n3.nabble.com/SolrJ-HTTP-caching-td490063.html -- View this message in context: http://lucene.472066.n3.nabble.com/Varnish-tp4072057p4073205.html Sent from the Solr - User mailing list archive at Nabble.com.

Is there a way to build indexes using SOLRJ without SOLR instance?

2013-06-26 Thread Learner
I currently have a SOLRJ program which I am using for indexing the data in SOLR. I am trying to figure out a way to build index without depending on running instance of SOLR. I should be able to supply the solrconfig and schema.xml to the indexing program which in turn create index files that I can

solrj indexing using embedded solr is slow

2013-06-27 Thread Learner
I was using ConcurrentUpdateSOLR for indexing documents to Solr. Later I had a need to do portable indexing hence started using Embedded solr server. I created a multithreaded program to create /submit the documents in batch of 100 to Embedded SOLR server (running inside Solrj indexing process) bu

Re: solrj indexing using embedded solr is slow

2013-06-27 Thread Learner
Shawn, Thanks a lot for your reply. I have pasted my entire code below, it would be great if you can let me know if I am doing anything wrong in terms of running the code in multithreaded environment. http://pastebin.com/WRLn3yWn -- View this message in context: http://lucene.472066.n3.nabbl

Re: Normalizing/Returning solr scores between 0 to 1

2013-06-27 Thread Learner
Might not be useful but a work around would be to divide all scores by max score to get scores between 0 and 1. -- View this message in context: http://lucene.472066.n3.nabble.com/Normalizing-Returning-solr-scores-between-0-to-1-tp4073797p4073829.html Sent from the Solr - User mailing list arch

Re: Is there a way to build indexes using SOLRJ without SOLR instance?

2013-06-27 Thread Learner
Thanks a lot for your response. I created a multithreaded program to create /submit the documents in batch of 100 to Embedded SOLR server but for some reason it takes more time to index the data when compared with ConcurrentUpdateeSOLR server. I was under assumption that embedded server would take

Question on forming query when using switch parser plugin?

2013-06-27 Thread Learner
Hi, I currently have a query as below. I am using the fq only if latlong value (using switch plugin) is not empty else I am not using fq at all. Whenever latlong value is empty, I just use value of $where (in "q") parameter to return the results based on location. Now whenever latlong value is a

Error- missing sfield for spatial request

2013-06-28 Thread Learner
I am trying to combine geospatial query (latlong) with the below query inside a search component but I am getting the below error.. *Error:* missing sfield for spatial request 400 ( _query_:"{!wp_optional df='addr_location_clean_i' qs=1 v=$fps_where}"^6.2 OR _query_:"{!w

Is it possible to use nested switch - urgent

2013-07-03 Thread Learner
I am using the switch parser plugin as below. Whenever there is a value for $latlong it will invoke $fq_bbox or else it will invoke $fq_simple.. Now I need to add one more case whenever $where is not present in the query I need to do call fq_all and ignore both fq_bbox / fq_simple. Can someone let

Best way to call asynchronously - Custom data import handler

2013-07-08 Thread Learner
I wrote a custom data import handler to import data from files. I am trying to figure out a way to make asynchronous call instead of waiting for the data import response. Is there an easy way to invoke asynchronously (other than using futures and callables) ? public class CustomFileImportHandler

How to create optional 'fq' plugin?

2013-07-10 Thread Learner
I am trying to suppress the error messages received when a value is not passed to a query, Ex: /select?first_name=peter&fq=$first_name&q=*:* I don't want the above query to throw error or die whenever the variable first_name is not passed to the query hence I came up with a plugin to return nul

How to make a variable in 'fq' optional?

2013-07-10 Thread Learner
I am trying to make a variable in fq optional, Ex: /select?first_name=peter&fq=$first_name&q=*:* I don't want the above query to throw error or die whenever the variable first_name is not passed to the query instead return the value corresponding to rest of the query. I can use switch but its

How to make a variable in 'fq' optional?

2013-07-10 Thread Learner
I am trying to make a variable in fq optional, Ex: /select?first_name=peter&fq=$first_name&q=*:* I don't want the above query to throw error or die whenever the variable first_name is not passed to the query instead return the value corresponding to rest of the query. I can use switch but its

How to make 'fq' optional?

2013-07-10 Thread Learner
I am trying to make a variable in fq optional, Ex: /select?first_name=peter&fq=$first_name&q=*:* I don't want the above query to throw error or die whenever the variable first_name is not passed to the query instead return the value corresponding to rest of the query. I can use switch but its

How to form / return filter (Query object)?

2013-07-10 Thread Learner
I was able to form a TermQuery as below, Query query=new TermQuery(new Term("id","value")); I am trying to form a filter query something that returns just the filter that can be used with any query type (q or fq). if (qstr == null || qstr.trim().length() < 1) {

ConcurrentUpdateSolrserver - Queue size not working

2013-06-18 Thread Learner
I am using ConcurrentUpdateSolrserver to create 4 threads (threadCount=4) with queueSize of 3. Indexing works fine as expected. My issue is that, I see that the documents are getting adding to server even before it reaches the queue size. Am I doing anything wrong? Or is queuesize not implem

Re: preserve special characters

2013-06-18 Thread Learner
You can use keyword tokenizer.. Creates org.apache.lucene.analysis.core.KeywordTokenizer. Treats the entire field as a single token, regardless of its content. Example: "http://example.com/I-am+example?Text=-Hello"; ==> "http://example.com/I-am+example?Text=-Hello"; -- View this message in co

Merge tool based on mergefactor

2013-06-18 Thread Learner
We have SOLR master, primarily for indexing and SOLR slave primarily for searching. I see that the merge factor plays a key factor in Indexing as well as searching. I would like to have a high merge factor for my master instance and low merge factor for slave. As of now since I just replicate the

fq vs q parameter

2013-06-19 Thread Learner
Hi, I am currently using the below configuration in one of my handler and I was thinking of removing the values from q parameter and including as a part of fq parameter. Can someone let me know if there is any performance improvement when using fq parameter compared to q? (

SolrCloud - Score calculation

2013-06-19 Thread Learner
Hi, Sorry if its a very basic question but I am pretty new to SolrCloud and I am trying to understand the underlying mechanism for calculating relevancy. Currently we are using SOLR 3.6.X and we use shards to perform distributed searching. Our shards are not of equal size hence sometimes the resu

Re: SolrCloud - Score calculation

2013-06-20 Thread Learner
Thanks for your response. So in case of SolrCloud, SOLR/zookeeper takes care of managing the indexing / searching. So in that case I assume most of the shards will be of equal size (I am just going to push the data to a leader). I assume IDF wont be a big issue then since the shards size are almo

Restarting SOLR will remove all cache?

2013-06-21 Thread Learner
I have a very simple question. Does restarting SOLR removes all caches (including disk caches if any?). I have disabled all caches in solrconfig.xml but even then I see that there is some caching happening all the time. I am currently doing some performance testing and I dont want cache to play a

SOLRJ commit question - SOLR 4.3.1

2013-06-24 Thread Learner
Hi, I am adding around 100 million records to SOLR using SOLRJ. I am not performing commit operation until I add all the documents to SOLR. I see that my program adds the docs very fast (1 million per minute) for around 18 million documents which is expected result but after 18 million records ind