Return the synonyms as part of Solr response

Hi, We have a requirement where we need to send the matched synonyms as part of Solr response. Do we need to customize the Solr response handler to do this? Regards, Siva -- View this message in context: http://lucene.472066.n3.nabble.com/Return-the-synonyms-as-part-of-Solr-response-tp40983

Solr cores across multiple machines

Hi, In my project, we are doing full index on dedicated machine and the index will be copied to other search serving machine. For this, we are copying the data folder from indexing machine to serving machine manually. Now, we wanted to use Solr's SWAP configuration to do this job. Looks like the S

Slowness of Solr search during the replication

Hi, I have configured Solr salve replication for every 1hr. During this time I am seeing my search is unresponsive. Any other architectural changes do we need to do to overcome this? I am giving some cache details which I have in my solrconfig.xml. true false 2 Any sugges

Re: Slowness of Solr search during the replication

Do we need to set the autowarmCount on Slave or master? As per the Solr WIKI, I found the below information. Solr4.0 autowarmCount can now be specified as a percentage (ie: "90%") which will be evaluated relative to the number of items in the existing cache. This can be an advantageous setting in

Auto Correction of Solr Query

Hi, Is there any way to "auto correct" the Solr query and get the results? For example, user tries to search for "beats by dre" , but by mistake , he typed "beats bt dre". In this case, Solr should correct the query and return the results for "beats by dre". Is there any suggestions, how we can a

Boost on specific fields

Hi, I have indexed product information , the product name, no of reviews and has_image fields. For example, any two products has "laptop" in the product name and the user issued "laptop" as the search query, both the products are coming as part of search results. Here, I am applying boosting on t

Re: Auto Correction of Solr Query

Thank you for the quick response. I checked the document on spellcheck.collate. Looks like, it is going to return the suggestion to the client and the client need to make one more request to the server with the suggestion. Is there any way to "auto correct" at the server end? -- View this mess

Re: Regarding mointoring the solr

You can look at this tool -- View this message in context: http://lucene.472066.n3.nabble.com/Regarding-mointoring-the-solr-tp4085392p4085423.html Sent from the Solr - User mailing list archive at Nabble.com.

Facing Solr performance during query search

Hi, Last week we configured Solr master and slave set up. All the Solr search requests are routed to slave. After this configuration, we are seeing drastic performance problems with Solr. Can any one explain what would be the reason? And, how to disable optimizing the index, warming the searcher

Re: Facing Solr performance during query search

Here I am providing the slave solrconfig information. 1 35 35 6 1 1024 20 static firstSearcher warming in solrconfig.xml

Re: Facets with 5000 facet fields - Out of memory error during the query time

I got more information with the responses.Now, It's time to re look into the number of facets to be configured. Thanks, Siva http://smarttechies.wordpress.com/ -- View this message in context: http://lucene.472066.n3.nabble.com/Facets-with-5000-facet-fields-Out-of-memory-error-during-the-quer

Out of memory during the indexing

Hi, I am getting the following error during the indexing.I am trying to index 14 million records but the document size is very minimal. *Error:* 2011-11-08 14:53:24,634 ERROR [STDERR] (Thread-12) java.lang.OutOfMemoryError: GC overhead limit exceeded 2011-11-08 14:54:07,910 ERROR [org.apache.coy

Search on multiple fields is not working

Hi, I have two indexed fields called profileId and tagName.When i issue a query like q=profileId:"99964" OR profileId:"10076" OR tagName:"MUSIC" AND "DESIGNER", i am getting only the results for tagName:"MUSIC" AND "DESIGNER".The results are not containing profileId 99964 and 10076. Can anybody t

Autosuggest with inner phrases

Hi , I implemented the auto suggest using terms component.But the suggestions are coming from the starting of the word.But i want inner phrases also.For example, if I type "bass" Auto-Complete should offer suggestions that include "bass fishing" or "bass guitar", and even "sea bass" (note how "ba

Speeding up solr indexing

Hi, I am indexing the data using DIH.Data coming from mysql.Each document contains 30 fields.Some of the fields are multi valued.When i am trying to index 10 million records it taking more time to index. Any body has suggestions to speed up indexing process?Any suggestions on solr admin level con

Re: Speeding up solr indexing

Hi, Please find the configurations below. Machine configurations(Solr running here): RAM - 4 GB HardDisk - 180GB Os - Red Hat linux version 5 Processor-2x Intel Core 2 Duo CPU @2.66GHz Machine configurations(Mysql server is running here): RAM - 4 GB HardDisk - 180GB Os - Red Hat linux version

Externalizing properties file

Hi, I created custom component in solr.This is using one properties file.When i place the jar in solr_home lib directory the class is coming into class path, but the properties file is not.If i bundle the properties file in side jar , the file is coming into class path.But i need to externalize t

Filtering results based on score

Hi, As part of solr results i am able to get the max score.If i want to filter the results based on the max score, let say the max score is 10 And i need only the results between max score to 50 % of max score.This max score is going to change dynamically.How can we implement this?Do we need to

Solr Relevency Calculation

Hi, I have 25 indexed fields in my document.But by default, if i give "q=laptops" this is going to search on five fields and iam getting the score as part of search results.How solr will calculate the score?Is it going to calculate only on the five fields or on 25 fields which are indexed?What is

Boosting the score based on certain field

Hi, In my document i have a filed called category.This contains "electronics,games ,..etc".For some of the category values i need to boost the document score.Let us say, for "electronics" category, i will decide the boosting parameter grater than the "games" category.Is there any body has the ide

RE: Solr MySQL Adding new column to table

4:50am To: "sivaprasad" Subject: Solr MySQL Adding new column to table Hello Techies, I am new to Solr, i am using it with mysql. Suppose i have table called person in mysql with two columns name, age and i have configured mysql in solr. now i have added a new column to person table calle

Searching with acronyms

Hi, I have a requirement where a user enters acronym of a word, then the search results should come for the expandable word.Let us say. If the user enters 'TV', the search results should come for 'Television'. Is the synonyms filter is the way to achieve this? Any inputs. Regards, Siva -- Vi

Facets with 5000 facet fields

Hi, We have configured solr for 5000 facet fields as part of request handler.We have 10811177 docs in the index. The solr server machine is quad core with 12 gb of RAM. When we are querying with facets, we are getting out of memory error. What we observed is , If we have larger number of facets

Full Import failed:org.apache.solr.handler.dataimport.DataImportHandlerException: com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception

Hi, When i am trying to index 16 millions of documents using dataimport handler, intermittently i am getting the below exception and the indexing get stopped. STACKTRACE: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpec

Problem with synonyms

Hi, I have a set of synonyms in synonyms.txt file. For ex: hdtv,High Definition Television, High Definition TV In the admin screen when i type "High Definition Television" as the query term to analyze , i got hdtv as the result of the analysis. But when is search for the term hdtv and "High D

Term component sort is not working

Hi, As part of terms component we have a parameter terms.sort=index|count. If we put terms.sort=index, will be returns the terms in index order. While doing the import, i have used the below query to index. SELECT ID,SEARCH_KEY,WEIGHTAGE FROM SEARCH_KEY_WEIGHTAGE ORDER BY weightage DESC So t

Re: Term component sort is not working

How can i utilize the weightage of terms which i captured from end user? any ideas -- View this message in context: http://lucene.472066.n3.nabble.com/Term-component-sort-is-not-working-tp1905059p1905958.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Problem with synonyms

Do i need to expand the synonyms at index time? -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-with-synonyms-tp1905051p1905976.html Sent from the Solr - User mailing list archive at Nabble.com.

Search results are not coming if the query contains()

Hi, I have the below analysis settings at index time and query time. When i analyze the query using admin screen i got the below result. hp laserjet2200(h3978a)mainten kit (h3978-60001) But when i submit the query for search

Re: Search results are not coming if the query contains()

+searchtext:hp +searchtext:laserjet +searchtext:2200 +searchtext:h3978a +searchtext:mainten +searchtext:kit +searchtext:h3978-60001 Why the "(" ,")" are trimming? Regards, Siva -Original Message- From: "Erick Erickson [via Lucene]" Sent: Monday, November 1

Re: Problem with synonyms

I did changes to the schema file as shown below. And i have an entry in the synonym.txt file as shown below. hdtv => High Definition Television, High Definition TV,High Definition Televisions,High Definition TVs Now i

Re: Term component sort is not working

Hi, I have given the terms component configuration. true autoSuggestTerm index termsComponent And i have two fileds in schema file Now iam trying to sort the terms which are returned by terms component based on WEIGHT

Re: Search results are not coming if the query contains()

I tried by escaping the special chars.Now it is working fine. Thanks guys. -- View this message in context: http://lucene.472066.n3.nabble.com/Search-results-are-not-coming-if-the-query-contains-tp1906181p1909589.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Term component sort is not working

uot; is entered by more number of times it should come first in the result.In this case i need to utilize the WEIGHTAGE(the number times searched) for sorting. Regards, Siva -Original Message- From: "Erick Erickson [via Lucene]" Sent: Tuesday, November 16, 20

Dismax is failing with json response writer

Hi, I am using dismax query parser.When i want the response in JSON, iam giving wt=json.Here it is throwing the below exception. HTTP Status 500 - null java.lang.NullPointerException at org.apache.solr.search.DocSlice$1.score(DocSlice.java:121) at org.apache.solr.request.JSONWriter.writeDocList(

Issue with relevancy

Hi, I configured search request handler as shown below. explicit I am submitting the below query for search. http://localhost:8680/solr/catalogSearch/select?facet=true&spellcheck=true&indent=on&omitHeader=true&stats.field=sal_amt&stats.field=volume&stats=true&wt=xml&q=prod_

Re: Dismax is failing with json response writer

The issue is solved.I replaced the solr core jar. Thanks Erick -- View this message in context: http://lucene.472066.n3.nabble.com/Dismax-is-failing-with-json-response-writer-tp1922170p1930382.html Sent from the Solr - User mailing list archive at Nabble.com.

String field with lower case filter

Hi, I am using a string filed with below configuration. One of the filed is using the fields type as "cat_string". I am using this as facet and i am searching on that field .While searching i need case insensitive search. Let us say cat:"Games" or ca

Re: String field with lower case filter

Thank you,It is perfectly working -- View this message in context: http://lucene.472066.n3.nabble.com/String-field-with-lower-case-filter-tp1930941p1935283.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Problem with synonyms

Even after expanding the synonyms also i am unable to get same results. Is there any other method to achieve this -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-with-synonyms-tp1905051p1935419.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Issue with relevancy

Thanks guys, I will try the mentioned options -- View this message in context: http://lucene.472066.n3.nabble.com/Issue-with-relevancy-tp1930292p1943645.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Phrase Search & Multiple Keywords with Double quotes

'\"' || c == '{' || c == '}' || c == '~' || c == '*' || c == '?' || c == '|' || c == '&' || c == ';' || Character.isWhitespace(c)) { sb.append('\\'); } sb.append(c); } return sb.toStri

Re: Problem with synonyms

Hi, This is looks like a bug.See the below url. https://issues.apache.org/jira/browse/LUCENE-1622 -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-with-synonyms-tp1905051p1944183.html Sent from the Solr - User mailing list archive at Nabble.com.

How to write custom component

Hi, I want to write a custom component which will be invoked before the query parser.The out put of this component should go to the query parser. How can i configure it in solrConfig.xml How can i get SynonymFilterFactory object programmatically. Please share your ideas. Regards, Siva -- Vie

Re: Problem with synonyms

In synonyms.txt file i have the below synonyms. ipod, i-pod, i pod If expand==false during the index time, Is it going to replace all the occurences of "i-pod", "i pod" with "ipod" ? -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-with-synonyms-tp1905051p1946336

RE: DIH - index Multiple tables in Database?

I think, the query it self is wrong, The query should be select id_bread,buttertype from bread,butter where a.id_bread=b.id_bread -Original Message- From: "snowyeoghan [via Lucene]" Sent: Tuesday, November 23, 2010 4:22pm To: "sivaprasad" Subject: DIH - i

RE: unknown field 'name'

The field names in the xml and schema.xml should be matched -Original Message- From: "McGibbney, Lewis John [via Lucene]" Sent: Tuesday, November 23, 2010 4:01pm To: "sivaprasad" Subject: unknown field 'name' Good Evening List, I have been working

Out of memory error

Hi, When i am trying to import the data using DIH, iam getting Out of memory error.The below are the configurations which i have. Database:Mysql Os:windows No Of documents:15525532 In Db-config.xml i made batch size as "-1" The solr server is running on Linux machine with tomcat. i set tomcat a

Search based on images

Hi, If i upload a product image, i need to find the similar images based on the uploaded image.The sample is given below. http://www.gazopa.com/similar?img=eb04%3A9601%2F1543805&img_url=http%3A%2F%2Fd.yimg.com%2Fi%2Fng%2Fsp%2Fp4%2F20090208%2F20%2F350396776.jpg# Anybody has any ideas on this.Plea

Search for social networking sites

Hi, I am building a social networking site.For searching profiles, i am trying to implement solr. But here i am facing a problem.As a social networking site, the data base is going to get more updates/inserts frequently.That means,the search is going to be in real time.How can we achieve this usin

Adding weightage to the facets count

Hi, I am building tag cloud for products by using facets.I made tag names as facets and i am taking facets count as reference to display tag cloud.Each product has tags with their own weightage.Let us say, For example prod1 has tag called “Light Weight” with weightage 20, prod2 has tag called “

Spellcheck suggestions as solr docs

Hi, I have configured spell check for the terms and it is working fine.But the spell check suggestions are just simple strings.For my requirement, i need the documents.How can i achieve this? Are there any other ways to do spell check?Please suggest .. Regards, Siva -- View this message in conte