Re: Spell Checker Reloading Issue
Hi Thanks for your response. Please find the attached. 1) schema.xml and solrconfig.xml In solrconfig.xml file, we are changing the below parts ... PART 1: false false 10 explicit 0.01 statusName_product_s^1.0 productId_product_s^1.0 iSBN10_product_s^1.0 iSBN13_product_s^1.0 prdMainTitle_product_s^1.0 prdKeywords_product_s^1.0 productDescription_product_s^1.0 prdMainSubTitle_product_s^1.0 contentTypeId_product_s^1.0 editionTypeId_product_s^1.0 statusId_product_s^1.0 formatId_product_s^1.0 audienceId_product_s^1.0 eraId_product_s^1.0 extentTypeId_product_s^1.0 divisionId_product_s^1.0 productPrice_product_s^1.0 basePrice_product_s^1.0 catalogPrice_product_s^1.0 editionName_product_s^1.0 productSource_product_s^1.0 ageRange_product_s^1.0 prdPublishingDate_product_s^1.0 productCopyright_product_s^1.0 productExtentName_product_s^1.0 parentTaxonomy_product_s^1.0 parentGroup_product_s^1.0 IndexId_s^1.0 productURL_product_s^1.0 websiteURL_product_s^1.0 productContributors_product_s^1.0 relatedFiles_product_s^1.0 relatedLinks_product_s^1.0 awards_product_s^1.0 imprints_product_s^1.0 product_product_s^1.0 documents_product_s^1.0 taxonomyPathElement_product_s^1.0 english^90 hindi^123 Glorious^2000 highlighting^1000 maths^100 ab^12 erer^4545 *,score spellcheck PART 2: textSpell default solr.spelling.FileBasedSpellChecker ./spellings.txt UTF-8 ./spellcheckerFile 0.7 Thanks Navdeep Grant Ingersoll-6 wrote: > > Can you share your configuration, or at least the relevant pieces? > > -Grant > On Jan 5, 2009, at 9:24 AM, Navdeep wrote: > >> >> Hi all >> >> we are facing an issue in spell checker with solr server. We are >> changing >> the below given attributes of SolrConfig.xml file >> >> 1) Accuracy >> 2) Number of Suggestions >> >> we are rebuilding solr indexes using "spellcheck.build=true" : >> URL used for POST_SOLR_URL= >> "select? >> q >> = >> *:*&spellcheck >> .q=flavro&spellcheck=true&spellcheck.build=true&qt=dismaxrequest" >> >> After performing the above steps, when we are trying to perform the >> final >> search for keyword, it is not working. >> Please share your thoughts on this issue. >> >> -- >> View this message in context: >> http://www.nabble.com/Spell-Checker-Reloading-Issue-tp21291873p21291873.html >> Sent from the Solr - User mailing list archive at Nabble.com. >> > > -- > Grant Ingersoll > > Lucene Helpful Hints: > http://wiki.apache.org/lucene-java/BasicsOfPerformance > http://wiki.apache.org/lucene-java/LuceneFAQ > > > > > > > > > > > > http://www.nabble.com/file/p21292901/schema.xml schema.xml http://www.nabble.com/file/p21292901/solrconfig.xml solrconfig.xml -- View this message in context: http://www.nabble.com/Spell-Checker-Reloading-Issue-tp21291873p21292901.html Sent from the Solr - User mailing list archive at Nabble.com.
Spell Checker Reloading Issue
Hi all we are facing an issue in spell checker with solr server. We are changing the below given attributes of SolrConfig.xml file 1) Accuracy 2) Number of Suggestions we are rebuilding solr indexes using "spellcheck.build=true" : URL used for POST_SOLR_URL= "select?q=*:*&spellcheck.q=flavro&spellcheck=true&spellcheck.build=true&qt=dismaxrequest" After performing the above steps, when we are trying to perform the final search for keyword, it is not working. Please share your thoughts on this issue. -- View this message in context: http://www.nabble.com/Spell-Checker-Reloading-Issue-tp21291873p21291873.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Spell Checker Reloading Issue
Hi Thanks for the concern, Grant My Issue is resolved. Problem was spell checker was not working after changing the accuracy or number of suggestions in solrconfig.xml file. Solution is:- We have to add "&build=true" in the command so that it should generate the indexes everytime we change the parameters in solrconfig.xml file. Now my spell checker is working fine. Thanks for your response Grant Ingersoll-6 wrote: > > Can you describe what "not working" means? You're not getting > suggestions or your getting exceptions? Is there any error in your log? > > If you add &debugQuery=true to your query, does it show that the > Spell component was run? (I think it should) > > Do your logs show the Spell Checker being initialized or anything else? > > On Jan 5, 2009, at 10:21 AM, Navdeep wrote: > >> >> Hi >> >> Thanks for your response. >> Please find the attached. >> 1) schema.xml and solrconfig.xml >> >> In solrconfig.xml file, we are changing the below parts ... >> >> PART 1: >> >> > class="solr.DisMaxRequestHandler" > >> >> >> false >> >> false >> >> 10 >> >> explicit >> >> 0.01 >> statusName_product_s^1.0 productId_product_s^1.0 >> iSBN10_product_s^1.0 iSBN13_product_s^1.0 prdMainTitle_product_s^1.0 >> prdKeywords_product_s^1.0 productDescription_product_s^1.0 >> prdMainSubTitle_product_s^1.0 contentTypeId_product_s^1.0 >> editionTypeId_product_s^1.0 statusId_product_s^1.0 >> formatId_product_s^1.0 >> audienceId_product_s^1.0 eraId_product_s^1.0 >> extentTypeId_product_s^1.0 >> divisionId_product_s^1.0 productPrice_product_s^1.0 >> basePrice_product_s^1.0 >> catalogPrice_product_s^1.0 editionName_product_s^1.0 >> productSource_product_s^1.0 ageRange_product_s^1.0 >> prdPublishingDate_product_s^1.0 productCopyright_product_s^1.0 >> productExtentName_product_s^1.0 parentTaxonomy_product_s^1.0 >> parentGroup_product_s^1.0 IndexId_s^1.0 productURL_product_s^1.0 >> websiteURL_product_s^1.0 productContributors_product_s^1.0 >> relatedFiles_product_s^1.0 relatedLinks_product_s^1.0 >> awards_product_s^1.0 >> imprints_product_s^1.0 product_product_s^1.0 documents_product_s^1.0 >> taxonomyPathElement_product_s^1.0 >> >> >> >> >> english^90 hindi^123 Glorious^2000 >> highlighting^1000 >> maths^100 ab^12 erer^4545 >> >>*,score >> >> >> >> spellcheck >> >> >> >> PART 2: >> >> >> >>textSpell >> >> >> default >> solr.spelling.FileBasedSpellChecker >> ./spellings.txt >> UTF-8 >> ./spellcheckerFile >>0.7 >> >> >> >> >> Thanks >> Navdeep >> >> >> >> >> Grant Ingersoll-6 wrote: >>> >>> Can you share your configuration, or at least the relevant pieces? >>> >>> -Grant >>> On Jan 5, 2009, at 9:24 AM, Navdeep wrote: >>> >>>> >>>> Hi all >>>> >>>> we are facing an issue in spell checker with solr server. We are >>>> changing >>>> the below given attributes of SolrConfig.xml file >>>> >>>> 1) Accuracy >>>> 2) Number of Suggestions >>>> >>>> we are rebuilding solr indexes using "spellcheck.build=true" : >>>> URL used for POST_SOLR_URL= >>>> "select? >>>> q >>>> = >>>> *:*&spellcheck >>>> .q=flavro&spellcheck=true&spellcheck.build=true&qt=dismaxrequest" >>>> >>>> After performing the above steps, when we are trying to perform the >>>> final >>>> search for keyword, it is not working. >>>> Please share your thoughts on this issue. >>>> >>>> -- >>>> View this message in context: >>>> http://www.nabble.com/Spell-Checker-Reloading-Issue-tp21291873p21291873.html >>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>> >>> >>> -- >>> Grant Ingersoll >>> >>> Lucene Helpful Hints: >>> http://wiki.apache.org/lucene-java/BasicsOfPerformance >>> http://wiki.apache.org/lucene-java/LuceneFAQ >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >> http://www.nabble.com/file/p21292901/schema.xml schema.xml >> http://www.nabble.com/file/p21292901/solrconfig.xml solrconfig.xml >> -- >> View this message in context: >> http://www.nabble.com/Spell-Checker-Reloading-Issue-tp21291873p21292901.html >> Sent from the Solr - User mailing list archive at Nabble.com. >> > > -- > Grant Ingersoll > > Lucene Helpful Hints: > http://wiki.apache.org/lucene-java/BasicsOfPerformance > http://wiki.apache.org/lucene-java/LuceneFAQ > > > > > > > > > > > > -- View this message in context: http://www.nabble.com/Spell-Checker-Reloading-Issue-tp21291873p21303979.html Sent from the Solr - User mailing list archive at Nabble.com.
How spell checker accuracy works ??
Hi all Please suggest me any link or documentation which will help me to understand the working of accuracy on solr server. For example: Accuracy tag is used in Solrconfig.xml file in below manner. textSpell default solr.spelling.FileBasedSpellChecker ./spellings.txt UTF-8 ./spellcheckerFile 0.70 As per above description, the accuracy set to 0.70 which means to 70% The keyword ( java ) is stored in spellings.txt file which is also mentioned above. Now if I try to make search for "jav" word, there is no result found (This is the problem, why there is no result ??) where as If I replace (java) keyword with (javas) in spellings.txt file and keep the accuracy 0.70 ... Now if I try to make search for "jav" word, I start getting the results ... What is this behaviour ?? Does anyone knows what is the reason ... Regards, Navdeep -- View this message in context: http://www.nabble.com/How-spell-checker-accuracy-workstp21456489p21456489.html Sent from the Solr - User mailing list archive at Nabble.com.
0.70 || Spell Checker Issue !!
Hi all The search with an accuracy defined by user in SOLRCONFIG.XML is not working for me. I have provided an example below. Please let me know your valuable suggestion. For example: Accuracy tag is used in Solrconfig.xml file in below manner. textSpell default solr.spelling.FileBasedSpellChecker ./spellings.txt UTF-8 ./spellcheckerFile 0.70 As per above description, the accuracy set to 0.70 which means to 70% The keyword ( java ) is stored in spellings.txt file which is also mentioned above. Now if I try to make search for "jav" word, there is no result found (This is the problem, why there is no result ??) where as If I replace (java) keyword with (javas) in spellings.txt file and keep the accuracy 0.70 ... Now if I try to make search for "jav" word, I start getting the results ... What is this behaviour ?? Does anyone knows what is the reason ... Regards, Navdeep -- View this message in context: http://www.nabble.com/%3Cstr-name%3D%22accuracy%22%3E0.70%3C-str%3E-%7C%7C-Spell-Checker-Issue-%21%21-tp21460978p21460978.html Sent from the Solr - User mailing list archive at Nabble.com.
error during heavy indexing
i am getting following error on heavy indexing .i am using Solr 4.7 .creating index in hdfs through map reduce .sending docs in batch of 50 . ERROR org.apache.solr.core.SolrCore – java.lang.RuntimeException: [was class org.eclipse.jetty.io.EofException] early EOF at com.ctc.wstx.util.ExceptionUtil.throwRuntimeException(ExceptionUtil.java:18) at com.ctc.wstx.sr.StreamScanner.throwLazyError(StreamScanner.java:731) at com.ctc.wstx.sr.BasicStreamReader.safeFinishToken(BasicStreamReader.java:3657) at com.ctc.wstx.sr.BasicStreamReader.getText(BasicStreamReader.java:809) at org.apache.solr.handler.loader.XMLLoader.readDoc(XMLLoader.java:397) at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:246) at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1916) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:768) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:205) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:744) Caused by: org.eclipse.jetty.io.EofException: early EOF at org.eclipse.jetty.server.HttpInput.read(HttpInput.java:65) at java.io.InputStream.read(InputStream.java:101) at com.ctc.wstx.io.UTF8Reader.loadMore(UTF8Reader.java:365) at com.ctc.wstx.io.UTF8Reader.read(UTF8Reader.java:110) at com.ctc.wstx.io.MergedReader.read(MergedReader.java:101) at com.ctc.wstx.io.ReaderSource.readInto(ReaderSource.java:84) at com.ctc.wstx.io.BranchingReaderSource.readInto(BranchingReaderSource.java:57) at com.ctc.wstx.sr.StreamScanner.loadMore(StreamScanner.java:992) at com.ctc.wstx.sr.BasicStreamReader.readTextSecondary(BasicStreamReader.java:4628) at com.ctc.wstx.sr.BasicStreamReader.readCoalescedText(BasicStreamReader.java:4126) at com.ctc.wstx.sr.BasicStreamReader.finishToken(BasicStreamReader.java:3701) at com.ctc.wstx.sr.BasicStreamReader.safeFinishToken(BasicStreamReader.java:3649) ... 36 more 5409264 [qtp667019593-1270] ERROR org.apache.solr.servlet.SolrDispatchFilter – null:java.lang.RuntimeException: [was class org.eclipse.jetty.io.EofException] early EOF at com.ctc.wstx.util.ExceptionUtil.throwRuntimeException(ExceptionUtil.java:18) at com.ctc.wstx.sr.StreamScanner.throwLazyError(StreamScanner.java:731) at com.ctc.wstx.sr.BasicStreamReader.safeFinishToken(BasicStreamReader.java:3657)
