This is better! At list the classifier is invoked! How many docs in the index have the class assigned? Take a look to the stacktrace and you should find the cause! I am now on mobile, I will check the code tomorrow! Cheers On 22 Jun 2016 5:26 pm, "Tomas Ramanauskas" <tomas.ramanaus...@springer.com> wrote:
> > I also tried with this config (adding **): > > > <initParams path="/update/**"> > <lst name="defaults"> > <str name="update.chain">classification</str> > </lst> > </initParams> > > > > > > And I get the error: > > > > $ curl http://localhost:8983/solr/demo/update -d ' > [ > {"id" : "book15", > "title_t":["The Way of Kings"], > "author_s":"Brandon Sanderson", > "cat_s": null, > "pubyear_i":2010, > "ISBN_s":"978-0-7653-2635-5" > } > ]' > {"responseHeader":{"status":500,"QTime":29},"error":{"trace":"java.lang.NullPointerException\n\tat > org.apache.lucene.classification.document.SimpleNaiveBayesDocumentClassifier.getTokenArray(SimpleNaiveBayesDocumentClassifier.java:202)\n\tat > org.apache.lucene.classification.document.SimpleNaiveBayesDocumentClassifier.analyzeSeedDocument(SimpleNaiveBayesDocumentClassifier.java:162)\n\tat > org.apache.lucene.classification.document.SimpleNaiveBayesDocumentClassifier.assignNormClasses(SimpleNaiveBayesDocumentClassifier.java:121)\n\tat > org.apache.lucene.classification.document.SimpleNaiveBayesDocumentClassifier.assignClass(SimpleNaiveBayesDocumentClassifier.java:81)\n\tat > org.apache.solr.update.processor.ClassificationUpdateProcessor.processAdd(ClassificationUpdateProcessor.java:94)\n\tat > org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleAdds(JsonLoader.java:474)\n\tat > org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:138)\n\tat > org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:114)\n\tat > org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:77)\n\tat > org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)\n\tat > org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:69)\n\tat > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:155)\n\tat > org.apache.solr.core.SolrCore.execute(SolrCore.java:2036)\n\tat > org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:657)\n\tat > org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:464)\n\tat > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:257)\n\tat > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)\n\tat > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)\n\tat > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)\n\tat > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)\n\tat > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)\n\tat > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1092)\n\tat > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)\n\tat > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)\n\tat > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat > org.eclipse.jetty.server.Server.handle(Server.java:518)\n\tat > org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)\n\tat > org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:244)\n\tat > org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)\n\tat > org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)\n\tat > org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\n\tat > org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:246)\n\tat > org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:156)\n\tat > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)\n\tat > org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)\n\tat > java.lang.Thread.run(Thread.java:745)\n","code":500}} > > > Tomas > > > On 22 Jun 2016, at 17:22, Tomas Ramanauskas < > tomas.ramanaus...@springer.com<mailto:tomas.ramanaus...@springer.com>> > wrote: > > Thanks for the response, Alessandro. > > I tried this and it didn’t work either: > > > > $ curl http://localhost:8983/solr/demo/update -d ' > [ > {"id" : "book14", > "title_t":["The Way of Kings"], > "author_s":"Brandon Sanderson", > "cat_s": null, > "pubyear_i":2010, > "ISBN_s":"978-0-7653-2635-5" > } > ]’ > > {"responseHeader":{"status":0,"QTime":2}} > > $ curl http://localhost:8983/solr/demo/get?id=book14 > { > "doc": > { > "id":"book14", > "title_t":["The Way of Kings"], > "author_s":"Brandon Sanderson", > "pubyear_i":2010, > "ISBN_s":"978-0-7653-2635-5", > "_version_":1537854598189940736}} > > > I don’t see “cat_s” field in the results at all. > > > Tomas > > > On 22 Jun 2016, at 16:39, Alessandro Benedetti <abenede...@apache.org > <mailto:abenede...@apache.org>> wrote: > > Hi Tomas, > first consideration : > an empty string is different from a NULL string. > This is controversial, I would suggest you to never use the empty String as > this can cause some others side effect. > Apart from that, the plugin will add the class only if the class field is > without any value > > Object documentClass = doc.getFieldValue(classFieldName); > if (documentClass == null) { > > Saying that, I would suggest you to build a sample index with some > document and then try to classify. > If this doesn't solve your issue, I can help you further. > > Cheers > > On Wed, Jun 22, 2016 at 3:45 PM, Tomas Ramanauskas < > tomas.ramanaus...@springer.com<mailto:tomas.ramanaus...@springer.com>> > wrote: > > I also tried this configuration, but could get the feature to work: > > > > <initParams path="/update/"> > <lst name="defaults"> > <str name="update.chain">classification</str> > </lst> > </initParams> > > > <updateRequestProcessorChain name="classification"> > <processor class="solr.ClassificationUpdateProcessorFactory"> > <str name="inputFields">title_t,author_s</str> > <str name="classField">cat_s</str> > <str name="algorithm">bayes</str> > </processor> > </updateRequestProcessorChain> > > > Tomas > > On 22 Jun 2016, at 13:46, Tomas Ramanauskas < > tomas.ramanaus...@springer.com<mailto:tomas.ramanaus...@springer.com > ><mailto:tomas.ramanaus...@springer.com>> > wrote: > > P.S. The version I use: > > 6.1.0-68 > > Also, earlier I said “If I modify an existing record, I think the > functionality works:”, but I think it doesn’t work for me at all. > > $ curl http://localhost:8983/solr/demo/get?id=book1 > { > "doc": > { > "id":"book1", > "title_t":["The Way of Kings"], > "author_s":"Brandon Sanderson", > "cat_s":"fantasy", > "pubyear_i":2010, > "ISBN_s":"978-0-7653-2635-5", > "_version_":1535488016326328320}} > > $ curl http://localhost:8983/solr/demo/update -d ' > [ > {"id" : "book1", > "title_t":["The Way of Kings"], > "author_s":"Brandon Sanderson", > "cat_s":"aaa", > "pubyear_i":2010, > "ISBN_s":"978-0-7653-2635-5" > } > ]' > {"responseHeader":{"status":0,"QTime":0}} > > $ curl http://localhost:8983/solr/demo/get?id=book1 > { > "doc": > { > "id":"book1", > "title_t":["The Way of Kings"], > "author_s":"Brandon Sanderson", > "cat_s":"fantasy", > "pubyear_i":2010, > "ISBN_s":"978-0-7653-2635-5", > "_version_":1535488016326328320}} > > > Tomas > > > On 22 Jun 2016, at 12:47, Tomas Ramanauskas < > tomas.ramanaus...@springer.com<mailto:tomas.ramanaus...@springer.com > ><mailto:tomas.ramanaus...@springer.com>> > wrote: > > Hi, everyone, > > > would someone be able to share a working example (step by step) that > demonstrates the use of Naive Bayes classifier in Solr? > > > I followed this Blog post: > > > https://alexbenedetti.blogspot.co.uk/2015/07/solr-document-classification-part-1.html?showComment=1464358093048#c2489902302085000947 > > And this tutorial: > http://yonik.com/solr-tutorial/ > > And this JIRA ticket: > https://issues.apache.org/jira/browse/SOLR-7739 > > > > So this is my configuration file (only what I added or modified): > > <initParams path="/update/**"> > <lst name="defaults"> > <str name="update.chain">classification</str> > </lst> > </initParams> > > > <updateRequestProcessorChain name="classification"> > <processor class="solr.ClassificationUpdateProcessorFactory"> > <str name="inputFields">title_t,author_s</str> > <str name="classField">cat_s</str> > <str name="algorithm">bayes</str> > </processor> > </updateRequestProcessorChain> > > > > If I modify an existing record, I think the functionality works: > > > $ curl http://localhost:8983/solr/demo/update -d ' > [ > {"id" : "book1", > "title_t":["The Way of Kings"], > "author_s":"Brandon Sanderson", > "cat_s":"", > "pubyear_i":2010, > "ISBN_s":"978-0-7653-2635-5" > } > ]' > {"responseHeader":{"status":0,"QTime":8}} > $ curl http://localhost:8983/solr/demo/get?id=book1 > { > "doc": > { > "id":"book1", > "title_t":["The Way of Kings"], > "author_s":"Brandon Sanderson", > "cat_s":"fantasy", > "pubyear_i":2010, > "ISBN_s":"978-0-7653-2635-5", > "_version_":1535488016326328320}} > > > > > If I add a new document, something isn’t quite working: > > $ curl http://localhost:8983/solr/demo/update -d ' > [ > {"id" : "book7", > "title_t":["The Way of Kings"], > "author_s":"Brandon Sanderson", > "cat_s":"", > "pubyear_i":2010, > "ISBN_s":"978-0-7653-2635-5" > } > ]' > {"responseHeader":{"status":0,"QTime":0}} > $ curl http://localhost:8983/solr/demo/get?id=book7 > { > "doc":null} > > > > > > > > > > -- > -------------------------- > > Benedetti Alessandro > Visiting card : http://about.me/alessandro_benedetti > > "Tyger, tyger burning bright > In the forests of the night, > What immortal hand or eye > Could frame thy fearful symmetry?" > > William Blake - Songs of Experience -1794 England > > >
