Hi Staszek,
Thank you for the fix so quickly!
As a trial, I set:
<str
name="PreprocessingPipeline.tokenizerFactory">org.apache.solr.handler.clustering.carrot2.LuceneCarrot2TokenizerFactory</str>
then I could start Solr without error. But when I make a request:
http://localhost:8983/solr/clustering?q=*%3A*&version=2.2&start=0&rows=10&indent=on&wt=json&fl=id&carrot.produceSummary=false
I got an exception:
org.apache.solr.common.SolrException: Carrot2 clustering failed
at
org.apache.solr.handler.clustering.carrot2.CarrotClusteringEngine.cluster(CarrotClusteringEngine.java:224)
at
org.apache.solr.handler.clustering.ClusteringComponent.process(ClusteringComponent.java:91)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:186)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at
org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:244)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Caused by: org.carrot2.core.ComponentInitializationException:
org.carrot2.util.attribute.AttributeBindingException: Could not assign field
org.carrot2.text.preprocessing.pipeline.CompletePreprocessingPipeline#tokenizerFactory with value
org.apache.solr.handler.clustering.carrot2.LuceneCarrot2TokenizerFactory
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.carrot2.util.ExceptionUtils.wrapAs(ExceptionUtils.java:63)
at
org.carrot2.core.PoolingProcessingComponentManager$ComponentInstantiationListener.objectInstantiated(PoolingProcessingComponentManager.java:234)
at
org.carrot2.core.PoolingProcessingComponentManager$ComponentInstantiationListener.objectInstantiated(PoolingProcessingComponentManager.java:169)
at
org.carrot2.util.pool.SoftUnboundedPool.borrowObject(SoftUnboundedPool.java:83)
at
org.carrot2.core.PoolingProcessingComponentManager.prepare(PoolingProcessingComponentManager.java:128)
at org.carrot2.core.Controller.process(Controller.java:333)
at org.carrot2.core.Controller.process(Controller.java:240)
at
org.apache.solr.handler.clustering.carrot2.CarrotClusteringEngine.cluster(CarrotClusteringEngine.java:220)
... 24 more
Caused by: org.carrot2.util.attribute.AttributeBindingException: Could not assign field
org.carrot2.text.preprocessing.pipeline.CompletePreprocessingPipeline#tokenizerFactory with value
org.apache.solr.handler.clustering.carrot2.LuceneCarrot2TokenizerFactory
at
org.carrot2.util.attribute.AttributeBinder$AttributeBinderActionBind.performAction(AttributeBinder.java:614)
at
org.carrot2.util.attribute.AttributeBinder.bind(AttributeBinder.java:311)
at
org.carrot2.util.attribute.AttributeBinder.bind(AttributeBinder.java:349)
at
org.carrot2.util.attribute.AttributeBinder.bind(AttributeBinder.java:219)
at
org.carrot2.util.attribute.AttributeBinder.set(AttributeBinder.java:149)
at
org.carrot2.util.attribute.AttributeBinder.set(AttributeBinder.java:129)
at org.carrot2.core.ControllerUtils.init(ControllerUtils.java:50)
at
org.carrot2.core.PoolingProcessingComponentManager$ComponentInstantiationListener.objectInstantiated(PoolingProcessingComponentManager.java:189)
... 30 more
Caused by: java.lang.IllegalArgumentException: Can not set
org.carrot2.text.linguistic.ITokenizerFactory field
org.carrot2.text.preprocessing.pipeline.BasicPreprocessingPipeline.tokenizerFactory to java.lang.String
at
sun.reflect.UnsafeFieldAccessorImpl.throwSetIllegalArgumentException(UnsafeFieldAccessorImpl.java:146)
at
sun.reflect.UnsafeFieldAccessorImpl.throwSetIllegalArgumentException(UnsafeFieldAccessorImpl.java:150)
at
sun.reflect.UnsafeObjectFieldAccessorImpl.set(UnsafeObjectFieldAccessorImpl.java:63)
at java.lang.reflect.Field.set(Field.java:657)
at
org.carrot2.util.attribute.AttributeBinder$AttributeBinderActionBind.performAction(AttributeBinder.java:610)
... 37 more
I should dig in, but if you have any clue, it would be appreciated. I'm using
3.6 branch.
koji
--
Query Log Visualizer for Apache Solr
http://soleami.com/
(12/05/20 21:11), Stanislaw Osinski wrote:
Hi Koji,
It's fixed in trunk and 3.6.1 branch now. If you hit any other issues with
this, let me know.
Staszek
On Sun, May 20, 2012 at 1:02 PM, Koji Sekiguchi<k...@r.email.ne.jp> wrote:
Hi Staszek,
I'll wait your fix. Thank you!
Koji Sekiguchi from iPad2
On 2012/05/20, at 18:18, Stanislaw Osinski<stanis...@osinski.name> wrote:
Hi Koji,
You're right, the current code overwrites the custom tokenizer though it
shouldn't. LuceneCarrot2TokenizerFactory is there to avoid circular
dependencies (Carrot2 default tokenizer depends on Lucene), but it
shouldn't be an issue with custom tokenizers.
I'll try to commit a fix later today. Meanwhile, if you have a chance to
recompile the code, a temporary solution would be to hardcode your
tokenizer class into the fragment you pasted:
BasicPreprocessingPipelineDescriptor.attributeBuilder(initAttributes)
.stemmerFactory(LuceneCarrot2StemmerFactory.class)
.tokenizerFactory(YourCustomTokenizer.class)
.lexicalDataFactory(SolrStopwordsCarrot2LexicalDataFactory.class);
Staszek
On Sun, May 20, 2012 at 9:40 AM, Koji Sekiguchi<k...@r.email.ne.jp>
wrote:
Hello,
As I'd like to use custom ITokenizerFactory, I set the following Carrot2
key
in solrconfig.xml:
<searchComponent name="clustering"
enable="${solr.clustering.enabled:true}"
class="solr.clustering.ClusteringComponent">
<lst name="engine">
<str name="name">default</str>
:
<str
name="PreprocessingPipeline.tokenizerFactory">my.own.TokenizerFactory</str>
</lst>
</searchComponent>
But seems that CarrotClusteringEngine overwrites it with
LuceneCarrot2TokenizerFactory
in init() method:
BasicPreprocessingPipelineDescriptor.attributeBuilder(initAttributes)
.stemmerFactory(LuceneCarrot2StemmerFactory.class)
.tokenizerFactory(LuceneCarrot2TokenizerFactory.class)
.lexicalDataFactory(SolrStopwordsCarrot2LexicalDataFactory.class);
Am I missing something?
koji
--
Query Log Visualizer for Apache Solr
http://soleami.com/
