Re: Hourly Faceting

2013-02-09 Thread Upayavira
Do it on the client, strip off the date and add together ny values you
have for the same hour.

Upayavira

On Sat, Feb 9, 2013, at 06:15 AM, Cool Techi wrote:
> Hi,
> 
> I want to facet results on an hourly basis, the following query gives me
> an hourly breakdown, but with the date part. I want just the hour part
> across the days. Is there any other way of doing this,
> 
> 
> 2013-02-01T00:00:00Z-330MINUTES
> true
> twitterId:191343557
> createdOnGMTDate
> +1HOUR
> 2013-02-08T23:59:59Z-330MINUTES
> 0
> 
> 
> Result
> 
> 0
> 0
> 0
> 0
> 0
> 0
> 
> Desired Result
> 
> 0
> 0
> 0
> 0
> 0
> 0
> 
> Regards,
> Ayush
> 


Re: Hourly Faceting

2013-02-09 Thread Erik Hatcher
At index time, add an hour field and then just field.facet on that. 

If you want to search/facet on something that you have available at index 
time... index it that way :) rather than trying to do the work at query time. 

And you could certainly do this automatically with a copyField and a custom 
field type.  Or of course easily from your indexer probably too. 

 Erik

On Feb 9, 2013, at 1:15, Cool Techi  wrote:

> Hi,
> 
> I want to facet results on an hourly basis, the following query gives me an 
> hourly breakdown, but with the date part. I want just the hour part across 
> the days. Is there any other way of doing this,
> 
> 
> 2013-02-01T00:00:00Z-330MINUTES
> true
> twitterId:191343557
> createdOnGMTDate
> +1HOUR
> 2013-02-08T23:59:59Z-330MINUTES
> 0
> 
> 
> Result
> 
> 0
> 0
> 0
> 0
> 0
> 0
> 
> Desired Result
> 
> 0
> 0
> 0
> 0
> 0
> 0
> 
> Regards,
> Ayush
> 


RE: UnionDocsAndPositionsEnum class not found

2013-02-09 Thread Markus Jelsma
Any ideas so far? I've not yet found anything that remotely looks like the root 
of the problem so far :)

 
-Original message-
> From:Markus Jelsma 
> Sent: Wed 06-Feb-2013 10:23
> To: solr-user@lucene.apache.org
> Subject: UnionDocsAndPositionsEnum class not found
> 
> Hi,
> 
> We're getting the following trace for some Dismax queries that contain 
> non-alphanumerics:
> 
> Feb 6, 2013 10:06:56 AM org.apache.solr.common.SolrException log
> SEVERE: null:java.lang.RuntimeException: java.lang.NoClassDefFoundError: 
> org/apache/lucene/search/UnionDocsAndPositionsEnum
> at 
> org.apache.solr.servlet.SolrDispatchFilter.sendError(SolrDispatchFilter.java:483)
> at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:290)
> at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
> at 
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
> at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
> at 
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:560)
> at 
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
> at 
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1072)
> at 
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
> at 
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
> at 
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
> at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
> at 
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
> at 
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
> at 
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
> at org.eclipse.jetty.server.Server.handle(Server.java:365)
> at 
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
> at 
> org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
> at 
> org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:926)
> at 
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:988)
> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:635)
> at 
> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
> at 
> org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
> at 
> org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
> at 
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
> at 
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.NoClassDefFoundError: 
> org/apache/lucene/search/UnionDocsAndPositionsEnum
> at 
> org.apache.lucene.search.MultiPhraseQuery.createWeight(MultiPhraseQuery.java:302)
> at 
> org.apache.lucene.search.BooleanQuery$BooleanWeight.(BooleanQuery.java:187)
> at 
> org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:401)
> at 
> org.apache.lucene.search.IndexSearcher.createNormalizedWeight(IndexSearcher.java:657)
> at 
> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:290)
> at 
> org.apache.solr.search.SolrIndexSearcher.getDocListAndSetNC(SolrIndexSearcher.java:1586)
> at 
> org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1306)
> at 
> org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:401)
> at 
> org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:418)
> at 
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:216)
> at 
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1816)
> at 
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:469)
> at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:269)
> ... 25 more
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.lucene.search.UnionDocsAndPositionsEnum
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.l

Re: UnionDocsAndPositionsEnum class not found

2013-02-09 Thread Mark Miller
Looks odd - the supposedly missing class looks like an inner class in 
MultiPhraseQuery.

- Mark

On Feb 9, 2013, at 6:19 AM, Markus Jelsma  wrote:

> Any ideas so far? I've not yet found anything that remotely looks like the 
> root of the problem so far :)
> 
> 
> -Original message-
>> From:Markus Jelsma 
>> Sent: Wed 06-Feb-2013 10:23
>> To: solr-user@lucene.apache.org
>> Subject: UnionDocsAndPositionsEnum class not found
>> 
>> Hi,
>> 
>> We're getting the following trace for some Dismax queries that contain 
>> non-alphanumerics:
>> 
>> Feb 6, 2013 10:06:56 AM org.apache.solr.common.SolrException log
>> SEVERE: null:java.lang.RuntimeException: java.lang.NoClassDefFoundError: 
>> org/apache/lucene/search/UnionDocsAndPositionsEnum
>>at 
>> org.apache.solr.servlet.SolrDispatchFilter.sendError(SolrDispatchFilter.java:483)
>>at 
>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:290)
>>at 
>> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
>>at 
>> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
>>at 
>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
>>at 
>> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:560)
>>at 
>> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
>>at 
>> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1072)
>>at 
>> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
>>at 
>> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
>>at 
>> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
>>at 
>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>>at 
>> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
>>at 
>> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
>>at 
>> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>>at org.eclipse.jetty.server.Server.handle(Server.java:365)
>>at 
>> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
>>at 
>> org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
>>at 
>> org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:926)
>>at 
>> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:988)
>>at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:635)
>>at 
>> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>>at 
>> org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
>>at 
>> org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
>>at 
>> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>at 
>> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>at java.lang.Thread.run(Thread.java:662)
>> Caused by: java.lang.NoClassDefFoundError: 
>> org/apache/lucene/search/UnionDocsAndPositionsEnum
>>at 
>> org.apache.lucene.search.MultiPhraseQuery.createWeight(MultiPhraseQuery.java:302)
>>at 
>> org.apache.lucene.search.BooleanQuery$BooleanWeight.(BooleanQuery.java:187)
>>at 
>> org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:401)
>>at 
>> org.apache.lucene.search.IndexSearcher.createNormalizedWeight(IndexSearcher.java:657)
>>at 
>> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:290)
>>at 
>> org.apache.solr.search.SolrIndexSearcher.getDocListAndSetNC(SolrIndexSearcher.java:1586)
>>at 
>> org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1306)
>>at 
>> org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:401)
>>at 
>> org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:418)
>>at 
>> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:216)
>>at 
>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
>>at org.apache.solr.core.SolrCore.execute(SolrCore.java:1816)
>>at 
>> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:469)
>>at 
>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:269)
>>... 25 more
>> Caused by: java.lang.ClassNotFoundException: 
>> org.apache.lucene.search.UnionDocsAndPositionsEnum
>>at java.net.URLClassLoader

Re: UnionDocsAndPositionsEnum class not found

2013-02-09 Thread Jack Krupansky
Any chance that you built with one version of Java but ran with an older 
version?


-- Jack Krupansky

-Original Message- 
From: Markus Jelsma

Sent: Saturday, February 09, 2013 6:19 AM
To: solr-user@lucene.apache.org
Subject: RE: UnionDocsAndPositionsEnum class not found

Any ideas so far? I've not yet found anything that remotely looks like the 
root of the problem so far :)



-Original message-

From:Markus Jelsma 
Sent: Wed 06-Feb-2013 10:23
To: solr-user@lucene.apache.org
Subject: UnionDocsAndPositionsEnum class not found

Hi,

We're getting the following trace for some Dismax queries that contain 
non-alphanumerics:


Feb 6, 2013 10:06:56 AM org.apache.solr.common.SolrException log
SEVERE: null:java.lang.RuntimeException: java.lang.NoClassDefFoundError: 
org/apache/lucene/search/UnionDocsAndPositionsEnum
at 
org.apache.solr.servlet.SolrDispatchFilter.sendError(SolrDispatchFilter.java:483)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:290)
at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:560)
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1072)
at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at 
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)

at org.eclipse.jetty.server.Server.handle(Server.java:365)
at 
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
at 
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at 
org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:926)
at 
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:988)
at 
org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:635)
at 
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at 
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at 
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)

at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.NoClassDefFoundError: 
org/apache/lucene/search/UnionDocsAndPositionsEnum
at 
org.apache.lucene.search.MultiPhraseQuery.createWeight(MultiPhraseQuery.java:302)
at 
org.apache.lucene.search.BooleanQuery$BooleanWeight.(BooleanQuery.java:187)
at 
org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:401)
at 
org.apache.lucene.search.IndexSearcher.createNormalizedWeight(IndexSearcher.java:657)
at 
org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:290)
at 
org.apache.solr.search.SolrIndexSearcher.getDocListAndSetNC(SolrIndexSearcher.java:1586)
at 
org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1306)
at 
org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:401)
at 
org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:418)
at 
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:216)
at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)

at org.apache.solr.core.SolrCore.execute(SolrCore.java:1816)
at 
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:469)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:269)

... 25 more
Caused by: java.lang.ClassNotFoundException: 
org.apache.lucene.search.UnionDocsAndPositionsEnum

at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at ja

RE: UnionDocsAndPositionsEnum class not found

2013-02-09 Thread Markus Jelsma
Yes, but it also happens when running locally. I've not yet been able to 
reproduce it without our request handler defaults.
 
-Original message-
> From:Jack Krupansky 
> Sent: Sat 09-Feb-2013 16:04
> To: solr-user@lucene.apache.org
> Subject: Re: UnionDocsAndPositionsEnum class not found
> 
> Any chance that you built with one version of Java but ran with an older 
> version?
> 
> -- Jack Krupansky
> 
> -Original Message- 
> From: Markus Jelsma
> Sent: Saturday, February 09, 2013 6:19 AM
> To: solr-user@lucene.apache.org
> Subject: RE: UnionDocsAndPositionsEnum class not found
> 
> Any ideas so far? I've not yet found anything that remotely looks like the 
> root of the problem so far :)
> 
> 
> -Original message-
> > From:Markus Jelsma 
> > Sent: Wed 06-Feb-2013 10:23
> > To: solr-user@lucene.apache.org
> > Subject: UnionDocsAndPositionsEnum class not found
> >
> > Hi,
> >
> > We're getting the following trace for some Dismax queries that contain 
> > non-alphanumerics:
> >
> > Feb 6, 2013 10:06:56 AM org.apache.solr.common.SolrException log
> > SEVERE: null:java.lang.RuntimeException: java.lang.NoClassDefFoundError: 
> > org/apache/lucene/search/UnionDocsAndPositionsEnum
> > at 
> > org.apache.solr.servlet.SolrDispatchFilter.sendError(SolrDispatchFilter.java:483)
> > at 
> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:290)
> > at 
> > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
> > at 
> > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
> > at 
> > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
> > at 
> > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:560)
> > at 
> > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
> > at 
> > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1072)
> > at 
> > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
> > at 
> > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
> > at 
> > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
> > at 
> > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
> > at 
> > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
> > at 
> > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
> > at 
> > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
> > at org.eclipse.jetty.server.Server.handle(Server.java:365)
> > at 
> > org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
> > at 
> > org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
> > at 
> > org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:926)
> > at 
> > org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:988)
> > at 
> > org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:635)
> > at 
> > org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
> > at 
> > org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
> > at 
> > org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
> > at 
> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
> > at 
> > org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
> > at java.lang.Thread.run(Thread.java:662)
> > Caused by: java.lang.NoClassDefFoundError: 
> > org/apache/lucene/search/UnionDocsAndPositionsEnum
> > at 
> > org.apache.lucene.search.MultiPhraseQuery.createWeight(MultiPhraseQuery.java:302)
> > at 
> > org.apache.lucene.search.BooleanQuery$BooleanWeight.(BooleanQuery.java:187)
> > at 
> > org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:401)
> > at 
> > org.apache.lucene.search.IndexSearcher.createNormalizedWeight(IndexSearcher.java:657)
> > at 
> > org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:290)
> > at 
> > org.apache.solr.search.SolrIndexSearcher.getDocListAndSetNC(SolrIndexSearcher.java:1586)
> > at 
> > org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1306)
> > at 
> > org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:401)
> > at 
> > org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:418)
> > at 
> > org.apache.solr.handler.component.Search

RE: UnionDocsAndPositionsEnum class not found

2013-02-09 Thread Markus Jelsma
Yes indeed. It makes little sense, the class is there.
 
-Original message-
> From:Mark Miller 
> Sent: Sat 09-Feb-2013 15:13
> To: solr-user@lucene.apache.org
> Subject: Re: UnionDocsAndPositionsEnum class not found
> 
> Looks odd - the supposedly missing class looks like an inner class in 
> MultiPhraseQuery.
> 
> - Mark
> 
> On Feb 9, 2013, at 6:19 AM, Markus Jelsma  wrote:
> 
> > Any ideas so far? I've not yet found anything that remotely looks like the 
> > root of the problem so far :)
> > 
> > 
> > -Original message-
> >> From:Markus Jelsma 
> >> Sent: Wed 06-Feb-2013 10:23
> >> To: solr-user@lucene.apache.org
> >> Subject: UnionDocsAndPositionsEnum class not found
> >> 
> >> Hi,
> >> 
> >> We're getting the following trace for some Dismax queries that contain 
> >> non-alphanumerics:
> >> 
> >> Feb 6, 2013 10:06:56 AM org.apache.solr.common.SolrException log
> >> SEVERE: null:java.lang.RuntimeException: java.lang.NoClassDefFoundError: 
> >> org/apache/lucene/search/UnionDocsAndPositionsEnum
> >>at 
> >> org.apache.solr.servlet.SolrDispatchFilter.sendError(SolrDispatchFilter.java:483)
> >>at 
> >> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:290)
> >>at 
> >> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
> >>at 
> >> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
> >>at 
> >> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
> >>at 
> >> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:560)
> >>at 
> >> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
> >>at 
> >> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1072)
> >>at 
> >> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
> >>at 
> >> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
> >>at 
> >> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
> >>at 
> >> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
> >>at 
> >> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
> >>at 
> >> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
> >>at 
> >> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
> >>at org.eclipse.jetty.server.Server.handle(Server.java:365)
> >>at 
> >> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
> >>at 
> >> org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
> >>at 
> >> org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:926)
> >>at 
> >> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:988)
> >>at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:635)
> >>at 
> >> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
> >>at 
> >> org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
> >>at 
> >> org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
> >>at 
> >> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
> >>at 
> >> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
> >>at java.lang.Thread.run(Thread.java:662)
> >> Caused by: java.lang.NoClassDefFoundError: 
> >> org/apache/lucene/search/UnionDocsAndPositionsEnum
> >>at 
> >> org.apache.lucene.search.MultiPhraseQuery.createWeight(MultiPhraseQuery.java:302)
> >>at 
> >> org.apache.lucene.search.BooleanQuery$BooleanWeight.(BooleanQuery.java:187)
> >>at 
> >> org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:401)
> >>at 
> >> org.apache.lucene.search.IndexSearcher.createNormalizedWeight(IndexSearcher.java:657)
> >>at 
> >> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:290)
> >>at 
> >> org.apache.solr.search.SolrIndexSearcher.getDocListAndSetNC(SolrIndexSearcher.java:1586)
> >>at 
> >> org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1306)
> >>at 
> >> org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:401)
> >>at 
> >> org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:418)
> >>at 
> >> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:216)
> >>at 
> >> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)

Re: UnionDocsAndPositionsEnum class not found

2013-02-09 Thread Alan Woodward
It's in a bit of a weird position, as it's not defined as an inner class, it's 
defined as a separate top-level class within the same file as MultiPhraseQuery. 
 I vaguely remember this giving me problems on the positions branch a while 
back, but I can't remember how I got it working in the end, sorry :-(

Maybe it should be moved to a top-level class in its own file?

Alan Woodward
www.flax.co.uk


On 9 Feb 2013, at 15:51, Markus Jelsma wrote:

> Yes indeed. It makes little sense, the class is there.
> 
> -Original message-
>> From:Mark Miller 
>> Sent: Sat 09-Feb-2013 15:13
>> To: solr-user@lucene.apache.org
>> Subject: Re: UnionDocsAndPositionsEnum class not found
>> 
>> Looks odd - the supposedly missing class looks like an inner class in 
>> MultiPhraseQuery.
>> 
>> - Mark
>> 
>> On Feb 9, 2013, at 6:19 AM, Markus Jelsma  wrote:
>> 
>>> Any ideas so far? I've not yet found anything that remotely looks like the 
>>> root of the problem so far :)
>>> 
>>> 
>>> -Original message-
 From:Markus Jelsma 
 Sent: Wed 06-Feb-2013 10:23
 To: solr-user@lucene.apache.org
 Subject: UnionDocsAndPositionsEnum class not found
 
 Hi,
 
 We're getting the following trace for some Dismax queries that contain 
 non-alphanumerics:
 
 Feb 6, 2013 10:06:56 AM org.apache.solr.common.SolrException log
 SEVERE: null:java.lang.RuntimeException: java.lang.NoClassDefFoundError: 
 org/apache/lucene/search/UnionDocsAndPositionsEnum
   at 
 org.apache.solr.servlet.SolrDispatchFilter.sendError(SolrDispatchFilter.java:483)
   at 
 org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:290)
   at 
 org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
   at 
 org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
   at 
 org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   at 
 org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:560)
   at 
 org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
   at 
 org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1072)
   at 
 org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
   at 
 org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   at 
 org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
   at 
 org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   at 
 org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
   at 
 org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
   at 
 org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   at org.eclipse.jetty.server.Server.handle(Server.java:365)
   at 
 org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
   at 
 org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
   at 
 org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:926)
   at 
 org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:988)
   at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:635)
   at 
 org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
   at 
 org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
   at 
 org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
   at 
 org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   at 
 org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   at java.lang.Thread.run(Thread.java:662)
 Caused by: java.lang.NoClassDefFoundError: 
 org/apache/lucene/search/UnionDocsAndPositionsEnum
   at 
 org.apache.lucene.search.MultiPhraseQuery.createWeight(MultiPhraseQuery.java:302)
   at 
 org.apache.lucene.search.BooleanQuery$BooleanWeight.(BooleanQuery.java:187)
   at 
 org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:401)
   at 
 org.apache.lucene.search.IndexSearcher.createNormalizedWeight(IndexSearcher.java:657)
   at 
 org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:290)
   at 
 org.apache.solr.search.SolrIndexSearcher.getDocListAndSetNC(SolrIndexSearcher.java:1586)
   at 
 org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSea

Help! How to remove shards from SolrCloud. They keep come back...

2013-02-09 Thread Rene Nederhand
Hi,

I am experimenting with SolrCloud (v. 4.1) and everything seems to work
fine.

Now I would like to restart with a clean environment, but I cannot get rid
of all the collections, shards and cores I have created.

What I did:
- Closed down all Zookeeper servers (I have an ensemble of 3) and Solr
servers (also 3)
- I have deleted the "collections" and "configs" from zookeeper;
- I deleted the data directory (version-2) from zookeeper
- I deleted my solr home (with all data files)
- Edited Solr.xml so there is no reference to instances anymore.

When I restart, I get an error about no existing SolrCores, but after
adding a new config, collection and one SolrCore I see a graph of all
previous existing shards/cores.

How can I go back to a clean state? How to remove these collections/shards?

Thanks for helping.

Rene


Re: Help! How to remove shards from SolrCloud. They keep come back...

2013-02-09 Thread Mark Miller
Did you clear the data dir for all 3 zk's? If not, you will find ghosts coming 
back to haunt you :)

It's often easier to clear zk programmatically - for example it's one call from 
the cmd line zkcli script.

http://wiki.apache.org/solr/SolrCloud#Command_Line_Util

- Mark

On Feb 9, 2013, at 1:19 PM, Rene Nederhand  wrote:

> Hi,
> 
> I am experimenting with SolrCloud (v. 4.1) and everything seems to work
> fine.
> 
> Now I would like to restart with a clean environment, but I cannot get rid
> of all the collections, shards and cores I have created.
> 
> What I did:
> - Closed down all Zookeeper servers (I have an ensemble of 3) and Solr
> servers (also 3)
> - I have deleted the "collections" and "configs" from zookeeper;
> - I deleted the data directory (version-2) from zookeeper
> - I deleted my solr home (with all data files)
> - Edited Solr.xml so there is no reference to instances anymore.
> 
> When I restart, I get an error about no existing SolrCores, but after
> adding a new config, collection and one SolrCore I see a graph of all
> previous existing shards/cores.
> 
> How can I go back to a clean state? How to remove these collections/shards?
> 
> Thanks for helping.
> 
> Rene



Re: Searcher behaviour in example distribution without explicit commit command?

2013-02-09 Thread Mark Miller
Nothing will ever open a new searcher unless you explicitly send a commit with 
openSearcher=true.

Either change openSearcher on your auto hard commit to true, or start using 
soft commit for visibility.

- Mark

On Feb 9, 2013, at 12:44 PM, Alexandre Rafalovitch  wrote:

> Hello,
> 
> I am looking at example in Solr 4.1 distribution. We have:
> 1) updateLog and _version_ enabled
> 2) (Hard) autoCommit set to 15 secs (15000) but also openSearcher=false
> 3) (Soft) autoCommit is commented out (disabled, I guess)
> 
> Given that, what is the expected behaviour when somebody adds documents
> without committing? Without doing any extra commits, will they ever see
> them even if they are committed to disk?
> 
> Or is something going to reopen searcher eventually?
> 
> I guess if there was a soft commit enabled, that would reopen the searcher
> on its schedule even if hard  commit did not. But it is not in the example.
> 
> Regards,
>Alex.
> 
> 
> Personal blog: http://blog.outerthoughts.com/
> LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch
> - Time is the quality of nature that keeps events from happening all at
> once. Lately, it doesn't seem to be working.  (Anonymous  - via GTD book)



Re: Searcher behaviour in example distribution without explicit commit command?

2013-02-09 Thread Shawn Heisey
I have autoCommit with openSearcher=false.  The only time autocommit 
comes into play is when I am rebuilding the entire index from MySQL, 12 
million docs per shard.


The autoCommit values within that are high enough (25000 docs and five 
minutes) that autoCommit will never be triggered during typical 
once-a-minute updates.  When those once-a-minute update cycles are 
complete, I do an explicit hard commit (which defaults to 
openSearcher=true).


I am not yet using soft commits on the new Solr, because I'm only 
halfway through the upgrade from 3.5.  When that's done, I will look 
into soft commits.


I just had an idea for a feature request - I'd like to have two parts to 
the autoCommit config - separate time/doc intervals for 
openSearcher=false and openSearcher=true.  Because soft commits are 
usually done with openSearcher=true, I don't think it really makes sense 
to have two interval sets there.


Thanks,
Shawn


On 2/9/2013 12:51 PM, Mark Miller wrote:

Nothing will ever open a new searcher unless you explicitly send a commit with 
openSearcher=true.

Either change openSearcher on your auto hard commit to true, or start using 
soft commit for visibility.

- Mark

On Feb 9, 2013, at 12:44 PM, Alexandre Rafalovitch  wrote:


Hello,

I am looking at example in Solr 4.1 distribution. We have:
1) updateLog and _version_ enabled
2) (Hard) autoCommit set to 15 secs (15000) but also openSearcher=false
3) (Soft) autoCommit is commented out (disabled, I guess)

Given that, what is the expected behaviour when somebody adds documents
without committing? Without doing any extra commits, will they ever see
them even if they are committed to disk?

Or is something going to reopen searcher eventually?

I guess if there was a soft commit enabled, that would reopen the searcher
on its schedule even if hard  commit did not. But it is not in the example.

Regards,
Alex.


Personal blog: http://blog.outerthoughts.com/
LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch
- Time is the quality of nature that keeps events from happening all at
once. Lately, it doesn't seem to be working.  (Anonymous  - via GTD book)