Hi
I have created https://issues.apache.org/jira/browse/SOLR-5260 as
proposed by Erick.
I hope anyone working with doc values can lead me in a direction of how
to solve the bug.
Best regards Trym
Den 23-09-2013 16:01, Erick Erickson skrev:
I haven't dived into the code, but it sure looks like a JIRA to me,
can you open one?
Best,
Erick
On Mon, Sep 23, 2013 at 1:48 AM, "Trym R. Møller" <t...@sigmat.dk> wrote:
Hi Erick
Thanks for your input.
I have retrieved and build the branch
http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_5
Doing the same setup as in my previous post (two shard collection, fieldA af
docValue type, index a single document and doing a facet search on fieldA),
I now get the below exception. The cause (which is not visible from the
stacktrace) is as previous: "Cannot use facet.mincount=0 on field fieldA
which is not indexed"
What could be my next steps from here?
620710 [qtp1728933440-15] ERROR org.apache.solr.core.SolrCore ▒
org.apache.solr.common.SolrException: Exception during facet.field: fieldA.
at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:569)
at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:554)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at org.apache.solr.request.SimpleFacets$1.execute(SimpleFacets.java:508)
at
org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:579)
at
org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:265)
at
org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1859)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:703)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:406)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:195)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at
org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:724)
Den 22-09-2013 17:09, Erick Erickson skrev:
right, I think you're running into a bug I remember going by. I can't
find it now, JIRA seems to be not responding. As I remember,
where if a shard doesn't have a doc on it, you get an error.
Although why facet.limit should figure in here is a mystery to me,
maybe a coincidence?
Significant work has been done about not requiring values for
DocValues fields and stuff. Can you give a try on 4.x or the
soon-to-be-released 4.5?
Best,
Erick
On Sun, Sep 22, 2013 at 6:26 AM, "Trym R. Møller" <t...@sigmat.dk> wrote:
Hi
I have a problem doing facet search on a doc value field in a multi shard
collection. Any ideas what I may be doing wrong?
My Solr schema specifies fieldA as a docvalue type and I have created a
two
shard collection using Solr 4.4.0.
When I do a facet search on fieldA with a "large" facet.limit then the
query
fails with the below exception
A "large" facet.limit seems to be when (10 + (facet.limit * 1,5)) *
number
of shards > rows matching my query
The exception does not occur when I run with a single shard collection.
It can easily be reproduced by indexing a single row and querying it, as
the
default facet.limit is 100.
The facet query received by Solr looks as follows:
576793 [qtp170860084-18] INFO org.apache.solr.core.SolrCore ¦
[trym_shard2_replica1] webapp=/solr path=/select
params={facet=true&start=0&q=*:*&distrib=true&collection=trym&facet.field=fieldA&wt=javabin&version=2&rows=0}
status=500 QTime=20
One of the "internal query" send by Solr to its shard looks like
576783 [qtp170860084-19] INFO org.apache.solr.core.SolrCore ¦
[trym_shard1_replica1] webapp=/solr path=/select
params={facet=true&distrib=false&collection=trym
&wt=javabin&version=2&rows=0&NOW=1379855011787&shard.url=192.168.56.1:8501/solr/trym_shard1_replica1/&df=text&fl=id,score&f.fieldA.facet.limit=160&start=0&q=*:
*&facet.field=fieldA&isShard=true&fsv=true} hits=1 status=500
QTime=2
576784 [qtp170860084-17] ERROR org.apache.solr.servlet.SolrDispatchFilter
¦
null:java.lang.IllegalStateException: Cannot use facet.mincount=0 on a
field
which is not indexed
at
org.apache.solr.request.NumericFacets.getCounts(NumericFacets.java:257)
at
org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:423)
at
org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:530)
at
org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:259)
at
org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1904)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:659)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:362)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at
org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
at
org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:724)
My schema.xml contains the following lines (among others :-))
<dynamicField name="*A" type="dlong" indexed="false" stored="true"
docValues="true" required="true"/>
...
<fieldType name="dlong" class="solr.TrieLongField"
docValuesFormat="Disk" precisionStep="0" positionIncrementGap="0"/>
Any help is appreciated. Thanks in advance.
Best regards Trym
