Inconsistent results with solr admin ui and solrj
Hi, I am running solr 6.1.0 with solrcloud. We have 3 instance of zookeeper and 3 instance of solrcloud. All three of them are active and up. One collection has 3 shards, each shard has 2 replicas. Everytime query whether from solrj or admin ui, getting inconsistent results. e.g. 1. numFound is always fluctuating. 2. facet count shows the count for a field, filter query on that field gets 0 results. 3. luke requests work(not sure whether gives correct info of all the dynamic field) on per shard not on collection when invoked from curl but doesnt work when called from solrj. 4. admin ui shows expanded results, same query goes from solrj, getExpandedResults() gives 0 docs. What would be cause of all this ? Any pointer to look for an error anything in the logs.
Re: Inconsistent results with solr admin ui and solrj
No offense intended, but you are looking at a problem with your work. You need to explain what you are doing not what is happening. If you are trying to use PHP and the latest PECL/PEAR, it does not work so well. It is considerably older than Solr 6.1. This was the only issue I ran into with 6.1. On 13 August 2016 at 06:10, Pranaya Behera wrote: > Hi, > I am running solr 6.1.0 with solrcloud. We have 3 instance of > zookeeper and 3 instance of solrcloud. All three of them are active and up. > One collection has 3 shards, each shard has 2 replicas. > > Everytime query whether from solrj or admin ui, getting inconsistent > results. e.g. > 1. numFound is always fluctuating. > 2. facet count shows the count for a field, filter query on that field > gets 0 results. > 3. luke requests work(not sure whether gives correct info of all the > dynamic field) on per shard not on collection when invoked from curl but > doesnt work when called from solrj. > 4. admin ui shows expanded results, same query goes from solrj, > getExpandedResults() gives 0 docs. > > What would be cause of all this ? Any pointer to look for an error > anything in the logs. >
Re: Inconsistent results with solr admin ui and solrj
Hi, I am using Java client i.e. SorlJ. On 13/08/16 16:31, GW wrote: No offense intended, but you are looking at a problem with your work. You need to explain what you are doing not what is happening. If you are trying to use PHP and the latest PECL/PEAR, it does not work so well. It is considerably older than Solr 6.1. This was the only issue I ran into with 6.1. On 13 August 2016 at 06:10, Pranaya Behera wrote: Hi, I am running solr 6.1.0 with solrcloud. We have 3 instance of zookeeper and 3 instance of solrcloud. All three of them are active and up. One collection has 3 shards, each shard has 2 replicas. Everytime query whether from solrj or admin ui, getting inconsistent results. e.g. 1. numFound is always fluctuating. 2. facet count shows the count for a field, filter query on that field gets 0 results. 3. luke requests work(not sure whether gives correct info of all the dynamic field) on per shard not on collection when invoked from curl but doesnt work when called from solrj. 4. admin ui shows expanded results, same query goes from solrj, getExpandedResults() gives 0 docs. What would be cause of all this ? Any pointer to look for an error anything in the logs.
Re: Inconsistent results with solr admin ui and solrj
Are you sure you are issuing the same queries to the same collections and the same request handlers. I would verify that before all else. Using network sniffers (Wireshark) if necessary. Regards, Alex On 13 Aug 2016 8:11 PM, "Pranaya Behera" wrote: Hi, I am running solr 6.1.0 with solrcloud. We have 3 instance of zookeeper and 3 instance of solrcloud. All three of them are active and up. One collection has 3 shards, each shard has 2 replicas. Everytime query whether from solrj or admin ui, getting inconsistent results. e.g. 1. numFound is always fluctuating. 2. facet count shows the count for a field, filter query on that field gets 0 results. 3. luke requests work(not sure whether gives correct info of all the dynamic field) on per shard not on collection when invoked from curl but doesnt work when called from solrj. 4. admin ui shows expanded results, same query goes from solrj, getExpandedResults() gives 0 docs. What would be cause of all this ? Any pointer to look for an error anything in the logs.
Re: Inconsistent results with solr admin ui and solrj
Hi Alexandre, I am sure I am firing the same queries with the same collection everytime. How do WireShark will help ? I am sorry not experienced with that tool. On 13/08/16 17:37, Alexandre Rafalovitch wrote: Are you sure you are issuing the same queries to the same collections and the same request handlers. I would verify that before all else. Using network sniffers (Wireshark) if necessary. Regards, Alex On 13 Aug 2016 8:11 PM, "Pranaya Behera" wrote: Hi, I am running solr 6.1.0 with solrcloud. We have 3 instance of zookeeper and 3 instance of solrcloud. All three of them are active and up. One collection has 3 shards, each shard has 2 replicas. Everytime query whether from solrj or admin ui, getting inconsistent results. e.g. 1. numFound is always fluctuating. 2. facet count shows the count for a field, filter query on that field gets 0 results. 3. luke requests work(not sure whether gives correct info of all the dynamic field) on per shard not on collection when invoked from curl but doesnt work when called from solrj. 4. admin ui shows expanded results, same query goes from solrj, getExpandedResults() gives 0 docs. What would be cause of all this ? Any pointer to look for an error anything in the logs.
Re: Inconsistent results with solr admin ui and solrj
Wire shark should show you what HTTP request actually looks like. So, a definite reference. I still recommend double checking that equivalence first. It is just sanity check before doing any more expensive digging. You can also enable trace logging in the admin ui to see low level request details to compare, but I don't remember which particular element right now. Regards, Alex On 13 Aug 2016 10:14 PM, "Pranaya Behera" wrote: Hi Alexandre, I am sure I am firing the same queries with the same collection everytime. How do WireShark will help ? I am sorry not experienced with that tool. On 13/08/16 17:37, Alexandre Rafalovitch wrote: > Are you sure you are issuing the same queries to the same collections and > the same request handlers. > > I would verify that before all else. Using network sniffers (Wireshark) if > necessary. > > Regards, > Alex > > On 13 Aug 2016 8:11 PM, "Pranaya Behera" wrote: > > Hi, > I am running solr 6.1.0 with solrcloud. We have 3 instance of > zookeeper > and 3 instance of solrcloud. All three of them are active and up. One > collection has 3 shards, each shard has 2 replicas. > > Everytime query whether from solrj or admin ui, getting inconsistent > results. e.g. > 1. numFound is always fluctuating. > 2. facet count shows the count for a field, filter query on that field gets > 0 results. > 3. luke requests work(not sure whether gives correct info of all the > dynamic field) on per shard not on collection when invoked from curl but > doesnt work when called from solrj. > 4. admin ui shows expanded results, same query goes from solrj, > getExpandedResults() gives 0 docs. > > What would be cause of all this ? Any pointer to look for an error anything > in the logs. > >
Re: ConcurrentModificationException due to high volume of requests
This is a bug. Please open a Jira issue. We need to dig where else this param map is being used. It is possible that there are more such bugs. On Fri, Aug 12, 2016 at 10:57 PM, Katherine Mora < km...@searchtechnologies.com> wrote: > Hi All, > > We are using Solr 5.2.1 in a production environment where we have a high > volume of requests. We are not having any timeouts or performance issues. > However, the logs are filled with this exception. > We've been researching and there isn't a lot of information about this > problem or why it happens. We have tried to reproduce it by sending queries > using JMeter and it only happens when multiple queries are sent at the same > time. > > Checking the code we found that this exception is within the core Solr > code and part of the exception caught our attention as it is logging debug > information (we are using INFO logging level) (org.apache.solr.search.stats. > LocalStatsCache.get(LocalStatsCache.java:40)). > > Has anyone seen this exception before? Would it be OK to generate a patch? > We were thinking about commenting the debug line or adding try/catch > statements. > > Thank you! > > > null:java.util.ConcurrentModificationException > at java.util.LinkedHashMap$LinkedHashIterator.nextEntry( > LinkedHashMap.java:394) > at java.util.LinkedHashMap$EntryIterator.next( > LinkedHashMap.java:413) > at java.util.LinkedHashMap$EntryIterator.next( > LinkedHashMap.java:412) > at org.apache.solr.common.params.ModifiableSolrParams.toString( > ModifiableSolrParams.java:201) > at java.lang.String.valueOf(String.java:2849) > at java.lang.StringBuilder.append(StringBuilder.java:128) > at org.apache.solr.request.SolrQueryRequestBase.toString( > SolrQueryRequestBase.java:165) > at org.apache.solr.search.stats.LocalStatsCache.get( > LocalStatsCache.java:40) > at org.apache.solr.handler.component.QueryComponent. > process(QueryComponent.java:366) > at org.apache.solr.handler.component.SearchHandler. > handleRequestBody(SearchHandler.java:255) > at org.apache.solr.handler.RequestHandlerBase.handleRequest( > RequestHandlerBase.java:143) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:2064) > at org.apache.solr.servlet.HttpSolrCall.execute( > HttpSolrCall.java:654) > at org.apache.solr.servlet.HttpSolrCall.call( > HttpSolrCall.java:450) > at org.apache.solr.servlet.SolrDispatchFilter.doFilter( > SolrDispatchFilter.java:227) > at org.apache.solr.servlet.SolrDispatchFilter.doFilter( > SolrDispatchFilter.java:196) > at org.eclipse.jetty.servlet.ServletHandler$CachedChain. > doFilter(ServletHandler.java:1652) > at org.eclipse.jetty.servlet.ServletHandler.doHandle( > ServletHandler.java:585) > at org.eclipse.jetty.server.handler.ScopedHandler.handle( > ScopedHandler.java:143) > at org.eclipse.jetty.security.SecurityHandler.handle( > SecurityHandler.java:577) > at org.eclipse.jetty.server.session.SessionHandler. > doHandle(SessionHandler.java:223) > at org.eclipse.jetty.server.handler.ScopedHandler.handle( > ScopedHandler.java:143) > at org.eclipse.jetty.server.handler.HandlerWrapper.handle( > HandlerWrapper.java:97) > at org.eclipse.jetty.server.handler.RequestLogHandler. > handle(RequestLogHandler.java:95) > at org.eclipse.jetty.server.handler.ContextHandler. > doHandle(ContextHandler.java:1129) > at org.eclipse.jetty.servlet.ServletHandler.doScope( > ServletHandler.java:515) > at org.eclipse.jetty.server.session.SessionHandler. > doScope(SessionHandler.java:185) > at org.eclipse.jetty.server.handler.ContextHandler. > doScope(ContextHandler.java:1061) > at org.eclipse.jetty.server.handler.ScopedHandler.handle( > ScopedHandler.java:141) > at org.eclipse.jetty.server.handler.ContextHandlerCollection. > handle(ContextHandlerCollection.java:215) > at org.eclipse.jetty.server.handler.HandlerCollection. > handle(HandlerCollection.java:110) > at org.eclipse.jetty.server.handler.HandlerWrapper.handle( > HandlerWrapper.java:97) > at org.eclipse.jetty.server.Server.handle(Server.java:497) > at org.eclipse.jetty.server.HttpChannel.handle( > HttpChannel.java:310) > at org.eclipse.jetty.server.HttpConnection.onFillable( > HttpConnection.java:257) > at org.eclipse.jetty.io.AbstractConnection$2.run( > AbstractConnection.java:540) > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob( > QueuedThreadPool.java:635) > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run( > QueuedThreadPool.java:555) > at java.lang.Thread.run(Thread.java:745) > > > KATHERINE MORA > Senior Engineer > > -- Regards, Shalin Shekhar Mangar.
Re: Inconsistent results with solr admin ui and solrj
Could it be that your cluster is not in sync, so that when Solr picks three nodes, results will vary depending on what replica answers? A few questions: a) Is your index static, i.e. not being updated live? b) Can you try to go directly to the core menu of both replicas for each shard, and compare numDocs / maxDocs for each? Both replicas in each shard should have same count. c) What are you querying on and sorting by? Does it happen with only one query and sorting? d) Are there any errors in the logs? If possible, please share some queries, responses, config, screenshots etc. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 13. aug. 2016 kl. 12.10 skrev Pranaya Behera : > > Hi, >I am running solr 6.1.0 with solrcloud. We have 3 instance of zookeeper > and 3 instance of solrcloud. All three of them are active and up. One > collection has 3 shards, each shard has 2 replicas. > > Everytime query whether from solrj or admin ui, getting inconsistent results. > e.g. > 1. numFound is always fluctuating. > 2. facet count shows the count for a field, filter query on that field gets 0 > results. > 3. luke requests work(not sure whether gives correct info of all the dynamic > field) on per shard not on collection when invoked from curl but doesnt work > when called from solrj. > 4. admin ui shows expanded results, same query goes from solrj, > getExpandedResults() gives 0 docs. > > What would be cause of all this ? Any pointer to look for an error anything > in the logs.
