Re: Atomic updates on multiple documents

2015-09-18 Thread Alfonso Muñoz-Pomer Fuentes
Thank you everyone for the useful comments and observations. I’ll start using atomic updates in the way they’re intended to and, if I don’t get the performance we need, I’ll try with a custom RequestUpdateProcessor. On 17/09/2015 20:08, Alexandre Rafalovitch wrote: You could probably do this

Re: Does more shards in core improve performance?

2015-09-18 Thread Gili Nachum
If cpu is just 50% and adding a shard does increase indexing throughput then check for disk bottleneck. On Sep 17, 2015 18:19, "Zheng Lin Edwin Yeo" wrote: > Thank you everyone for your reply. > > > How many CPUs on that machine? How many other requests using the server? > > A) There's 8 CPU on t

Re: Question related to reranking and RankQuery

2015-09-18 Thread Joel Bernstein
The ReRankQuery re-ranks the Top N documents of the main query based on a query. Rather then the CustomScoreQuery you may want to look at ReRanking by a Function Query using the FunctionQParserPlugin. This would allow you to directly control the ReRankScore for the top N documents. Writing your ow

How to check Zookeeper ensemble status?

2015-09-18 Thread Merlin Morgenstern
I am running a 3 node zookeeper ensemble on 3 machines dedicated to SolrCloud 5.2.x Inside the Solr Admin-UI I can check "live nodes", but how can I check if all three zookeeper nodes are up? I am asking since node2 has 25% CPU usage by zookeeper while beeing idle and I wonder what the cause is.

Re: How to check Zookeeper ensemble status?

2015-09-18 Thread Sameer Maggon
Have you tried zkServer.sh status? This will tell you whether zookeeper is running or not and whether it's acting as a leader or follower. Sameer. On Friday, September 18, 2015, Merlin Morgenstern < merlin.morgenst...@gmail.com> wrote: > I am running a 3 node zookeeper ensemble on 3 machines de

Headscratcher 1 of 2

2015-09-18 Thread Mark Fenbers
Greetings, Using an Index-based spell-checker, I get some results, but not what I'm looking for. Using a File-based checker, I never get any results, but no errors either. I've trimmed down my configuration to only use one spell-checker and named it "default", but still empty results on my t

Headscratcher 2 of 2

2015-09-18 Thread Mark Fenbers
Greetings! I cannot seem to configure the spell-checker to return results in XML instead of JSON. I tried programmatically, as in ... params.set("wt", "xml"); solr.query(params); ... and I tried through the solrconfig.xml. My problem here is that it is not exactly clear (because I've seen

Re: Securing solr 5.2 basic auth permission rules

2015-09-18 Thread Aziz Gaou
Hi, Thank you Sanders for your quick reply, I ty now to follow the steps 2015-09-17 19:37 GMT+00:00 Sanders, Marshall (AT - Atlanta) < marshall.sand...@autotrader.com>: > So the issue is that when it's stated that solr runs on jetty 9 what it > really means is that it runs on 5% of jetty9 and t

Re: Question related to reranking and RankQuery

2015-09-18 Thread Ajinkya Kale
Is there a way I can issue a regular query with q and then apply functionQuery only on the top n documents of the result from q ? Applying functionQuery on all documents will be very expensive in my case. I am not able to find a way to "rerank" only top N documents using Function Query. --aj On F

Re: Question related to reranking and RankQuery

2015-09-18 Thread Joel Bernstein
The syntax would be something like this: q=hello+world&rq={!rerank reRankQuery=$rqq reRankDocs=100}&rqq={!func}myFunc() I'm not sure if there is a test case demonstrating this but it should work. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Sep 18, 2015 at 2:42 PM, Ajinkya Kale wrote:

Re: How to check Zookeeper ensemble status?

2015-09-18 Thread Susheel Kumar
Additionally you may want to use the four letter commands like stat et.c. using nc or telnet http://zookeeper.apache.org/doc/r3.3.3/zookeeperAdmin.html Thanks, Susheel On Fri, Sep 18, 2015 at 11:54 AM, Sameer Maggon wrote: > Have you tried zkServer.sh status? > > This will tell you whether zo

Re: Question related to reranking and RankQuery

2015-09-18 Thread Ajinkya Kale
Thank Joel! This is exactly what I was looking for. I did not realize rerank was extensible to your own Function Query. This is good. --aj On Fri, Sep 18, 2015 at 12:00 PM Joel Bernstein wrote: > The syntax would be something like this: > > q=hello+world&rq={!rerank reRankQuery=$rqq > reRankDoc

Is docValues required in Solr 5.x for distributed result grouping?

2015-09-18 Thread Shawn Heisey
A query that works fine in Solr 4.9.1 doesn't work in 5.2.1 with the same schema. The field that I am grouping on does not have docValues. I get this exception: java.lang.IllegalStateException: unexpected docvalues type SORTED_SET for field 'ip' (expected=SORTED). Use UninvertingReader or index

write.lock

2015-09-18 Thread Mark Fenbers
Greetings, Whenever I try to build my spellcheck index (params.set("spellcheck.build", true); or put a check in the spellcheck.build box in the web interface) I get the following stacktrace. Removing the write.lock file does no good. The message comes right back anyway. I read in a post th

Re: Headscratcher 2 of 2

2015-09-18 Thread Upayavira
What URL are you posting to? Why do you want to use JSON or XML from SolrJ, which is best using javabin anyway? Get it right via a URL first, then try to port it over to SolrJ. Then, look in the Solr logs and you'll see the params that were passed over to Solr - maybe you'll see what's getting set

Re: SolrCloud clarification/Question

2015-09-18 Thread Ravi Solr
Thank you very much Sameer, Erick and Upayavira. I got the solr cloud working !!! Hurray !! Cheers Ravi Kiran Bhaskar On Thu, Sep 17, 2015 at 3:10 AM, Upayavira wrote: > and replicationFactor is the number of copies of your data, not the > number of servers marked 'replica'. So as has been sai

Re: Headscratcher 2 of 2

2015-09-18 Thread Mark Fenbers
OK, I understand now! To view the results before going much farther, I simply did a "System.err.println(queryresponse);" which printed the results in a JSON-like format. Instead, I need to use the methods of the queryresponse object to view my output. Apparently, the queryreponse.toString()

Zero Query results

2015-09-18 Thread Mark Fenbers
Greetings! Using the browser interface to run a query on my indexed data, specifying "q=logtext:*" gives me all 9800+ documents indexed -- as expected. But if I specify something like "q=logtext:Sunday", then I get zero results even though ~1000 documents contain the word Sunday. So I'm puz

Re: Zero Query results

2015-09-18 Thread Erik Hatcher
What's the debug info (debug=true) for that query? Did you by chance change field types or query parser? > On Sep 18, 2015, at 19:53, Mark Fenbers wrote: > > Greetings! > > Using the browser interface to run a query on my indexed data, specifying > "q=logtext:*" gives me all 9800+ documents

Re: Zero Query results

2015-09-18 Thread Shawn Heisey
On 9/18/2015 5:53 PM, Mark Fenbers wrote: > Using the browser interface to run a query on my indexed data, > specifying "q=logtext:*" gives me all 9800+ documents indexed -- as > expected. But if I specify something like "q=logtext:Sunday", then I > get zero results even though ~1000 documents con

Re: problem with tutorial

2015-09-18 Thread Fernando Garza
Xin Cai gmail.com> writes: > > hi Everyone > I am a complete noob when it comes to Solr and when I try to follow the > tutorial and run Solr I get the error message > > "Waiting to see Solr listening on port 8983 [-] Still not seeing Solr > listening on 8983 after 30 seconds!" > > I did some

Re: Question related to reranking and RankQuery

2015-09-18 Thread Ajinkya Kale
Is there a way to do something like q=hello+world&rq={!rerank reRankQuery=$rqq reRankDocs=100}&rqq=sort={!func}myFunc() desc ? or even as simple as 1. http://localhost:8983/solr/0/select?q=edgengram:abc&wt=json&indent=true&debugQuery=true&rq={!rerank reRankQuery=$rqq reRankDocs=20}&rqq

Re: Zero Query results

2015-09-18 Thread Mark Fenbers
On 9/18/2015 8:33 PM, Shawn Heisey wrote: The "field:*" syntax is something you should not get in the habit of using. It is a wildcard search. What this does under the covers is looks up all the possible terms in that field across the entire index, and constructs a Lucene query that actually i

Re: Zero Query results

2015-09-18 Thread Erick Erickson
bq: There is no fieldType defined in my solrconfig.xml, unless you are referring to this line: Well, that's because you should be looking in schema.xml ;). This line from your stacktrace file is very suspicious: logtext:Wednesday It _looks_ like your logtext file is perhaps a "string" type

Re: Duplicate Documents

2015-09-18 Thread Mr Havercamp
Thanks. Okay have done what you suggest, I.e. removed the overwrite=true which should default to solr's default value. I've also tried a re-index and left it to run for a few days; so far so good, nothing indicating duplicates, so as you say, could just be a bug in my code. Will continue to monito