Re: multi word search for elevator (QueryElevationComponent) not working

2014-04-16 Thread remi tassing
Hi Niranjan, you should setup it up so the query matches the elevation criteria, for example elevating "ipod" and "apple ipod" as well or changing the "string" accordingly Remi On Mon, Apr 14, 2014 at 9:19 PM, Niranjan wrote: > Hi All, > > I have implemented a sponsor search where I have to e

Show the score in the search result

2014-04-16 Thread Croci Francesco Luigi (ID SWS)
I read that if I add the string "score" in the fl field, I should be able to see the score within the retuned documents. As I understand "score" is a "special/reserved" word and I don't have to define in the schema (right)? I did so, but in the returned fields' list I see no score field... Her

Re: deleting large amount data from solr cloud

2014-04-16 Thread Erick Erickson
The optimize should, indeed, reduce the index size. Be aware that it may consume 2x the disk space. You may also try expungedeletes, see here: https://wiki.apache.org/solr/UpdateXmlMessages Best, Erick On Wed, Apr 16, 2014 at 12:47 AM, Vinay Pothnis wrote: > Another update: > > I removed the rep

Re: Tipping point of solr shards (Num of docs / size)

2014-04-16 Thread Erick Erickson
So how can we answer this in a meaningful way? You haven't told us anything except the number of docs. Are you running on a laptop or a monster server? What kinds of queries are you executing? How much memory to the JVM? What kinds of faceting are you doing? How many unique fields per facet field?

Re: Show the score in the search result

2014-04-16 Thread Erick Erickson
What version of Solr? Works fine for me. Best, Erick On Wed, Apr 16, 2014 at 6:38 AM, Croci Francesco Luigi (ID SWS) wrote: > I read that if I add the string "score" in the fl field, I should be able to > see the score within the retuned documents. > > As I understand "score" is a "special/res

Re: Show the score in the search result

2014-04-16 Thread Jack Krupansky
Also, "*:*" is a constant score query, so the score will always be 1.0. Not a terribly good example to request the score. Please provide the Solr query response, with the debug=true parameter so we can see for ourselves that no score is returned. -- Jack Krupansky -Original Message-

Re: Autocomplete with Case-insensitive feature

2014-04-16 Thread Dmitry Kan
1. did you re-index after changing schema? 2. Why do use KeywordTokenizerFactory and not StandardTokenizerFactory? KTF treats entire field contents as one token. Does it do what you really want? [1] 3. If you'd use STF, TrimFilterFactory would be obsolete, as tokenization has been done already. [

Deploy solr.war on glassfish server

2014-04-16 Thread Ajay Patel
Hi there i am trying to deply the solr.war on glassfish server while deploying those war file i get the following error. can some one please guide me for this same. that how can i deploy solr.war in galssfish server. Error occurred during deployment: Exception while loading the app : CDI deplo

Re: Distributed commits in CloudSolrServer

2014-04-16 Thread Peter Keegan
Are distributed commits also done in parallel across shards? Peter On Tue, Apr 15, 2014 at 3:50 PM, Mark Miller wrote: > Inline responses below. > -- > Mark Miller > about.me/markrmiller > > On April 15, 2014 at 2:12:31 PM, Peter Keegan (peterlkee...@gmail.com) > wrote: > > I have a SolrCloud

Re: Distributed commits in CloudSolrServer

2014-04-16 Thread Peter Keegan
>Are distributed commits also done in parallel across shards? I meant 'sequentially' across shards. On Wed, Apr 16, 2014 at 9:08 AM, Peter Keegan wrote: > Are distributed commits also done in parallel across shards? > > Peter > > > On Tue, Apr 15, 2014 at 3:50 PM, Mark Miller wrote: > >> Inline

Re: Deploy solr.war on glassfish server

2014-04-16 Thread Alexandre Rafalovitch
What does server log actually says? At this point, this is very glassfishy. I'd look for mentions of missing jars, e.g. for logging. Also, which version of Solr. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr

RE: Show the score in the search result

2014-04-16 Thread Croci Francesco Luigi (ID SWS)
Hello Erik, Solr 4.7.1 Francesco -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Mittwoch, 16. April 2014 14:01 To: solr-user@lucene.apache.org Subject: Re: Show the score in the search result What version of Solr? Works fine for me. Best, Erick On Wed,

Re: Deploy solr.war on glassfish server

2014-04-16 Thread Ajay Patel
Solr Version is 4.7.1 and glassfish version is 4 . On Wednesday 16 April 2014 06:39 PM, Alexandre Rafalovitch wrote: What does server log actually says? At this point, this is very glassfishy. I'd look for mentions of missing jars, e.g. for logging. Also, which version of Solr. Regards, A

RE: Show the score in the search result

2014-04-16 Thread Croci Francesco Luigi (ID SWS)
Hello Jack, here is the query: http://localhost:7001/solr/collection1/select?q=*%3A*&rows=5&fl=*%2Cscore&wt=json&indent=true&debugQuery=true and here the response: { "responseHeader": { "status": 0, "QTime": 0 }, "response": { "numFound": 842, "start": 0, "docs": [

RE: Show the score in the search result

2014-04-16 Thread Croci Francesco Luigi (ID SWS)
Hello Jack, I know it's not the best example, but I just wanted to see the score field "printed out"... :) Francesco -Original Message- From: Jack Krupansky [mailto:j...@basetechnology.com] Sent: Mittwoch, 16. April 2014 14:32 To: solr-user@lucene.apache.org Subject: Re: Show the score

Re: clusterstate.json does not reflect current state of down versus active

2014-04-16 Thread Rich Mayfield
Shawn Heisey-4 wrote > What are you trying to achieve with your restart? Can you just reload > the collections one by one instead? We restart when we update a handler, schema, or solrconfig for our cores. I’ve tried just shutting down both nodes. Updating both, and restarting both. With a 1,000

RE: Transformation on a numeric field

2014-04-16 Thread Jean-Sebastien Vachon
Thanks for the information. I will look into this but I`m curious to know why something this basic requires an external script... Anyone knows why we can`t have an analysis chain on a numeric field ? Looks to me like it would be very useful to be able to manipulate/transform a value without an

Re: Tipping point of solr shards (Num of docs / size)

2014-04-16 Thread Shawn Heisey
On 4/15/2014 10:44 PM, Mukesh Jha wrote: > In my solr cluster I've multiple shards and each shard containing > ~500,000,000 documents total index size being ~1 TB. > > I was just wondering how much more can I keep on adding to the shard before > we reach a tipping point and the performance starts

Re: Deploy solr.war on glassfish server

2014-04-16 Thread Shawn Heisey
On 4/16/2014 6:51 AM, Ajay Patel wrote: > i am trying to deply the solr.war on glassfish server while deploying > those war file i get the following error. can some one please guide me > for this same. that how can i deploy solr.war in galssfish server. > > Error occurred during deployment: > Exce

Re: clusterstate.json does not reflect current state of down versus active

2014-04-16 Thread Shawn Heisey
On 4/16/2014 8:02 AM, Rich Mayfield wrote: > However there doesn’t appear to be a way to force leadership to/from a > particular replica. I would have expected that doing a core reload on the current leader would force an election and move the leader, but on my 4.2.1 SolrCloud (the only version I

Re: Autocomplete with Case-insensitive feature

2014-04-16 Thread Sunayana
Thanks for replying, 1.Yes,I re-indexed data after the changes. 2.Changing to STF, did not help.. -- View this message in context: http://lucene.472066.n3.nabble.com/Autocomplete-with-Case-insensitive-feature-tp4131182p4131499.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: deleting large amount data from solr cloud

2014-04-16 Thread Vinay Pothnis
Thank you Erick! Yes - I am using the expunge deletes option. Thanks for the note on disk space for the optimize command. I should have enough space for that. What about the heap space requirement? I hope it can do the optimize with the memory that is allocated to it. Thanks Vinay On 16 April 2

Re: Estimating RAM usage of SolrCache instances?

2014-04-16 Thread Gregg Donovan
Ideally we could get good approximates for all of them, including any of our custom caches (of which we have about five). The RAM size estimator spreadsheet [1] is helpful but we'd love to get accurate live size metrics. [1] https://github.com/apache/lucene-solr/blob/trunk/dev-tools/size-estimator

Stuck on SEVERE: Error filterStart

2014-04-16 Thread Arthur Pemberton
I am trying Solr for the first time, and I am stuck at the error "SEVERE: Error filterStart" My setup: - Centos 6.x - OpenJDK 1.7 - Tomcat 7 >From reading [1] I believe the issue is missing JAR files, but I have no idea where to put them, even the wiki is a bit vague on that. Lib directories

Can I reconstruct text from tokens?

2014-04-16 Thread Alexandre Rafalovitch
Hello, If I use very basic tokenizers, e.g. space based and no filters, can I reconstruct the text from the tokenized form? So, "This is a test" -> "This", "is", "a", "test" -> "This is a test"? I know we store enough information, but I don't know internal API enough to know what I should be loo

Re: Can I reconstruct text from tokens?

2014-04-16 Thread Ramkumar R. Aiyengar
Logically if you tokenize and put the results in a multivalued field, you should be able to get all values in sequence? On 16 Apr 2014 16:51, "Alexandre Rafalovitch" wrote: > Hello, > > If I use very basic tokenizers, e.g. space based and no filters, can I > reconstruct the text from the tokenize

Re: Stuck on SEVERE: Error filterStart

2014-04-16 Thread Alexandre Rafalovitch
For learning purposes, I would just download the distribution from the website, unzip it and run from there. Using built-in Jetty. Then, once you are happy , go back to Tomcat and figure it out. If that's not an option, you need to find what classpath your tomcat is using. Have you actually tried

Re: Can I reconstruct text from tokens?

2014-04-16 Thread Alexandre Rafalovitch
Why? I want stored=false, at which point multivalued field is just offset values in the dictionary. Still have to reconstruct from offsets. Or am I missing something? Regards, Alex On 16/04/2014 10:59 pm, "Ramkumar R. Aiyengar" wrote: > Logically if you tokenize and put the results in a mu

Re: Stuck on SEVERE: Error filterStart

2014-04-16 Thread David Santamauro
You need to copy /example/lib/ext/*.jar into your tomcat lib directory (/usr/share/tomcat/lib) Also make sure a /usr/share/tomcat/conf/log4j.properties is there as well. ... then restart. HTH David On 4/16/2014 11:47 AM, Arthur Pemberton wrote: I am trying Solr for the first time, and I

RE: Transformation on a numeric field

2014-04-16 Thread Chris Hostetter
: Anyone knows why we can`t have an analysis chain on a numeric field ? : Looks to me like it would be very useful to be able to : manipulate/transform a value without an external resources. Analysis only affects *indexed* terms -- it has no impact on the stored values (or things like docValue

RE: Show the score in the search result

2014-04-16 Thread Chris Hostetter
: here is the query: : http://localhost:7001/solr/collection1/select?q=*%3A*&rows=5&fl=*%2Cscore&wt=json&indent=true&debugQuery=true : : : and here the response: that's bizare. Do me a favor, and: * post the results of .../select?q=*%3A*&rows=1&fl=score&wt=json&indent=true&echoParams=true

Re: Show the score in the search result

2014-04-16 Thread Jack Krupansky
And try it with wt=xml ... maybe there's something odd with JSON. And also with echoParams=all so we can be sure what's really passed. I suppose if you had an "invariant" for "fl", then fl would be ignored, but... that would be a less likely scenario. -- Jack Krupansky -Original Message-

RE: cache warming questions

2014-04-16 Thread Matt Kuiper
Thanks Erick, this is helpful information! So it sounds like, at minimum the cache size (at least for filterCache and queryResultCache) should be the sum of the autowarmCount for that cache and the number of queries defined for the newSearcher listener. Otherwise some items in the caches will

Re: Stuck on SEVERE: Error filterStart

2014-04-16 Thread Arthur Pemberton
Thank you. I had evidently misunderstood where it needed to be copied to. That helped, though that directory already contained all but one file. On Wed, Apr 16, 2014 at 12:45 PM, David Santamauro < david.santama...@gmail.com> wrote: > > You need to copy /example/lib/ext/*.jar into your tomcat li

RE: Tipping point of solr shards (Num of docs / size)

2014-04-16 Thread Toke Eskildsen
mukh@gmail.com [mukh@gmail.com] On Behalf Of Mukesh Jha [me.mukesh@gmail.com] wrote: > In my solr cluster I've multiple shards and each shard containing > ~500,000,000 documents total index size being ~1 TB. > I was just wondering how much more can I keep on adding to the shard before

Re: clusterstate.json does not reflect current state of down versus active

2014-04-16 Thread Daniel Collins
We actually have a similar scenario, we have 64 cores per machine, and even that sometimes has issues when we shutdown all cores at once. We did start to write a "force election for Shard X" tool but it was harder than we expected, its still on our to-do list. Some context, we run 256 shards spre

Re: clusterstate.json does not reflect current state of down versus active

2014-04-16 Thread Mark Miller
bq.  before any of Solr gets to do its shutdown sequence Yeah, this is kind of an open issue. There might be a JIRA for it, but I cannot remember. What we really need is an explicit shutdown call that can be made before stopping jetty so that it’s done gracefully. --  Mark Miller about.me/markrm

Re: Autocomplete with Case-insensitive feature

2014-04-16 Thread Dmitry Kan
Could you show the updated field definition? Does analysis page show sensible output for your query on indexing/querying sides? On Wed, Apr 16, 2014 at 5:52 PM, Sunayana wrote: > Thanks for replying, > 1.Yes,I re-indexed data after the changes. > 2.Changing to STF, did not help.. > > > > > -- >

Re: waitForLeaderToSeeDownState when leader is down

2014-04-16 Thread Jessica Mallet
Hi Furkan, Thanks for the reply. I understand the intent. However, in the case I described, the follower is blocked on looking for a leader (throws the pasted exception because it can't find the leader) before it participates in election; therefore, it will never come up while the leader waits for

Re: clusterstate.json does not reflect current state of down versus active

2014-04-16 Thread Rich Mayfield
Shawn Heisey-4 wrote > I can envision two issues for you to file in Jira. The first would be > an Improvement issue, the second would be a Bug: > > * SolrCloud: Add API to move leader off a Solr instance > * SolrCloud: LotsOfCollections takes a long time to stabilize I've created: * SOLR-5990 -

Re: waitForLeaderToSeeDownState when leader is down

2014-04-16 Thread Mark Miller
What version are you testing? Thought we had addressed this. --  Mark Miller about.me/markrmiller On April 16, 2014 at 6:02:09 PM, Jessica Mallet (mewmewb...@gmail.com) wrote: Hi Furkan, Thanks for the reply. I understand the intent. However, in the case I described, the follower is blocked

Re: deleting large amount data from solr cloud

2014-04-16 Thread Vinay Pothnis
Hello, Couple of follow up questions: * When the optimize command is run, looks like it creates one big segment (forceMerge = 1). Will it get split at any point later? Or will that big segment remain? * Is there anyway to maintain the number of segments - but still merge to reclaim the deleted d

WordDelimiterFilterFactory and StandardTokenizer

2014-04-16 Thread Bob Laferriere
 I am seeing odd behavior from WordDelimiterFilterFactory  (WDFF) when used in conjunction with StandardTokenizerFactory (STF). If I use the following configuration:          

Re: WordDelimiterFilterFactory and StandardTokenizer

2014-04-16 Thread Shawn Heisey
On 4/16/2014 8:37 PM, Bob Laferriere wrote: >> I am seeing odd behavior from WordDelimiterFilterFactory (WDFF) when >> used in conjunction with StandardTokenizerFactory (STF). >> I see the following results for the document of “wi-fi”: >> >> Index: “wi”, “fi” >> Query: “wi”,”fi”,”wifi” >> >

Re: WordDelimiterFilterFactory and StandardTokenizer

2014-04-16 Thread Jack Krupansky
Typically the white space tokenizer is the best choice when the word delimiter filter will be used. -- Jack Krupansky -Original Message- From: Shawn Heisey Sent: Wednesday, April 16, 2014 11:03 PM To: solr-user@lucene.apache.org Subject: Re: WordDelimiterFilterFactory and StandardToke

Re: deleting large amount data from solr cloud

2014-04-16 Thread Shalin Shekhar Mangar
You can specify maxSegments parameter e.g. maxSegments=5 while optimizing. On Thu, Apr 17, 2014 at 6:46 AM, Vinay Pothnis wrote: > Hello, > > Couple of follow up questions: > > * When the optimize command is run, looks like it creates one big segment > (forceMerge = 1). Will it get split at any

Re: Wait Flush, Wait Searcher and commit Scenarios

2014-04-16 Thread rulinma
good. -- View this message in context: http://lucene.472066.n3.nabble.com/Wait-Flush-Wait-Searcher-and-commit-Scenarios-tp491509p4131651.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: waitFlush and waitSearcher

2014-04-16 Thread rulinma
mark -- View this message in context: http://lucene.472066.n3.nabble.com/waitFlush-and-waitSearcher-tp476887p4131653.html Sent from the Solr - User mailing list archive at Nabble.com.