Re: Apache Solr Quiz

2012-10-31 Thread Yulia Crowder
I will love to cover other parts of SOLR management. If you have any Solr quiz question on mind, please send it to me and I will insert it to the quiz (and to the site). Together we can make a good SOLR quiz questions for the community. Thank you all. Yulia http://www.quizmeup.com/quiz/**apache-so

Re: SolrCloud AutoSharding? In enterprise environment?

2012-10-31 Thread joseph_12345
Thanks Otis for the response. 1. Is there any performance impact if the client is invoking the solr index using the VIP url instead of individual shard URLs? If the default sharding of SOLR is based on uniqueId.hashcode % numServers, how does the SOLR identify which Shard to get the data if client

RE: Unable to build trunk

2012-10-31 Thread Markus Jelsma
Hi, Where is that lock file located? I triggered it again (in another contrib) and wil trigger it again in the future and don't want to remove my ivy cache each time :) Thanks -Original message- > From:Robert Muir > Sent: Tue 30-Oct-2012 15:14 > To: solr-user@lucene.apache.org > Su

Re: Unable to build trunk

2012-10-31 Thread Robert Muir
you will have to use 'find' on your .ivy2 ! On Wed, Oct 31, 2012 at 6:32 AM, Markus Jelsma wrote: > Hi, > > Where is that lock file located? I triggered it again (in another contrib) > and wil trigger it again in the future and don't want to remove my ivy cache > each time :) > > Thanks > > > -

Re: Are there any limitations on multi-value field joins?

2012-10-31 Thread Erick Erickson
As I remember, the underlying algorithm enumerates all the unique values in the field when doing the join (or something like that). So when the filed you're joining has many unique values, it performs poorly. Worse, it'll be fine on small data sets, the kind we usually develop with. But then when y

Re: need help on solr search

2012-10-31 Thread Erick Erickson
You need to provide significantly more information than you have. What are your perf requirements? How big is your data set? What kinds of searches are you talking about here? How are you measuring response? This really feels like an "XY" problem. Best Erick On Wed, Oct 31, 2012 at 1:33 AM, jche

Re: SolrCloud AutoSharding? In enterprise environment?

2012-10-31 Thread Erick Erickson
There's no real magic about the index structure, it's just the same as non-cloud Solr. So presumably you have example and example2 directories or some such. They're just standard Solr installations with the index in the usual place, the docs for the particular shard are stored in the data/index dir

Query regarding range search on int fields

2012-10-31 Thread Leena Jawale
Hi, I have created Solr XML data source. In that I want to make range query on int field which is price. But by default it is considering that field as text. So I have added Price in the fields section making price as int, Indexed=true, Search by default=true, Stored=true, Include in results=tru

SOLR 3.5 sometimes throws java.lang.NumberFormatException: For input string: "java.math.BigDecimal:1848.66"

2012-10-31 Thread Marcin Pilaczynski
Welcome all, We have a very strange problem with SOLR 3.5. It SOMETIMES throws exceptions: 2012-10-31 10:20:06,408 SEVERE [org.apache.solr.core.SolrCore:185] (http-10.205.49.74-8080-155) org.apache.solr.common.SolrException: ERROR: [doc=MyDoc # d3mo1351674222122-1 # 2012-10-31 08:03:42.122] Error

Re: SOLR 3.5 sometimes throws java.lang.NumberFormatException: For input string: "java.math.BigDecimal:1848.66"

2012-10-31 Thread Rafał Kuć
Hello! Look at what Solr returns in the error - you send the following value "java.math.BigDecimal:1848.66" - remove the "java.math.BigDecimal:" and your problem should be gone. -- Regards, Rafał Kuć Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - ElasticSearch > Welcome all, > W

Re: SOLR 3.5 sometimes throws java.lang.NumberFormatException: For input string: "java.math.BigDecimal:1848.66"

2012-10-31 Thread Erick Erickson
It _looks_ like somehow the string you're sending as a BigDecimal is, literally, "java.math.BigDecimal:1848.66" rather than "1848.66". How are you generating the field value? I'm guessing that your (SolrJ?) program is somehow messing this up... Best Erick On Wed, Oct 31, 2012 at 7:28 AM, Marcin

Re: Query regarding range search on int fields

2012-10-31 Thread Erick Erickson
Is this LucidWorks? You'll need to ask on the LucidWorks forums if so. Best Erick On Wed, Oct 31, 2012 at 7:26 AM, Leena Jawale wrote: > Hi, > > I have created Solr XML data source. In that I want to make range query on > int field which is price. > But by default it is considering that field a

No lockType configured for NRTCachingDirectory

2012-10-31 Thread Markus Jelsma
Hi, Besides replication issues (see other thread) we're also seeing these warnings in the logs on all 10 nodes and for all cores using today's or yesterday's trunk. 2012-10-31 11:01:03,328 WARN [solr.core.CachingDirectoryFactory] - [main] - : No lockType configured for NRTCachingDirectory(org

Re: Query regarding range search on int fields

2012-10-31 Thread Gora Mohanty
On 31 October 2012 16:56, Leena Jawale wrote: > Hi, > > I have created Solr XML data source. In that I want to make range query on > int field which is price. > But by default it is considering that field as text. So I have added Price > in the fields section making price as int, > Indexed=true,

Re: SOLR 3.5 sometimes throws java.lang.NumberFormatException: For input string: "java.math.BigDecimal:1848.66"

2012-10-31 Thread Marcin Pilaczynski
First we were adding BigDecimal object to SolrInputDocument directly as field value. Now we are adding BigDecimal.toPlainString() as field value. SOLR relies on JavaBinCodec class which does de/serialization in it's own way - some kind of bug in there? I don't know what is the proper way to handl

Re: Grouping based on multiple criteria

2012-10-31 Thread Marcio Ghiraldelli
I have a similar issue, and I am solving it by implementing my own components and dealiing with the resultings doc IDs public class MerchantShuffleComponent extends SearchComponent { ... ctx.docs = shuffledDocList; rb.rsp.getValues().remove("response"); rb.rsp.add("respons

After to SOLR 4.0.0 Upgrade - ClusterState says we are the leader, but locally we don't think so

2012-10-31 Thread balaji.gandhi
Hi, After upgrading from Solr 4.0.0-Beta to Solr 4.0.0 we are getting this error from ALL the leader nodes:- Oct 31, 2012 6:44:03 AM org.apache.solr.update.processor.DistributedUpdateProcessor doDefensiveChecks SEVERE: ClusterState says we are the leader, but locally we don't think so Is there a

Re: Datefaceting on multiple value in solr

2012-10-31 Thread Sagar Joshi1304
Thanks Chris, seems it is working fine, below is the query http://localhost:8993/solr/select?q=*:*&fq=(!tag=test)name:test*&fq=(!tag=test1)name:test1&fq=(!tag=test3)name:test3&&facet=true&facet.range={!key=test ex=test1,test3}Admission_Date&facet.range={!key=test1 ex=test,test3}Admission_Date&fac

Re: After to SOLR 4.0.0 Upgrade - ClusterState says we are the leader, but locally we don't think so

2012-10-31 Thread Mark Miller
Hmm...not sure - perhaps you could share you zookeeper data (there is a dump to clipboard option in the admin ui, cloud tab). Anything else interesting in the logs? Some zookeeper layout changes were made, and I'm not sure an upgrade from beta/alpha was ever really tested with them (I didn't make

Re: No lockType configured for NRTCachingDirectory

2012-10-31 Thread Mark Miller
By trunk do you mean 4X or 5X? On Wed, Oct 31, 2012 at 7:47 AM, Markus Jelsma wrote: > Hi, > > Besides replication issues (see other thread) we're also seeing these > warnings in the logs on all 10 nodes and for all cores using today's or > yesterday's trunk. > > 2012-10-31 11:01:03,328 WARN [s

RE: No lockType configured for NRTCachingDirectory

2012-10-31 Thread Markus Jelsma
That's 5, the actual trunk/ -Original message- > From:Mark Miller > Sent: Wed 31-Oct-2012 16:29 > To: solr-user@lucene.apache.org > Subject: Re: No lockType configured for NRTCachingDirectory > > By trunk do you mean 4X or 5X? > > On Wed, Oct 31, 2012 at 7:47 AM, Markus Jelsma > wrote

Re: Solr4.0 / SolrCloud queries

2012-10-31 Thread Mark Miller
If you can share any logs, that would help as well. - Mark

Re: Solr Swap Function doesn't work when using Solr Cloud - SOLR3866

2012-10-31 Thread Andre Bois-Crettez
Hello, Same as Sam, I believe the SWAP command is important for important use cases. For example, with Solr 3, we do use Current and Temp cores, so that incremental updates to the index are done live on Current, as well as searches. Whenever a full/baseline/from scratch index need to be performe

Re: After to SOLR 4.0.0 Upgrade - ClusterState says we are the leader, but locally we don't think so

2012-10-31 Thread balaji.gandhi
Mark, We have tried the following:- 1. Removing everything in the ZooKeeper snapshot directory 2. Removing the indexes We get the same error in both the cases. Attached the cloud dumps:- cloud_dump.json Thanks, Balaji -- V

Re: SolrJ 4.0.0 addFilterQuery() issue ?

2012-10-31 Thread Indika Tantrigoda
Just created the defect in Jira. https://issues.apache.org/jira/browse/SOLR-4020 Thanks. On 31 October 2012 10:47, Indika Tantrigoda wrote: > Thanks for the reply Chris. > > Yes you are correct, SolrJ is serializing a String[] instead of the > separate String values. > > Using solrQuery.add("fq

Re: need help on solr search

2012-10-31 Thread jchen2000
Sure. here are some more details: 1) we are having 30M ~ 60M documents per node (right now we have 4 nodes, but that will increase in the future). Documents are relatively small (around 3K), but 99% searches must be returned within 200ms and this is measured by test drivers sitting right in front

Re: SOLR 3.5 sometimes throws java.lang.NumberFormatException: For input string: "java.math.BigDecimal:1848.66"

2012-10-31 Thread Chris Hostetter
: SOLR relies on JavaBinCodec class which does de/serialization in it's : own way - some kind of bug in there? : : I don't know what is the proper way to handle BigDecimal values in : SOLR 3.5 after all? The safe thing to do is only add "primitive" java objects that Solr understands natively -

Re: SolrCloud Tomcat configuration: problems and doubts.

2012-10-31 Thread Mark Miller
A big difference if you are using tomcat is that you still need to specify jetty.port - unless you change the name of that sys prop in solr.xml. Some more below: On Wed, Oct 31, 2012 at 2:09 PM, Luis Cappa Banda wrote: > Hello! > > How are you?I followed SolrCloud Wiki tutorial and noticed that

Re: Anyone working on adapting AnalyzingQueryParser to solr?

2012-10-31 Thread balaji.gandhi
Hi, Is the AnalyzingQueryParser ported to SOLR? I read that it it available in Lucene. Not sure about SOLR. We are trying to workaround this limitation:- "On wildcard and fuzzy searches, no text analysis is performed on the search word." http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilte

Re: need help on solr search

2012-10-31 Thread Otis Gospodnetic
Hi, Not sure if I follow your requirements correctly, but it sounds like you may be looking for phrase queries (as opposed to term/keyword queries). Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring - http://sematext.com/spm/index.html On Wed, Oct

Re: Datefaceting on multiple value in solr

2012-10-31 Thread Otis Gospodnetic
Hi, I didn't follow the thread, but maybe you are looking for &fq=(name1 OR name2 OR ) for those 100 names you mentioned, so that 1 doesn't filter out the other 99. Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring - http://sematext.com/spm/inde

Solr 4.0 admin panel

2012-10-31 Thread Tannen, Lev (USAEO) [Contractor]
Hi, I apologize for the trivial question, but I cannot find out what is wrong. I try to switch from Solr 3.6 to Solr 4.0. All what I have done was I have downloaded and unzipped the official binary file for Windows (32 bit) and run just an example and it does not work. In Solr 3.6 the request h

Re: Anyone working on adapting AnalyzingQueryParser to solr?

2012-10-31 Thread Ahmet Arslan
> We are trying to workaround this limitation:- > > "On wildcard and fuzzy searches, no text analysis is > performed on the search > word." I think http://wiki.apache.org/solr/MultitermQueryAnalysis is a more elegant way to deal with this.

Re: Solr 4.0 admin panel

2012-10-31 Thread Péter Király
Dear Lev, core0 is only available on multicore environment. You should start Solr as java -Dsolr.solr.home=multicore -jar start.jar cheers, Péter 2012/10/31 Tannen, Lev (USAEO) [Contractor] : > Hi, > I apologize for the trivial question, but I cannot find out what is wrong. I > try to switch f

Re: Solr 4.0 admin panel

2012-10-31 Thread James Ji
The right address to go is http://localhost:8983/solr/ on Solr 4.0. http://localhost:8983/solr/admin links to nothing if you go check the servlet. Cheers James On Wed, Oct 31, 2012 at 3:25 PM, Tannen, Lev (USAEO) [Contractor] < lev.tan...@usdoj.gov> wrote: > Hi, > I apologize for the trivial qu

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Jack Krupansky
Scoring or ranking of document relevancy is called "similarity". You can create your own similarity class, or even have a field-specific similarity class. See, for example: http://lucene.apache.org/core/4_0_0/core/org/apache/lucene/search/similarities/TFIDFSimilarity.html http://lucene.apache.o

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Ahmet Arslan
> I would like to lower or eliminate > the contribution of the fieldNorm > on some searches. I figured that a LocalParam might help, > but I cannot > find any documentation on it. Is there documentation on how > to reduce > the consideration for tf, idf, fieldNorm, and coord? Where > is that? "om

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Ahmet Arslan
> > I would like to lower or eliminate > > the contribution of the fieldNorm > > on some searches. I figured that a LocalParam might > help, > > but I cannot > > find any documentation on it. Is there documentation on > how > > to reduce > > the consideration for tf, idf, fieldNorm, and coord? > Wh

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Dotan Cohen
On Wed, Oct 31, 2012 at 11:50 PM, Ahmet Arslan wrote: > "omitNorms=true|false > > This is arguably an advanced option. Set to true to omit the norms associated > with this field (this disables length normalization and index-time boosting > for the field, and saves some memory). Only full-text fi

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Jack Krupansky
You could write a custom search component that checked for your desired request parameters, and then it could set them for a custom similarity class, which you would also have to write. -- Jack Krupansky -Original Message- From: Dotan Cohen Sent: Wednesday, October 31, 2012 6:07 PM T

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Dotan Cohen
On Wed, Oct 31, 2012 at 11:44 PM, Jack Krupansky wrote: > Scoring or ranking of document relevancy is called "similarity". You can > create your own similarity class, or even have a field-specific similarity > class. > > See, for example: > http://lucene.apache.org/core/4_0_0/core/org/apache/lucen

Re: Solr 4.0 admin panel

2012-10-31 Thread Chris Hostetter
: The right address to go is http://localhost:8983/solr/ on Solr 4.0. : http://localhost:8983/solr/admin links to nothing if you go check the : servlet. For back compat, http://localhost:8983/solr/admin should automatially redirect to http://localhost:8983/solr/#/ -- regardless of wether you are

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Dotan Cohen
On Thu, Nov 1, 2012 at 12:16 AM, Jack Krupansky wrote: > You could write a custom search component that checked for your desired > request parameters, and then it could set them for a custom similarity > class, which you would also have to write. > Perhaps, but if I'm going that route I would hav

Re: Anyone working on adapting AnalyzingQueryParser to solr?

2012-10-31 Thread balaji.gandhi
Hi iorixxx, this is how we our email field defined. So a query like [emailAddress : bob*] would match b...@bob.com, but queri

Re: solr blocking on commit

2012-10-31 Thread dbabits
I second the original poster- all selects are blocked during commits. I have Master replicating to Slave. Indexing happens to Master, few docs/about every 30 secs Selects are run against Slave. This is the pattern from the Slave log: Oct 30, 2012 12:33:23 AM org.apache.solr.core.SolrDeletionPolic

Re: After adding field to schema, the field is not being returned in results.

2012-10-31 Thread Otis Gospodnetic
Hi, That should work just fine. It;s either a bug or you are doing something you didn't mention. Maybe you can provide a small, self-enclosed unit test and stick it in JIRA? Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring - http://sematext.com/s

Re: After adding field to schema, the field is not being returned in results.

2012-10-31 Thread Alexandre Rafalovitch
And - just to get stupid options out of the way - you don't have any parameters defined on the handlers that may list the fields to return? Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of nature that

Re: After adding field to schema, the field is not being returned in results.

2012-10-31 Thread Dotan Cohen
On Thu, Nov 1, 2012 at 2:52 AM, Otis Gospodnetic wrote: > Hi, > > That should work just fine. It;s either a bug or you are doing something > you didn't mention. Maybe you can provide a small, self-enclosed unit test > and stick it in JIRA? > I would assume that it's me doing something wrong! Ho

SOLRJ - Error while using CommonsHttpSolrServer

2012-10-31 Thread Jegannathan Mehalingam
- I tried using HttpSolrServer, but had some problems and some news groups mentioned that it is buggy and I should be using CommonsHttpSolrServer. So, I am using CommonsHttpSolrServer. But both approaches does not work. - I have tried using SOLR 4.0 as well as 3.6.1. I get errors in both cases.

Re: SOLRJ - Error while using CommonsHttpSolrServer

2012-10-31 Thread Shawn Heisey
On 10/31/2012 10:06 PM, Jegannathan Mehalingam wrote: - I tried using HttpSolrServer, but had some problems and some news groups mentioned that it is buggy and I should be using CommonsHttpSolrServer. So, I am using CommonsHttpSolrServer. But both approaches does not work. - I have tried using