Re: Cloudera Manager install

2014-09-15 Thread rulinma
4.4 I think. -- View this message in context: http://lucene.472066.n3.nabble.com/Cloudera-Manager-install-tp4136250p4158810.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Altenative preview for specific fields

2014-09-15 Thread Ahmet Arslan
Hi, f.text.hl.alternateField=text&f.text.hl.maxAlternateFieldLength=500 will display first 500 characters of text field. On Monday, September 15, 2014 8:38 AM, SolrUser1543 wrote: Hi , thanks for the answer. I tried to use this technique , but the desired result was not achieved. Can you

Re: q and logical operators.

2014-09-15 Thread John Nielsen
Thanks for the heads up. On Fri, Sep 12, 2014 at 5:48 PM, Erick Erickson wrote: > John: > > Glad it worked. Bit a little careful with large slops. As the slop > increases, you approach the same result set as > > vis AND dis AND dur > > so choosing the appropriate slop is something of a balancing

RE: Facets not supporting multi language?

2014-09-15 Thread Cario, Elaine
If you have some control over the value of the facet, could you prefix each facet value with the language, separated by some delimiter? (e.g. EN/vegetarian, FR/vegeterian,...). Then use a facet.prefix to limit the facet values returned for the language you want (e.g. facet.prefix=FR). Your ap

Solr Exceptions -- "immense terms"

2014-09-15 Thread Christopher Gross
Solr 4.9.0 Java 1.7.0_49 I'm indexing an internal Wiki site. I was running on an older version of Solr (4.1) and wasn't having any trouble indexing the content, but now I'm getting errors: SCHEMA: LOGS: Caused by: java.lang.IllegalArgumentException: Document contains at least one immense term

Re: Solr Exceptions -- "immense terms"

2014-09-15 Thread Michael Della Bitta
If you're using a String fieldtype, you're not indexing it so much as dumping the whole content blob in there as a single term for exact matching. You probably want to look at one of the text field types for textural content. That doesn't explain the difference in behavior between Solr versions,

Re: Solr Exceptions -- "immense terms"

2014-09-15 Thread Michael Della Bitta
I just came back to this because I figured out you're trying to just store this text. Now I'm baffled. How big is it? :) Not sure why an analyzer is running if you're just storing the content. Maybe you should post your whole schema.xml... there could be a copyfield that's dumping the text into a

RE: Inconsistent relevancy score between browser refreshes

2014-09-15 Thread Tao, Jing
Thanks Erick! After optimization, the scores don't change anymore. Now the only time order may change between browser refreshes is if the score is exactly the same between documents. But that's understandable. First Request: refcenter_323409 Vertebrobasilar Stroke 3.4728973 refcenter_191

Re: Solr Exceptions -- "immense terms"

2014-09-15 Thread Christopher Gross
Yeah -- for this part I'm just trying to store it to show it later. There was a change in Lucene 4.8.x. Before then, the exception was just being eaten...now they throw it up and don't index that document. Can't push the whole schema up -- but I do copy the content field into a "text" field (tex

Re: Solr Exceptions -- "immense terms"

2014-09-15 Thread Jack Krupansky
You can use an update request processor to filter the input for large values. You could write a script with the stateless script processor which ignores or trims large input values. -- Jack Krupansky -Original Message- From: Christopher Gross Sent: Monday, September 15, 2014 7:58 AM

ExternalFileField documentation problems?

2014-09-15 Thread Demian Katz
I've just been doing some experimentation with the ExternalFileField. I ran into obstacles due to some apparently incorrect documentation in the wiki: https://cwiki.apache.org/confluence/display/solr/Working+with+External+Files+and+Processes It seems that for some reason the and definitions ar

RE: Moving to HDFS, How to merge indices from 8 servers ?‏‏

2014-09-15 Thread Amey Jadiye
Thanks for reply Erik, I think i have some misconfusion about how SOLR works with HDFS, and solution i am thinking could be reorganised by user community :) Here is the actual solution/situation which is implemented by me *Usecase* : I need a google like search engine which should be work in dis

Mongo DB Users

2014-09-15 Thread Aaron Susan
Hi, I am here to inform you that we are having a contact list of *Mongo DB Users *would you be interested in it? Data Field’s Consist Of: Name, Job Title, Verified Phone Number, Verified Email Address, Company Name & Address Employee Size, Revenue size, SIC Code, Industry Type etc., We also prov

Re: Solr Exceptions -- "immense terms"

2014-09-15 Thread Alexandre Rafalovitch
May not need a script for that: http://www.solr-start.com/javadoc/solr-lucene/org/apache/solr/update/processor/TruncateFieldUpdateProcessorFactory.html Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources and newsletter: http://www.solr-start.com/ and @solrstart S

Re: Moving to HDFS, How to merge indices from 8 servers ?‏‏

2014-09-15 Thread Michael Della Bitta
There's not much about Solr Cloud or HDFS indexes that suggests you should only have one logical shard. If your goal is better uptime with a sharded index, you should add more replicas. If your collection is small enough that one machine can serve one query with acceptable performance, but you wan

Re: Solr Exceptions -- "immense terms"

2014-09-15 Thread Jack Krupansky
I knew it was in there somewhere! But... that truncates the full field value, as opposed to an individual term for a text field. It depends on whether the immediate issue was for a text field or for a string field. The underlying issue may be that it rarely makes sense to "index" a full wiki pa

Re: Mongo DB Users

2014-09-15 Thread Ed Smiley
Remove On 9/15/14, 8:35 AM, "Aaron Susan" wrote: >Hi, > >I am here to inform you that we are having a contact list of *Mongo DB >Users *would you be interested in it? > >Data Field¹s Consist Of: Name, Job Title, Verified Phone Number, Verified >Email Address, Company Name & Address Employee Size

Re: Solr Exceptions -- "immense terms"

2014-09-15 Thread Christopher Gross
[sorry if this double posts -- I got an error on sending so I'm trying it again..] I'm storing the page content in a "string" in Solr -- for display later. I'm indexing that content into a text field (text_en_splitting) for full-text searching. I'm getting an error on the "string" portion, but pe

spam detection issue on sending legitimate mail to Solr list

2014-09-15 Thread Tom Burton-West
HI all, I just sent a very long post with 5 or 6 links to relevant articles in response to a thread on the Solr users list and got a message my mail was rejected due to a spam score.Can anyone tell me what I need to do to change the message so I can send it to the list. (Is there some refere

Re: Tricky exact match, unwanted search results

2014-09-15 Thread FiMka
Seems now the problem is solved for me. I have already tried to re-index the documents, but after I have re-indexed the core once again, Solr starts returning the correct results. query: srcphrase:in AND srcphrase:case AND srcphrase:if the phrase found query: srcphrase:"case if in"~3 the phrase fou

Re: spam detection issue on sending legitimate mail to Solr list

2014-09-15 Thread Chris Hostetter
: The error that the other server returned was: : 552 spam score (6.2) exceeded threshold (HTML_MESSAGE,RCVD_IN_DNSWL_ : LOW,SPF_NEUTRAL,URIBL_SBL HTML_MESSAGE: BAD - send plain text messages instead of HTML RCVD_IN_DNSWL_LOW: GOOD - your domain is considered unlikely to send spam SPF_NEUTRAL:

Re: Mongo DB Users

2014-09-15 Thread Rakesh Varna
Remove Regards, Rakesh Varna On Mon, Sep 15, 2014 at 9:29 AM, Ed Smiley wrote: > Remove > > On 9/15/14, 8:35 AM, "Aaron Susan" wrote: > > >Hi, > > > >I am here to inform you that we are having a contact list of *Mongo DB > >Users *would you be interested in it? > > > >Data Field¹s Consist Of:

Re: Solr Exceptions -- "immense terms"

2014-09-15 Thread Alexandre Rafalovitch
Solr is for search. Storing fields is to make retrieval easier. When you hit an edge case, you need to step back and reconsider the price you are paying for that "easier" bit. It can play at being a "NoSQL Database", but it is not the primary use case and its behaviour at the edge-cases is not opti

Re: spam detection issue on sending legitimate mail to Solr list

2014-09-15 Thread Shawn Heisey
On 9/15/2014 10:56 AM, Tom Burton-West wrote: > I just sent a very long post with 5 or 6 links to relevant articles in > response to a thread on the Solr users list and got a message my mail was > rejected due to a spam score.Can anyone tell me what I need to do to > change the message so I ca

Re: Moving to HDFS, How to merge indices from 8 servers ?‏‏

2014-09-15 Thread Amey - codeinventory
well, i have 8 m1.large ec2 having 2 core 7gb ram and 1tb ebs attached to each server for index. in my case i dont expect index to be store in ram neither a quick reply as its not a real time application, i just want fault tolerance in application and availability of full data. Is it good to

Re: Mongo DB Users

2014-09-15 Thread Jack Krupansky
>Waiting for a positive response! -1 -- Jack Krupansky -Original Message- From: Rakesh Varna Sent: Monday, September 15, 2014 10:18 AM To: solr-user@lucene.apache.org Subject: Re: Mongo DB Users Remove Regards, Rakesh Varna On Mon, Sep 15, 2014 at 9:29 AM, Ed Smiley wrote: Rem

Re: Solr Exceptions -- "immense terms"

2014-09-15 Thread Chris Hostetter
: SCHEMA: : : : LOGS: : Caused by: java.lang.IllegalArgumentException: Document contains at least : one immense term in field="content" (whose UTF8 encoding is longer than the I don't think you are using the schema.xml you think you are ... that exception is *very* specific to the *INDEXED* te

Re: Solr Exceptions -- "immense terms"

2014-09-15 Thread Bryan Bende
I ran into this problem as well when upgrading to Solr 4.8.1... We had a somewhat large binary field that was "indexex=false stored=true", but because of the copyField copying "*" to "text" it would hit the immense term issue. In our case we didn't need this field to be indexed (parts of it were

Re: Solr Dynamic Field Performance

2014-09-15 Thread Saumitra Srivastav
Thanks for reply Erick. I found this article: http://e-mats.org/2011/01/solr-memory-usage-and-dynamic-fields/ Just to confirm, the fieldCache doesn't store anything extra when we use dynamic fields and do sorting query on that...

Re: How to implement multilingual word components fields schema?

2014-09-15 Thread Tom Burton-West
Hi Ilia, I see that Trey answered your question about how you might stack language specific filters in one field. If I remember correctly, his approach assumes you have identified the language of the query. That is not the same as detecting the script of the query and is much harder. Trying to

Re: Solr Exceptions -- "immense terms"

2014-09-15 Thread Christopher Gross
Thanks Hoss -- adding in the LengthFilterFactory did the trick. -- Chris On Mon, Sep 15, 2014 at 1:57 PM, Bryan Bende wrote: > I ran into this problem as well when upgrading to Solr 4.8.1... > > We had a somewhat large binary field that was "indexex=false stored=true", > but because of the copy

Re: Mongo DB Users

2014-09-15 Thread Greg Solovyev
Remove me from this thread please Thanks, Greg - Original Message - From: "Jack Krupansky" To: solr-user@lucene.apache.org Sent: Monday, September 15, 2014 10:44:00 AM Subject: Re: Mongo DB Users > >Waiting for a positive response! -1 -- Jack Krupansky -Original Message- Fro

Re: Mongo DB Users

2014-09-15 Thread Trilok Prithvi
Remove please. Thanks! On Mon, Sep 15, 2014 at 11:52 AM, Greg Solovyev wrote: > Remove me from this thread please > > Thanks, > Greg > > - Original Message - > From: "Jack Krupansky" > To: solr-user@lucene.apache.org > Sent: Monday, September 15, 2014 10:44:00 AM > Subject: Re: Mongo DB

Re: Moving to HDFS, How to merge indices from 8 servers ?‏‏

2014-09-15 Thread Michael Della Bitta
If all you need is better availability, I would start by trying out an additional replica of each shard on a different box, so each box would be serving the data for 2 shards and each shard would be available on 2 boxes. Michael Della Bitta Applications Developer o: +1 646 532 3062 appinions in

Spring data solr can not search Bluetooth®

2014-09-15 Thread sachin.jain
Hi I am using spring data solr to access Solr. I have a framework that has search functionality. When I try to search for Bluetooth® in solr directly as a query it produces results, but when I try to do the same using spring data solr it does not give any results. Any idea about the odd behavior

Re: Solr Dynamic Field Performance

2014-09-15 Thread Chris Hostetter
: : : Just to confirm, the fieldCache doesn't store anything extra when we use : dynamic fields and do sorting query on that...right? the way the FieldCache works, is that it has to "cache" a value for every document -- even if

Re: Solr Dynamic Field Performance

2014-09-15 Thread Erick Erickson
@Bill: Well, if you're creating 5,000 dynamic fields, whether from lots of matches to a few patterns or 5,000 patterns, you deserve what you get ;). Notice I was careful to say: bq: Dynamic fields, once they are actually _in_ a document aren't any different than statically defined fields So whi

Re: Solr Dynamic Field Performance

2014-09-15 Thread Erick Erickson
@Bill: Well, if you're creating 5,000 dynamic fields, whether from lots of matches to a few patterns or 5,000 patterns, you deserve what you get ;). Notice I was careful to say: bq: Dynamic fields, once they are actually _in_ a document aren't any different than statically defined fields So whi

Re: Spring data solr can not search Bluetooth®

2014-09-15 Thread Chris Hostetter
if your Solr server is giving you the results you expect when you query it directly, then it sounds like you have your fieldTypes and anaylsers configured appropriately. any problem you might be seeing when querying from your client via Spring data source bindings sounds like it is probably a

RE: Mongo DB Users

2014-09-15 Thread Michael Beccaria
Remove From: Aaron Susan Sent: Monday, September 15, 2014 11:35 AM To: Aaron Susan Subject: Mongo DB Users Hi, I am here to inform you that we are having a contact list of *Mongo DB Users *would you be interested in it? Data Field’s Consist Of: Name, Job

Re: ExternalFileField documentation problems?

2014-09-15 Thread Ahmet Arslan
Hi Demian, Only icla signed people can edit confluence. Community contribution operates via comments. Please post your findings (mistakes, corrections, etc) as a comment at the bottom of the page. A committer will notice it and take action accordingly. Ahmet On Monday, September 15, 2014 6:

RE: Mongo DB Users

2014-09-15 Thread Yago Riveiro
remove— /Yago Riveiro On Mon, Sep 15, 2014 at 10:31 PM, Michael Beccaria wrote: > Remove > > From: Aaron Susan > Sent: Monday, September 15, 2014 11:35 AM > To: Aaron Susan > Subject: Mongo DB Users > Hi, > I am here to inform you that we are having a co

Re: Mongo DB Users

2014-09-15 Thread Sunny Khatri
remove On Mon, Sep 15, 2014 at 3:55 PM, Yago Riveiro wrote: > remove— > /Yago Riveiro > > On Mon, Sep 15, 2014 at 10:31 PM, Michael Beccaria > wrote: > > > Remove > > > > From: Aaron Susan > > Sent: Monday, September 15, 2014 11:35 AM > > To: Aaron Susa

remove requests [Mongo DB Users]

2014-09-15 Thread Richard
Folks -- These remove requests (more than a half dozen so far) are rather foolish. The person who sent the original "Mongo DB Users" message simply spammed the "solr-user@lucene ..." list, they didn't send to individual user addresses. So, if your "remove" request is intended for the spammer, it's

Re: Mongo DB Users

2014-09-15 Thread Patti Kelroe-Cooke
Remove Kind regards Patti On Mon, Sep 15, 2014 at 5:35 PM, Aaron Susan wrote: > Hi, > > I am here to inform you that we are having a contact list of *Mongo DB > Users *would you be interested in it? > > Data Field’s Consist Of: Name, Job Title, Verified Phone Number, Verified > Email Address, C