Re: Match in MultiValueField

2014-06-18 Thread Ahmet Arslan
Hi, So you have a query=foo bar and you want to retrieve yes foo ? In other words you want to learn which fields caused a match. May be you can use dynamic fields (instead of multivalued) and use debugQuery=true response to extract that information no foo1  yes foo  no foo1  On Monday, J

Basic Authentication for Admin GUI

2014-06-18 Thread Thomas Fischer
Hello, I'm trying to set up a basic authentication for the admin function in the new solr GUI. For this I have to give the appropriate url-pattern, e.g. / will match every URL in my solr server. But the GUI now runs all administrative tasks under /#/ and there is no particular /admin/ branch any

VelocityResponseWriter in solr

2014-06-18 Thread Vivekanand Ittigi
Hi, I want to use VelocityResponseWriter in solr. I've indexed a website( for example http://www.biginfolabs.com/). If i type a query http://localhost:8983/solr/collection1/select?q=santhos&wt=xml&indent=true I will get al

Solr and OpenNLP - Error loading class 'solr.OpenNLPTokenizerFactory'

2014-06-18 Thread Bhadra Mani
Hi All, Using link https://wiki.apache.org/solr/OpenNLP#Deployment_to_Solr Followed the steps. bin/trainall.sh - It keept running while I executed next step "go to trunk-dir/solr and run 'ant test-contrib'" (This has 2 test suite failed.) Later created war file using 'ant dist' (Build Successful

Fwd: Solr and OpenNLP - Error loading class 'solr.OpenNLPTokenizerFactory'

2014-06-18 Thread Bhadra Mani
I am facing this issue https://issues.apache.org/jira/browse/SOLR-3625 but adding to solrconfig.xml doesnot work. it is on 4.8.1 Thanks, Bhadra -- Forwarded message -- From: Bhadra Mani Date: Wed, Jun 18, 2014 at 4:46 PM Subject: Solr and OpenNLP - Error loading class 'solr.OpenNL

Re: Converting XML response of Search query into HTML.

2014-06-18 Thread Venkata krishna
Thanks for quick responses, Ahemt , i have tried by removing ampersand then xml response has not converted to html response it is in just xml only. Erik , according to your suggestion i used VelocityResponseWriter. like this manner query.set("&wt", "velocity"); query.

Re: Document security filtering in distributed solr (with multi shard)

2014-06-18 Thread Ali Nazemian
Any idea would be appropriate. On Tue, Jun 17, 2014 at 5:44 PM, Ali Nazemian wrote: > Dear Alexandre, > Yeah I saw that, but what is the best way of doing that from the > performance point of view? > I think of one solution myself: > Suppose we have a RDBMS for users that contains the category

Re: Document security filtering in distributed solr (with multi shard)

2014-06-18 Thread Alexandre Rafalovitch
The performance you should usually test yourself. Especially, since you probably want some sort of cashing. But post-filters were specifically designed to be used for expensive operations (and you can order them too to apply in sequence). They should also work distributed, though each shard will n

Re: Converting XML response of Search query into HTML.

2014-06-18 Thread Erik Hatcher
The ‘&’ is only for separating parameters when building a URL, but omit the ‘&’ when using SolrJ. You’ll probably need to do a little bit of SolrJ trickery to get the response back as text, such that SolrJ doesn’t try to interpret the response as XML or javabin. Erik On Jun 18, 2014,

What is causing snapshots?

2014-06-18 Thread Tom Van den Abbeele
Hi all, I'm trying to figure out what is causing several snapshots a day on a multi-core solr 3.5.0 instance deployed in Jboss with replication via the ReplicationHandler. Currently the parameters indicate there will be made a backup after an optimize, but at the moment there are no automatic o

Re: VelocityResponseWriter in solr

2014-06-18 Thread Erik Hatcher
You’ll see that all the fields are visible when you either use /browse?wt=xml or /browse?debugQuery=true, so the values are all there (via fl=*). The default non-debug view only shows a few fields, but you can adjust the template(s) used to render things how you’d like. The main template to re

Solr 4.8 result page desplay changes and highlighting

2014-06-18 Thread vicky
Hi Everyone, I just installed solr 4.8 release and playing with DIH and Velocity configuration. I am trying to change result page columns to display more # of fields and type of format to tabular since I have 1 rows to display on one page if I can in out of box configuration. I also tried h

Re: Highlighting not working

2014-06-18 Thread vicky
Were you ever able to resolve this issue? I am having same issue and highligh is not working for me on solr 4.8? -- View this message in context: http://lucene.472066.n3.nabble.com/Highlighting-not-working-tp4112659p4142513.html Sent from the Solr - User mailing list archive at Nabble.com.

add new Fields with SolrJ without changing schema.xml

2014-06-18 Thread benjelloun
Hello, I need to add new Fields with SolrJ without changing schema.xml. this is my code java : HttpSolrServer server = new HttpSolrServer("http://localhost:8080/solr";); SolrInputDocument doc = new SolrInputDocument(); doc.addField("id", id); doc.addField("Titre", nomdocument); the id and Titr

Calculating filterCache size

2014-06-18 Thread Benjamin Wiens
Hi, I'm looking for a formula to calculate filterCache size in the RAM. The best estimation I can find is here http://stackoverflow.com/questions/2004/solr-filter-cache-fastlrucache-takes-too-much-memory-and-results-in-out-of-mem An index of 1.000.000 would thus take 12,5 GB in the RAM with t

Leader Selection Error

2014-06-18 Thread Gurfan
Hi, We have a SolrCloud 4.7.1 setup having some leader and some replica. If a leader goes down then it tries to elect the leader between the replica`s. Between the replica`s some replica`s gets into recovery mode. In this activity an error is thrown "we are not the leader". The server went into 40

Re: Calculating filterCache size

2014-06-18 Thread Erick Erickson
You pretty much have it. Actually, the number you want is the "maxDoc" figure from the admin UI screen. The formula will be maxDoc/8 bytes + (some overhead but not enough to matter), for EVERY entry. You'll never fit 100B docs on a single machine anyway. Lucene has a hard limit of 2B docs, and I'v

Re: add new Fields with SolrJ without changing schema.xml

2014-06-18 Thread Erick Erickson
bq: I need to add new Fields with SolrJ without changing schema.xml You have three options: 1> change the schema.xml file. but you say you can't. Why not? 2> use dynamic fields. If you're lucky, you have the stock schema.xml and can use them. They'll require some suffix to match the pattern though

Re: add new Fields with SolrJ without changing schema.xml

2014-06-18 Thread benjelloun
Hello, i'm using this configuration on solrconfig.xml: true managed-schema Can you please give me an exemple on SolrJ for adding a new field. thanks, best regards, Anass BENJELLOUN -- View this message in context: http://lucene.472066.n3.nabble.com/add-new-Fields-w

RE: Highlighting not working

2014-06-18 Thread Teague James
Vicky, I resolved this by making sure that the field that is searched has "stored=true". By default "text" is searched, which is the destination of the copyFields and is not stored. If you change your copyField destination to a field that is stored and use that field as the default search field th

Re: add new Fields with SolrJ without changing schema.xml

2014-06-18 Thread benjelloun
Hello, this is what i want to do: public static void addNewField(Boolean uniqueId,String type, Boolean indexed,Boolean stored,Boolean multivalued,Boolean sortmissinglast,Boolean required){ . .

Re: Converting XML response of Search query into HTML.

2014-06-18 Thread Venkata krishna
Hi Erik, I have tried by removing '&' and i got response as in text format but i don't want response in text form. We need to get response as in html form with out any exception(Expected mime type application/xml but got text/html).So could you please provide any suggestion. Thanks, venkata kris

Re: add new Fields with SolrJ without changing schema.xml

2014-06-18 Thread Walter Underwood
Why can't you change schema.xml? --wunder On Jun 18, 2014, at 8:56 AM, benjelloun wrote: > Hello, > > this is what i want to do: > > public static void addNewField(Boolean uniqueId,String type, Boolean > indexed,Boolean stored,Boolean multivalued,Boolean > sortmissinglast,Boolean re

Re: Calculating filterCache size

2014-06-18 Thread Benjamin Wiens
Thanks Erick! So let's say I have a config of MaxDocuments = 1,000,000 So according to your formula, filterCache should roughly have the potential to consume this much RAM: ((1,000,000 / 8) + 128) * (10,000) = 1,251,280,000 byte / 1,000 = 1,251,280 kb / 1,000 = 1,251.28 mb / 1000 = 1.25 gb Tha

Limit Porter stemmer to plural stemming only?

2014-06-18 Thread Jacob, Jerry (RIS-ATL)
Hi, Can you please share the Java code for Plural Only Porter Stemmer for English if you don't mind? Thanks, Jerry

Re: Calculating filterCache size

2014-06-18 Thread Shawn Heisey
On 6/18/2014 10:57 AM, Benjamin Wiens wrote: > Thanks Erick! > So let's say I have a config of > > class="solr.FastLRUCache" > size="1" > initialSize="1" > autowarmCount="5000"/> > > MaxDocuments = 1,000,000 > > So according to your formula, filterCache should roughly have the potential >

Re: MergeReduceIndexerTool takes a lot of time for a limited number of documents

2014-06-18 Thread Wolfgang Hoschek
Consider giving the MR tasks more RAM, for example via hadoop jar /opt/cloudera/parcels/CDH/lib/solr/contrib/mr/search-mr-*-job.jar org.apache.solr.hadoop.MapReduceIndexerTool -D 'mapred.child.java.opts=-Xmx2000m’ ... Wolfgang. On May 26, 2014, at 10:48 AM, Costi Muraru wrote: > Hey Erick, >

Synonyms - 20th and 20

2014-06-18 Thread Jae Joo
I have a synonyms.txt file which has 20th,twentieth Once I apply the synonym, I see "20th", "twentieth" and "20" for "20th". Does anyone know where "20" comes from? How can I have only "20th" and "twentieth"? Thanks, Jae

Re: Synonyms - 20th and 20

2014-06-18 Thread Diego Fernandez
What tokenizer and filters are you using? Diego Fernandez - 爱国 Software Engineer US GSS Supportability - Diagnostics - Original Message - > I have a synonyms.txt file which has > 20th,twentieth > > Once I apply the synonym, I see "20th", "twentieth" and "20" for "20th". > Does anyone kn

Looking for migration stories to an HDFS-backed Solr Cloud

2014-06-18 Thread Michael Della Bitta
Hi everyone, We're considering a migration to an HDFS-backed Solr Cloud, both from our 4.2-based Solr Cloud, and a legacy 3.6 classic replication setup. In the end, we hope to unify these two and upgrade to 4.8.1, or 4.9 if that's out in time. I'm wondering how many of you have experience with mi

RE: Solr maximum Optimal Index Size per Shard

2014-06-18 Thread Toke Eskildsen
Toke Eskildsen [t...@statsbiblioteket.dk] wrote: [Toke: SSDs with 2.7TB of index on a 256GB machine] > tl;dr: for small result sets (< 1M hits) on unwarmed searches with > simple queries, response time is below 100ms. If we enable faceting with > plain Solr, this jumps to about 1 second. > I did

Re: Warning message logs on startup after upgrading to 4.8.1

2014-06-18 Thread Chris Hostetter
: WARN o.a.s.r.ManagedResource- No stored data found for : /schema/analysis/stopwords/english : WARN o.a.s.r.ManagedResource- No stored data found for : /schema/analysis/synonyms/english : : I fixed these by commenting out the managed_en field type in my : schema, see https://g

Why aren't my nested documents nesting?

2014-06-18 Thread Vinay B,
Probably a silly error. Can someone point out my mistake? Code and output gists at https://gist.github.com/anonymous/fb9cdb5b44e76b2c308d Thanks Code: SolrInputDocument solrDoc = new SolrInputDocument(); solrDoc.addField("id", documentId); solrDoc.addField("content_type",

What's the best way to specify nested child documents using UpdateRequest

2014-06-18 Thread Vinay B,
SolrJ allows a direct linkage between parent and child document using SolrInputDocument.addChildDocument(...) . We, however, construct our request via a raw UpdateRequest() as that gives us a bit more flexibility. I'm investigating how best to add nested docs using this approach. >From my underst

Re: Debug different Results from different Request Handlers

2014-06-18 Thread O. Olson
Thank you Erik (and to steffkes who helped me on the IRC #Solr Chat). Sorry for the delay in responding, but I got this to work. Your suggestion about adding debug=true to the query helped me. Since I was adding this to the Velocity request handler, I could not see the debug results, but

ICUTokenizer or StandardTokenizer or ??? for "text_all" type field that might include non-whitespace langs

2014-06-18 Thread Allison, Timothy B.
All, In one index I’m working with, the setup is the typical langid mapping to language specific fields. There is also a text_all field that everything is copied to. The documents can contain a wide variety of languages including non-whitespace languages. We’ll be using the ICUTokenFilter in

Re: ICUTokenizer or StandardTokenizer or ??? for "text_all" type field that might include non-whitespace langs

2014-06-18 Thread Alexandre Rafalovitch
I don't think the text_all field would work too well for multilingual setup. Any reason you cannot use edismax to search over a bunch of fields instead? Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficienc

Re: What's the best way to specify nested child documents using UpdateRequest

2014-06-18 Thread Mikhail Khludnev
On Thu, Jun 19, 2014 at 3:32 AM, Vinay B, wrote: > I'm hoping that > despite this, that the child can be modified updated later on, without > affecting the main document. > Nope. You have to rewrite whole block. -- Sincerely yours Mikhail Khludnev Principal Engineer, Grid Dynamics

Re: Why aren't my nested documents nesting?

2014-06-18 Thread Mikhail Khludnev
because you need you query by special query parser http://blog.griddynamics.com/2013/09/solr-block-join-support.html to nest the output you need https://issues.apache.org/jira/browse/SOLR-5285 On Thu, Jun 19, 2014 at 3:20 AM, Vinay B, wrote: > Probably a silly error. Can someone point out my mi

Re: Bug in Collapsing QParserPlugin : Sort by 3 or more fields is broken

2014-06-18 Thread Umesh Prasad
Continuing the discussion on mailing list from Jira. An Example *id group f1 f2*1 g1 5 10 2 g1 5 1000 3 g1 5 1000 4 g1 10 100 5 g2

Re: Warning message logs on startup after upgrading to 4.8.1

2014-06-18 Thread Marius Dumitru Florea
On Thu, Jun 19, 2014 at 12:49 AM, Chris Hostetter wrote: > > : WARN o.a.s.r.ManagedResource- No stored data found for > : /schema/analysis/stopwords/english > : WARN o.a.s.r.ManagedResource- No stored data found for > : /schema/analysis/synonyms/english > : > : I fixed these by c