Re: SolrCloud replica always fully resync index from leader node

2014-12-01 Thread stephon
Hello Ludovic, Before then, I have comment out AutoCommit, the old-style configuration. But not works, the replica is fully resync every 2 days. What is the correct way to make a replica to prevent this issue, or what config I missed? Thanks a lot -- View this message in context: http://luce

Re: Constantly high disk read access (40-60M/s)

2014-12-01 Thread Po-Yu Chuang
Hi all, Thanks for all your suggestions. Looks like I have to add a lot of RAM or use SSD to hold my index data eventually. For now, I am trying to reduce the size of the index data by removing unnecessary fields and set stored="false" for some fields. Thanks, Po-Yu On Mon, Dec 1, 2014 at 10:20

Re: SOLR Join Query, Use highest weight.

2014-12-01 Thread Mikhail Khludnev
Hello, AFAIK {!join} doesn't supply any meaningful scores. I can suggest https://issues.apache.org/jira/browse/SOLR-6234 On Tue, Dec 2, 2014 at 4:35 AM, Darin Amos wrote: > Hello, > > I had sent an email a few days ago talking about implementing a custom > rollup query component. I have changed

Re: Constantly high disk read access (40-60M/s)

2014-12-01 Thread Otis Gospodnetic
Po-Yu, To add what others have said: * Your query cache is clearly not serving its purpose, so you are just wasting your heap on it. Consider disabling it. * That's a pretty big index. Do your queries really always have to go against the whole index? Are there multiple "tenants" in this index t

Re: Standardized index metrics (Was: Constantly high disk read access (40-60M/s))

2014-12-01 Thread Otis Gospodnetic
Hi, On Sat, Nov 29, 2014 at 2:27 PM, Michael Sokolov < msoko...@safaribooksonline.com> wrote: > On 11/29/14 1:30 PM, Toke Eskildsen wrote: > >> Michael Sokolov [msoko...@safaribooksonline.com] wrote: >> >>> I wonder if there's any value in providing this metric (total index size >>> - stored fiel

SOLR Join Query, Use highest weight.

2014-12-01 Thread Darin Amos
Hello, I had sent an email a few days ago talking about implementing a custom rollup query component. I have changed directions a little bit because I have learned about the JoinQuery. I have an index that contains a combination of parent and child documents. The parent child relationship is a

Re: Large fields storage

2014-12-01 Thread Jack Krupansky
In particular, if they are image-intensive, all the images go away. And the formatting as well. -- Jack Krupansky -Original Message- From: Ahmet Arslan Sent: Monday, December 1, 2014 6:02 PM To: solr-user@lucene.apache.org Subject: Re: Large fields storage Hi Avi, I assume your docu

Re: Large fields storage

2014-12-01 Thread Erick Erickson
I really have to question the utility of this. The doc will match a _lot_ of queries, but I guess they'll be scored quite low due to length normalization. And even if the user does decide to click on the document, are they going to then download a bigger than 1G document? All in all, your concern

Re: TrieLongField not store large longs correctly

2014-12-01 Thread Chris Hostetter
See also SOLR-6364 and the suggestion there to jave an optional "json.long=[num|text]" param for clients that want solr to return longs as a quoted string values rather then as raw JSON numbers... https://issues.apache.org/jira/browse/SOLR-6364 ...would probably be fairly trivial to implement

Re: Large fields storage

2014-12-01 Thread Ahmet Arslan
Hi Avi, I assume your documents are rich documents like pdf word, am I correct? When you extract textual content from them, their size will shrink. Ahmet On Tuesday, December 2, 2014 12:11 AM, Avishai Ish-Shalom wrote: Hi all, I have very large documents (as big as 1GB) which i'm indexing a

Large fields storage

2014-12-01 Thread Avishai Ish-Shalom
Hi all, I have very large documents (as big as 1GB) which i'm indexing and planning to store in Solr in order to use highlighting snippets. I am concerned about possible performance issues with such large fields - does storing the fields require additional RAM over what is required to index/fetch/

Re: Different update handlers for auto commit configuration

2014-12-01 Thread Chris Hostetter
: I thought that the auto commit is per update handler because they are : configured within the update handler tag. is not the same thing as a that does updates. there can be many "Update request handlers" configured, but there is only ever one in a SolrCore. -Hoss http://www.lucidworks.

Re: Schemaless configuration using 4.10.2/API returning 404

2014-12-01 Thread nbosecker
Perfect - the web.xml configuration was exactly what was missing. Thanks so much! ;) -- View this message in context: http://lucene.472066.n3.nabble.com/Schemaless-configuration-using-4-10-2-API-returning-404-tp4167869p4171932.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Contextual search

2014-12-01 Thread Mikhail Khludnev
Doesn't it seem like WordBreakSolrSpellChecker mentioned at http://wiki.apache.org/solr/SpellCheckComponent? On Mon, Dec 1, 2014 at 5:46 PM, ASHOK SARMAH wrote: > Hii all .i wanted to know how solr performs contextual search.actually in > my search list i had given the query as "three book".i go

Re: What is the new startup procedure following: SOLR-3619?

2014-12-01 Thread Joel Bernstein
Thanks Alex. Updating again did the trick. Joel Bernstein Search Engineer at Heliosearch On Mon, Dec 1, 2014 at 12:28 PM, Alexandre Rafalovitch wrote: > On 1 December 2014 at 12:14, Joel Bernstein wrote: > > SolrConfigRestApi > Do it again: https://issues.apache.org/jira/browse/SOLR-6476 > > R

Re: What is the new startup procedure following: SOLR-3619?

2014-12-01 Thread Alexandre Rafalovitch
On 1 December 2014 at 12:14, Joel Bernstein wrote: > SolrConfigRestApi Do it again: https://issues.apache.org/jira/browse/SOLR-6476 Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources and newsletter: http://www.solr-start.com/ and @solrstart Solr popularizers c

What is the new startup procedure following: SOLR-3619?

2014-12-01 Thread Joel Bernstein
Not having much luck starting Solr in trunk with the new startup scripts. I've scanned the README's but I'm not seeing anything definitive on the how startup works. Here is the steps I took: 1) Updated trunk 2) Ran: ant compile; ant dist; ant example; 3) Ran: bin/solr start 4) This error appears

Getting the position of a word via Solr API

2014-12-01 Thread adfel70
Hi, I am trying to retrieve from Solr API the position of a word from a text field that was indexes but not stored. I am storing the text field in an external repository and trying to do the Solr built-in snippet function by myself, outside Solr. Basically, all I need is to get from Solr the actu

Re: Shingles from sentences

2014-12-01 Thread Alexandre Rafalovitch
Maybe every sentence should be a value in a multi-valued field? Then, they are spaced out 100 (as configured) tokens apart and not shingled. Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources and newsletter: http://www.solr-start.com/ and @solrstart Solr popular

Re: Start With and contain search

2014-12-01 Thread Alexandre Rafalovitch
Sounds like a straight-up case on putting NgramFitlerFactory in the index (but not query) part of the type definition chain: http://www.solr-start.com/info/analyzers/#NGramFilterFactory Make sure to play with the Analysis screen of the AdminUI, it will show you what happens on indexing and search.

Start With and contain search

2014-12-01 Thread melb
Hi, I am new in Solr, I have a solr collection with domain names and I want to be able to search in domains the search can give me the domains which begin with the query term or contain it example: query : dom results: domain1 domain2 predommain domainsuffix rgds, -- View this message

Re: Schemaless configuration using 4.10.2/API returning 404

2014-12-01 Thread Stefan Moises
Hi, I've had the same problem - double-check your web.xml and make sure, all the required REST stuff is in there, that is: ... SolrRestApi org.restlet.ext.servlet.ServerServlet org.restlet.application org.apache.solr.rest.SolrSchemaRestApi SolrConfigRestApi org

Re: Contextual search

2014-12-01 Thread Alexandre Rafalovitch
If you need Solr to treat 'thri' (invalid English) as 'three', you need to tell it to do so. Look at the synonym modules in the example's schema.xml. Or you could do phonetic matches. You have a couple of choices for those, but basically it's all about the specific analyzer chains to experiment wi

Shingles from sentences

2014-12-01 Thread vit
I have a text consisting from sentences. Which analyzer can I use to restrict creating shingles from sentences. Meaning a shingle cannot have parts from two neighbor sentences. -- View this message in context: http://lucene.472066.n3.nabble.com/Shingles-from-sentences-tp4171834.html Sent from

Contextual search

2014-12-01 Thread ASHOK SARMAH
Hii all .i wanted to know how solr performs contextual search.actually in my search list i had given the query as "three book".i got the suggestn as "a book of three".which i wanted.but when i specify it as "thri book".it specifies me of spelling check for thri as three its fyn.but why i dont get i

Re: Different update handlers for auto commit configuration

2014-12-01 Thread danny teichthal
Thanks for the reply Erik, I thought that the auto commit is per update handler because they are configured within the update handler tag. >From a little debugging on SOLR code and it looked as if the Commit Tracker will schedule a soft commit on update if it gets commitwithin value, and if not it