Re: Timeout when deleting collections or aliases in Solr 4.6.1

2014-03-28 Thread Shalin Shekhar Mangar
Hi Dave, Three things to note: 1. The default timeout of 60s has been raised to 3 minutes in 4.7. Unfortunately, the timeout if not configurable. 2. The timeout happens because these commands execute on the overseer collection processor (actually the same node as overseer) in a single thread. So i

Re: SolrCloud 4.6.1 hanging

2014-03-28 Thread Mark Miller
I'm looking into a hang as well - not sure of it involves searching as well, but it may. Can you file a JIRA issue - let's track it down. - Mark > On Mar 28, 2014, at 8:07 PM, Rafał Kuć wrote: > > Hello! > > I have an issue with one of the SolrCloud deployments and I wanted to > ask maybe so

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Shawn Heisey
On 3/28/2014 4:07 PM, Rishi Easwaran wrote: > > Shawn, > > I changed the autoSoftCommit value to 15000 (15 sec). > My index size is pretty small ~4GB and its running on a SSD drive with ~100 > GB space on it. > Now I see the warn message every 15 seconds. > > The caches I think are minimal >

SolrCloud 4.6.1 hanging

2014-03-28 Thread Rafał Kuć
Hello! I have an issue with one of the SolrCloud deployments and I wanted to ask maybe someone had a similar issue. Six machines, a collection with 6 shards with a replication factor of 3. It all runs on 6 physical servers, each with 24 cores. We've indexed about 32 milion documents and everything

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Rishi Easwaran
Shawn, I changed the autoSoftCommit value to 15000 (15 sec). My index size is pretty small ~4GB and its running on a SSD drive with ~100 GB space on it. Now I see the warn message every 15 seconds. The caches I think are minimal 200 I think still something is going on. I mean 15s on

Re: zookeeper reconnect failure

2014-03-28 Thread Michael Della Bitta
Hi, Jessica, We've had a similar problem when DNS resolution of our Hadoop task nodes has failed. They tend to take a dirt nap until you fix the problem manually. Are you experiencing this in AWS as well? I'd say the two things to do are to poll the node state via HTTP using a monitoring tool so

Re: SolrJ partial document updates

2014-03-28 Thread Yonik Seeley
There's a small SolrJ example at the bottom of this page: http://heliosearch.org/solr/atomic-updates/ -Yonik http://heliosearch.org - solve Solr GC pauses with off-heap filters and fieldcache On Fri, Mar 28, 2014 at 2:48 PM, Jamie Johnson wrote: > I would like to begin exploring partial documen

Re: Timeout when deleting collections or aliases in Solr 4.6.1

2014-03-28 Thread Dave Seltzer
I just wanted to bump my question in hopes that someone would see it. Does anyone know how I might track down the cause of this timeout, or perhaps extend the timeout? -D On Thu, Mar 27, 2014 at 11:21 AM, Dave Seltzer wrote: > I'm trying to delete some data on a 12 node Solr cloud environment

zookeeper reconnect failure

2014-03-28 Thread Jessica Mallet
Hi, First off, I'd like to give a disclaimer that this probably is a very edge case issue. However, since it happened to us, I would like to get some advice on how to best handle this failure scenario. Basically, we had some network issue where we temporarily lost connection and DNS. The zookeepe

RE: commit=false in Solr update URL

2014-03-28 Thread Joshi, Shital
Thank you! -Original Message- From: Shawn Heisey [mailto:s...@elyograg.org] Sent: Friday, March 28, 2014 3:14 PM To: solr-user@lucene.apache.org Subject: Re: commit=false in Solr update URL On 3/28/2014 1:02 PM, Joshi, Shital wrote: > You mean default for openSearcher is false right? So

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Dmitry Kan
And in addition, if you begin to see more onDeckSearchers warming up simultaneously, just bumping up maxWarmingSearchers is only postponing the proper core problem solution [1] We have been through this ourselves! http://wiki.apache.org/solr/SolrPerformanceProblems#Slow_commits On Fri, Mar 28,

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Shawn Heisey
On 3/28/2014 1:03 PM, Rishi Easwaran wrote: I thought auto soft commit was for NRT search (shouldn't it be optimized for search performance), if i have to wait 10 mins how is it NRT? or am I missing something? You are correct, but once a second is REALLY often. If the rest of your config is

Re: Update single field through SolrJ

2014-03-28 Thread Shawn Heisey
On 3/28/2014 1:02 PM, Jean-Sebastien Vachon wrote: I`d like to know how (it is possible) to update a field`s value using SolrJ. I looked at the API and could not figure it out so for now I'm using the UpdateHandler by sending it a JSON formatted document illustrating the required changes. Is

Re: commit=false in Solr update URL

2014-03-28 Thread Shawn Heisey
On 3/28/2014 1:02 PM, Joshi, Shital wrote: You mean default for openSearcher is false right? So unless I specify commit=false&openSearcher=true in my Solr Update URL the current searcher and caches will not get invalidated. If commit=false, openSearcher does not matter -- it's part of a commi

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Rishi Easwaran
Hi Dmitry, I thought auto soft commit was for NRT search (shouldn't it be optimized for search performance), if i have to wait 10 mins how is it NRT? or am I missing something? Thanks, Rishi. -Original Message- From: Dmitry Kan To: solr-user Sent: Fri, Mar 28, 2014 1:02 pm Subj

Update single field through SolrJ

2014-03-28 Thread Jean-Sebastien Vachon
Hi All, I`d like to know how (it is possible) to update a field`s value using SolrJ. I looked at the API and could not figure it out so for now I'm using the UpdateHandler by sending it a JSON formatted document illustrating the required changes. Is there a way to do the same through SolrJ?

RE: commit=false in Solr update URL

2014-03-28 Thread Joshi, Shital
Thanks. You mean default for openSearcher is false right? So unless I specify commit=false&openSearcher=true in my Solr Update URL the current searcher and caches will not get invalidated. -Original Message- From: Shawn Heisey [mailto:s...@elyograg.org] Sent: Friday, March 28, 2014 1

SolrJ partial document updates

2014-03-28 Thread Jamie Johnson
I would like to begin exploring partial document updates, but I have not seen any documentation that would indicate that SolrJ supports this, are there any documents describing how to do this or if it's even supported?

Fwd: Product index schema for solr

2014-03-28 Thread Ajay Patel
Hi Solr user & developers. i am new in the world of solr search engine. i have a complex product database structure in postgres. Product has many product_quantity_price attrbutes in range For e.g Product iD 1 price range is stored in product_quantity_price table in following manner. min_qty

Re: Enabling other SimpleText formats besides postings

2014-03-28 Thread Michael McCandless
You told the fieldType to use SimpleText only for the postings, not all other parts of the codec (doc values, live docs, stored fields, etc...), and so it used the default codec for those components. If instead you used the SimpleTextCodec (not sure how to specify this in Solr's schema.xml) then a

(Date) Range faceting issue when start = end

2014-03-28 Thread Thibaut Rizzi
Hello all, I'm not sure if I am missing something of if this is a bug but I am facing an issue with the following scenario. I am doing a range faceting on a date field with the following parameters : facet.range.start = facet.range.end = a date facet.range.gap = +1YEAR facet.range.hardend = tr

Re: Block until replication finishes

2014-03-28 Thread Fermin Silva
Hi, that's what I'm trying. I'm however really cautious when it comes to a while (somethingIsTrue) { doSomething; sleep; } Is that safe? What if the slave hungs up, the network is slow/fails, etc? Thanks On Thu, Mar 27, 2014 at 1:40 PM, Chris W wrote: > Hi > > You can use the "details"

Search in URL

2014-03-28 Thread Cool Techi
Hi, We have several tweets stored in our system which are of the following nature, https://twitter.com/SharFairies/status/448992742257881088 I am searching for keywords like starcinema or abs-cbn.com, but these results are not returned, how can I search in this setup. My field type is defined

Re: commit=false in Solr update URL

2014-03-28 Thread Shawn Heisey
On 3/28/2014 10:22 AM, Joshi, Shital wrote: What happens when we use commit=false in Solr update URL? http://$solr_url/solr/$solr_core/update/csv?commit=false&separator=|&trim=true&skipLines=2&_shard_=$shardid 1. Does it invalidate all caches? We really need to know this. 2. Nothing

Re: how do I get search for "fort st john" to match "ft saint john"

2014-03-28 Thread solr-user
yes, and I can see that (as expected) per the field type: 1. the indexed value is lowercased 2. stripped of non-alpha characters 3. multiple consecutive whitespace is removed 4. trimmed 5. goes thru the SynonymFilterFactory where: a. the indexed value of "Marina/Former Fort Ord" is "marina former

Re: (Date) Range faceting issue when start = end

2014-03-28 Thread Chris Hostetter
: I'm not sure if I am missing something of if this is a bug but I am facing an : issue with the following scenario. The specific scnerios you are descirbing is an interesting edge case -- but i believe it's working as designed. basically the range generation logic that computes the set of "(lo

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Dmitry Kan
Hi Rishi, Do you really need soft-commit every second? Can you make it 10 mins, for example? What is happening (conditional on checking your logs) is that several commits (looks like 2 in your case) are arriving in a quick succession. Then system is starting to warmup the searchers, one per each

commit=false in Solr update URL

2014-03-28 Thread Joshi, Shital
Hi, What happens when we use commit=false in Solr update URL? http://$solr_url/solr/$solr_core/update/csv?commit=false&separator=|&trim=true&skipLines=2&_shard_=$shardid 1. Does it invalidate all caches? We really need to know this. 2. Nothing happens to existing searcher, correct? 3

Re: Question on highlighting edgegrams

2014-03-28 Thread Software Dev
Shalin, I am running 4.7 and seeing this behavior :( On Thu, Mar 27, 2014 at 10:36 PM, Shalin Shekhar Mangar wrote: > Yes, there are known bugs with EdgeNGram filters. I think they are fixed in > 4.4 > > See https://issues.apache.org/jira/browse/LUCENE-3907 > > On Fri, Mar 28, 2014 at 10:17 AM,

Re: Block until replication finishes

2014-03-28 Thread Chris W
You can use a timeout? In our system we do that same but with a timeout of around 30 minutes for any replication to slave completes. So far any replication > 30 minutes (even for cores as big as 10G) indicated a problem with a core or network on our side On Fri, Mar 28, 2014 at 6:43 AM, Fermin

Re: Please help: Problems adding a document to the solr collection

2014-03-28 Thread Alexandre Rafalovitch
Grep for uuid in config directory. It's probably in solrconfig.xml especially if you have dedup chain. Regards, Alex On 28/03/2014 7:52 pm, "Silvia Suárez" wrote: > Dear all: > > I'm trying to add a solr document into the solr collection. The code that I > am using is like this: > > public

Solr CoreAdmin RELOAD + Properties

2014-03-28 Thread David Stuart
Hey, In the Solr CoreAdmin CREATE action you have the ability to define arbitrary properties by defining propery.[name] = value, this works well in both Solr 3.x and Solr 4.x. To change a property value on a core in Solr 3.x you could run the CREATE command again and this would overwrite the va

Enabling other SimpleText formats besides postings

2014-03-28 Thread Ken Krugler
Hi all, I've been using the SimpleTextCodec in the past, but I just noticed something odd… I'm running Solr 4.3, and enable the SimpleText posting format via something like: The resulting index does have the expected _0_SimpleText_0.pst text output, but I just noticed that the other fil

Please help: Problems adding a document to the solr collection

2014-03-28 Thread Silvia Suárez
Dear all: I'm trying to add a solr document into the solr collection. The code that I am using is like this: public static void addDocuments (HttpSolrServer serverCore2) throws SolrServerException, IOException { SolrInputDocument doc1 = new SolrInputDocument(); doc1.addField( "c_noticia", "

Context-aware suggesters in Solr

2014-03-28 Thread Alan Woodward
Hi all, I have a few of questions about the context-aware AnalyzingInfixSuggester: - is it possible to choose a specific field for the context at runtime (say, I want to limit suggestions by a field that I've already faceted on), or is it limited to the hardcoded CONTEXTS_FIELD_NAME? - is the co

Block Join Parent Query across children docs

2014-03-28 Thread mertens
Hello Solr Users, In my system I have multiple records belonging to users, and I need to perform a query to find users who have records that meet the criteria of that query. For example, if my record has the field "search" and I query for search:((item1 AND item2) NOT item3), I want to find all us