Commit Issue in Solr 3.4

2014-02-06 Thread samarth s
Hi, I have been using the solr version 3.4 in a project for about more than a year. It is only now that I have started facing a weird problem of never ending back to back commit cycles. I can say this looking at the InfoStream logs, that, as soon as one commit cycle is done with another one almost

Re: Commit Issue in Solr 3.4

2014-02-08 Thread samarth s
ot; wrote: > On 2/6/2014 9:56 AM, samarth s wrote: > > Size of index = 260 GB > > Total Docs = 100mn > > Usual writing speed = 50K per hour > > autoCommit-maxDocs = 400,000 > > autoCommit-maxTime = 1500,000 (25 mins) > > merge factor = 10 > > > > M/c

Sum as a Projection for Facet Queries

2013-07-01 Thread samarth s
Hi, We have a need of finding the sum of a field for each facet.query. We have looked at StatsComponent but that supports only facet.field. Has anyone written a patch over StatsComponent that supports the same along with some performance measures? Is t

Re: updateLog in Solr 4.2

2013-04-14 Thread samarth s
I have a similar problem on this one. The reason for this is my application performs back to back updates. And, as came out of my performance tests, the update immediately after the first one, seems to be a lot slower than as compared to not having any update logs. Is this a genuine case, or did I

Solr Open File Descriptors

2011-10-16 Thread samarth s
Hi, Is it safe to assume that with a megeFactor of 10 the open file descriptors required by solr would be around (1+ 10) * 10 = 110 ref: *http://onjava.com/pub/a/onjava/2003/03/05/lucene.html#indexing_speed* Solr wiki: http://wiki.apache.org/solr/SolrPerformanceFactors#Optimization_Considerationss

Re: Solr Open File Descriptors

2011-10-22 Thread samarth s
Thanks for sharing your insights shawn On Mon, Oct 17, 2011 at 1:27 AM, Shawn Heisey wrote: > On 10/16/2011 12:01 PM, samarth s wrote: > >> Hi, >> >> Is it safe to assume that with a megeFactor of 10 the open file >> descriptors >> required by solr would

Too many connections in CLOSE_WAIT state on master solr server

2011-12-13 Thread samarth s
Hi, I am using solr replication and am experiencing a lot of connections in the state CLOSE_WAIT at the master solr server. These disappear after a while, but till then the master solr stops responding. There are about 130 open connections on the master server with the client as the slave m/c and

Re: Too many connections in CLOSE_WAIT state on master solr server

2011-12-13 Thread samarth s
ould be chosen considering >> the number of connection you'd like to keep alive. >> >> Let me know if it works for you. >> >> On Tue, Dec 13, 2011 at 2:57 PM, samarth s >> wrote: >> >>> Hi, >>> >>> I am using solr replica

Re: Too many connections in CLOSE_WAIT state on master solr server

2011-12-14 Thread samarth s
lose, so Mikhail's suggestion > seems like a good idea. > > Best > Erick > > On Wed, Dec 14, 2011 at 12:28 AM, samarth s > wrote: >> The updates to the master are user driven, and are needed to be >> visible quickly. Hence, the high frequency of replication. It may b

Dynamically create new core

2010-11-02 Thread samarth s
Hi, I have a requirement of dynamically creating new cores(master). Each core should have a replicated slave core. I am working with Java and using SolrJ as my solr client. I came across CoreAdminRequest class and looks like the way to go. CoreAdminRequest.createCore("NewCore1", "NewCore1", solr

Re: Atomicity of commits (soft OR hard) across replicas - Solr Cloud

2013-01-07 Thread samarth s
with > the failing node). > > The local commit operation in one node *is* atomic. > > Tomás > > > On Mon, Dec 31, 2012 at 7:04 AM, samarth s >wrote: > > > Tried reading articles online, but could not find one that confirmed the > > same 100% :)

Error on using the projection parameter - fl - in Solr 4

2013-01-08 Thread samarth s
Hi all, I am in a process of migrating my application from Solr 3.6 to Solr 4. A query that used to work is giving an error with Solr 4. The query looks like: q=*:*&fl=E_abc@@xyz The error displayed on the admin page is: can not use FieldCache on multivalued field: E_abc The field printed in th

Re: Error on using the projection parameter - fl - in Solr 4

2013-01-26 Thread samarth s
#x27; symbols in it? If it worked in 3.6, > it was probably not intentional, classic "undocumented behavior". > > The first thing I'd try is replacing the @ with __ in my schema... > > Best > Erick > > On Tue, Jan 8, 2013 at 6:58 AM, samarth s >wrote: > > > q=*:*&fl=E_abc@@xyz > -- Regards, Samarth

Request Timeout Parameter in update queries

2012-03-16 Thread samarth s
Hi, Does an update query to solr work well when sent with a timeout parameter ? https://issues.apache.org/jira/browse/SOLR-502 For example, consider an update query was fired with a timeout of 30 seconds, and the request got aborted half way due to the timeout. Can this corrupt the index in any wa

Re: Too many connections in CLOSE_WAIT state on master solr server

2012-03-18 Thread samarth s
t; regards > Ranveer > > > > On Thursday 15 December 2011 11:30 AM, samarth s wrote: >> >> Thanks Erick and Mikhail. I'll try this out. >> >> On Wed, Dec 14, 2011 at 7:11 PM, Erick Erickson >>  wrote: >>> >>> I'm guessing (and it&#x

Re: solr dynamic core creation

2010-11-21 Thread samarth s
Hi nizan, I have the same requirement of creating cores on the fly. Was looking for some API provided by http solr server. Currently working around by writing my own shell script on the server (solr server :) ). Any better leads on the same? Thanks, Samarth On Thu, Nov 11, 2010 at 9:27 PM, Rober

Glob in fl parameter

2010-12-22 Thread samarth s
Hi, Is there any support for glob in the 'fl' param. This would be very useful in case of retrieving dynamic fields. I have read the wiki for FieldAliasesAndGlobsInParams. Is there any related patch? Thanks for any pointers, Samarth

Total number of groups after collapsing

2010-12-23 Thread samarth s
Hi, I have been using collapsing in my application. I have a requirement of finding the no of groups matching some filter criteria. Something like a COUNT(DISTINCT columnName). The only solution I can currently think of is using the query: q=*:*&rows=Integer.MAX_VALUE&start=0&fl=score&collapse.fi

Re: Total number of groups after collapsing

2010-12-23 Thread samarth s
Hi, I figured out a better way of doing it. The following query would be a better option: q=*:*&start=2147483647&rows=0&collapse=true&collapse.field=abc&collapse.threshold=1 Thanks, Samarth On Thu, Dec 23, 2010 at 8:57 PM, samarth s wrote: > Hi, > > I hav

Collapsing with start, rows parameters

2010-12-29 Thread samarth s
Hi, I am using collapsing with start & rows parameters. For start=0 & rows=10 my query looks like: q=f1:v1+AND+f2:v2&date:[*+TO+*]&rows=10&start=0&fl=rootId&collapse.field=rootId&collapse.threshold=1&collapse.type=normal&collapse.includeCollapsedDocs.fl=id The same query with start=10, gives me a

Re: exception obtaining write lock on startup

2011-01-17 Thread samarth s
In that case why is there a separate lock factory of SingleInstanceLockFactory? On Fri, Dec 31, 2010 at 6:25 AM, Lance Norskog wrote: > This will not work. At all. > > You can only have one Solr core instance changing an index. > > On Thu, Dec 30, 2010 at 4:38 PM, Tri Nguyen wrote: >> Hi, >> >>

Field Cache

2011-05-07 Thread samarth s
Hi, I have read lucene field cache is used in faceting and sorting. Is it also populated/used when only selected fields are retrieved using the 'fl' OR 'included fields in collapse' parameters? Is it also used for collapsing? -- Regards, Samarth

Solr 4.0 Beta Release

2012-09-12 Thread samarth s
Hi All, Would just like to verify if Solr 4.0 Beta has been released. Does the following url give the official beta release: http://www.apache.org/dyn/closer.cgi/lucene/solr/4.0.0-BETA -- Regards, Samarth

Re: Solr 4.0 Beta Release

2012-09-13 Thread samarth s
sky > > -Original Message- From: samarth s > Sent: Wednesday, September 12, 2012 9:54 AM > To: solr-user@lucene.apache.org > Subject: Solr 4.0 Beta Release > > > Hi All, > > Would just like to verify if Solr 4.0 Beta has been released. Does the >

Solr cloud in 4.0 with NRT performance

2012-09-14 Thread samarth s
Hi, I am currently using features like facet and group/collapse on solr 3.6. The frequency of writing is user driven, and hence is expected to be visible real time or at least near real time. These updates should be consistent in facet and group results as well. Also to handle the query load, I ma