Re: Sorting Problem with custom ValueSourceParser

2016-11-02 Thread Tirthankar
@Rohit you can look into this. http://www.javaworld.com/article/2074996/hashcode-and-equals-method-in-java-object---a-pragmatic-concept.html A good article for hashcode and equals -- View this message in context: http://lucene.472066.n3.nabble.com/Sorting-Problem-with-custom-ValueSourceParser

Solr5.5:DocValues/CopyField does not work with Atomic updates

2016-04-21 Thread Tirthankar Chatterjee
Hi, Here is the scenario for SOLR5.5: FieldA type= stored=true indexed=true FieldB type= stored=false indexed=true docValue=true usedocvalueasstored=false FieldA copyTo FieldB Try an Atomic update and we are getting this error: possible analysis error: DocValuesField "mtmround" appears more t

Re: Parallel SQL / calcite adapter

2015-11-20 Thread Tirthankar Chatterjee
We are implementing a JDBC driver on drill with Solr as a storage plugin The code had been here and we need help if anyone can contribute doing a code review and performance testing https://github.com/apache/drill/pull/201/files Thanks, Tirthankar On Nov 20, 2015, at 12:25 PM, William Bell

Re: schema / config file names

2014-07-02 Thread Tirthankar Chatterjee
role_schema.xml and then fire up cores for each of these role. Is there a better way to solve this issue? Thanks Tirthankar > On 02-Jul-2014, at 10:22 pm, "Chris Hostetter" > wrote: > > > : Is it required for the schema.xml and solrconfig.xml to have those exact &g

Re: “ClientAbortException: java.io.IOException” in solr query error

2014-05-25 Thread Tirthankar
But this exception could be thrown by SOLRJ which is a client to the SOLR server. Isn't that possible. -- View this message in context: http://lucene.472066.n3.nabble.com/ClientAbortException-java-io-IOException-in-solr-query-error-tp4082321p4138093.html Sent from the Solr - User mailing list

Re: Swapping Cores

2013-11-20 Thread Tirthankar Chatterjee
, Shawn Heisey wrote: > On 11/19/2013 10:18 PM, Tirthankar Chatterjee wrote: >> I have a site that I crawl and host the index. The web site has changes >> every month which requires it to re-crawl. Now there is a new SOLR index >> that is created. How effectively can I swap

Swapping Cores

2013-11-19 Thread Tirthankar Chatterjee
but once due to any reason tomcat is restarted the temp core data is gone after the restart. Is there a way we dont lose the new index after the swap. Thanks, Tirthankar ***Legal Disclaimer*** "This communication may contain confidentia

Re: opinion: Stats over the faceting component

2013-03-20 Thread Tirthankar Chatterjee
We have done something similar. Please read http://lucene.472066.n3.nabble.com/How-to-modify-Solr-StatsComponent-to-support-stats-query-td4028991.html https://plus.google.com/101157854606139706613/posts/HmYYit3RABM If this is something you wanted. On Mar 20, 2013, at 7:08 PM, Anirudha Jadhav wro

Re: Migrating solr 3.6 to solr 4.0

2012-12-03 Thread Tirthankar Chatterjee
can you paste the content of solr.xml On Dec 4, 2012, at 1:26 AM, Shaveta_Chawla wrote: > Hi, > > I had solr3.6 installed on my system, now i am migrating my solr3.6 to > solr4.0. but i am getting the error > > SEVERE: Unable to create core: collection1 > java.io.IOException: Can't find resourc

Re: Scalability of Solr Result Grouping/Field Collapsing: Millions/Billions of documents?

2012-08-22 Thread Tirthankar Chatterjee
at 4:10 PM, Tirthankar Chatterjee wrote: > This wont work, see my thread on Solr3.6 Field collapsing > Thanks, > Tirthankar > > -Original Message- > From: Tom Burton-West > Date: Tue, 21 Aug 2012 18:39:25 > To: solr-user@lucene.apache.org > Reply-To: "s

Re: Scalability of Solr Result Grouping/Field Collapsing: Millions/Billions of documents?

2012-08-21 Thread Tirthankar Chatterjee
This wont work, see my thread on Solr3.6 Field collapsing Thanks, Tirthankar -Original Message- From: Tom Burton-West Date: Tue, 21 Aug 2012 18:39:25 To: solr-user@lucene.apache.org Reply-To: "solr-user@lucene.apache.org" Cc: William Dueber; Phillip Farber Subject: Scalabili

Re: SOLR3.6:Field Collapsing/Grouping throws OOM

2012-08-16 Thread Tirthankar Chatterjee
Awesome, you rock !!!. Thanks to Eric too for coming up with the ideas. But honestly I am more interested to know this EFF concept. I will do my reading and then throw up questions if I don't get it. External File Field and function queries are something which i have not evaluated yet, but I a

Re: SOLR3.6:Field Collapsing/Grouping throws OOM

2012-08-15 Thread Tirthankar Chatterjee
ine here is I don't think grouping is a good approach for this problem.... Best Erick On Wed, Aug 15, 2012 at 5:04 AM, Tirthankar Chatterjee wrote: > Hi Erick, > You are so right on the memory calculations. I am happy that I know now that > I was doing something wrong. Yes I am gett

Re: SOLR3.6:Field Collapsing/Grouping throws OOM

2012-08-15 Thread Tirthankar Chatterjee
actually feels like an XY problem, can you back up and let us know what the use-case you're trying to solve is? Perhaps there are less memory- consumptive solutions possible. Best Erick On Tue, Aug 14, 2012 at 6:38 AM, Tirthankar Chatterjee wrote: > Editing the query...remove I don'

Re: SOLR3.6:Field Collapsing/Grouping throws OOM

2012-08-14 Thread Tirthankar Chatterjee
Editing the query...remove I don't know where it came from while I did copy/paste.... Tirthankar Chatterjee wrote: Hi, I have a beefy box with 24Gb RAM (12GB for Tomcat7 which houses SOLR3.6) 2 Processors Intel Xeon 64 bit Server, 30TB HDD. JDK 1.7.0_03 x64 bit Data Index Dir Size:

SOLR3.6:Field Collapsing/Grouping throws OOM

2012-08-13 Thread Tirthankar Chatterjee
Hi, I have a beefy box with 24Gb RAM (12GB for Tomcat7 which houses SOLR3.6) 2 Processors Intel Xeon 64 bit Server, 30TB HDD. JDK 1.7.0_03 x64 bit Data Index Dir Size: 400GB Metadata of files is stored in it. I have around 15 schema fields. Total number of items:150million approx. I have a sce

Re: curl or nutch

2012-05-16 Thread Tirthankar Chatterjee
disadvantage. You can look at Aperture, Manifold CF frameworks for comparing with nutch. Thanks, Tirthankar Sent from handheld - Original Message - From: Tolga [mailto:to...@ozses.net] Sent: Wednesday, May 16, 2012 03:43 AM To: solr-user@lucene.apache.org ; u...@nutch.apache.org Subject

Re: Solr 3.5 takes very long to commit gradually

2012-04-12 Thread Tirthankar Chatterjee
thanks Rohit.. for the information. On Apr 12, 2012, at 4:08 AM, Rohit wrote: > Hi Tirthankar, > > The average size of documents would be a few Kb's this is mostly tweets > which are being saved. The two cores are storing different kind of data and > nothing else. > >

Re: Solr 3.5 takes very long to commit gradually

2012-04-12 Thread Tirthankar Chatterjee
Hi Rohit, Can you please check the solrconfig.xml in 3.5 and compare it with 3.1 if there are any warming queries specified while opening the searchers after a commit. Thanks, Tirthankar On Apr 12, 2012, at 3:30 AM, Tirthankar Chatterjee wrote: > Hi Rohit, > What would be the average s

Re: Solr 3.5 takes very long to commit gradually

2012-04-12 Thread Tirthankar Chatterjee
Hi Rohit, What would be the average size of your documents and also can you please share your idea of having 2 cores in the master. I just wanted to know the reasoning behind the design. Thanks in advance Tirthankar On Apr 12, 2012, at 3:19 AM, Jan Høydahl wrote: > What operating sys

Re: which mergePolicy

2012-03-18 Thread Tirthankar Chatterjee
Hi, Do you see any issues with the default one. On Mar 18, 2012, at 6:10 AM, Messpero wrote: > hi everyone, > > i have a big index (~100 GB, ~55 documents) with 200 fields per > document. I search with large queries, that's the reason why i must change > the value of maxBooleanClauses to 8

RE: NRT and commit behavior

2011-09-21 Thread Tirthankar Chatterjee
Okay, but is there any number that if we reach on the index size or total docs in the index or the size of physical memory that sharding should be considered. I am trying to find the winning combination. Tirthankar -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com

RE: NRT and commit behavior

2011-09-14 Thread Tirthankar Chatterjee
Erick, Also, we had our solrconfig where we have tried increasing the cache making the below value for autowarm count as 0 helps returning the commit call within the second, but that will slow us down on searches -Original Message- From: Tirthankar

RE: NRT and commit behavior

2011-09-14 Thread Tirthankar Chatterjee
e what the bottleneck is (I/O, CPU, etc?). What else is running on your machine? It's quite surprising that it takes that long. How much memory are you giving the JVM? etc... You might want to review: http://wiki.apache.org/solr/UsingMailingLists Best Erick On Fri, Sep 9, 2011 at 9:41

RE: Alias name for a index field

2011-09-09 Thread Tirthankar Chatterjee
handled in Solr. Erik On Sep 9, 2011, at 09:59 , Tirthankar Chatterjee wrote: > Hi, > Is there a way that we can give an alias name for a field so that the schema > is not required to change. > > Use Case: We defined the schema with a field called "conv" (basica

Alias name for a index field

2011-09-09 Thread Tirthankar Chatterjee
e Solution: Use copy field but that definitely takes some resource, instead can we have something like an alias name, so a field can have multiple alias names which different users from geographical regions can use for doing fielded search. Let us know what you thinkor if a JIRA already exists.

RE: NRT and commit behavior

2011-09-09 Thread Tirthankar Chatterjee
good resourced hardware with multiple processors and 16gb RAM 64 bit VM, etc. We tried passing waitSearcher as false and found that inside the code it hard coded to be true. Is there any specific reason. Can we change that value to honor what is being passed. Thanks, Tirthankar -Original Message--

RE: Document Size for Indexing

2011-09-06 Thread Tirthankar Chatterjee
0MB's. We see failure in the large size files. We are indexing 100 such documents in one batch. I will get you the stack trace soon. Thanks, Tirthankar -Original Message- From: simon [mailto:mtnes...@gmail.com] Sent: Wednesday, August 31, 2011 3:29 PM To: solr-user@lucene.

RE: very slow commits and overlapping commits

2011-08-31 Thread Tirthankar Chatterjee
Try looking at your warming queries. Create a warming query that will not return ay results. See if it helps returning commits faster. Thx -Original Message- From: Bill Au [mailto:bill.w...@gmail.com] Sent: Friday, May 27, 2011 3:47 PM To: solr-user@lucene.apache.org Subject: Re: very

RE: NRT and commit behavior

2011-08-31 Thread Tirthankar Chatterjee
er. Are we doing something wrong here? Thanks, Tirthankar -Original Message- From: Jonathan Rochkind [mailto:rochk...@jhu.edu] Sent: Monday, July 18, 2011 11:38 AM To: solr-user@lucene.apache.org; yo...@lucidimagination.com Subject: Re: NRT and commit behavior In practice, in my experienc

RE: Document Size for Indexing

2011-08-31 Thread Tirthankar Chatterjee
I am using 64 bit JVM and we are going out of memory in extraction phase where TIKA assigns the content after extracting to SOLRInputDocument in the pipeline which gets loaded in memory. We are using released 3.1 version of SOLR. Thanks, Tirthankar -Original Message- From: simon

Document Size for Indexing

2011-08-30 Thread Tirthankar Chatterjee
Hi, I have a machine (win 2008R2) with 16GB RAM, I am having issue indexing 1/2GB files. How do we avoid creating a SOLRInputDocument or is there any way to directly use Lucene Index writer classes. What would be the best approach. We need some suggestions. Thanks, Tirthankar

Re: Using Edismax

2011-06-14 Thread Tirthankar Chatterjee
hanges. So you're > getting "2010" indexed as a separate token and > you're also searching on it... > > Best > Erick > > On Mon, Jun 13, 2011 at 3:07 PM, Tirthankar Chatterjee > wrote: >> We are using edismax for query and the query fired is (url

RE: Using Edismax

2011-06-13 Thread Tirthankar Chatterjee
There is an (underscore) character before 2010 -Original Message- From: Tirthankar Chatterjee [mailto:tchatter...@commvault.com] Sent: Monday, June 13, 2011 3:08 PM To: solr-user@lucene.apache.org Subject: Using Edismax We are using edismax for query and the query fired is (url:_2010

Using Edismax

2011-06-13 Thread Tirthankar Chatterjee
2&start=0&rows=10&indent=on&defType=edismax> the url field is of type text_rev Results that SOLR returns has 1 extra item which we don't want to get. How do we achieve that? Results: SPC265_SharePoint_2010.pptx OpenTRs2010.xlsx(we don't want this to be returned) Th

RE: where is INFOSTREAM.txt located?

2011-04-06 Thread Tirthankar Chatterjee
Thanks All, I figured it out. http://lucene.472066.n3.nabble.com/general-debugging-techniques-td868300.html See the last line on this page. -Original Message- From: Tirthankar Chatterjee [mailto:tchatter...@commvault.com] Sent: Wednesday, April 06, 2011 6:15 PM To: solr-user

where is INFOSTREAM.txt located?

2011-04-06 Thread Tirthankar Chatterjee
**Legal Disclaimer*** "This communication may contain confidential and privileged material for the sole use of the intended recipient. Any unauthorized review, use or distribution by others is strictly prohibited. If you have received the message in err

RE: FW: Very very large scale Solr Deployment = how to do (Expert Question)?

2011-04-05 Thread Tirthankar Chatterjee
Hi Jen, Can you please forward the diagram attachment too that Ephraim sent. :-) Thanks, Tirthankar -Original Message- From: Jens Mueller [mailto:supidupi...@googlemail.com] Sent: Tuesday, April 05, 2011 10:30 PM To: solr-user@lucene.apache.org Subject: Re: FW: Very very large scale