Solr5.5:DocValues/CopyField does not work with Atomic updates

Hi, Here is the scenario for SOLR5.5: FieldA type= stored=true indexed=true FieldB type= stored=false indexed=true docValue=true usedocvalueasstored=false FieldA copyTo FieldB Try an Atomic update and we are getting this error: possible analysis error: DocValuesField "mtmround" appears more t

Re: Parallel SQL / calcite adapter

We are implementing a JDBC driver on drill with Solr as a storage plugin The code had been here and we need help if anyone can contribute doing a code review and performance testing https://github.com/apache/drill/pull/201/files Thanks, Tirthankar On Nov 20, 2015, at 12:25 PM, William Bell mail

Re: schema / config file names

Chris, We have actually done that. Our requirement was basically have a single installation of Solr to assume different roles and each role had its own changes for optimisation done on solrconfig.xml and schema.xml When we start a role we basically adapt to file role_solrconfig.xml and role_sch

Re: Swapping Cores

, Shawn Heisey wrote: > On 11/19/2013 10:18 PM, Tirthankar Chatterjee wrote: >> I have a site that I crawl and host the index. The web site has changes >> every month which requires it to re-crawl. Now there is a new SOLR index >> that is created. How effectively can I swap

Swapping Cores

Hi, I have a site that I crawl and host the index. The web site has changes every month which requires it to re-crawl. Now there is a new SOLR index that is created. How effectively can I swap the previous one with the new one with minimal downtime for search. We have tried swapping the core b

Re: opinion: Stats over the faceting component

We have done something similar. Please read http://lucene.472066.n3.nabble.com/How-to-modify-Solr-StatsComponent-to-support-stats-query-td4028991.html https://plus.google.com/101157854606139706613/posts/HmYYit3RABM If this is something you wanted. On Mar 20, 2013, at 7:08 PM, Anirudha Jadhav wro

Re: Migrating solr 3.6 to solr 4.0

can you paste the content of solr.xml On Dec 4, 2012, at 1:26 AM, Shaveta_Chawla wrote: > Hi, > > I had solr3.6 installed on my system, now i am migrating my solr3.6 to > solr4.0. but i am getting the error > > SEVERE: Unable to create core: collection1 > java.io.IOException: Can't find resourc

Re: Scalability of Solr Result Grouping/Field Collapsing: Millions/Billions of documents?

at 4:10 PM, Tirthankar Chatterjee wrote: > This wont work, see my thread on Solr3.6 Field collapsing > Thanks, > Tirthankar > > -Original Message- > From: Tom Burton-West > Date: Tue, 21 Aug 2012 18:39:25 > To: solr-user@lucene.apache.org > Reply-To: "s

Re: Scalability of Solr Result Grouping/Field Collapsing: Millions/Billions of documents?

This wont work, see my thread on Solr3.6 Field collapsing Thanks, Tirthankar -Original Message- From: Tom Burton-West Date: Tue, 21 Aug 2012 18:39:25 To: solr-user@lucene.apache.org Reply-To: "solr-user@lucene.apache.org" Cc: William Dueber; Phillip Farber Subject: Scalability of Solr R

Re: SOLR3.6:Field Collapsing/Grouping throws OOM

Awesome, you rock !!!. Thanks to Eric too for coming up with the ideas. But honestly I am more interested to know this EFF concept. I will do my reading and then throw up questions if I don't get it. External File Field and function queries are something which i have not evaluated yet, but I a

Re: SOLR3.6:Field Collapsing/Grouping throws OOM

ine here is I don't think grouping is a good approach for this problem.... Best Erick On Wed, Aug 15, 2012 at 5:04 AM, Tirthankar Chatterjee wrote: > Hi Erick, > You are so right on the memory calculations. I am happy that I know now that > I was doing something wrong. Yes I am gett

Re: SOLR3.6:Field Collapsing/Grouping throws OOM

actually feels like an XY problem, can you back up and let us know what the use-case you're trying to solve is? Perhaps there are less memory- consumptive solutions possible. Best Erick On Tue, Aug 14, 2012 at 6:38 AM, Tirthankar Chatterjee wrote: > Editing the query...remove I don'

Re: SOLR3.6:Field Collapsing/Grouping throws OOM

Editing the query...remove I don't know where it came from while I did copy/paste.... Tirthankar Chatterjee wrote: Hi, I have a beefy box with 24Gb RAM (12GB for Tomcat7 which houses SOLR3.6) 2 Processors Intel Xeon 64 bit Server, 30TB HDD. JDK 1.7.0_03 x64 bit Data Index Dir Size:

SOLR3.6:Field Collapsing/Grouping throws OOM

Hi, I have a beefy box with 24Gb RAM (12GB for Tomcat7 which houses SOLR3.6) 2 Processors Intel Xeon 64 bit Server, 30TB HDD. JDK 1.7.0_03 x64 bit Data Index Dir Size: 400GB Metadata of files is stored in it. I have around 15 schema fields. Total number of items:150million approx. I have a sce

Re: curl or nutch

If you use curl you will need to track every document and recurse inside folders,etc. If you use nutch it takes care of incremental crawling in the configured locations and submits the docs which changed from its previous run. The lack of a simple File system crawler around Solr is a big disadv

Re: Solr 3.5 takes very long to commit gradually

Regards, > Rohit > Mobile: +91-9901768202 > About Me: http://about.me/rohitg > > -Original Message- > From: Tirthankar Chatterjee [mailto:tchatter...@commvault.com] > Sent: 12 April 2012 13:14 > To: solr-user@lucene.apache.org > Subject: Re: Solr 3.5 takes very

Re: Solr 3.5 takes very long to commit gradually

Hi Rohit, Can you please check the solrconfig.xml in 3.5 and compare it with 3.1 if there are any warming queries specified while opening the searchers after a commit. Thanks, Tirthankar On Apr 12, 2012, at 3:30 AM, Tirthankar Chatterjee wrote: > Hi Rohit, > What would be the average s

Re: Solr 3.5 takes very long to commit gradually

Hi Rohit, What would be the average size of your documents and also can you please share your idea of having 2 cores in the master. I just wanted to know the reasoning behind the design. Thanks in advance Tirthankar On Apr 12, 2012, at 3:19 AM, Jan Høydahl wrote: > What operating system? > A

Re: which mergePolicy

Hi, Do you see any issues with the default one. On Mar 18, 2012, at 6:10 AM, Messpero wrote: > hi everyone, > > i have a big index (~100 GB, ~55 documents) with 200 fields per > document. I search with large queries, that's the reason why i must change > the value of maxBooleanClauses to 8

RE: NRT and commit behavior

Wed, Sep 14, 2011 at 7:35 AM, Tirthankar Chatterjee wrote: > Erick, > Also, we had  our solrconfig where we have tried increasing the cache > making the below value for autowarm count as 0 helps returning the commit > call within the second, but that will slow us down

RE: NRT and commit behavior

memory are you giving the JVM? etc... You might want to review: http://wiki.apache.org/solr/UsingMailingLists Best Erick On Fri, Sep 9, 2011 at 9:41 AM, Tirthankar Chatterjee wrote: > Erick, > What you said is correct for us the searches are based on some Active > Directory permission

RE: NRT and commit behavior

ame sort, facet, > etc. to avoid getting your data straight from the queryResultCache. > > My guess is that the last query will return much more quickly than the second > query. Which would indicate that the first form isn't doing you any good. > > But a test is worth a thousan

RE: Alias name for a index field

handled in Solr. Erik On Sep 9, 2011, at 09:59 , Tirthankar Chatterjee wrote: > Hi, > Is there a way that we can give an alias name for a field so that the schema > is not required to change. > > Use Case: We defined the schema with a field called "conv" (basica

Alias name for a index field

Hi, Is there a way that we can give an alias name for a field so that the schema is not required to change. Use Case: We defined the schema with a field called "conv" (basically to store conversation of an email) There are users who wants this to be used as "subject" One Solution: Use copy fiel

RE: NRT and commit behavior

rent terms but with the same sort, facet, etc. to avoid getting your data straight from the queryResultCache. My guess is that the last query will return much more quickly than the second query. Which would indicate that the first form isn't doing you any good. But a test is worth a thousand

RE: Document Size for Indexing

apache.org Subject: Re: Document Size for Indexing So if I understand you, you are using Tika /SolrJ together in a Solr client process which talks to your Solr server ? What is the heap size ? Can you give us a stack trace from the OOM exception ? -Simon On Wed, Aug 31, 2011 at 10:58 AM, Tirthankar

RE: very slow commits and overlapping commits

Try looking at your warming queries. Create a warming query that will not return ay results. See if it helps returning commits faster. Thx -Original Message- From: Bill Au [mailto:bill.w...@gmail.com] Sent: Friday, May 27, 2011 3:47 PM To: solr-user@lucene.apache.org Subject: Re: very

RE: NRT and commit behavior

Also noticed that "waitSearcher" parameter value is not honored inside commit. It is always defaulted to true which makes it slow during indexing. What we are trying to do is use an invalid query (which wont return any results) as a warming query. This way the commit returns faster. Are we doi

RE: Document Size for Indexing

[mailto:mtnes...@gmail.com] Sent: Tuesday, August 30, 2011 1:23 PM To: solr-user@lucene.apache.org Subject: Re: Document Size for Indexing what issues exactly ? are you using 32 bit Java ? That will restrict the JVM heap size to 2GB max. -Simon On Tue, Aug 30, 2011 at 11:26 AM, Tirthankar

Document Size for Indexing

Hi, I have a machine (win 2008R2) with 16GB RAM, I am having issue indexing 1/2GB files. How do we avoid creating a SOLRInputDocument or is there any way to directly use Lucene Index writer classes. What would be the best approach. We need some suggestions. Thanks, Tirthankar ***

Re: Using Edismax

hanges. So you're > getting "2010" indexed as a separate token and > you're also searching on it... > > Best > Erick > > On Mon, Jun 13, 2011 at 3:07 PM, Tirthankar Chatterjee > wrote: >> We are using edismax for query and the query fired is (url

RE: Using Edismax

There is an (underscore) character before 2010 -Original Message- From: Tirthankar Chatterjee [mailto:tchatter...@commvault.com] Sent: Monday, June 13, 2011 3:08 PM To: solr-user@lucene.apache.org Subject: Using Edismax We are using edismax for query and the query fired is (url:_2010

Using Edismax

We are using edismax for query and the query fired is (url:_2010) http://redcarpet2.dm2.commvault.com:27000/solr/select/?q=url: 2010&version=2.2&start=0&rows=10&indent=on&defType=edismax

RE: where is INFOSTREAM.txt located?

Thanks All, I figured it out. http://lucene.472066.n3.nabble.com/general-debugging-techniques-td868300.html See the last line on this page. -Original Message- From: Tirthankar Chatterjee [mailto:tchatter...@commvault.com] Sent: Wednesday, April 06, 2011 6:15 PM To: solr-user

where is INFOSTREAM.txt located?

**Legal Disclaimer*** "This communication may contain confidential and privileged material for the sole use of the intended recipient. Any unauthorized review, use or distribution by others is strictly prohibited. If you have received the message in err

RE: FW: Very very large scale Solr Deployment = how to do (Expert Question)?

Hi Jen, Can you please forward the diagram attachment too that Ephraim sent. :-) Thanks, Tirthankar -Original Message- From: Jens Mueller [mailto:supidupi...@googlemail.com] Sent: Tuesday, April 05, 2011 10:30 PM To: solr-user@lucene.apache.org Subject: Re: FW: Very very large scale Solr