Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-17 Thread Naveen Gupta
jayya >>>>> http://solr-ra.tgels.org >>>>> http://rankingalgorithm.tgels.org<http://rankingalgorithm.** >>>>> tgels.org <http://rankingalgorithm.tgels.org>> >>>>> >>>>> >>>>> >>>>

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-15 Thread Naveen Gupta
uot; >>>> > >>>> wrote: >>>> >>>> Naveen: >>>>> >>>>> NRT with Apache Solr 3.3 and RankingAlgorithm does need a commit for a >>>>> document to become searchable. Any document that you add through updat

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Naveen Gupta
Hi Mark/Erick/Nagendra, I was not very confident about NRT at that point of time, when we started project almost 1 year ago, definitely i would try NRT and see the performance. The current requirement was working fine till we were using commitWithin 10 millisecs in the XMLDocument which we were p

exceeded limit of maxWarmingSearchers ERROR

2011-08-13 Thread Naveen Gupta
Hi, Most of the settings are default. We have single node (Memory 1 GB, Index Size 4GB) We have a requirement where we are doing very fast commit. This is kind of real time requirement where we are polling many threads from third party and indexes into our system. We want these results to be av

Re: LockObtainFailedException

2011-08-12 Thread Naveen Gupta
al size), so the bottleneck(s) > should be findable once you trace through the indexing operations. > > > > On Thu, Aug 11, 2011 at 1:02 PM, Naveen Gupta wrote: > > Yes this was happening because of JVM heap size > > > > But the real issue is that if our index size is gr

Re: LockObtainFailedException

2011-08-11 Thread Naveen Gupta
n with no other error or explananation in > the logs, this is almost always because the JVM has run out of memory. > Have you checked/profiled your mem usage/GC during the stream operation? > > > > On Thu, Aug 11, 2011 at 3:18 AM, Naveen Gupta wrote: > > Hi, > > > &

LockObtainFailedException

2011-08-10 Thread Naveen Gupta
Hi, We are doing streaming update to solr for multiple user, We are getting Aug 10, 2011 11:56:55 AM org.apache.solr.common.SolrException log SEVERE: org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: NativeFSLock@/var/lib/solr/data/index/write.lock at org.apache

Re: indexing taking very long time

2011-08-05 Thread Naveen Gupta
to Solr? You have to > provide those kinds of details to get meaningful help. > > Best > Erick > On Aug 2, 2011 8:06 AM, "Naveen Gupta" wrote: > > Hi > > > > We have a requirement where we are indexing all the messages of a a > thread, > > a thread

Re: indexing taking very long time

2011-08-05 Thread Naveen Gupta
as multithreading, one option is to simply have multiple clients > indexing simultaneously. But you haven't indicated how the indexing is > being > done. Are you using DIH? SolrJ? Streaming documents to Solr? You have to > provide those kinds of details to get meaningful help.

Re: merge factor performance

2011-08-04 Thread Naveen Gupta
Sorry for 15k Docs, it is taking 3 mins. On Thu, Aug 4, 2011 at 10:07 PM, Naveen Gupta wrote: > Hi, > > We are having a requirement where we are having almost 100,000 documents to > be indexed (atleast 20 fields). These fields are not having length greater > than 10 KB. > >

merge factor performance

2011-08-04 Thread Naveen Gupta
Hi, We are having a requirement where we are having almost 100,000 documents to be indexed (atleast 20 fields). These fields are not having length greater than 10 KB. Also we are running parallel search for the same index. We found that it is taking almost 3 min to index the entire documents. S

Re: IMP: indexing taking very long time

2011-08-02 Thread Naveen Gupta
Can somebody answer this? What should be the best strategy for optimize (when million of messages we are indexing for a new registered user) Thanks Naveen On Tue, Aug 2, 2011 at 5:36 PM, Naveen Gupta wrote: > Hi > > We have a requirement where we are indexing all the messages of a

indexing taking very long time

2011-08-02 Thread Naveen Gupta
Hi We have a requirement where we are indexing all the messages of a a thread, a thread may have attachment too . We are adding to the solr for indexing and searching for applying few business rule. For a user, we have almost many threads (100k) in number and each thread may be having 10-20 messa

relevant result for query with boost factor on parameters

2011-06-18 Thread Naveen Gupta
Hi, I am trying to achieve this use case with following expectation three fields 1. field1 2. field2 3. field3 field1 should have the max relevance field2 should have the next field3 is the last the term will be entered by end user (say* rock roll*) i want to show the results which will cont

Re: ERROR on posting update request using CURL in php

2011-06-09 Thread Naveen Gupta
Hi, curl http://localhost:8983/solr/update?commit=true -H "Content-Type: text/xml" --data-binary 'testdoc' Regards Naveen On Fri, Jun 10, 2011 at 10:18 AM, Naveen Gupta wrote: > Hi > > This is my document > > in php > > $xmldoc = 'F_146 name=&

ERROR on posting update request using CURL in php

2011-06-09 Thread Naveen Gupta
Hi This is my document in php $xmldoc = 'F_14674gmail.com121sample.pptx'; $ch = curl_init("http://localhost:8080/solr/update";); curl_setopt($ch, CURLOPT_RETURNTRANSFER,1); curl_setopt ($ch, CURLOPT_POST, 1); curl_setopt($ch, CURLOPT_HTTPHEADER, array("Co

Re: tika integration exception and other related queries

2011-06-09 Thread Naveen Gupta
aining where the match is. > > Hope that helps. > > Kind regards, > Gary. > > > > > On 09/06/2011 03:00, Naveen Gupta wrote: > >> Hi Gary >> >> It started working .. though i did not test for Zip files, but for rar >> files, it is working fine ..

Re: tika integration exception and other related queries

2011-06-08 Thread Naveen Gupta
ith-Tika-and-Solr-1-4-1-td2327933.html > > I got it to work with the 3.1 source and a couple of patches. > > Hope this helps. > > Regards, > Gary. > > > > On 08/06/2011 04:12, Naveen Gupta wrote: > >> Hi Can somebody answer this ... >> >> 3. ca

tika integration exception and other related queries

2011-06-07 Thread Naveen Gupta
at > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) > at java.lang.Thread.run(Thread.java:619) > Thanks Naveen On Tue, Jun 7, 2011 at 3:33 PM, Naveen Gupta wrote: > Hi > > We are using requestextractinghandler and we are getting fol

getting numberformat exception while using tika

2011-06-07 Thread Naveen Gupta
Hi We are using requestextractinghandler and we are getting following error. we are giving microsoft docx file for indexing. I think that this is something to do with field date definition .. but now very sure ...what field type should we use? 2. we are trying to index jpg (when we search over t

Re: TIKA INTEGRATION PERFORMANCE

2011-06-06 Thread Naveen Gupta
tp://wiki.apache.org/solr/SolrReplication > > Were this the answers you were looking for or did I misunderstand your > questions? > > Tomás > > On Mon, Jun 6, 2011 at 2:54 AM, Naveen Gupta wrote: > > > Hi > > > > Since it is php, we are using solphp for calling curl

TIKA INTEGRATION PERFORMANCE

2011-06-05 Thread Naveen Gupta
Hi Since it is php, we are using solphp for calling curl based call, what my concern here is that for each user, we might be having 20-40 attachments needed to be indexed each day, and there are various users ..daily we are targeting around 500-1000 users .. right now if you see, we http://loca

Re: php library for extractrequest handler

2011-06-03 Thread Naveen Gupta
Yes, that one i used and it is working fine .thanks to nabble .. Thanks Naveen On Fri, Jun 3, 2011 at 4:02 PM, Gora Mohanty wrote: > On Fri, Jun 3, 2011 at 3:55 PM, Naveen Gupta wrote: > > Hi > > > > We want to post to solr server with some of the files (rtf,doc,etc) usi

Re: Strategy --> Frequent updates in our application

2011-06-03 Thread Naveen Gupta
Hi Pravesh We don't have that setup right now .. we are thinking of doing that for writes we are going to have one instance and for read, we are going to have another... do you have other design in mind .. kindly share Thanks Naveen On Fri, Jun 3, 2011 at 2:50 PM, pravesh wrote: > You c

php library for extractrequest handler

2011-06-03 Thread Naveen Gupta
Hi We want to post to solr server with some of the files (rtf,doc,etc) using php .. one way is to post using curl is there any client like java client (solrcell) urls will also help Thanks Naveen

Re: How to display search results of solr in to other application.

2011-06-02 Thread Naveen Gupta
Hi Romi As per me, you need to understand how ajax with jquery works .. then go for json and then jsonp (if you are fetching from different) query here is dynamic query which you will be trying to hit solr .. (it could be simple text, or more advanced query string) http://wiki.apache.org/solr/Co

different indexes for multitenant approach

2011-06-02 Thread Naveen Gupta
Hi I want to implement different index strategy where we want to keep indexes with respect to each tennant and we want to maintain indexes separately ... first level of category -- company name second level of category - company name + fields to be indexed then further categories - group of dif

Strategy --> Frequent updates in our application

2011-06-02 Thread Naveen Gupta
Hi We are having an application where every 10 mins, we are doing indexing of users docs repository, and eventually, if some thread is being added in that particular discussion, we need to index the thread again (please note we are not doing blind indexing each time, we have various rules to filte

Re: tika and solr 3,1 integration

2011-06-02 Thread Naveen Gupta
mic field named "attr_*" in the schema. The > "uprefix=attr_" parameter means that if Solr can't find an extracted field > in the schema, it'll add the prefix "attr_" and try again. > > *Juan* > > > > On Thu, Jun 2, 2011 at 4:21 AM, Na

tika and solr 3,1 integration error

2011-06-02 Thread Naveen Gupta
Hi I am trying to integrate solr 3.1 and tika (which comes default with the version) and using curl command trying to index few of the documents, i am getting this error. the error is attr_meta field is unknown. i checked the solrconfig, it looks perfect to me. can you please tell me what i am m

tika and solr 3,1 integration

2011-06-02 Thread Naveen Gupta
Hi I am trying to integrate solr 3.1 and tika (which comes default with the version) and using curl command trying to index few of the documents, i am getting this error. the error is attr_meta field is unknown. i checked the solrconfig, it looks perfect to me. can you please tell me what i am m