Re: too many open files

2008-07-14 Thread Brian Carmalt
Am Montag, den 14.07.2008, 09:50 -0400 schrieb Yonik Seeley: > Solr uses reference counting on IndexReaders to close them ASAP (since > relying on gc can lead to running out of file descriptors). > How do you force them to close ASAP? I use File and FileOutputStream objects, I close the output st

Re: Wiki for 1.3

2008-07-14 Thread Norberto Meijome
On Mon, 14 Jul 2008 23:25:25 + sundar shankar <[EMAIL PROTECTED]> wrote: >Thanks for your patient response. I dont wanna know the classes changed, > but I wanna get a hand on the wiki page for the same. I tried to search for > these classes in the solr wiki. I was getting a page does not

RE: Wiki for 1.3

2008-07-14 Thread sundar shankar
Hi, Thanks for your patient response. I dont wanna know the classes changed, but I wanna get a hand on the wiki page for the same. I tried to search for these classes in the solr wiki. I was getting a page does not exist. This is the result of the search I did on solr wiki site. http://wiki.a

Re: Wiki for 1.3

2008-07-14 Thread Norberto Meijome
On Mon, 14 Jul 2008 15:52:35 + sundar shankar <[EMAIL PROTECTED]> wrote: > Hi Hoss, > I was talking about classes like EdgeNGramFilterFactory, > PatterReplaceFilterfactory etc. I didnt find these in the 1.2 Jar. Where do I > find wiki for these and Specific classes introduced fo

RE: Solr searching issue..

2008-07-14 Thread sundar shankar
Copy field dest="text". I am not sure if u can copy into text or something like that. We copy it into a field of type text or string etc.. Plus what is ur query string. what gives u no results. How do u index it?? need more clues to figure out answer dude :) > From: [EMAIL PROTECTED]> To: solr

RE: Max Warming searchers error

2008-07-14 Thread sundar shankar
OOps, Sorry about that. > Date: Sun, 13 Jul 2008 18:13:51 -0700> From: [EMAIL PROTECTED]> To: > solr-user@lucene.apache.org> Subject: Re: Max Warming searchers error> > > : > Subject: Max Warming searchers error> : In-Reply-To: <[EMAIL PROTECTED]>> : > References: <[EMAIL PROTECTED]>> > > h

RE: Wiki for 1.3

2008-07-14 Thread sundar shankar
Hi Hoss, I was talking about classes like EdgeNGramFilterFactory, PatterReplaceFilterfactory etc. I didnt find these in the 1.2 Jar. Where do I find wiki for these and Specific classes introduced for 1.3? -Sundar > Date: Sun, 13 Jul 2008 09:44:20 -0700 > From: [EMAIL PROTECTED] >

Re: too many open files

2008-07-14 Thread Alexey Shakov
Yonik Seeley schrieb: On Mon, Jul 14, 2008 at 10:17 AM, Alexey Shakov <[EMAIL PROTECTED]> wrote: Yonik Seeley schrieb: On Mon, Jul 14, 2008 at 5:14 AM, Alexey Shakov <[EMAIL PROTECTED]> now we have set the limt to ~1 files but this is not the solution - the amount of open fi

Re: too many open files

2008-07-14 Thread Yonik Seeley
On Mon, Jul 14, 2008 at 10:17 AM, Alexey Shakov <[EMAIL PROTECTED]> wrote: > Yonik Seeley schrieb: >> >> On Mon, Jul 14, 2008 at 5:14 AM, Alexey Shakov <[EMAIL PROTECTED]> >>> now we have set the limt to ~1 files >>> but this is not the solution - the amount of open files increases >>> permanan

Re: - uniqueness not enforced?

2008-07-14 Thread Fuad Efendi
I verified, I use same field definitions: id 1.3 development version taken from SVN few months ago. I use SOLRJ add(Collection docs, some docs could have same Id. I'll double-check... Thanks I was adding new documents with same Id in a hope that it will replace old one; instead, new docu

Re: too many open files

2008-07-14 Thread Alexey Shakov
Yonik Seeley schrieb: On Mon, Jul 14, 2008 at 5:14 AM, Alexey Shakov <[EMAIL PROTECTED]> wrote: now we have set the limt to ~1 files but this is not the solution - the amount of open files increases permanantly. Earlier or later, this limit will be exhausted. How can you tell? Are

Re: - uniqueness not enforced?

2008-07-14 Thread Yonik Seeley
On Mon, Jul 14, 2008 at 10:01 AM, Fuad Efendi <[EMAIL PROTECTED]> wrote: > I was adding new documents with same Id in a hope that it will replace old > one; instead, new document added with same Id. Is it bug? It should work fine. It might be a schema issue for you... try the solr example setup.

Re: too many open files

2008-07-14 Thread Yonik Seeley
On Mon, Jul 14, 2008 at 9:52 AM, Fuad Efendi <[EMAIL PROTECTED]> wrote: > Even Oracle requires 65536; MySQL+MyISAM depends on number of tables, > indexes, and Client Threads. > > From my experience with Lucene, 8192 is not enough; leave space for OS too. > > Multithreaded application (in most cases

- uniqueness not enforced?

2008-07-14 Thread Fuad Efendi
Hi, I was adding new documents with same Id in a hope that it will replace old one; instead, new document added with same Id. Is it bug? Thanks

Re: too many open files

2008-07-14 Thread Fuad Efendi
Even Oracle requires 65536; MySQL+MyISAM depends on number of tables, indexes, and Client Threads. From my experience with Lucene, 8192 is not enough; leave space for OS too. Multithreaded application (in most cases) multiplies number of files to a number of threads (each thread needs own ha

Re: too many open files

2008-07-14 Thread Yonik Seeley
Solr uses reference counting on IndexReaders to close them ASAP (since relying on gc can lead to running out of file descriptors). -Yonik On Mon, Jul 14, 2008 at 9:15 AM, Brian Carmalt <[EMAIL PROTECTED]> wrote: > Hello, > > I have a similar problem, not with Solr, but in Java. From what I have >

Re: too many open files

2008-07-14 Thread Brian Carmalt
Hello, I have a similar problem, not with Solr, but in Java. From what I have found, it is a usage and os problem: comes from using to many files, and the time it takes the os to reclaim the fds. I found the recomendation that System.gc() should be called periodically. It works for me. May not be

Re: too many open files

2008-07-14 Thread Yonik Seeley
On Mon, Jul 14, 2008 at 5:14 AM, Alexey Shakov <[EMAIL PROTECTED]> wrote: > now we have set the limt to ~1 files > but this is not the solution - the amount of open files increases > permanantly. > Earlier or later, this limit will be exhausted. How can you tell? Are you seeing descriptor use

Re: Document rating/popularity and scoring

2008-07-14 Thread climbingrose
Hi Yonik, I have had a looked at ExternalFileField. However, I coudn't figured out how to include the externally referenced field in the search results. Also, sorting on this type of field isn't possible right? Thanks. On Sat, Jul 12, 2008 at 2:28 AM, climbingrose <[EMAIL PROTECTED]> wrote: > T

Re: too many open files

2008-07-14 Thread Alexey Shakov
now we have set the limt to ~1 files but this is not the solution - the amount of open files increases permanantly. Earlier or later, this limit will be exhausted. Fuad Efendi schrieb: Have you tried [ulimit -n 65536]? I don't think it relates to files marked for deletion...

RE: Solr searching issue..

2008-07-14 Thread dudes dudes
again whatever I have pasted it didn't work ! .. I have attached the schema.xml file instead,,, sorry for spamming you all thanks ak > From: [EMAIL PROTECTED] > To: solr-user@lucene.apache.org > Subject: RE: Solr searching issue.. > Date: Mon, 14 Jul 200

RE: Solr searching issue..

2008-07-14 Thread dudes dudes
with some strange reason my copy and paste didn't work !!! sorry to terrible you all.. hope you can see them now.. > From: [EMAIL PROTECTED] > To: solr-user@lucene.apache.org > Subject: RE: Solr searching issue.. > Date: Mon, 14 Jul 2008 09:17:32 +0100 >

RE: Solr searching issue..

2008-07-14 Thread dudes dudes
Hi again, I have done the followings, but I do get zero replies .. please let me know what I have done wrong... thanks version type: nightly build solr-2008-07-07 // for n-gram

Re: Using SolrJ for response

2008-07-14 Thread Noble Paul നോബിള്‍ नोब्ळ्
You may need to check your classpath and ensure that you are using the correct versions of httpclient (the ones shipped with solr) On Mon, Jul 14, 2008 at 1:00 PM, Ranjeet <[EMAIL PROTECTED]> wrote: > Hi, > > I am new to solrJ, in following code I got exception. Plese help, we did not > get getP

Using SolrJ for response

2008-07-14 Thread Ranjeet
Hi, I am new to solrJ, in following code I got exception. Plese help, we did not get getParams() method in HttpConnectionManager. In which jar we get with this method. public static void main (String [] args) { /*String url = "http://localhost:8983/solr";; SolrServer server = new CommonsHttp