Re: Indexing a lot of documents?

2007-06-01 Thread Jordan Hayes
I'm not clear exactly what you mean by batches. What I'm doing is: <-- #1 [...] <-- #100 So that's 100, in 1 HTTP POST. Lucene sometimes just requires many file descriptors (this will be somewhat alleviated with Solr 1.2). Is there a way to find out how many is "many" ...

Re: Indexing a lot of documents?

2007-06-01 Thread Yonik Seeley
On 6/1/07, Erik Hatcher <[EMAIL PROTECTED]> wrote: On Jun 1, 2007, at 10:47 PM, Mike Klaas wrote: >> Am I just doing something wrong? > > No. Lucene sometimes just requires many file descriptors (this > will be somewhat alleviated with Solr 1.2). I suggest upping the > open file limit (I upped

Re: Indexing a lot of documents?

2007-06-01 Thread Erik Hatcher
On Jun 1, 2007, at 10:47 PM, Mike Klaas wrote: Am I just doing something wrong? No. Lucene sometimes just requires many file descriptors (this will be somewhat alleviated with Solr 1.2). I suggest upping the open file limit (I upped mine from 1024 to 45000 to handle huge indices). You

Re: Indexing a lot of documents?

2007-06-01 Thread Mike Klaas
On 1-Jun-07, at 6:35 PM, Jordan Hayes wrote: New user here, and I ran into a problem trying to load a lot of documents (~900k). I tried to load them all at once, which seemed to run for a long time and then finally crap out with "Too many open files" ... so I read in an FAQ that "about 100

Indexing a lot of documents?

2007-06-01 Thread Jordan Hayes
New user here, and I ran into a problem trying to load a lot of documents (~900k). I tried to load them all at once, which seemed to run for a long time and then finally crap out with "Too many open files" ... so I read in an FAQ that "about 100" might be a good number. I split my documents u

Re: question about highlight field

2007-06-01 Thread Chris Hostetter
: I have a question about how to use the highlight field(hl.fl), below is : my test result. As you can see, if I don't use hl.fl in the query, the : highlighting element in the result only shows the id information. I have according to the wiki, a blank (or missing) hl.fl should result in the fiel

Re: question about highlight field

2007-06-01 Thread Mike Klaas
On 1-Jun-07, at 9:37 AM, Xuesong Luo wrote: Hi, there, I have a question about how to use the highlight field(hl.fl), below is my test result. As you can see, if I don't use hl.fl in the query, the highlighting element in the result only shows the id information. I have to add the field

question about highlight field

2007-06-01 Thread Xuesong Luo
Hi, there, I have a question about how to use the highlight field(hl.fl), below is my test result. As you can see, if I don't use hl.fl in the query, the highlighting element in the result only shows the id information. I have to add the field name (hl.fl=TITLE) to the query to see the field infor

Re: Solr on JBOSS 4.0.3

2007-06-01 Thread Thierry Collogne
Thank you for the suggestion. I downloaded a newer version of JBOSS and then copied the files from the JBOS_HOME\lib\endorsed to the WEB-INF\lib folder of Solr. That solved it. On 31/05/07, Daniel Naber <[EMAIL PROTECTED]> wrote: On Thursday 31 May 2007 09:58, Thierry Collogne wrote: > Is the