On Wed, Apr 15, 2009 at 7:28 PM, vivek sar wrote:
> lsof at
> this point usually shows at 1400, but my ulimit is much higher than
> that.
Could you be hitting a kernel limit?
cat /proc/sys/fs/file-max
cat /proc/sys/fs/file-nr
http://www.netadmintools.com/art295.html
-Yonik
http://www.lucidimag
lr logs
and finding errors.
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
- Original Message
> From: vivek sar
> To: solr-user@lucene.apache.org
> Sent: Wednesday, April 15, 2009 7:28:57 PM
> Subject: Re: Question on StreamingUpdateSolrServer
>
the number of open file handles.
>
> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>
>
>
> - Original Message
>> From: vivek sar
>> To: solr-user@lucene.apache.org
>> Sent: Friday, April 10, 2009 5:59:37 PM
>> Subject: Re: Ques
t; To: solr-user@lucene.apache.org
> Sent: Friday, April 10, 2009 5:59:37 PM
> Subject: Re: Question on StreamingUpdateSolrServer
>
> I also noticed that the Solr app has over 6000 file handles open -
>
> "lsof | grep solr | wc -l" - shows 6455
>
> I'
Message
> From: vivek sar
> To: solr-user@lucene.apache.org
> Sent: Tuesday, April 14, 2009 3:12:41 AM
> Subject: Re: Question on StreamingUpdateSolrServer
>
> The machine's ulimit is set to 9000 and the OS has upper limit of
> 12000 on files. What would explain this?
The machine's ulimit is set to 9000 and the OS has upper limit of
12000 on files. What would explain this? Has anyone tried Solr with 25
cores on the same Solr instance?
Thanks,
-vivek
2009/4/13 Noble Paul നോബിള് नोब्ळ् :
> On Tue, Apr 14, 2009 at 7:14 AM, vivek sar wrote:
>> Some more update.
On Tue, Apr 14, 2009 at 7:14 AM, vivek sar wrote:
> Some more update. As I mentioned earlier we are using multi-core Solr
> (up to 65 cores in one Solr instance with each core 10G). This was
> opening around 3000 file descriptors (lsof). I removed some cores and
> after some trial and error I foun
Some more update. As I mentioned earlier we are using multi-core Solr
(up to 65 cores in one Solr instance with each core 10G). This was
opening around 3000 file descriptors (lsof). I removed some cores and
after some trial and error I found at 25 cores system seems to work
fine (around 1400 file d
Here is some more information about my setup,
Solr - v1.4 (nightly build 03/29/09)
Servlet Container - Tomcat 6.0.18
JVM - 1.6.0 (64 bit)
OS - Mac OS X Server 10.5.6
Hardware Overview:
Processor Name: Quad-Core Intel Xeon
Processor Speed: 3 GHz
Number Of Processors: 2
Total Number Of Cores: 8
L
On Mon, Apr 13, 2009 at 12:36 PM, vivek sar wrote:
> I index in 10K batches and commit after 5 index cyles (after 50K). Is
> there any limitation that I can't search during commit or
> auto-warming? I got 8 CPU cores and only 2 were showing busy (using
> top) - so it's unlikely that the CPU was p
I index in 10K batches and commit after 5 index cyles (after 50K). Is
there any limitation that I can't search during commit or
auto-warming? I got 8 CPU cores and only 2 were showing busy (using
top) - so it's unlikely that the CPU was pegged.
2009/4/12 Noble Paul നോബിള് नोब्ळ् :
> If you use S
If you use StreamingUpdateSolrServer it POSTs all the docs in a single
request. 10 million docs may be a bit too much for a single request. I
guess you should batch it in multiple requests of smaller chunks,
It is likely that the CPU is really hot when the autowarming is hapening.
getting a decen
Thanks Shalin.
I noticed couple more things. As I index around 100 million records a
day, my Indexer is running pretty much at all times throughout the
day. Whenever I run a search query I usually get "connection reset"
when the commit is happening and get "blank page" when the
auto-warming of sea
On Sun, Apr 12, 2009 at 2:15 AM, vivek sar wrote:
>
> The problem is I don't see any error message in the catalina.out. I
> don't even see the request coming in - I simply get blank page on
> browser. If I keep trying the request goes through and I get respond
> from Solr, but then it become unre
Thanks Shalin.
The problem is I don't see any error message in the catalina.out. I
don't even see the request coming in - I simply get blank page on
browser. If I keep trying the request goes through and I get respond
from Solr, but then it become unresponsive again or sometimes throws
"connection
On Sat, Apr 11, 2009 at 3:29 AM, vivek sar wrote:
> I also noticed that the Solr app has over 6000 file handles open -
>
>"lsof | grep solr | wc -l" - shows 6455
>
> I've 10 cores (using multi-core) managed by the same Solr instance. As
> soon as start up the Tomcat the open file count goes
I also noticed that the Solr app has over 6000 file handles open -
"lsof | grep solr | wc -l" - shows 6455
I've 10 cores (using multi-core) managed by the same Solr instance. As
soon as start up the Tomcat the open file count goes up to 6400. Few
questions,
1) Why is Solr holding on to al
Hi,
I was using CommonsHttpSolrServer for indexing, but having two
threads writing (10K batches) at the same time was throwing,
"ProtocolException: Unbuffered entity enclosing request can not be repeated. "
I switched to StreamingUpdateSolrServer (using addBeans) and I don't
see the problem a
18 matches
Mail list logo
