Re: fieldCache problem OOM exception

2011-07-23 Thread Santiago Bazerque
_12jl.tii > -rw-r--r-- 1 solr users 30850743727 19. Jul 11:20 _12jl.tis > -rw-r--r-- 1 solr users 20 9. Jun 11:11 segments.gen > -rw-r--r-- 1 solr users 274 19. Jul 11:20 segments_pl > Size: 146,15 GB > Docs: 29.557.308 > > > Regards, > Bernd > > > A

Re: fieldCache problem OOM exception

2011-07-21 Thread Santiago Bazerque
Hello Erick, I have a 1.7MM documents, 3.6GB index. I also hava an unusual amount of dynamic fields, that I use for sorting. My FieldCache currently has about 13.000 entries, even though my index only has 1-3 queries per second. Each query sorts by two dynamic fields, and facets on 3-4 fields that

Re: Weird optimize performance degradation

2011-06-22 Thread Santiago Bazerque
being done on trunk to flatten > out this curve, but that's not going to do you much good > in the 3.x code line... > > Best > Erick > > On Sun, Jun 19, 2011 at 10:32 AM, Santiago Bazerque > wrote: > > Hello Erick, thanks for your answer! > > > > Yes, our o

Re: Weird optimize performance degradation

2011-06-19 Thread Santiago Bazerque
your index. > > Are you sure you're not just seeing successively longer times on each > optimize and just noticing it after 10? > > Best > Erick > > On Sun, Jun 19, 2011 at 6:04 AM, Santiago Bazerque > wrote: > > Hello! > > > > Here is a puzzling

Weird optimize performance degradation

2011-06-19 Thread Santiago Bazerque
Hello! Here is a puzzling experiment: I build an index of about 1.2MM documents using SOLR 3.1. The index has a large number of dynamic fields (about 15.000). Each document has about 100 fields. I add the documents in batches of 20, and every 50.000 documents I optimize the index. The first 10

Large number of dynamic fields

2011-06-02 Thread Santiago Bazerque
Hello, I have a 7Gb index having 2MM documents. Each document has about 400 fields, but fields are dynamic and in total I have ~200k fields. We're using SOLR 3.1 and tomcat 5.5. We are seeing very slow start-up times (from tomcat startup to SOLR ready to answer queries about 5 minutes). We have t

Slow, CPU-bound commit

2011-05-09 Thread Santiago Bazerque
Hello, I am using the new SOLR 3.1 for a 2.6 Gb, 1MM documents index. Reading the forums and the archive I learned that SOLR and Lucene now manage commits and transactions a bit differently than in previous versions, and indeed I feel the behavior has changed. Here's the thing: committing a few 1