Re: TooManyOpenFiles: indexing in one core, doing many searches at the same time in another

2009-07-14 Thread Bruno Aranda
Hi, my process is: I index 60 docs in the secondary core (each doc has 5 fields). No problem with that. After this core is indexed (and optimized) it will be used only for searches, during the main core indexing. Currently, I am using mergeFactoror 10 for the main core. I will try with 2 to se

Re: TooManyOpenFiles: indexing in one core, doing many searches at the same time in another

2009-07-14 Thread Mark Miller
What merge factor are you using now? The merge factor will influence the number of files that are created as the index grows. Lower = fewer file descriptors needed, but also slower bulk indexing. You could up the Max Open Files settings on your OS. You could also use true Which writes mu

Re: TooManyOpenFiles: indexing in one core, doing many searches at the same time in another

2009-07-14 Thread Marc Sturlese
Setting: 2 may help. have you tried it? Indexing will be a bit slower but will be faster optimizing. You can check with lsof to see how many files jetty/tomcat (or the server you are using) is holding Bruno Aranda wrote: > > Hi, > > We are having a TooManyOpenFiles exception in our indexing p

TooManyOpenFiles: indexing in one core, doing many searches at the same time in another

2009-07-14 Thread Bruno Aranda
Hi, We are having a TooManyOpenFiles exception in our indexing process. We are reading data from a database and indexing this data into one of the two cores of our solr instance. Each of the cores has a different schema as they are used for a different purpose. While we index in the first core, we