Re: concurrency problem with delta-import (indexing various cores simultaniously)

2009-02-28 Thread Marc Sturlese
Thank you so much Ryuuichi, I was completelly stuck with this problem! Ryuuichi KUMAI wrote: > > Hello Marc, > > I faced the similar problem, and I found a workaround. > If the performance degradation in your application is caused by GC, > this information might help you: > > https://issues.ap

Re: concurrency problem with delta-import (indexing various cores simultaniously)

2009-02-27 Thread Ryuuichi KUMAI
Hello Marc, I faced the similar problem, and I found a workaround. If the performance degradation in your application is caused by GC, this information might help you: https://issues.apache.org/jira/browse/SOLR-1042 Regards, Ryuuichi Kumai. 2009/2/21 Marc Sturlese : > > I am working with 3 inde

Re: concurrency problem with delta-import (indexing various cores simultaniously)

2009-02-20 Thread Marc Sturlese
I am working with 3 index of 1 gig each. I am using the standard setting of the GC, haven't changed anything and using java version "1.6.0_07". I don't know so much about GV configuration... just read this http://marcus.net/blog/2007/11/10/solr-search-and-java-gc-tuning/ when a month ago I exepr

Re: concurrency problem with delta-import (indexing various cores simultaniously)

2009-02-20 Thread Shalin Shekhar Mangar
On Fri, Feb 20, 2009 at 11:23 PM, Marc Sturlese wrote: > > Yes, > Now it's almost tree days non-stop since I am running updates with the 3 > cores with cron jobs. If there are updates of 1 docs everything is > alrite. When I start doing updates of 30 is when that core runs really > slow. I

Re: concurrency problem with delta-import (indexing various cores simultaniously)

2009-02-20 Thread Marc Sturlese
Yes, Now it's almost tree days non-stop since I am running updates with the 3 cores with cron jobs. If there are updates of 1 docs everything is alrite. When I start doing updates of 30 is when that core runs really slow. I have to abort the import in that core and keep updating with less

Re: concurrency problem with delta-import (indexing various cores simultaniously)

2009-02-20 Thread Shalin Shekhar Mangar
On Fri, Feb 20, 2009 at 10:43 PM, Marc Sturlese wrote: > > Hey, > Yeah, I patched the bug reported by Ryuuichi of the SimpleDateFormat > aswell. > Is there any other known concurrency bug that maybe I am missing? > In my use case I could manage to index not concurrently but would like to > discove

Re: concurrency problem with delta-import (indexing various cores simultaniously)

2009-02-20 Thread Marc Sturlese
Hey, Yeah, I patched the bug reported by Ryuuichi of the SimpleDateFormat aswell. Is there any other known concurrency bug that maybe I am missing? In my use case I could manage to index not concurrently but would like to discover why this is happening... Thank you very much! Shalin Shekhar Ma

Re: concurrency problem with delta-import (indexing various cores simultaniously)

2009-02-20 Thread Shalin Shekhar Mangar
On Fri, Feb 20, 2009 at 8:41 PM, Marc Sturlese wrote: > > Hey there, > I am indexing 3 cores concurrently from 3 diferent mysql tables (I do it > every 5 minutes with a cron job). > The three cores use JdbcDataSource as datasource in data-config.xml > Reached a point, the core that fetches more my

concurrency problem with delta-import (indexing various cores simultaniously)

2009-02-20 Thread Marc Sturlese
Hey there, I am indexing 3 cores concurrently from 3 diferent mysql tables (I do it every 5 minutes with a cron job). The three cores use JdbcDataSource as datasource in data-config.xml Reached a point, the core that fetches more mysql rows starts running so so solw until the thread seems to stop