Re: Upgrade from 1.2 to 1.3 gives 3x slowdown + script!

2008-12-11 Thread Fergus McMenemie
Yonik >Another thought I just had - do you have autocommit enabled? > No; not as far as I know! The solrconfig.xml from the two versions are equivalent as best I can tell, also they are exactly as provided in the download. The only changes were made by the attached script and should not affect co

Re: Upgrade from 1.2 to 1.3 gives 3x slowdown + script!

2008-12-08 Thread Yonik Seeley
Another thought I just had - do you have autocommit enabled? A lucene commit is now more expensive because it syncs the files for safety. If you commit frequently, this could definitely cause a slowdown. -Yonik On Wed, Nov 26, 2008 at 10:54 AM, Fergus McMenemie <[EMAIL PROTECTED]> wrote: > Hell

Re: Upgrade from 1.2 to 1.3 gives 3x slowdown + script!

2008-12-01 Thread Fergus McMenemie
Hello Grant, > >Haven't forgotten about you, but I've been traveling and then into >some US Holidays here. Happy thanks giving! > >To confirm I am understanding, you are seeing a slowdown between 1.3- >dev from April and one from September, right? Yep. Here are the MD5 hashes:- fergus: md5 *.w

Re: Upgrade from 1.2 to 1.3 gives 3x slowdown + script!

2008-11-30 Thread Grant Ingersoll
Hi Fergie, Haven't forgotten about you, but I've been traveling and then into some US Holidays here. To confirm I am understanding, you are seeing a slowdown between 1.3- dev from April and one from September, right? Can you produce an MD5 hash of the WAR file or something, such that I c

Re: Upgrade from 1.2 to 1.3 gives 3x slowdown + script!

2008-11-26 Thread Fergus McMenemie
Hello Grant, Not much good with Java profilers (yet!) so I thought I would send a script! Details... details! Having decided to produce a script to replicate the 1.2 vis 1.3 speed problem. The required rigor revealed a lot more. 1) The faster version I have previously referred to as 1.2,

Re: Upgrade from 1.2 to 1.3 gives 3x slowdown

2008-11-21 Thread Grant Ingersoll
On Nov 20, 2008, at 9:18 AM, Fergus McMenemie wrote: Hello Grant, Were you overwriting the existing index or did you also clean out the Solr data directory, too? In other words, was it a fresh index, or an existing one? And was that also the case for the 22 minute time? No in each case

Re: Upgrade from 1.2 to 1.3 gives 3x slowdown

2008-11-20 Thread Fergus McMenemie
Hello Grant, >Were you overwriting the existing index or did you also clean out the >Solr data directory, too? In other words, was it a fresh index, or an >existing one? And was that also the case for the 22 minute time? No in each case it was a new index. I store the indexes (the "data" d

Re: Upgrade from 1.2 to 1.3 gives 3x slowdown

2008-11-20 Thread Grant Ingersoll
Hi Fergus, Were you overwriting the existing index or did you also clean out the Solr data directory, too? In other words, was it a fresh index, or an existing one? And was that also the case for the 22 minute time? Would it be possible to profile the two instance and see if you notice