Can you verify that rev 701485 still performs reasonably well? This is from October 2008 and I get similar results to the earlier rev. Am now trying some other versions between October and when you first reported the issue in November.

-Grant

On Mar 30, 2009, at 3:37 PM, Grant Ingersoll wrote:

Fregus,

Is rev 643465 the absolute latest you tried that still performs? i.e. every revision after is slower?

-Grant

On Mar 30, 2009, at 12:45 PM, Grant Ingersoll wrote:

Fergus,

I think the problem may actually be due to something that was introduced by a change to Solr's StopFilterFactory and the way it loads the stop words set. See https://issues.apache.org/jira/browse/SOLR-1095

I am in the process of testing it out and will let you know.

-Grant

On Mar 28, 2009, at 11:00 AM, Grant Ingersoll wrote:

Hey Fergus,

Finally got a chance to run your scripts, etc. per the thread:
http://www.lucidimagination.com/search/document/5c3de15a4e61095c/upgrade_from_1_2_to_1_3_gives_3x_slowdown_script#8324a98d8840c623

I can reproduce your slowdown.

One oddity with rev 643465 is:

On the old version, there is an exception during startup:
Mar 28, 2009 10:44:31 AM org.apache.solr.common.SolrException log
SEVERE: java.lang.NullPointerException
at org .apache .solr .handler .component.SearchHandler.handleRequestBody(SearchHandler.java:129) at org .apache .solr .handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java: 125)
     at org.apache.solr.core.SolrCore.execute(SolrCore.java:953)
     at org.apache.solr.core.SolrCore.execute(SolrCore.java:968)
at org .apache .solr .core.QuerySenderListener.newSearcher(QuerySenderListener.java:50)
     at org.apache.solr.core.SolrCore$3.call(SolrCore.java:797)
at java.util.concurrent.FutureTask $Sync.innerRun(FutureTask.java:303)
     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor $Worker.runTask(ThreadPoolExecutor.java:885) at java.util.concurrent.ThreadPoolExecutor $Worker.run(ThreadPoolExecutor.java:907)
     at java.lang.Thread.run(Thread.java:637)

I see two things in CHANGES.txt that might apply, but I'm not sure:
1. I think commons-csv was upgraded
2. The CSV loader stuff was refactored to share common code

I'm still investigating.

-Grant

--------------------------
Grant Ingersoll
http://www.lucidimagination.com/

Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids) using Solr/Lucene:
http://www.lucidimagination.com/search


--------------------------
Grant Ingersoll
http://www.lucidimagination.com/

Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids) using Solr/Lucene:
http://www.lucidimagination.com/search


--------------------------
Grant Ingersoll
http://www.lucidimagination.com/

Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids) using Solr/Lucene:
http://www.lucidimagination.com/search

Reply via email to