schema.xml changes and the impact on Solr?

2007-08-13 Thread Kevin Holmes
We're planning to make changes to our schema.xml file... I need to ask a few questions 1 - if we add fields / remove fields to be indexed, how will this affect our current indexes. Will we need to completely recreate millions on indexes (or is it indices)? Scenario 1a :: we've been injec

RE: Any clever ideas to inject into solr? Without http?

2007-08-09 Thread Kevin Holmes
Is this a native feature, or do we need to get creative with scp from one server to the other? If it's a contention between search and indexing, separate them via a query-slave and an index-master. --cw

Any clever ideas to inject into solr? Without http?

2007-08-09 Thread Kevin Holmes
I inherited an existing (working) solr indexing script that runs like this: Python script queries the mysql DB then calls bash script Bash script performs a curl POST submit to solr We're injecting about 1000 records / minute (constantly), frequently pushing the edge of our CPU / RAM limit

RE: Too many open files

2007-08-09 Thread Kevin Holmes
You're a gentleman and a scholar. I will donate the M&Ms to myself :). Can you tell me from this snippet of my solrconfig.xml what I might tweak to make this more betterer? -KH false 10 1000 2147483647 1 1000 1

Too many open files

2007-08-09 Thread Kevin Holmes
java.io.FileNotFoundException: /usr/local/bin/apache-solr/enr/solr/data/index/_16ik.tii (Too many open files) When I'm importing, this is the error I get. I know it's vague and obscure. Can someone suggest where to start? I'll buy a bag of M&Ms (not peanut) for anyone who can help me solve t

Heap size vs memory allocation

2007-08-06 Thread Kevin Holmes
I'm searching through the mail archives and a few old letters make it sound as if "heap size" is a different setting completely than memory allocation on execute. The box has 4gb RAM, and I'm executing solr with 2500 max / 1000 min like this: java -Xmx2500M -Xms1000M -jar start.jar Is this

RE: Error when starting Solr using Tomcat V6 (tomcat6-6.0.13)

2007-08-02 Thread Kevin Holmes
What's the command you are using to start solr?

RE: Please help! Solr 1.1 HTTP server stops responding

2007-07-30 Thread Kevin Holmes
This might be relevant too? Jul 30, 2007 3:05:22 PM org.apache.solr.core.SolrException log SEVERE: Error during auto-warming of key:[EMAIL PROTECTED]:java.lang.OutOfMemory Error: Java heap space Jul 30, 2007 3:05:25 PM org.apache.solr.core.SolrException log SEVERE: Error during auto-warming of k

RE: Please help! Solr 1.1 HTTP server stops responding

2007-07-30 Thread Kevin Holmes
debiandos:~# curl -i http://localhost:8983/solr/select/?q=superduperobscuretestingstring HTTP/1.1 200 OK Date: Mon, 30 Jul 2007 19:20:40 GMT Server: Jetty/5.1.11RC0 (Linux/2.6.18-4-686 i386 java/1.5.0_11 Content-Type: text/xml; charset=UTF-8 Content-Length: 272 0121superduperobscuretestingstring

RE: Please help! Solr 1.1 HTTP server stops responding

2007-07-30 Thread Kevin Holmes
org.apache.lucene.index.IndexWriter.(IndexWriter.java:258) at org.apache.lucene.index.IndexWriter.(IndexWriter.java:208) at org.apache.solr.update.SolrIndexWriter.(SolrIndexWriter.java:66) at org.apache.solr.update.UpdateHandler.createMainIndexWriter(UpdateHandler .java:119) Kevin

RE: Please help! Solr 1.1 HTTP server stops responding

2007-07-30 Thread Kevin Holmes
Just got this: Jul 30, 2007 3:02:14 PM org.apache.solr.core.SolrException log SEVERE: java.lang.OutOfMemoryError: Java heap space Jul 30, 2007 3:02:30 PM org.apache.solr.core.SolrException log SEVERE: java.lang.OutOfMemoryError: Java heap space Kevin Holmes eNR Services, Inc. 20 Glover