Re: dataimporthandler large dataset

2011-08-12 Thread Kyle Lee
We have a 200,000,000 record index with 14 fields, and we can re-index the entire data set in about five hours. One thing to note is that the DataImportHandler uses one thread per entity by default. If you have a multcore box, you can drastically speed indexing by specifying a threadcount of n+1, w

Re: Severe errors in solr configuration

2011-07-26 Thread Kyle Lee
Could you provide the relevant sections of the logs pertaining to this error? On Tue, Jul 26, 2011 at 12:13 PM, Xue-Feng Yang wrote: > Hi all, > > I'm new to solr. > > I installed solr 3.3 with glassfish 3.1 in ubuntu 10.4. > > It works fine until I set security manager in glassfish since I don'

Re: How to check that solr server is running

2011-07-23 Thread Kyle Lee
This is more of a jQuery question than a question about Solr. In any case, if Solr isn't running at the location specified, then the connection will be refused, and an error will be thrown. You can easily set up a handler that will fire when this event occurs: http://api.jquery.com/ajaxError/ On

Re: Manipulating a Fuzzy Query's Prefix Length

2011-07-20 Thread Kyle Lee
Update: Solr/Lucene 4.0 will incorporate a new fuzzy search algorithm with substantial performance improvements. To tide us over until this release, we've simply rebuilt from source with a default prefix length of 2, which will suit our needs until then. On Wed, Jul 20, 2011 at 10:09 AM,

Re: How can i find a document by a special id?

2011-07-20 Thread Kyle Lee
Is the mediacode always alphabetic, and is the ID always numeric?

Re: Tokenizer Question

2011-07-20 Thread Kyle Lee
I'm not sure how to accomplish what you're asking, but have you considered using a synonyms file? This would also allow you to catch ostensibly unrelated name substitutes such as Robert -> Bob and Richard -> Dick. On Wed, Jul 20, 2011 at 10:57 AM, Jamie Johnson wrote: > I have a query which star

Re: How can i find a document by a special id?

2011-07-20 Thread Kyle Lee
Perhaps I'm missing something, but if your fields are indexed as "1234567" but users are searching for "AB1234567," is it not possible simply to strip the prefix from the user's input before sending the request? On Wed, Jul 20, 2011 at 10:57 AM, Per Newgro wrote: > Hi, > > i'm new to solr. I bui

Manipulating a Fuzzy Query's Prefix Length

2011-07-20 Thread Kyle Lee
We're performing fuzzy searches on a field possessing a large number of unique terms. Specifying a required minimum similarity of 0.7 results in a query execution time of 13-15 seconds, which stands in stark contrast to our average query time of 40ms. We suspect that the performance problem most l

bbox query syntax

2011-07-01 Thread Kyle Lee
Hello all, What are we doing incorrectly with this query? http://10.0.0.121:8080/solr/select?q=(description:rifle)&fq=(transactionDate:[NOW-30DAY/DAYTO NOW/DAY] AND {!bbox sfield=storeLocation pt=32.73,-96.97 d=20}) If we leave the transactionDate field out of the filter query string, the query

Re: Apache Solr Failover Support in Master-Slave Setup

2011-06-15 Thread Kyle Lee
place, you have your delta query re-index > all of the data that's changed since last known good commit that was > replicated to your slave. > > Hope this helps. > Erick > > On Wed, Jun 15, 2011 at 3:05 PM, Kyle Lee > wrote: > > Hello, > > > > Our develo

Apache Solr Failover Support in Master-Slave Setup

2011-06-15 Thread Kyle Lee
Hello, Our development team is currently looking into migrating our search system to Apache Solr, and we would greatly appreciate some advice on setup. We are indexing approximately two hundred million database rows. We add about a hundred thousand new rows throughout the day. These new database r