Re[2]: startsWith?

2008-05-03 Thread JLIST
Hello Otis, Do you mean that if I index the URL as a "text" field, I'll be able to do * for a given prefix because the text will be tokenized at the "/" and should suffice for my need? Thanks, Jack > Anyhow, for your needs you could also try something simple as > http://domain/articles/2008/* to

Re: Tokenize integers?

2008-05-03 Thread Otis Gospodnetic
I think you are after http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#head-1c9b83870ca7890cd73b193cefed83c283339089 Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> > To: solr-user@lucene.a

Re: Help optimizing

2008-05-03 Thread Otis Gospodnetic
Daniel, 1.5 seconds is quite long and 60 seconds ismore than scary - smells like some is not set up right. You have a lot of fields of type text, but a number of field sound like they really need not be tokenized and should thus be of type string. Do you really need 6 warming searchers? I th

Re: startsWith?

2008-05-03 Thread Otis Gospodnetic
Hi, Special URL tokenization if often a good thing to do with URLs. For example, over on Simpy.com you can do searches like this: http://www.simpy.com/links/site/techcrunch.com http://www.simpy.com/links/site/www.techcrunch.com If you were to examine results, you'd see that the two result sets

Tokenize integers?

2008-05-03 Thread solr
Hi, What is the recommended way to configure a fieldtype for a field that looks like this in the source system? categoryIds=1,325,488 The order of these id's are not important. I want to be able to fetch all the id's, separately, ie I want them to be stored as multivalue, I guess... And

startsWith?

2008-05-03 Thread JLIST
Hi, I wonder it's possible search for text/string fields that starts with a substring, similar to Java's startsWith function? For example, if I have a URL indexed as text or string field, can I find URLs that starts with "http://domain/articles/2008/"; ? If not, what's the best way to implement a

Help optimizing

2008-05-03 Thread Daniel Andersson
Hi (again) people We've now invested in a server with 8 GB of RAM after too many OutOfMemory-errors. Our database/index is 3.5 GB and contains 4,352,471 documents. Most documents are less than 1 kb. When performing a search, the results vary between 1.5 seconds up to 60 seconds. I don't