Re: Max. number of Error messages

: Is there any parameter to set the max. number of error messages.. : The Solr system was killed after a couple of error messages which caused by : WRONG QUERY are you refering to maxing out the number of error messages in the log file? There may be a JDK LoggingFilter that can ignore "

Backup of a Solr index

Is there a standard way to dump the Solr index to a file or to a directory as backup, and to import a such saved index to another Solr index later? Another question I have, is whether one is allowed to copy the /data/index folder while the Solr server is still running, as easy alternative t

How to configure Solr on Tomcat 6.0 as windows Service

Hello everyone, I have tried Solr using jetty, its run on command prompt, but now I want to comfigure solr on tomcat-6, so nay one know how to configure it as windows service using tomcat. Please let me know how its is possible. -- Thanks in advance, Laxmilal menaria http://www.chambal.com/ ht

No search results when configure solr on tomcat as service

Hello, I have configured solr as Multiple Solr appswith tomcat 5.5, using http://wiki.apache.org/solr/SolrTomcat for configuration. After configuration and search with admin panel it doesn't show any results, but

Re: big perf-difference between solr-server vs. SOlrJ req.process(solrserver)

Otis Gospodnetic wrote: Maybe I'm not following your situation 100%, but it sounded like pulling the values of purely stored fields is the slow part. *Perhaps* using a non-Lucene data store just for the saved fields would be faster. For this purpose Nutch uses external files in Hadoop MapFile f

correct escapes in csv-Update files

I use UpdateCSV to feed my data into SOLR and it works very well. The only thing I don't understand is how to properly escape the encapsulator and the backslash. An example with the default encapsulator ("): "This is a text with a \"quote\"" "This gives one \ backslash" "This gives two backslashes

Re: How to configure Solr on Tomcat 6.0 as windows Service

For tomcat configuration notes, check: http://wiki.apache.org/solr/SolrTomcat I don't use tomcat, (their user list may be more useful if something goes wrong) - but this may help: http://tomcat.apache.org/tomcat-5.5-doc/windows-service-howto.html ryan Laxmilal Menaria wrote: Hello everyone,

Re: No search results when configure solr on tomcat as service

Are you indexing files while tomcat is running? If so, are you sending the message? If so, can you see what is happening in the logs? The jetty example and your tomcat setup probably put their indexes in different places, so they will not have the same results. ryan Laxmilal Menaria wrot

RE: a problem with SimplePostTool

Actually it was not a problem with the xml, I ran all the xmls using one thread and I found no problem at all. But when I changed the solr version (I was using nightly) with version 1.2, all the threads run safely. -Original Message- From: Ryan McKinley [mailto:[EMAIL PROTECTED] Sent: Sun

Re: a problem with SimplePostTool

was it a recent nightly build? We saw a similar problem a month or so back. If you get the same behavior on the current /trunk we need to fix it! ryan Heba Farouk wrote: Actually it was not a problem with the xml, I ran all the xmls using one thread and I found no problem at all. But when I

How to perform a double query in one

Hi, Is there a way to perform 2 search queries in one search request, and then return their combined results? Currently I am performing the following: I have a document which consists of "id" field which is the unique identifier, the "info" field, and an "xid" field which contains the ids of oth

RE: Backup of a Solr index

Solr indexes are file-based, so there's no need to "dump" the index to a file. In terms of how to create backups and move those backups to other servers, check out this page http://wiki.apache.org/solr/CollectionDistribution. Hope that helps. -Original Message- From: Jörg Kiegeland

Re: spellchecker and multi-core index replication

Has anyone done any work on this? https://issues.apache.org/jira/browse/SOLR-433 Thanks. Doug Ryan McKinley wrote: OG: Yes, I think that makes sense - distribute everything for a given core, not just its index. And the spellchecker could then also have its data dir (and only index/ undern

Create new core on the fly

Is it going to be possible (soon) to register new Solr cores on the fly? I know the LOAD action is yet to be implemented, but will that let you create new cores that are not listed in the multicore.xml? We're occasionally going to have to create new cores and would like to not have to stop/sta

Re: Create new core on the fly

The LOAD method will load a core from a schema/config file -- it will not need to be in multicore.xml (the persist=true option should serialize this change into multicore.xml) Henri's latest patch implements LOAD, but it needs some clean up to apply cleanly to the current trunk. ryan Doug

Re: How to perform a double query in one

Custom request handler approach seems the most straight forward and the only one I can think of quickly. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Rishabh Joshi <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: Wednesday, January

Re: spellchecker and multi-core index replication

As far as I know, the answer is no. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Doug Steigerwald <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: Wednesday, January 2, 2008 11:20:02 AM Subject: Re: spellchecker and multi-core index

Re: How to perform a double query in one

If I understand the question... you essentially want a JOIN function. Find the set of docs linked to by an initial query. Right now, you either need to do two queries (in the client or custom RequestHandler) OR, if possible, flatten the data into each doc. For your specific example, can you

Re: Backup of a Solr index

If you're writing to disk, you can minimize the chance of an inconsistent index by hardlinking the files first (cp -l) -Mike On 2-Jan-08, at 8:10 AM, Charlie Jackson wrote: Solr indexes are file-based, so there's no need to "dump" the index to a file. In terms of how to create backups and

Re: How to configure Solr on Tomcat 6.0 as windows Service

On Wed, 2 Jan 2008 16:25:58 +0530 "Laxmilal Menaria" <[EMAIL PROTECTED]> wrote: > I have tried Solr using jetty, its run on command prompt, but now I want to > comfigure solr on tomcat-6, so nay one know how to configure it as windows > service using tomcat. Any particular reason you don't use Je

Solr RPS is painfully low

Hello, I have a situation where I'm using solr with a 3Gb complete index (in ram) on a dual-core AMD machine, and I'm only getting about 1.3rps on cold queries (which for most part there is little chance for the query to be identical) Is this normal? The index contains about 20MM documents a

Re: Solr RPS is painfully low

How many rows are you requesting? Are you sorting? --wunder On 1/2/08 4:09 PM, "Alex Benjamen" <[EMAIL PROTECTED]> wrote: > Hello, > > I have a situation where I'm using solr with a 3Gb complete index (in ram) on > a dual-core > AMD machine, and I'm only getting about 1.3rps on cold queries (w

Performance stats for indeces with over 10MM documents

Hi, I'm very interested in sharing performance stats with those who have indeces that contain more than 10MM documents. It seems that the response times and QPS drops drastically with the number of documents in the index. This overall makes sense, but it would be good to know what kind of QPS o

Re: Performance stats for indeces with over 10MM documents

Alex, That's too slow. Can you provide more details about your schema, queries etc? jds On Jan 2, 2008 7:28 PM, Alex Benjamen <[EMAIL PROTECTED]> wrote: > Hi, > > I'm very interested in sharing performance stats with those who have indeces > that > contain more than 10MM documents. It seems th

Re: Solr RPS is painfully low

Are you (or have you tried) breaking these queries up as a set of filter queries? fq=gender:f&fq=( friends:y )&fq= country:us&fq= age:(18 || 19 || 20 || 21)&fq=photos:y (mod correct syntax) Should get you the same result but each fq is cached separately as a bitset and future queries tha

RE: Solr RPS is painfully low

Walter: >How many rows are you requesting? Are you sorting? --wunder I'm only requesting 20 rows, and I'm not specifically sorting by any field. Does solr automatically induce sort by default, and if so, how do I disable it? Thanks, Alex

RE: Performance stats for indeces with over 10MM documents

JDS: > That's too slow. Can you provide more details about your schema, queries etc? Ofcourse - I'm using the standard config which comes with solr, and I've added the following fields :

Re: Performance stats for indeces with over 10MM documents

Are you faceting? Please provide the exact lines logged in Solr's console for the offending queries - that would show us _exactly_ what you're hitting Solr with, not just the q parameter as you seem to have provided. Erik On Jan 2, 2008, at 8:47 PM, Alex Benjamen wrote: JDS: Th

Re: No search results when configure solr on tomcat as service

I have created index using jetty and after that have created multiple webapp with tomcat, data index folder is copied to webapps. On 1/2/08, Ryan McKinley <[EMAIL PROTECTED]> wrote: > > Are you indexing files while tomcat is running? If so, are you sending > the message? If so, can you see what

Re: How to configure Solr on Tomcat 6.0 as windows Service

I have already running tomcat on server. On 1/3/08, Norberto Meijome <[EMAIL PROTECTED]> wrote: > > On Wed, 2 Jan 2008 16:25:58 +0530 > "Laxmilal Menaria" <[EMAIL PROTECTED]> wrote: > > > I have tried Solr using jetty, its run on command prompt, but now I want > to > > comfigure solr on tomcat-6,

Re: Performance stats for indeces with over 10MM documents

On 2-Jan-08, at 5:47 PM, Alex Benjamen wrote: gender:m AND status:(2 || 8 || 6 || 3) AND age:(26 || 27 || 28 || 29) AND orientation:3 gender:f AND age:(27 || 28 || 29 || 30 || 31 || 32 || 33 || 34 || 35 || 36 ) AND orientation:2 AND photos:y gender:f AND (activity:y) AND age:(28 || 29 || 30

Re: Filter Query and query score

On 1-Jan-08, at 11:54 PM, climbingrose wrote: Doc1: [Title=Java; Location=Parramatta, NSW; latitude=x1; longitude=x2] Doc2: [Title=Java; Location=North Ryde, NSW; latitude=x3; longitude=x4] Doc3: [Title=Java; Location=Parramatta] My filter query looks like this: fq= (+latitude[lat1 TO lat

RE: Performance stats for indeces with over 10MM documents

Mike, Thanks for the input, it's really valueable. Several forum users have suggested using fq to separate the caching of filters, and I can immediately see how this would help. I'm changing the code right now and going to run some benchmarks, hopefully see a big gain just from that > - use

Re: Performance stats for indeces with over 10MM documents

Alex, Not to be a pain, but the response I had when looking at the query was, why not do this in a SQL database, which is designed precisely to process this sort of request at speed? I've noticed that people sometimes try to get Solr to act as a generalized information store -- I'm not sure that'

Re: How to configure Solr on Tomcat 6.0 as windows Service

Have configured successfully. Now I want to configure solr on different Indexes with tomcat, Please let me how it is possible. On 1/3/08, Laxmilal Menaria <[EMAIL PROTECTED]> wrote: > > I have already running tomcat on server. > > On 1/3/08, Norberto Meijome <[EMAIL PROTECTED]> wrote: > > > > On W

Re: No search results when configure solr on tomcat as service

Have configured successfully and getting search results. Now I want to configure solr on different Indexes with tomcat, Please let me how it is possible. On 1/3/08, Laxmilal Menaria <[EMAIL PROTECTED]> wrote: > > I have created index using jetty and after that have created multiple > webapp with t

Re: Performance stats for indeces with over 10MM documents

On 2-Jan-08, at 9:52 PM, Alex Benjamen wrote: Thanks for the input, it's really valueable. Several forum users have suggested using fq to separate the caching of filters, and I can immediately see how this would help. I'm changing the code right now and going to run some benchmarks, hopeful