Re: listing/enumerating field information

2007-01-11 Thread Tracey Jaquith
interesting!  Code-searching for relevant lucene classes led me to try adding    to my solrconfig.xml This allowed me to try this request...    http://localhost:8983/solr/select?rows=0&qt=test&q=fields which I think gets me (2) below. --tracey Tracey Jaquith wrote: The Internet

Re: Performance tuning

2007-01-11 Thread Thorsten Scherler
On Thu, 2007-01-11 at 14:57 +, Stephanie Belton wrote: > Hello, > > > > Solr is now up and running on our production environment and working great. > However it is taking up a lot of extra CPU and memory (CPU usage has doubled > and memory is swapping). Is there any documentation on perfo

Re: Performance tuning

2007-01-11 Thread Yonik Seeley
On 1/11/07, Stephanie Belton <[EMAIL PROTECTED]> wrote: Solr is now up and running on our production environment and working great. However it is taking up a lot of extra CPU and memory (CPU usage has doubled and memory is swapping). Is there any documentation on performance tuning? There see

How can I update a specific field of an existing document?

2007-01-11 Thread Iris Soto
Hello everybody, I want update a specific field in a document, but i don't find how do it in the documentation of Solr. Is that posible?, I need to index only a field for a document, Do i have to index all the document for this? The problem is that i have to transform a bizdata object to a file

Re: How can I update a specific field of an existing document?

2007-01-11 Thread Thorsten Scherler
On Thu, 2007-01-11 at 10:19 -0600, Iris Soto wrote: > Hello everybody, > I want update a specific field in a document, but i don't find how do it > in the documentation of Solr. > Is that posible?, I need to index only a field for a document, Do i have > to index all the document for this? > The

Re: listing/enumerating field information

2007-01-11 Thread Yonik Seeley
On 1/11/07, Tracey Jaquith <[EMAIL PROTECTED]> wrote: The Internet Archive is getting close to going live with Solr. I have two remaining classes of problems. 1) across the entire index, enumerate all the unique values for a given field. 2) we use unrestricted dynamicField additions from doc

Re: Does Solr support integration with the Compass framework?

2007-01-11 Thread Graham O'Regan
doesn't compass use multiple indexes? have a read of the "direct lucene" box on http://www.opensymphony.com/compass/versions/1.1M3/html/introduction.html#i-use-lucene would that prevent the two being used together? i'd be interested in getting the two working together as well, it'd be great to

Re: listing/enumerating field information

2007-01-11 Thread Chris Hostetter
: Code-searching for relevant lucene classes led me to try adding : : to my solrconfig.xml holy cow, i forgot that thing even existed! ... as you can see by skimmingthe code it's a hodge podge of misc crap that was used early on as a simple way to test that things were working. Writing a mor

Re: listing/enumerating field information

2007-01-11 Thread Yonik Seeley
On 1/11/07, Chris Hostetter <[EMAIL PROTECTED]> wrote: Writing a more generic "Stats" request handler that does what you're describing certianly seems like a good idea. Hmmm, I hadn't thought of it as a separate handler, but as long as these types of requests aren't related to a base query, and

RE: Performance tuning

2007-01-11 Thread Stephanie Belton
This is the output of the free command: [EMAIL PROTECTED] root2]# free -m total used free sharedbuffers cached Mem: 2007 1888119 0 86814 -/+ buffers/cache:986 1020 Swap: 1992207

Re: listing/enumerating field information

2007-01-11 Thread Chris Hostetter
: > Attempting to enumerating : > all of the values for a field could be dangerous : : We do it for faceting :-) But we don't drag it all into memory at once... i ment trying to return them all to the user at one time ... even if we decreased the server side memory usage risk my supporting Iter

RE: Performance tuning

2007-01-11 Thread Stephanie Belton
Thanks for sending this link, I seem to have missed that on the wiki! -Original Message- From: Thorsten Scherler [mailto:[EMAIL PROTECTED] Sent: 11 January 2007 15:06 To: solr-user@lucene.apache.org Subject: Re: Performance tuning On Thu, 2007-01-11 at 14:57 +, Stephanie Belton wrote

Re: Performance tuning

2007-01-11 Thread Yonik Seeley
On 1/11/07, Stephanie Belton <[EMAIL PROTECTED]> wrote: This is the output of the free command: [EMAIL PROTECTED] root2]# free -m total used free sharedbuffers cached Mem: 2007 1888119 0 86814 -/+ buffers/cache:

RE: Performance tuning

2007-01-11 Thread Stephanie Belton
Thanks for that. I am sorry this isn't really Solr-related but how can I monitor the swapping if I can't rely on the output of the free command? Do you think I could still achieve any significant improvements by going through the performance tuning advice on the wiki? -Original Message-

WordDelimiterFilter usage

2007-01-11 Thread Jeff Rodenburg
I'm trying to determine how to index/query for a certain use case, and the WordDelimiterFilterFactory appears to be what I need to use. Here's the scenario: - Text field being indexed - Field exists as a full name - Data might be "cold play" - This should match against searches for "cold play" a

Re: WordDelimiterFilter usage

2007-01-11 Thread Chris Hostetter
WordDelimiterFilter wo't really help you in this situations ... but it would help if you find a lot of users are searching for ColdPlay or cold-play. if you have a finite list of popular terms like this that you need to deal with, the SynonymFilter can help you out. : Date: Thu, 11 Jan 2007 13:

Re: Performance tuning

2007-01-11 Thread Yonik Seeley
On 1/11/07, Stephanie Belton <[EMAIL PROTECTED]> wrote: Thanks for that. I am sorry this isn't really Solr-related but how can I monitor the swapping if I can't rely on the output of the free command? Do you think I could still achieve any significant improvements by going through the performanc

RE: Performance tuning

2007-01-11 Thread Stephanie Belton
The reason I am keeping a close eye on resource usage is that our traffic is increasing by around 20% every month (currently over 400,000 page impressions/day although not all of them are search queries!) and I want to make sure we tackle any performance issues before it gets too late. I would rath

Re: Performance tuning

2007-01-11 Thread Yonik Seeley
On 1/11/07, Stephanie Belton <[EMAIL PROTECTED]> wrote: The reason I am keeping a close eye on resource usage is that our traffic is increasing by around 20% every month (currently over 400,000 page impressions/day although not all of them are search queries!) and I want to make sure we tackle an

Re: Performance tuning

2007-01-11 Thread Walter Underwood
On 1/11/07 2:33 PM, "Yonik Seeley" <[EMAIL PROTECTED]> wrote: > On 1/11/07, Stephanie Belton <[EMAIL PROTECTED]> wrote: >> The reason I am keeping a close eye on resource usage is that our traffic is >> increasing by around 20% every month (currently over 400,000 page >> impressions/day although n

Re: How can I update a specific field of an existing document?

2007-01-11 Thread Thorsten Scherler
On Thu, 2007-01-11 at 17:48 +0100, Thorsten Scherler wrote: > On Thu, 2007-01-11 at 10:19 -0600, Iris Soto wrote: > > Hello everybody, > > I want update a specific field in a document, but i don't find how do it > > in the documentation of Solr. > > Is that posible?, I need to index only a field f

Re: Performance tuning

2007-01-11 Thread Mike Klaas
On 1/11/07, Stephanie Belton <[EMAIL PROTECTED]> wrote: Thanks for that. I am sorry this isn't really Solr-related but how can I monitor the swapping if I can't rely on the output of the free command? $ vmstat -S M 3 procs ---memory-- ---swap-- -io --system-- cpu

Re: How can I update a specific field of an existing document?

2007-01-11 Thread Iris Soto
Thorsten Scherler escribió: On Thu, 2007-01-11 at 17:48 +0100, Thorsten Scherler wrote: On Thu, 2007-01-11 at 10:19 -0600, Iris Soto wrote: Hello everybody, I want update a specific field in a document, but i don't find how do it in the documentation of Solr. Is that posible?, I need t

Re: WordDelimiterFilter usage

2007-01-11 Thread Jeff Rodenburg
Thanks Hoss - it is a finite list, but in the tens of thousands. I'm going to easy route -- adding another field that indexes the terms with no included whitespace. This is used in an ajax-style lookup, so it works for this scenario. Not something I'd normally do in a typical index, for sure.