Need deployment strategy

2010-01-13 Thread Paul Rosen
Hi all, The way the indexing works on our system is as follows: We have a separate "staging" server with a copy of our web app. The clients will index a number of documents in a batch on the staging server (this happens about once a week), then they play with the results on the staging server

Re: SOLR Performance Tuning: Pagination

2009-12-24 Thread Paul Rosen
This is similar to a problem I've been having. It's pretty easy to just limit the user to 200 pages when the results are sorted by relevance, but if they are sorted alphabetically, then that doesn't work. It would be nice if there were a "limit=2000" parameter to the solr call that is applied t

Re: Webinar: An Introduction to Basics of Search and Relevancy with Apache Solr hosted by Lucid Imagination

2009-12-02 Thread Paul Rosen
Is there, or will there be, a screencast of this available? I'm sorry to have missed it. Tom Hill wrote: In this introductory technical presentation, renowned search expert Mark Bennett, CTO of Search Consultancy New Idea Engineering, will present practical tips and examples to help you quickl

Re: indexing on differnt server

2009-11-12 Thread Paul Rosen
I'm not sure if this is what you mean, but we do all our indexing on a non-public server so we can test it. Only when everyone is satisfied do we put it on the public server. To do that we just tar up the "index" folder and scp it to the server. To install it, we stop solr, untar it, and start

Re: de-boosting certain facets during search

2009-11-10 Thread Paul Rosen
her wrote: Paul, Inline below... On Nov 9, 2009, at 6:28 PM, Paul Rosen wrote: If I could just create the desired URL, I can probably work backwards and construct the correct ruby call. Right, this list will always serve you best if you take the Ruby out of the equation. solr-ruby, while cool

Re: de-boosting certain facets during search

2009-11-09 Thread Paul Rosen
that matters. I'd like the search to put all of the objects that contain genre "Citation" below the 10 objects that do not contain that genre. I've read the various pages on boosting, but since I'm not actively searching on the field that I want to put a boost value on

Re: Why doesn't highlighting work on this document?

2009-11-09 Thread Paul Rosen
find that the text matched was later in the doc. Jake -Original Message- From: Paul Rosen [mailto:p...@performantsoftware.com] Sent: Friday, November 06, 2009 4:07 PM To: solr-user@lucene.apache.org Subject: Why doesn't highlighting work on this document? I have a puzzling case t

storing other files in index directory

2009-11-02 Thread Paul Rosen
Are there any pitfalls to storing an arbitrary text file in the same directory as the solr index? We're slinging different versions of the index around while we're testing and it's hard to keep them straight. I'd like to put a readme.txt file in the directory that contains some history about

relevancy and merging

2009-10-26 Thread Paul Rosen
Is there any difference to the relevancy score for a document that has been added directly to an index vs. the same document that got into the index because of a merge? In other words, I'd like to build my index in pieces (since people in different cities will be working on parts of it), but I

Re: format of sort parameter in Solr::Request::Standard

2009-10-12 Thread Paul Rosen
tor] hash[:df] = @params[:default_field] Does this make sense? Should this be changed in the next version of the solr-ruby gem? Paul Rosen wrote: Hi all, I'm using solr-ruby 0.0.7 and am having trouble getting Sort to work. I have the following statement: req = Solr::Request::St

Re: solr severe error when doing a faceted search

2009-10-09 Thread Paul Rosen
gardless of the method). You can get the old behavior bt adding either of the parameters "facet.method=enum" or "f.content.facet.method=enum" We'll add something to the release notes. -Yonik http://www.lucidimagination.com On Fri, Oct 9, 2009 at 3:23 PM, Paul Rosen wrot

solr severe error when doing a faceted search

2009-10-09 Thread Paul Rosen
(using solr 1.4 nightly; solr-ruby 0.0.7) I am attempting to do an auto-complete with the following statement: req = Solr::Request::Standard.new( :start => 0, :rows => 0, :shards => [ 'resources', 'exhibits'], :query => "*:*", :filter_queries => [ ], :facets => {:fields => [ "content" ], :min

format of sort parameter in Solr::Request::Standard

2009-10-09 Thread Paul Rosen
Hi all, I'm using solr-ruby 0.0.7 and am having trouble getting Sort to work. I have the following statement: req = Solr::Request::Standard.new(:start => start, :rows => max, :sort => [ :title_sort => :ascending ], :query => query, :filter_queries => filter_queries, :field_list => @field_lis

Re: Merging multicore indexes

2009-10-06 Thread Paul Rosen
Shalin Shekhar Mangar wrote: The path on the wiki page was wrong. You need to use the adminPath in the url. Look at the adminPath attribute in solr.xml. It is typically /admin/cores So the correct path for you would be: http://localhost:8983/solr/admin/cores?action=mergeindexes&core=merged&ind

Merging multicore indexes

2009-10-04 Thread Paul Rosen
Hi, I've been trying to experiment with merging, but have been running into some problems. First, I'm using ruby and the solr-ruby-0.0.7 gem. It looks like there is no support in that gem for merging. Have I overlooked something? Second, I was attempting to just follow the instructions in

Re: Specifying "all except field" in field list?

2009-10-02 Thread Paul Rosen
ldAliasesAndGlobsInParams On Fri, Oct 2, 2009 at 1:27 PM, Paul Rosen wrote: Hi, Is there a way to request all fields in an object EXCEPT a particular one? In other words, the following pseudo code is what I'd like to express: req = Solr::Request::Standard.new(:start => page*size,

Specifying "all except field" in field list?

2009-10-02 Thread Paul Rosen
Hi, Is there a way to request all fields in an object EXCEPT a particular one? In other words, the following pseudo code is what I'd like to express: req = Solr::Request::Standard.new(:start => page*size, :rows => size, :query => my_query, :field_list => [ ALL EXCEPT 'text' ]) Is there a way

Re: shards and facet_count

2009-09-25 Thread Paul Rosen
Sorry for the long delay in responding, but I've just gotten back to this problem... I got the solr 1.4 nightly and the problem went away, so I guess it is a solr 1.3 bug. Thanks for all the input! Lance Norskog wrote: Paul, can you create an HTTP url that does this exact query? With multip

Re: multicore shards and relevancy score

2009-09-15 Thread Paul Rosen
Shalin Shekhar Mangar wrote: On Tue, Sep 15, 2009 at 2:39 AM, Paul Rosen wrote: I've done a few experiments with searching two cores with the same schema using the shard syntax. (using solr 1.3) My use case is that I want to have multiple cores because a few different people will be man

multicore shards and relevancy score

2009-09-14 Thread Paul Rosen
Hi, I've done a few experiments with searching two cores with the same schema using the shard syntax. (using solr 1.3) My use case is that I want to have multiple cores because a few different people will be managing the indexing, and that will happen at different times. The data, however, i

Re: shards and facet_count

2009-09-14 Thread Paul Rosen
Shalin Shekhar Mangar wrote: On Fri, Sep 11, 2009 at 2:35 AM, Paul Rosen wrote: Hi again, I've mostly gotten the multicore working except for one detail. (I'm using solr 1.3 and solr-ruby 0.0.6 in a rails project.) I've done a few queries and I appear to be able to get hits f

shards and facet_count

2009-09-10 Thread Paul Rosen
Hi again, I've mostly gotten the multicore working except for one detail. (I'm using solr 1.3 and solr-ruby 0.0.6 in a rails project.) I've done a few queries and I appear to be able to get hits from either core. (yeah!) I'm forming my request like this: req = Solr::Request::Standard.new(

Re: solr 1.3 and multicore data directory

2009-09-10 Thread Paul Rosen
2009 at 1:57 AM, Paul Rosen wrote: Hi All, I'm trying to set up solr 1.3 to use multicore but I'm getting some puzzling results. My solr.xml file is: When I start up solr, everything looks normal until I get this line in the log: INFO: [resources] Opening new SolrCo

solr 1.3 and multicore data directory

2009-09-09 Thread Paul Rosen
Hi All, I'm trying to set up solr 1.3 to use multicore but I'm getting some puzzling results. My solr.xml file is: dataDir="solr/resources/data/" /> dataDir="solr/exhibits/data/" /> dataDir="solr/reindex_resources/data/" /> When I start up solr, everything looks normal until I g

Re: multicore and ruby

2009-09-09 Thread Paul Rosen
lhost:8983/solr/core0,localhost:8983/solr/core1') because it has a "?" in it. Erik Hatcher wrote: With solr-ruby, simply put the core name in the URL of the Solr::Connection... solr = Solr::Connection.new('http://localhost:8983/solr/core_name') Erik On Sep 9,

Re: multicore and ruby

2009-09-09 Thread Paul Rosen
Hi Matt, What kinds of things were you hoping to find when looking for multicore support in either solr-ruby or rsolr? I have a couple of uses for it: 1) Search and merge the results from multiple indexes: http://localhost:8983/solr/core0/select?shards=localhost:8983/solr/core0,localhost:898

multicore and ruby

2009-09-09 Thread Paul Rosen
Hi all, I'd like to start experimenting with multicore in a ruby on rails app. Right now, the app is using the solr-ruby-rails-0.0.5 to communicate with solr and it doesn't appear to have direct support for multicore and I didn't have any luck googling around for it. We aren't necessarily we

Re: Partial updates?

2009-08-28 Thread Paul Rosen
That sounds very similar to my use case, too. (Mentioned in the recent thread "Updating a solr record"). So +1 on allowing updates! Jason Rutherglen wrote: Don, I started work on fixing this a while back. However I plan to resume again soon. Basically one would be able to update fields to a pa

Re: Updating a solr record

2009-08-27 Thread Paul Rosen
Hi Eric, I think I understand what you are saying but I'm not sure how it would work. I think you are saying to have two different indexes, each one has the same documents, but one has the hard-to-get fields and the other has the easy-to-get fields. Then I would make the same query twice, once

Re: Updating a solr record

2009-08-27 Thread Paul Rosen
solr because I just can't create the record the same way as I originally did. (Besides the time involved in crawling all those websites, some of them only allow us access for a limited amount of time, so to reindex, we need to call them up and schedule a time for them to whitelist us.)

Updating a solr record

2009-08-27 Thread Paul Rosen
I realize there is no way to update particular fields in a solr record. I know the recommendation is to delete the record from the index and re-add it, but in my case, it is difficult to completely reindex, so that creates problems with my work flow. That is, the info that I use to create a so

Re: strange sorting results: each word in field is sorted

2009-08-19 Thread Paul Rosen
Erik Hatcher wrote: On Aug 19, 2009, at 2:45 PM, Paul Rosen wrote: You can see the problem here (at least until it's fixed!): http://nines.performantsoftware.com/search/saved?user=paul&name=poem Hi Paul - that project looks familiar! :) Hi Erik! I should hope so! And I'

strange sorting results: each word in field is sorted

2009-08-19 Thread Paul Rosen
I'm trying to sort, but I am not always getting the correct results and I'm not sure where to start tracking down the problem. You can see the problem here (at least until it's fixed!): http://nines.performantsoftware.com/search/saved?user=paul&name=poem If you sort by Title/Ascending, you ge