How to use Similarity

2007-04-19 Thread James liu
i uncoment Similarity in Schema.xmland start tomcat i use admin gui to test and find it not effect. maybe something is wrong, anyone know? -- regards jl

AW: Leading wildcards

2007-04-19 Thread Burkamp, Christian
Hi there, Solr does not support leading wildcards, because it uses Lucene's standard QueryParser class without changing the defaults. You can easily change this by inserting the line parser.setAllowLeadingWildcards(true); in QueryParsing.java line 92. (This is after creating a QueryParser inst

Re: Leading wildcards

2007-04-19 Thread Michael Kimsal
I've investigated this recently, and it looks like the latest lucene dev supposedly supports leading/trailing at the same time. However, I couldn't get the latest dev solr to build with the latest dev lucene (as of two weeks ago). A lucene mailing list seemed to indicate that lucene as of the la

Re: Facet Browsing

2007-04-19 Thread Jennifer Seaman
> I can't seem to get things like facet.mincount to work. We had same issue when we used Solr incubator version. Now we are using trunk version of Solr and the issue was gone. Where is this "trunk version"? I thought apache-solr-1.1.0-incubating.zip was the latest release. Can anyone provide

Re: Facet Browsing

2007-04-19 Thread Yonik Seeley
On 4/19/07, Jennifer Seaman <[EMAIL PROTECTED]> wrote: > > I can't seem to get things like facet.mincount to work. >We had same issue when we used Solr incubator version. >Now we are using trunk version of Solr and the issue was gone. Where is this "trunk version"? "trunk" is a reference to th

Re: Snapshooting or replicating recently indexed data

2007-04-19 Thread Yonik Seeley
On 4/19/07, Doss <[EMAIL PROTECTED]> wrote: It seems the snapshooter takes the exact copy of the indexed data, that is all the contents inside the index directory, how can we take the recently added once? ... cp -lr ${data_dir}/index ${temp} mv ${temp} ${name} ... I don't quite understand

Re: Leading wildcards

2007-04-19 Thread Erik Hatcher
On Apr 19, 2007, at 6:56 AM, Michael Kimsal wrote: It's bugged us a little bit, because it's something that we need (to be able to emulate the previous foo LIKE '%bar%' SQL behaviour we're replacing), but can't offer our users yet. I have also run into this issue and have intended to fix up

Re: Leading wildcards

2007-04-19 Thread Michael Kimsal
Agreed, but in our tests (100M index) it wasn't a performance hit, and much better (as in it actually worked) than MSSQL ;) On 4/19/07, Erik Hatcher <[EMAIL PROTECTED]> wrote: On Apr 19, 2007, at 6:56 AM, Michael Kimsal wrote: > It's bugged us a little bit, because it's something that we ne

Re: Leading wildcards

2007-04-19 Thread Yonik Seeley
On 4/19/07, Erik Hatcher <[EMAIL PROTECTED]> wrote: parser.setAllowLeadingWildcards(true); I have also run into this issue and have intended to fix up Solr to allow configuring that switch on QueryParser. Any reason that parser.setAllowLeadingWildcards(true) shouldn't be the default? Does it

Re: Facet Browsing

2007-04-19 Thread Erik Hatcher
On Apr 19, 2007, at 9:32 AM, Jennifer Seaman wrote: Can anyone provide a quick tutorial on how to setup facet browsing? After a keyword search I just want to allow the user to narrow the results by category, then by state, then by city and then by company. Some sample code would be apprecia

Re: Leading wildcards

2007-04-19 Thread Erik Hatcher
On Apr 19, 2007, at 10:39 AM, Yonik Seeley wrote: On 4/19/07, Erik Hatcher <[EMAIL PROTECTED]> wrote: parser.setAllowLeadingWildcards(true); I have also run into this issue and have intended to fix up Solr to allow configuring that switch on QueryParser. Any reason that parser.setAllowLeadi

Re: Leading wildcards

2007-04-19 Thread Michael Kimsal
It still seems like it's only something that would be invoked by a user's query. If I queried for *foobar and leading wildcards were not on in the server, I'd get back nothing, which isn't really correct. I'd think the application should tell the user that that syntax isn't supported. Perhaps I

Re: Leading wildcards

2007-04-19 Thread Erik Hatcher
On Apr 19, 2007, at 11:04 AM, Michael Kimsal wrote: Perhaps I'm simplifying it a bit. It would certainly help out our comfort level to have it either be on or configurable by default, rather than having to maintain a 'patched' version (yes, the patch is only one line, but it's the princi

Re: Facet Browsing

2007-04-19 Thread Kevin Lewandowski
I recommend you build your query with facet options in raw format and make sure you're getting back the data you want. Then build it into your app. On 4/18/07, Jennifer Seaman <[EMAIL PROTECTED]> wrote: Does anyone have any sample code (php, perl, etc) how to setup facet browsing with paging? I

Re: Leading wildcards

2007-04-19 Thread Michael Kimsal
I'm in the middle of looking in to that. For *you* ;) it may seem like a quick thing to do. For me, who's not an expert at this stuff, it's a balance between delving in deeply enough to figure how to do it and hitting our deadlines. It's actually on someone else's plate here, but he's backed u

Re: Leading wildcards

2007-04-19 Thread Erik Hatcher
On Apr 19, 2007, at 11:37 AM, Michael Kimsal wrote: It's not that I don't *want* to contribute, but hardly have enough time to get the basics done some days. You can rest assured that all of us here are in that same boat. :) And you can also rest assured that the switch your asking for wil

Multiple indexes?

2007-04-19 Thread Matthew Runo
Hey there- I was wondering if the following was possible, and, if so, how to set it up... I want to index two different types of data, and have them searchable from the same interface. For example, a group of products, with size, color, price, etc info. And a group of brands, with brand,

Multiple Solr Cores

2007-04-19 Thread Henrib
Following up on a previous thread in the Solr-User list, here is a patch that allows managing multiple cores in the same VM (thus multiple config/schemas/indexes). The SolrCore.core singleton has been changed to a Map; the current singleton behavior is keyed as 'null'. (Which is used by SolrInfoRe

Re: acts_as_solr

2007-04-19 Thread solruser
Hi, Does the acts_as_solr supports now fancier results such as highlight? Although I see options to use facets but have not yet explored with the plugin. TIA -amit Erik Hatcher wrote: > > > On Aug 28, 2006, at 10:25 PM, Erik Hatcher wrote: >> I'd like to commit this to the Solr repository.

Re: Multiple indexes?

2007-04-19 Thread Cody Caughlan
Why not just store an additional "object_type" field which differentiates between the actual type of data you are looking for? So if you're looking for some shoes: (size:8 AND color:'blue') AND object_type:'shoe' Or if you're searching on brands (genre:'skater' AND brand_desc:'skater boy') AND

Re: Multiple indexes?

2007-04-19 Thread Henrib
You can not have more than one Solr core per application (to be precise, per class-loader since there are a few statics). One way is thus to have 2 webapps - when & if indexes do not have the same lifetime/radically different schema/etc. However, the common wisdom is that you usually dont really n

Re: Multiple Solr Cores

2007-04-19 Thread mpelzsherman
This sounds like a great idea, and potentially very useful for my company. Can you explain a bit about how you would configure the various solr/home paths, and how the different indexes would be accessed by clients? Thanks! - Michael -- View this message in context: http://www.nabble.com/Mult

Re: Facet Browsing

2007-04-19 Thread Mike Klaas
On 4/18/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 4/18/07, Koji Sekiguchi <[EMAIL PROTECTED]> wrote: > > I can't seem to get things like facet.mincount to work. > > We had same issue when we used Solr incubator version. > Now we are using trunk version of Solr and the issue was gone. Hmmm,

Re: help need on words with special characters

2007-04-19 Thread Mike Klaas
On 4/18/07, Doss <[EMAIL PROTECTED]> wrote: I am new to solr(and 0 in lucene), my doubt is how can i protect words with special characters from tokenizing, sat for example A+, A1+ etc. because when i searched for "group A" i am getting results with A+ aswell as A1+ and so on, is there any sp

Re: Multiple indexes?

2007-04-19 Thread Matthew Runo
Ah hah! This appears to be what I'm interested in doing. I'll have to read up on object_types. ++ | Matthew Runo | Zappos Development | [EMAIL PROTECTED] | 702-943-7833 ++ On Apr

Re: Multiple indexes?

2007-04-19 Thread Cody Caughlan
If you're doing this in Ruby, there is an "acts_as_solr" plugin for Rails which takes exactly this approach to store all different kinds of Model objects in the same index...I just "took" the idea from there... /Cody On 4/19/07, Matthew Runo <[EMAIL PROTECTED]> wrote: Ah hah! This appears to be

Re: Multiple Solr Cores

2007-04-19 Thread Henrib
There is still only one solr.home instance used to load the various classes which is used as the one 'root'. >From there, you can have multiple solrconfig*.xml & schema*.xml (even absolute pathes); calling new SolrCore(name_of_core, path_to_solrconfig, path_to_schema) creates a named core that you

Re: Multiple indexes?

2007-04-19 Thread Matthew Runo
I'll actually be doing this in Perl.. any ideas on perl? heh ++ | Matthew Runo | Zappos Development | [EMAIL PROTECTED] | 702-943-7833 ++ On Apr 19, 2007, at 11:59 AM, Cody Caugh

Filter question...

2007-04-19 Thread escher2k
I have a bunch of fields that I am trying to filter on. When I try to filter the data across the multiple fields, the result seems to even retrieve fields where the data is not present. For instance if the filter query contains this - primary_state:New Delhi OR primary_country:New Delhi OR prima

Re: Multiple indexes?

2007-04-19 Thread Erik Hatcher
Matthew, All that is meant by "object_types" is an additional stored/indexed field in the Solr schema that gets added to every document providing context of which type it is (shoes or brands). Then you can limit searches to a particular area by just filtering on type:shoes, for example.

Re: Filter question...

2007-04-19 Thread Jennifer Seaman
Is there a way to only retrieve those records that contain both the words "New" and "Delhi". I'm just starting with this, put I found you need to do; primary_state:"New Delhi" I never used the OR yet!

Querying an index while commiting/optimizing

2007-04-19 Thread Cody Caughlan
This is more of a Lucene question than a Solr one, but... is it possible to query a Solr(Lucene) index while it is in the middle of performing a commit/optimize? Some of the Lucene documentation *implies*, but on a logical level it seems kind of crazy. But at the same time, for applications where

Re: Querying an index while commiting/optimizing

2007-04-19 Thread Yonik Seeley
On 4/19/07, Cody Caughlan <[EMAIL PROTECTED]> wrote: This is more of a Lucene question than a Solr one, but... is it possible to query a Solr(Lucene) index while it is in the middle of performing a commit/optimize? Yep, no problems. You can query concurrently with adds, deletes, commits, and o

Re: Querying an index while commiting/optimizing

2007-04-19 Thread Cody Caughlan
Ok, cool. At the worse case, are you just not going to get any hits, even though you "know" the data is in there, but it just hasnt been indexed yet? How does that work? /cody On 4/19/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 4/19/07, Cody Caughlan <[EMAIL PROTECTED]> wrote: > This is mor

Re: Querying an index while commiting/optimizing

2007-04-19 Thread Yonik Seeley
On 4/19/07, Cody Caughlan <[EMAIL PROTECTED]> wrote: How does that work? From the user perspective, you continue to "see" the previous version of the index that was last committed until the current commit is completely finished. -Yonik

Re: Querying an index while commiting/optimizing

2007-04-19 Thread Cody Caughlan
PERFECT. Thanks guys/gals. On 4/19/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 4/19/07, Cody Caughlan <[EMAIL PROTECTED]> wrote: > How does that work? From the user perspective, you continue to "see" the previous version of the index that was last committed until the current commit is compl

Re: Multiple indexes?

2007-04-19 Thread Matthew Runo
Ah. That makes sense then. I wasn't sure if that was the best way to go about things or not. I didn't want to end up with a bunch of fields that were not being used all the time if it would cause a degradation in search quality. ++ |

Re: [acts_as_solr] Few question on usage

2007-04-19 Thread Chris Hostetter
I don't really know alot about Ruby, but as i understand it there are more then a few versions of something called "acts_as_solr" floating arround ... the first written by Erik as a proof of concept, and then pickedu pand polished a bit by someone else (whose name escapes me) all of the "serious"

Re: limiting the rows returned for a query

2007-04-19 Thread Chris Hostetter
: I want to do a simple query to the solr index. something like : q=stateid:1 countryid:1 : : but i'm really only concerned with getting the record above and below a : certain (dynamic) recordid in the search results. you have to define what "above and below" means in your context ... do you mea

Re: Requests per second/minute monitor?

2007-04-19 Thread Chris Hostetter
: Is there a good spot to track request rate in Solr? Has anyone : built a monitor? I would think it would make more sense to track this in your application server then to add it to Solr itself. -Hoss

Re: Leading wildcards

2007-04-19 Thread Chris Hostetter
: > Any reason that parser.setAllowLeadingWildcards(true) shouldn't be : > the default? i'm of two minds on this, both of which vote "don't do it" from a predictibility standpoint, i think we should keep the default beahvior the same as the base QueryParsers default behavior as much as possible

Re: help need on words with special characters

2007-04-19 Thread Chris Hostetter
: with special characters from tokenizing, sat for example A+, A1+ etc. : because when i searched for "group A" i am getting results with A+ : aswell as A1+ and so on, is there any special way to index these type of : words? all fo the tokenization is controlled via the analyzers you configure in

Re: Leading wildcards

2007-04-19 Thread Yonik Seeley
On 4/19/07, Chris Hostetter <[EMAIL PROTECTED]> wrote: : > Any reason that parser.setAllowLeadingWildcards(true) shouldn't be : > the default? i'm of two minds on this, both of which vote "don't do it" from a predictibility standpoint, i think we should keep the default beahvior the same as th

Re: Leading wildcards

2007-04-19 Thread Yonik Seeley
On 4/19/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: > from a stability standpoint, i would suggest that people should have to go > out of their way to get this behavior, since it does open up the > possiblity of a query OOMing Solr extremely easily. ConstantScorePrefixQuery is used... there shou

Re: Multiple indexes?

2007-04-19 Thread Chris Hostetter
: So if you're looking for some shoes: : (size:8 AND color:'blue') AND object_type:'shoe' : Or if you're searching on brands : (genre:'skater' AND brand_desc:'skater boy') AND object_type:'brand' a slight improvement on this: put your object_type restriction in a filter query (&fq=object_type:foo

Re: Filter question...

2007-04-19 Thread escher2k
Thanks Jennifer. But the issue with the quotes would be that it would match the string exactly and not find it, if there were other words in between (e.g. New Capital Delhi). Jennifer Seaman wrote: > > >>Is there a way to only retrieve those records that contain both the >>words "New" and "De

Re: Leading wildcards

2007-04-19 Thread Chris Hostetter
: For things that return results, yes. I think that taking away : features isn't a good thing, but adding them can be (basically, : backward compatibility). i don't know that this is really dding a feature ... it's changing syntax. "foo:*bar" has meaning by default in the query parser ... it's m

Re: Leading wildcards

2007-04-19 Thread Chris Hostetter
: > ConstantScorePrefixQuery is used... there shouldn't be an issue with : > memory, just time. : : Oops, except we aren't always talking about a prefix query. : I know at least some expanding queries automatically limit to the max : number of boolean clauses. Not sure if all of them do though.

Re: Filter question...

2007-04-19 Thread Mike Klaas
On 4/19/07, escher2k <[EMAIL PROTECTED]> wrote: Thanks Jennifer. But the issue with the quotes would be that it would match the string exactly and not find it, if there were other words in between (e.g. New Capital Delhi). If you want to restrict a section of a query to a field, use brackets:

Re: Filter question...

2007-04-19 Thread Chris Hostetter
: not find it, if there were other words in between (e.g. New Capital Delhi). then you should use field:"New Delhi"~3 or (+field:New +field:Delhi) what you have now is going to match any docs that have "New" in any of the fields you care about or Delhi in whatever you default search field is. in

Re: Filter question...

2007-04-19 Thread escher2k
Thanks Chris. We are using dismax already :) Chris Hostetter wrote: > > > : not find it, if there were other words in between (e.g. New Capital > Delhi). > > then you should use field:"New Delhi"~3 or (+field:New +field:Delhi) what > you have now is going to match any docs that have "New" in

Re: Filter question...

2007-04-19 Thread escher2k
Thanks Mike. I just tested it on one field and looks like it works fine. Mike Klaas wrote: > > On 4/19/07, escher2k <[EMAIL PROTECTED]> wrote: >> >> Thanks Jennifer. But the issue with the quotes would be that it would >> match >> the string exactly and >> not find it, if there were other words

Re: Leading wildcards

2007-04-19 Thread Yonik Seeley
On 4/19/07, Chris Hostetter <[EMAIL PROTECTED]> wrote: : For things that return results, yes. I think that taking away : features isn't a good thing, but adding them can be (basically, : backward compatibility). i don't know that this is really dding a feature ... it's changing syntax. "foo:*ba

Re: Multiple indexes?

2007-04-19 Thread Ryan McKinley
As this question comes up so often, i put a new page on the wiki: http://wiki.apache.org/solr/MultipleIndexes We should fill in more details and link it to the front page. Chris Hostetter wrote: : So if you're looking for some shoes: : (size:8 AND color:'blue') AND object_type:'shoe' : Or i

Re: Leading wildcards

2007-04-19 Thread Chris Hostetter
: > i don't know that this is really dding a feature ... it's changing syntax. : > "foo:*bar" has meaning by default in the query parser ... it's meaning may : > typically result in a query that doesn't match anything, : : I think it's adding syntax, not changing it. : Right now, you get an except

Re: Question: index performance

2007-04-19 Thread Chris Hostetter
: solr, 100 documents at a time. I was doing a commit after each of those : but after what Yonik says I will remove it and commit only after each : batch of 25k. do the commit only when you think it's neccessary to expose those docs to your search clients, one of which may be "you" checking on th

Solr performance warnings

2007-04-19 Thread Michael Thessel
Hello, in my logs I get from time to time this message: INFO: PERFORMANCE WARNING: Overlapping onDeckSearchers=2 What does this mean? What can I do to avoid this? Cheers, Michael

Re: Multiple Solr Cores

2007-04-19 Thread Chris Hostetter
I'm sorry to say I am *way* behind on my patch reading (and moving into my new place this weekend where i have no net access isn't going to help) so i can't comment on the technique (or even style) of this patch ... but if you could do peopel a favor and open a Jira issue and post it there for peo

Re: Solr performance warnings

2007-04-19 Thread Erik Hatcher
On Apr 19, 2007, at 7:47 PM, Michael Thessel wrote: in my logs I get from time to time this message: INFO: PERFORMANCE WARNING: Overlapping onDeckSearchers=2 What does this mean? What can I do to avoid this? I think you have issued multiple commits (or optimizes) that hadn't fully finished

Re: [acts_as_solr] Few question on usage

2007-04-19 Thread Erik Hatcher
Sorry, I missed the original mail. Hoss has got it right. Personally I'd love to see acts_as_solr definitively come into the solr-ruby fold. Regarding your questions: : 1. What are other alternatives are available for ruby integration with solr : other than acts-as_solr plugin. acts_a

yesterday i download solr, it not support IndexInfo

2007-04-19 Thread James liu
i read it from http://wiki.apache.org/solr/IndexInfoRequestHandler -- regards jl

Re: yesterday i download solr, it not support IndexInfo

2007-04-19 Thread Erik Hatcher
On Apr 19, 2007, at 9:42 PM, James liu wrote: i read it from http://wiki.apache.org/solr/IndexInfoRequestHandler Could you elaborate? What request did you make of Solr? What was its response? What solrconfig.xml file are you using? The example config file has the indexinfo request

Re: yesterday i download solr, it not support IndexInfo

2007-04-19 Thread Ryan McKinley
James liu wrote: i read it from http://wiki.apache.org/solr/IndexInfoRequestHandler The IndexInfoRequestHandler was added since the solr 1.1. You will need to compile the source from: http://svn.apache.org/repos/asf/lucene/solr/trunk/ to get the IndexInfo handler.

Re: yesterday i download solr, it not support IndexInfo

2007-04-19 Thread James liu
I know it should be configed in solrconfig.xml. and i think it may be with newest version. But i find no, so i just think is it problem when i download. 2007/4/20, Erik Hatcher <[EMAIL PROTECTED]>: On Apr 19, 2007, at 9:42 PM, James liu wrote: > i read it from http://wiki.apache.org/solr/In

Facet.query

2007-04-19 Thread Ge, Yao \(Y.\)
When mutiple facet queries are specified, are they booleaned as OR or AND? -Yao

RE: Facet.query

2007-04-19 Thread Ge, Yao \(Y.\)
Never mind. I should have read the example (http://wiki.apache.org/solr/SimpleFacetParameters#head-1da3ab3995bc4abc dce8e0f04be7355ba19e9b2c) first. From: Ge, Yao (Y.) Sent: Thursday, April 19, 2007 10:41 PM To: 'solr-user@lucene.apache.org' Subject: Facet.query

Re: Facet.query

2007-04-19 Thread James liu
I think it only concern with QueryWord, not about Facet。 2007/4/20, Ge, Yao (Y.) <[EMAIL PROTECTED]>: Never mind. I should have read the example (http://wiki.apache.org/solr/SimpleFacetParameters#head-1da3ab3995bc4abc dce8e0f04be7355ba19e9b2c) first. From: Ge