Re: Recent updates to Solrsharp

2007-06-20 Thread Yonik Seeley
On 6/21/07, Jeff Rodenburg <[EMAIL PROTECTED]> wrote: As an aside, it would be nice to record these issues more granularly in JIRA. Could we get a component created for our client library, similar to java/php/ruby? Done. -Yonik

Recent updates to Solrsharp

2007-06-20 Thread Jeff Rodenburg
Thanks to Yonik, Michael, Ryan, (and others) for some recent help on various issues discovered with Solrsharp. We were able to discover a few issues with the library relative to the Solr 1.2 release. Those issues have been remedied and have been pushed into source control. The Solrsharp source

RE: Faceted Search!

2007-06-20 Thread niraj tulachan
Hi Mike, Currently, I'm just running the demo example provided in the Solr web site on my local windows machines. I was purely looking into generating XML feed file and feeding to the Solr server. However, I was also looking into implementing having sub-categories within the categories if

delete changed?

2007-06-20 Thread James liu
solr:1.2 curl http://192.168.7.6:8080/solr0/update --data-binary 'nodeid:20' i remember it is ok when i use solr 1.1 does it change? it show me: HTTP Status 400 - missing content stream -- *type* Status report *message* *missing content stream* *description* *The

Re: Multiple doc types in schema

2007-06-20 Thread Jim Dow
Ignore the poor segmentation scheme (document types combined with categorizing), but this is working quite well as we get close to going live with a product. This static IndexDocKey class contains enumerator that generates Catalog keys for each type of document (POJO / Model object) that gets ind

Re: SolrSharp example

2007-06-20 Thread Jeff Rodenburg
Thanks for checking, Michael -- great find. I'm in process of readying this same fix for inclusion in the source code (I'm verifying against a full 1.2install.) The SolrField class is now also being extended to incorporate an IsDefaulted property, which will permit the SolrSchema.IsValidUpdateIn

Re: Multiple doc types in schema

2007-06-20 Thread James liu
I see SOLR-215 from this mail. Does it now really support multi index and search it will return merged data? for example: i wanna search: aaa, and i have index1, index2, index3, index4it should return the result from index1,index2,index3, index4 and merge result by score, datetime, or other

Re: SolrSharp example

2007-06-20 Thread Michael Plax
Hello, Yonik and Jeff thank you for your help. You are right this was content-type issue. in order to run example following things need to be done: 1.Code (SolrSharp) should be changed from: src\Configuration\SolrSearcher.cs(217):oRequest.ContentType = "application/x-www-form-urle

Re: Slave/Master swap

2007-06-20 Thread James liu
If just one master or one slave server fail, i think u maybe can use master index server. shell controlled by program is easy for me. i use php and shell_exec. 2007/6/21, Otis Gospodnetic <[EMAIL PROTECTED]>: Right, that SAN con 2 Masters sounds good. Lucky you with your lonely Master! Wh

RE: Faceted Search!

2007-06-20 Thread Mike Austin
Niraj: What environment are you using? SQL Server/.NET/Windows? or something else? -Mike -Original Message- From: Chris Hostetter [mailto:[EMAIL PROTECTED] Sent: Wednesday, June 20, 2007 4:24 PM To: solr-user@lucene.apache.org Subject: Re: Faceted Search! : define the sub-categories.

Re: All facet.fields for a given facet.query?

2007-06-20 Thread Yonik Seeley
On 6/20/07, Chris Hostetter <[EMAIL PROTECTED]> wrote: facet.mincount is a way to tell solr not to bother giving you those 0 counts ... An aside: shouldn't that be the default? All of the people using facets that I have seen always have to set facet.mincount=1 (or facet.zeros=false) -Yonik

Re: Rejecting fields with null values

2007-06-20 Thread Yonik Seeley
Keep in mind filters too... they can be much more efficient if used often: ?q=test&fq=field_b:[* TO *] -Yonik On 6/20/07, Thiago Jackiw <[EMAIL PROTECTED]> wrote: Hoss, > As an inverted index, the Lucene index Solr uses doesn't know when > documents have an "empty" value ... it stores the inve

Re: Rejecting fields with null values

2007-06-20 Thread Thiago Jackiw
Hoss, As an inverted index, the Lucene index Solr uses doesn't know when documents have an "empty" value ... it stores the inverted mapping of value=>documents, so there is no way to query for field_b:NULL, let alone "NOT field_b:bull" I see what you mean. I guess searching for fields that re

Re: All facet.fields for a given facet.query?

2007-06-20 Thread Chris Hostetter
: I realized, that the facets are build out of the whole index, not the : subset : returned by the initial query. Therefore I have a large number of empty : facets which I simply ignore. In my case the QueryTime is somewhat facet.mincount is a way to tell solr not to bother giving you those 0 cou

Re: All facet.fields for a given facet.query?

2007-06-20 Thread Martin Grotzke
On Wed, 2007-06-20 at 12:49 -0700, Chris Hostetter wrote: > : > I solve this problem by having metadata stored in my index which tells > : > my custom request handler what fields to facet on for each category ... > : How do you define this metadata? > > this might be a good place to start, note th

Re: Rejecting fields with null values

2007-06-20 Thread Chris Hostetter
: I'm not sure if this is possible or not, but, is there a way to do a : search and reject fields that are empty or have null values like the : pseudo code below? As an inverted index, the Lucene index Solr uses doesn't know when documents have an "empty" value ... it stores the inverted mapping o

Re: RAMDirecotory instead of FSDirectory for SOLR

2007-06-20 Thread Otis Gospodnetic
Hi Jeryl, Three weeks later - any luck with Solr + Terracotta? Thanks, Otis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Simpy -- http://www.simpy.com/ - Tag - Search - Share - Original Message From: Jeryl Cook <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Se

Rejecting fields with null values

2007-06-20 Thread Thiago Jackiw
I'm not sure if this is possible or not, but, is there a way to do a search and reject fields that are empty or have null values like the pseudo code below? ?q=test+AND+(NOT+field_b:NULL) If this is not currently supported, does anyone think this is not a god idea to be implemented? Thanks, --

Re: Multiple doc types in schema

2007-06-20 Thread Otis Gospodnetic
This sounds like a potentially good use-case for SOLR-215! See https://issues.apache.org/jira/browse/SOLR-215 Otis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Simpy -- http://www.simpy.com/ - Tag - Search - Share - Original Message From: Chris Hostetter <[EMAIL PRO

Re: page rank

2007-06-20 Thread Nick Jenkin
Also if you are using the standard request handler you can use the "val" hack: foo:"bar" _val_:"recip(rord(numberField),1,1000,1000)" You can find more info about this here: http://wiki.apache.org/solr/FunctionQuery -Nick On 6/21/07, Daniel Alheiros <[EMAIL PROTECTED]> wrote: Hi David. Yes y

Re: All facet.fields for a given facet.query?

2007-06-20 Thread Thomas Traeger
Chris Hostetter schrieb: : to make it clear, i agree that it doesn't make sense faceting on all : available fields, I only want faceting on those 300 attributes that are : stored together with the fields for full text searches. A : product/document has typically only 5-10 attributes. : : I like t

Re: snapinstaller safety

2007-06-20 Thread Bill Au
There isn't any technical reason for not checking. I just didn't think of it when I first wrote the script. We are using links to create the new index so we are not taking up any more disk space or inodes. But I suppose something could still go wrong since the system has to create a new directo

Re: Slave/Master swap

2007-06-20 Thread Otis Gospodnetic
Right, that SAN con 2 Masters sounds good. Lucky you with your lonely Master! Where I work hw failures are pretty common. Otis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Simpy -- http://www.simpy.com/ - Tag - Search - Share - Original Message From: Chris Hostet

Re: Slave/Master swap

2007-06-20 Thread Chris Hostetter
: The more expensive solution might be to have Solr instances run on top : of a SAN and then one could really have multiple Master instances, one : in stand-by mode and ready to be started as the new Master if the i *believe* that if you have two solr isntances pointed at the same physical data

Re: Slave/Master swap

2007-06-20 Thread Otis Gospodnetic
Hi, Yes, I thought of flag file + wrapper script tricks, but that didn't sound super elegant either, and the other differences in behaviour between master and slave are also true. H, I've always wanted to try DRDB (http://www.drbd.org/). Master->(Master+Slaves) replication via DRDB? I im

Re: Faceted Search!

2007-06-20 Thread Chris Hostetter
: define the sub-categories. let's say from the above example, the : category "price" has different sub-categories like "less than 100" : ,"100-200"? I'm guessing, we explicit define this in XML feed file, but : I could be very wrong. In any case, can you please give me the short : example achi

Re: problems getting data into solr index

2007-06-20 Thread Mike Klaas
On 20-Jun-07, at 6:38 AM, vanderkerkoff wrote: Hello Mike, Brian My brain is approcahing saturation point and I'm reading these two opinoins as opposing each other. I'm sure I'm reading it incorrectly, but they seem to contradict each other. Are they? solr.py takes unicode and enco

Re: SolrSharp example

2007-06-20 Thread Jeff Rodenburg
On 6/20/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 6/20/07, Michael Plax <[EMAIL PROTECTED]> wrote: > This is a log that I got after runnning SolrSharp example. I think example > program posts not properly formatted xml. > I'm running Solr on Windows XP, Java 1.5. Are those settings could be

Re: Faceted Search!

2007-06-20 Thread niraj tulachan
Hi Chris, thank you for the reply. I was reading other posting regarding faceted search and seems like they are using the filtering capability of Lucene for that. If that the case, can we have control over the "label" of categories? For example: in shopper.com when we search for camera gi

Re: Multi-language indexing and searching

2007-06-20 Thread Chris Hostetter
: So far it sounds good for my needs, now I'm going to try if my other : features still work (I'm worried about highlighting as I'm going to return a : different field)... i'm not really a highlighting guy so i'm not sure ... but if you're okay with *simple* highlighting you can probably just hig

Re: All facet.fields for a given facet.query?

2007-06-20 Thread Chris Hostetter
: to make it clear, i agree that it doesn't make sense faceting on all : available fields, I only want faceting on those 300 attributes that are : stored together with the fields for full text searches. A : product/document has typically only 5-10 attributes. : : I like to decide at index time whic

Re: All facet.fields for a given facet.query?

2007-06-20 Thread Chris Hostetter
: > I solve this problem by having metadata stored in my index which tells : > my custom request handler what fields to facet on for each category ... : How do you define this metadata? this might be a good place to start, note that this message is almost two years old, and predates the opensourc

Re: Faceted Search!

2007-06-20 Thread Chris Hostetter
: Thanks Chris for replying my question. So I'm thinking about using a : CMS and when somebody publishes a page in CMS, I would generated this : well structure XML file and feed that xml to Solr to generate the index : on those data. Then, I can simply do faceted search using the correct : Lucene

Re: Slave/Master swap

2007-06-20 Thread Chris Hostetter
: I'm wondering if there are slicker ways to do this, ways that would : minimize the downtime, for instance. Perhaps, just like Will Johnson is : trying to make IndexSchema updateable in a live system, the snapshooter : could be turned on/off programatically, say via a special request : handler.

Re: SolrSharp example

2007-06-20 Thread Yonik Seeley
On 6/20/07, Michael Plax <[EMAIL PROTECTED]> wrote: This is a log that I got after runnning SolrSharp example. I think example program posts not properly formatted xml. I'm running Solr on Windows XP, Java 1.5. Are those settings could be the problem? Solr1.2 is pickier about the Content-type i

Re: SolrSharp example

2007-06-20 Thread Michael Plax
Hi Jeff, This is a log that I got after runnning SolrSharp example. I think example program posts not properly formatted xml. I'm running Solr on Windows XP, Java 1.5. Are those settings could be the problem? Thank you Michael Jun 19, 2007 5:26:39 PM org.apache.solr.core.SolrException log SE

Re: page rank

2007-06-20 Thread Daniel Alheiros
Hi David. Yes you can. Just define a field as a slong type field: It can be used to sort (&sort=numberField desc) or to boost your score (it will depend on the RequestHandler you are going to use). In terms of score which RequestHandler are you planning to use? If using dismax you can de

page rank

2007-06-20 Thread David Xiao
Hello folks, I am using solr to index web contents. I want to know is that possible to tell solr about rank information of contents? For example, I give each content an integer number. And I hope solr take this number into consideration when it generates search result. (larger number, mo

Re: SolrSharp example

2007-06-20 Thread Jeff Rodenburg
Hi Michael - Moving this conversations to the general solr mailing list... 1. SolrSharp example solution works with schema.xml from apache-solr-1.1.0-incubating.If I'm using schema.xml from apache-solr-1.2.0 example program doesn't update index... I didn't realize the solr 1.2 release c

Slave/Master swap

2007-06-20 Thread Otis Gospodnetic
Hi, I saw https://issues.apache.org/jira/browse/SOLR-265 (Make IndexSchema updateable in live system) which made me think of something I wished for a while back. Having a single Solr Master and a couple of Solr Slaves is a common setup. If any of the Slaves fails, a decent LB knows not to t

snapinstaller safety

2007-06-20 Thread Otis Gospodnetic
Hi, Looking at src/scripts/snapinstaller more closely, I saw this block of code: # install using hard links into temporary directory # remove original index and then atomically copy new one into place logMessage installing snapshot ${name} cp -lr ${name}/ ${data_dir}/index.tmp$$ /bin/rm -rf ${dat

Re: problems getting data into solr index

2007-06-20 Thread Brian Whitman
Mike is talking about solr.py, the python script, I'm talking about Solr itself. I think your problem is in the former. You should play around with unicode in python for awhile. Remember that your terminal itself probably doesn't support utf-8, the biggest problem I run into is doing > prin

Re: problems getting data into solr index

2007-06-20 Thread vanderkerkoff
Hello Mike, Brian My brain is approcahing saturation point and I'm reading these two opinoins as opposing each other. I'm sure I'm reading it incorrectly, but they seem to contradict each other. Are they? Brian Whitman wrote: > > Solr has no problems with proper utf8 and you don't need to do

Re: All facet.fields for a given facet.query?

2007-06-20 Thread Martin Grotzke
On Wed, 2007-06-20 at 12:59 +0200, Thomas Traeger wrote: > Martin Grotzke schrieb: > > On Tue, 2007-06-19 at 19:16 +0200, Thomas Traeger wrote: [...] > >> I think it would be really nice, if I don't have to know which facets > >> fields are there at query time, instead just import attributes into

Re: All facet.fields for a given facet.query?

2007-06-20 Thread Thomas Traeger
Martin Grotzke schrieb: On Tue, 2007-06-19 at 19:16 +0200, Thomas Traeger wrote: Hi, I'm also just at that point where I think I need a wildcard facet.field parameter (or someone points out another solution for my problem...). Here is my situation: I have many products of different types

Re: All facet.fields for a given facet.query?

2007-06-20 Thread Thomas Traeger
first: sorry for the bad quoting, I found your message in the archive only... I have many products of different types with totally different attributes. There are currently more than 300 attributes I use dynamic fields to import the attributes into solr without having to define a specific fi

Re: Multi-language indexing and searching

2007-06-20 Thread Daniel Alheiros
Hi Hoss Thanks again for your attention. Looks like after your last instructions I thought the same way as you :) What I did yesterday: 1. Created the schema with the fields with language variations (created as concrete fields anyway because in this case, using dynamic it wouldn't be better for