Re: Faceted browsing: status

2006-08-14 Thread Chris Hostetter
:Simple faceted browsing (grouping) support in the standard query :handler : group by field (provide counts for each distinct value in that : field) : group by (query1, query2, query3, query4, query5) : How far/close is this task to completion? (I'm trying to gauge time

Re: Faceted Browsing questions

2006-06-29 Thread Erik Hatcher
On Jun 29, 2006, at 12:30 AM, Vish D. wrote: Any update on your progress? Eager to get my hands on on your latest code... :=) It's all in our Subversion repository: Sorry I didn't announce it, but we do have a patacriticism- developm

Re: Faceted Browsing questions

2006-06-28 Thread Vish D.
Erik, Any update on your progress? Eager to get my hands on on your latest code... :=) Thanks! On 6/28/06, Chris Hostetter <[EMAIL PROTECTED]> wrote: : > well, the most obvious solution i can think of would be a patch adding an : > invert() method to DocSet, HashDocSet and BitDocSet. :) :

Re: Faceted Browsing questions

2006-06-28 Thread Chris Hostetter
: > well, the most obvious solution i can think of would be a patch adding an : > invert() method to DocSet, HashDocSet and BitDocSet. :) : : Yes, we could add a flip(startIndex, endIndex) or flip(maxDoc) Yeah ... like i suggested before just make maxDoc an intrinsic property that DocSets know w

Re: Faceted Browsing questions

2006-06-28 Thread Yonik Seeley
On 6/26/06, Chris Hostetter <[EMAIL PROTECTED]> wrote: : My next challenge is to re-implement the catch-all facets that I used : to do by unioning all documents in an (Open)BitSet and inverting it. : How can I invert a DocSet (I realize I gat get the bits and do it : that way, but is there a bett

Re: Faceted Browsing questions

2006-06-26 Thread Chris Hostetter
: It may not even be necessary to cache this type of lookup since it is : simply a TermEnum through specific fields in the index. Maybe simply : doing the TermEnum in the request handler instead of iterating : through a cache would be just as fast or faster. Any thoughts on that? While commutin

Re: Faceted Browsing questions

2006-06-26 Thread Erik Hatcher
On Jun 24, 2006, at 4:29 PM, Yonik Seeley wrote: On 6/24/06, Erik Hatcher <[EMAIL PROTECTED]> wrote: This weekend :) I have imported more data than my hacked implementation can handle without bumping up Jetty's JVM heap size, so I'm now at the point where it is necessary for me to start using

Re: Faceted Browsing questions

2006-06-24 Thread Vish D.
Erik, Oh good! Keep me (us) updated!! As for committing some code into Solr, and the real world uses, I am sure we can find some generic/abstract rules for faceted browsing -- simplest being, a set of fields/categories defined in schema.xml, which could be used for an optional extented query res

Re: Faceted Browsing questions

2006-06-24 Thread Yonik Seeley
On 6/24/06, Erik Hatcher <[EMAIL PROTECTED]> wrote: This weekend :) I have imported more data than my hacked implementation can handle without bumping up Jetty's JVM heap size, so I'm now at the point where it is necessary for me to start using the LRUCache. Though I have already refactored to

Re: Faceted Browsing questions

2006-06-24 Thread Erik Hatcher
On Jun 24, 2006, at 12:38 PM, Vish D. wrote: Erik, when do you plan on having your implementation refactored with "good" use of code? This weekend :) I have imported more data than my hacked implementation can handle without bumping up Jetty's JVM heap size, so I'm now at the point whe

Re: Faceted Browsing questions

2006-06-24 Thread Vish D.
Thank you Chris and Erik. That makes it a bit clearer, but I might need to sit down and look at the code (nines + DisMax...) a bit closer to see how it all works in Solr. Erik, when do you plan on having your implementation refactored with "good" use of code? Or, in general, when is Solr planning

Re: Faceted Browsing questions

2006-06-23 Thread Chris Hostetter
: nature of the data I am working with. I have searched through the mailing : list and seen some posts mentioning BitSets DocSets, etc.., but wasn't clear : on if those are already built into the solr's nightly builds (I don't see : any documentation either on the wiki, or online). Can some please

Re: Faceted Browsing questions

2006-06-23 Thread Erik Hatcher
I'm extremely time constrained at the moment, but I'll reply briefly. Solr provides the ground work for making faceted features possible, but out of the box it does not provide it without coding a custom request handler and knowing a little about Lucene and Solr's APIs. As you've seen, bi

Re: faceted browsing

2006-04-04 Thread Chris Hostetter
: What I'd really like to see is an XML query language so I can toss all : the hackish URL query arguments and really move much of the query plugin : logic out into the query itself instead of in the Java code. : customers. We'll introduce dynamic attribute bucketing. Rather than : produce a l

Re: faceted browsing

2006-04-04 Thread Trey Hyde
Chris Hostetter wrote: : My (our) query plugin uses specialized SolrCache's in lieu of the meta : data records. For each new searcher installed each fields possible : values will be determined and stored in a cache (off the top of my head, Are you determining the field values based on all in

Re: faceted browsing

2006-04-03 Thread Chris Hostetter
Hey everybody ... sorry i'm getting into the discussion so late ... i was in a Cloud Forrest in Costa Rica for 8 days -- plenty of Internet Cafe's, but i avoided all of them. First off, i wanted to point out that this discussion came up about a month ago, and a lot of ideas about how to define c

Re: faceted browsing

2006-04-03 Thread Richard \"Trey\" Hyde
My (our) query plugin uses specialized SolrCache's in lieu of the meta data records. For each new searcher installed each fields possible values will be determined and stored in a cache (off the top of my head, some fields have a cardinality of well over 500k). Each time a query is run that r

Re: faceted browsing

2006-03-30 Thread Yonik Seeley
On 3/30/06, Erik Hatcher <[EMAIL PROTECTED]> wrote: > Now I need to investigate the flexibility of the solrconfig.xml - can > custom parameters be set there, such that a custom SolrRequestHandler > could read them? For example, I'd want to list the field names that > are the "facets", such that c

Re: faceted browsing

2006-03-30 Thread Erik Hatcher
Yonik, Thanks for the recommendations. It's reassuring to know I was on the right track in realizing that a custom SolrRequestHandler was needed to accomplish this. Now I need to investigate the flexibility of the solrconfig.xml - can custom parameters be set there, such that a custom So

Re: faceted browsing

2006-03-29 Thread Yonik Seeley
On 3/29/06, Clay Webster <[EMAIL PROTECTED]> wrote: > How could faceted browsing be accomplished without [Chris's] metadata > documents? The most basic form: consider if a field called "category" existed on each document. You could then ask for the counts of the top 10 values in category field fo

Re: faceted browsing

2006-03-29 Thread Clay Webster
How could faceted browsing be accomplished without [Chris's] metadata documents? --cw On 3/29/06, Yonik Seeley <[EMAIL PROTECTED]> wrote: > > Solr has a lot of support to do faceted browsing, but one must > currently write a custom query handler to implement the faceting > logic. > > The support

Re: faceted browsing

2006-03-29 Thread Yonik Seeley
Solr has a lot of support to do faceted browsing, but one must currently write a custom query handler to implement the faceting logic. The support includes: - custom query handlers: - the ability to return more data than just a list of documents - a filter cache with autowarming, for fast ac