Query norm for a function query ?

2007-05-22 Thread Mekin Maheshwari
What does Query norm mean for a function query ? From the explain output: 0.88247913 = (MATCH) FunctionQuery(org.apache.solr.search.function.ReciprocalFloatFunction:500.0/(1.0*float(float(popularity Rank))+500.0)), product of: 0.998004 = 500.0/(1.0*float(float(popularityRank)=1.0)+500.0)

Re: TEI indexing

2007-05-22 Thread Erik Hatcher
On May 21, 2007, at 10:52 PM, Gary Browne wrote: I'm wondering if anyone has any hints on how to prepare TEI documents for indexing - I was about to write some XSLT but didn't want to reinvent the wheel (unless it's punctured)? I'm using Ruby to index TEI files, and leveraging the XPathMapper

Re: Query norm for a function query ?

2007-05-22 Thread Yonik Seeley
The query norm is just a way to balance clauses of different queries (1/sqrt(sum of squares of each clause weight) IIRC). So a boost on one clause causes the scores of other clauses to go down (because the sum of squares is higher). Your big boost *caused* the low queryNorm (but it will cause t

Interesting Practical Solr Question

2007-05-22 Thread [EMAIL PROTECTED]
Hi, I use Solr to search through a set of about 200,000 documents. Each document has a numeric ID. How to do the following: 1) I use facets and want to return the facets for "all documents" as the starting point of the user interface. In other words, I want to /select the facet counts for ab

Re: Interesting Practical Solr Question

2007-05-22 Thread Erik Hatcher
On May 22, 2007, at 9:58 AM, [EMAIL PROTECTED] wrote: I use Solr to search through a set of about 200,000 documents. Each document has a numeric ID. How to do the following: 1) I use facets and want to return the facets for "all documents" as the starting point of the user interface. In oth

RE: Interesting Practical Solr Question

2007-05-22 Thread Will Johnson
Possible solutions inline: 1) I use facets and want to return the facets for "all documents" as the starting point of the user interface. In other words, I want to /select the facet counts for about 10 facets (like states for example) for all documents without having to do a search. Is this possi

Re: Interesting Practical Solr Question

2007-05-22 Thread Erik Hatcher
On May 22, 2007, at 10:07 AM, Will Johnson wrote: 2) Each document will be shown to the user with a check box next to it. I want to user to be able to select certain documents and "save" their ids some where else. This is not a problem. However, I also want to give the user an ability to sa

RE: Interesting Practical Solr Question

2007-05-22 Thread Will Johnson
> 3) Once the user saves the list, I want them to be able to do further > searches by do a "negative union" with the set of ids they already > saved. So for example, if they already saved 1000 ids into one of > their > lists, they would need to be able to get results from Solr that match > their

Re: Interesting Practical Solr Question

2007-05-22 Thread [EMAIL PROTECTED]
Hi Erik and Will, Thanks for the suggestions! The *:* is exactly what I was after for question #1. I was not aware of that syntax. I would like to be able to save the query itself, however, the users may decide to pick only some of the documents, all of them and unselect some, etc. The point o

RE: Interesting Practical Solr Question

2007-05-22 Thread Martin Grotzke
On Tue, 2007-05-22 at 10:07 -0400, Will Johnson wrote: > Possible solutions inline: > > 1) I use facets and want to return the facets for "all documents" as the > starting point of the user interface. In other words, I want to /select > the facet counts for about 10 facets (like states for exampl

RE: Interesting Practical Solr Question

2007-05-22 Thread Will Johnson
Sorry, too many assumoptions. The query needs to be *:* and then you need to add facet.field parameters for each facet you want back. Something along the lines of: http://localhost:8983/solr/select?q=*:*&rows=0&facet=true&facet.field=ty pe&facet.field=quantity - will -Original Message-

Re: Interesting Practical Solr Question

2007-05-22 Thread Yonik Seeley
On 5/22/07, Martin Grotzke <[EMAIL PROTECTED]> wrote: On Tue, 2007-05-22 at 10:07 -0400, Will Johnson wrote: > Possible solutions inline: > > 1) I use facets and want to return the facets for "all documents" as the > starting point of the user interface. In other words, I want to /select > the fa

Re: solr plugins

2007-05-22 Thread John Wang
Hi Yonik: Thank you again for your help! I created an improvement item in jira (SOLR-243) on this. -John On 5/19/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 5/19/07, John Wang <[EMAIL PROTECTED]> wrote: > Hi Yonik: > > Thanks for the info! > > This solves my problem, but n

Re: Interesting Practical Solr Question

2007-05-22 Thread Martin Grotzke
On Tue, 2007-05-22 at 10:44 -0400, Yonik Seeley wrote: > On 5/22/07, Martin Grotzke <[EMAIL PROTECTED]> wrote: > > On Tue, 2007-05-22 at 10:07 -0400, Will Johnson wrote: > > > Possible solutions inline: > > > > > > 1) I use facets and want to return the facets for "all documents" as the > > > start

Re: Interesting Practical Solr Question

2007-05-22 Thread Erik Hatcher
On May 22, 2007, at 11:31 AM, Martin Grotzke wrote: You need to specify the constrants (facet.query or facet.field params) Too bad, so we would have either to know the schema in the application or provide queries for index metadata / the schema / faceting info. However, the LukeRequestHandle

Re: Interesting Practical Solr Question

2007-05-22 Thread Martin Grotzke
On Tue, 2007-05-22 at 13:06 -0400, Erik Hatcher wrote: > On May 22, 2007, at 11:31 AM, Martin Grotzke wrote: > >> You need to specify the constrants (facet.query or facet.field > >> params) > > Too bad, so we would have either to know the schema in the application > > or provide queries for index

slow MLT, how to inject top tf-idf terms on indexing

2007-05-22 Thread Brian Whitman
We're looking at MLT queries that take 10-60 seconds on average to return, using the latest (this a.m.) SOLR-69 patch. Our data dir is 8.5G with 300K docs, but almost all of those have on average 50-200KB of stored text in thousands of fragments (multivalued field, one chunk per sentence.)

RE: How to handle hl.fl form variable (any variable with a dot in its name) from javascript?

2007-05-22 Thread Teruhiko Kurosaka
Ryan, Thank you. The JavaScript code you mentioned works well. But I am now hitting the similar problem with XSLT. The following XSLT code can't retrieve the value of "hl.fl" parameter even though the similar code for other parameter works. I am using the XSLT Writer and whatever XSLT pro

Re: Interesting Practical Solr Question

2007-05-22 Thread Erik Hatcher
On May 22, 2007, at 1:36 PM, Martin Grotzke wrote: For sure, perhaps the schema field element could be extended by an attribute "isfacet" There is no effective difference between a "facet" field and any other indexed field. What fields are "facets" is application specific and not really s

Heap Out of Memory Error

2007-05-22 Thread [EMAIL PROTECTED]
Hi, I am running Solr within the Jetty using start.jar. I am indexing about 200,000 documents. Sometimes out of the blue, the Solr instance cannot process any more requests and returns "heap out of memory" error. This happens more often when I issue queries against the index that is being upda

RE: Heap Out of Memory Error

2007-05-22 Thread Daniel Pitts
> -Original Message- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] > Sent: Tuesday, May 22, 2007 12:31 PM > > Hi, > > I am running Solr within the Jetty using start.jar. I am > indexing about 200,000 documents. Sometimes out of the blue, > the Solr instance cannot process any more

Query

2007-05-22 Thread solruser
Hi, I have a question related to Index, where I have indexed my document with mutiple replies enumerated fields in the document. e.g. .. .. now how can I query document so I can search a document on the content of any reply. Can I make a query such as <<< reply*:con

Re: Interesting Practical Solr Question

2007-05-22 Thread Martin Grotzke
On Tue, 2007-05-22 at 15:10 -0400, Erik Hatcher wrote: > On May 22, 2007, at 1:36 PM, Martin Grotzke wrote: > > For sure, perhaps the schema field element could be extended by an > > attribute "isfacet" > > There is no effective difference between a "facet" field and any > other indexed field.

Re: How to handle hl.fl form variable (any variable with a dot in its name) from javascript?

2007-05-22 Thread Mike Klaas
On 22-May-07, at 11:38 AM, Teruhiko Kurosaka wrote: Ryan, Thank you. The JavaScript code you mentioned works well. But I am now hitting the similar problem with XSLT. The following XSLT code can't retrieve the value of "hl.fl" parameter even though the similar code for other parameter works.

Re: Query

2007-05-22 Thread Yonik Seeley
On 5/22/07, solruser <[EMAIL PROTECTED]> wrote: I have a question related to Index, where I have indexed my document with mutiple replies enumerated fields in the document. e.g. .. .. now how can I query document so I can search a document on the content of any reply

Re: how to use function queries

2007-05-22 Thread Nick Jenkin
Hi Mike Try: _val_:"recip(rord(date),1,1000,1000)^2" -Nick On 5/22/07, mike topper <[EMAIL PROTECTED]> wrote: I'm trying to retrieve results from solr such that newer documents' scores are boosted. From the solr wiki it states that I should use a function query to influence the score but I'm a

Re: Query

2007-05-22 Thread solruser
Hi Yonik, Thanks for the reply. I thought of using multi-valued field but since I am using reply ids to store as string and I have dynamic field in schema. I am not sure will multi-valued field will work in this scenario case. Earlier I tried to another field in the document which contain ne

List of highlighted terms from search query

2007-05-22 Thread solruser
Hi, I am wondering can we get the list of all highlighted terms from the search query. If yes can someone suggest query options? Thanks -- View this message in context: http://www.nabble.com/List-of-highlighted-terms-from-search-query-tf3801344.html#a10755381 Sent from the Solr - User mailin

Re: List of highlighted terms from search query

2007-05-22 Thread James liu
first u try enable highlighting( http://wiki.apache.org/solr/HighlightingParameters) and u try solr admin gui to see its output and u will find what u wanna. 2007/5/23, solruser <[EMAIL PROTECTED]>: Hi, I am wondering can we get the list of all highlighted terms from the search query. If

Re: List of highlighted terms from search query

2007-05-22 Thread solruser
Hi James, I have already had tried out options for highlighting but unfortunately since solr highligted results does not include special characters in the results, thats the reason I am looking for a way to get list of highlighted terms that I can use to highlight the terms. I assume this might b

Re: List of highlighted terms from search query

2007-05-22 Thread James liu
2007/5/23, solruser <[EMAIL PROTECTED]>: Hi James, I have already had tried out options for highlighting but unfortunately since solr highligted results does not include special characters special characters? maybe u should print some . in the results, thats the reason I am looking for a