Re: facet.sort and distributed search

2008-11-26 Thread Aleksander M. Stensby
This is a known issue but take a look at the following jira issue and the patch supplied there: https://issues.apache.org/jira/browse/SOLR-764 Haven't tried it myself, but i believe it should do the trick for you. Hope that helps. Cheers, Aleksander On Wed, 26 Nov 2008 22:53:21 +0100, Grégoi

Re: Can a lucene document be used in solr?

2008-11-26 Thread Aleksander M. Stensby
Hello there, do you mean a lucene Document or do you mean if it is possible to use an existing lucene index with solr? In the latter case, the answer is yes, since solr is built on top of lucene. But it requires you to configure your schema.xml to correlate to the index-structure of your ex

Re: [VOTE] Community Logo Preferences

2008-11-26 Thread Sean Timm
https://issues.apache.org/jira/secure/attachment/12394165/solr-logo.png https://issues.apache.org/jira/secure/attachment/12394475/solr2_maho-vote.png https://issues.apache.org/jira/secure/attachment/12394350/solr.s4.jpg https://issues.apache.org/jira/secure/attachment/12394282/solr2_maho_impressio

Can a lucene document be used in solr?

2008-11-26 Thread Sajith Vimukthi
Hi all, Can someone of you all tell me whether I can use a lucene document in solr? Regards, Sajith Vimukthi Weerakoon Associate Software Engineer | ZONE24X7 | Tel: +94 11 2882390 ext 101 | Fax: +94 11 2878261 | http://www.zone24x7.com

Re: [VOTE] Community Logo Preferences

2008-11-26 Thread Mike Klaas
https://issues.apache.org/jira/secure/attachment/12394350/solr.s4.jpg https://issues.apache.org/jira/secure/attachment/12394268/apache_solr_c_red.jpg https://issues.apache.org/jira/secure/attachment/12393995/sslogo-solr-70s.png https://issues.apache.org/jira/secure/attachment/12393936/logo_remake

Re: [VOTE] Community Logo Preferences

2008-11-26 Thread Erik Hatcher
https://issues.apache.org/jira/secure/attachment/12394070/sslogo-solr-finder2.0.png https://issues.apache.org/jira/secure/attachment/12394475/solr2_maho-vote.png https://issues.apache.org/jira/secure/attachment/12393995/sslogo-solr-70s.png

range queries on string field with millions of values

2008-11-26 Thread Naomi Dushay
I have a performance problem and I haven't thought of a clever way around it. I work at the Stanford University Libraries. We have a collection of over 8 million items. Each item has a call number. I have been asked to provide a way to browse forward and backward from an arbitrary call

facet.sort and distributed search

2008-11-26 Thread Grégoire Neuville
Hi, I'm working on an web application one functionality of which consists in presenting to the user a list of terms to seize in a form field, sorted alphabetically. As long as one single index was concerned, I used solr facets to produce the list and it worked fine. But I must now deal with severa

Re: [VOTE] Community Logo Preferences

2008-11-26 Thread Ryan McKinley
https://issues.apache.org/jira/secure/attachment/12394218/solr-solid.png https://issues.apache.org/jira/secure/attachment/12391946/apache_solr_burning.png https://issues.apache.org/jira/secure/attachment/12394070/sslogo-solr-finder2.0.png https://issues.apache.org/jira/secure/attachment/12394282/so

[REMINDER] Community Logo Preferences

2008-11-26 Thread Ryan McKinley
Just a reminder that if you have not yet voted for your favorite logos, the "vote" closes tonight at midnight. Happy Thanksgiving! ryan

Re: omiting no price documents when sorting on price

2008-11-26 Thread Matthew Runo
You also don't /need/ to put in a price in the index. If something doesn't have a value for a field, you can just not send the field. Then sorting won't be thrown off by the dummy value. Then those documents simply won't have a "price" field. Of course, if you need to facet on it or query i

Re: omiting no price documents when sorting on price

2008-11-26 Thread Erick Erickson
Assuming you know you want to do this at query time, couldn't you just add a -price:0 clause to your query? Best Erick On Wed, Nov 26, 2008 at 11:00 AM, joeMcElroy <[EMAIL PROTECTED]> wrote: > > im sure this is an easy question but... > > when a product doesn't have a price, I index the price as

Re: newbie question on SOLR distributed searches with many "shards"

2008-11-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
Look at the file http://svn.apache.org/viewvc/lucene/solr/trunk/example/solr/conf/solrconfig.xml?revision=720502&view=markup and take a look at the line you may see the defaults there. you can add your param just the way the echoParams is configured On Wed, Nov 26, 2008 at 9:32 PM, Gerald De C

Re: [VOTE] Community Logo Preferences

2008-11-26 Thread Alexander Ramos Jardim
https://issues.apache.org/jira/secure/attachment/12394264/apache_solr_a_red.jpg 2008/11/23 Ryan McKinley <[EMAIL PROTECTED]> > Please submit your preferences for the solr logo. > > For full voting details, see: > http://wiki.apache.org/solr/LogoContest#Voting > > The eligible logos are: > > ht

Re: [VOTE] Community Logo Preferences

2008-11-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
https://issues.apache.org/jira/secure/attachment/12394070/sslogo-solr-finder2.0.png https://issues.apache.org/jira/secure/attachment/12394165/solr-logo.png https://issues.apache.org/jira/secure/attachment/12394266/apache_solr_b_red.jpg https://issues.apache.org/jira/secure/attachment/12394282/solr2

Re: CachedSqlEntityProcessor's purpose

2008-11-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
I am raising an issue for better error checking in CachedSqlEntityprocessor https://issues.apache.org/jira/browse/SOLR-884 On Wed, Nov 26, 2008 at 9:34 PM, Steffen B. <[EMAIL PROTECTED]> wrote: > > > Noble Paul നോബിള്‍ नोब्ळ् wrote: >> >> I suspect only one thing >> are the data types same for pro

Re: CachedSqlEntityProcessor's purpose

2008-11-26 Thread Steffen B.
Noble Paul നോബിള്‍ नोब्ळ् wrote: > > I suspect only one thing > are the data types same for productid and product.id > in the db? > Good point. I just checked and they are both int(11). Could the problem be caused by the different column names, id in the products table and productid in the dat

RE: newbie question on SOLR distributed searches with many "shards"

2008-11-26 Thread Gerald De Conto
Thx Paul How would I do so? i.e. would you be able to provide a simple example of putting shard info into the SearchHandlers defaults or invariants section? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Noble Paul ??? ?? Sent: Tuesday, Novembe

PHPResponseWriter problem with (de)serialization (spellchecker)

2008-11-26 Thread Steffen B.
Hi everyone, maybe it's just me, but whenever I try to deserialize a Solr response that contains the spellchecker with spellcheck.extendedResults, it fails. I'm using PHP5 and everthing is pretty much up-to-date. true will be converted to [...] s:10:"spellcheck";a:1:{s:11:"suggestions

omiting no price documents when sorting on price

2008-11-26 Thread joeMcElroy
im sure this is an easy question but... when a product doesn't have a price, I index the price as 0. When sorting on price, these values come up first or last. How can you omit these items when sorting against price. thanks joe -- View this message in context: http://www.nabble.com/omiting-

Re: Upgrade from 1.2 to 1.3 gives 3x slowdown + script!

2008-11-26 Thread Fergus McMenemie
Hello Grant, Not much good with Java profilers (yet!) so I thought I would send a script! Details... details! Having decided to produce a script to replicate the 1.2 vis 1.3 speed problem. The required rigor revealed a lot more. 1) The faster version I have previously referred to as 1.2,

Re: CachedSqlEntityProcessor's purpose

2008-11-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
I suspect only one thing are the data types same for productid and product.id in the db? On Wed, Nov 26, 2008 at 5:38 PM, Steffen B. <[EMAIL PROTECTED]> wrote: > > Hi Noble Paul, > thanks for your quick response. > > > Noble Paul നോബിള്‍ नोब्ळ् wrote: >> >> What i expect to happen is when you ru

Re: Keyword extraction

2008-11-26 Thread Scurtu Vitalie
Sorry for not writing clearly. Yes, it works good for its purpose, and I didn't want to say that moreLikeThis component does not work at all. In the same time it's good to know what are the limitations and the problems of moreLikeThis function. What I want to point out is that queries_gener

Re: [VOTE] Community Logo Preferences

2008-11-26 Thread k_richard
https://issues.apache.org/jira/secure/attachment/12394165/solr-logo.png https://issues.apache.org/jira/secure/attachment/12391987/solr.png https://issues.apache.org/jira/secure/attachment/12392306/apache_solr_sun.png https://issues.apache.org/jira/secure/attachment/12394282/solr2_maho_impression.p

Re: Keyword extraction

2008-11-26 Thread Jeff Newburn
Unfortunately, as it stands the interestingTerms and the debugQuery do not explain why solr chose the matches it did for moreLikeThis. There is currently a task in jira to try to add the information to debugQuery. The ticket can be found here: https://issues.apache.org/jira/browse/SOLR-860 -Jeff

Re: Keyword extraction

2008-11-26 Thread Aleksander M. Stensby
Ah, yes, That is important. In lucene, the MLT will see if the term vector is stored, and if it is not it will still be able to perform the querying, but in a much much much less efficient way.. Lucene will analyze the document (and the variable DEFAULT_MAX_NUM_TOKENS_PARSED will be used to

Re: Keyword extraction

2008-11-26 Thread Aleksander M. Stensby
I'm sure that for certain problems and cases you will need to do quite a bit tweaking to make it work (to suite your needs), but i responded to your statement because you made it sound like the MoreLikeThis component does not work at all for its purpuse, while it actually do work as intende

RE: Keyword extraction

2008-11-26 Thread Plaatje, Patrick
Hi Aleksander, This was a typo on my end, the original query included a semicolon instead of an equal sign. But I think it has to do with my field not being stored and not being identified as termVectors="true". I'm recreating the index now, and see if this fixes the problem. Best, patrick -

Re: Keyword extraction

2008-11-26 Thread Aleksander M. Stensby
Hi there! Well, first of all i think you have an error in your query, if I'm not mistaken. You say http://localhost:8080/solr/select/?q=id=18477975... but since you are referring to the field called "id", you must say: http://localhost:8080/solr/select/?q=id:18477975... (use colon instead of th

Re: Keyword extraction

2008-11-26 Thread Scurtu Vitalie
Yes, I totally understand, and agree.  MoreLikeThis uses TF-IDF to rank terms, then it generates queries based on top ranked terms.  In any case, I wasn't able to make it work after many attempts. Finally, I've used a different method for queries generation, and it works better, or at least g

RE: Deleting indices

2008-11-26 Thread Raghunandan Rao
I have restarted and re-indexed all the docs after the change in the schema.xml. I was able to search even after that. I hit browser with this url http://localhost:7001/solr/select?q=name:2124&fl=*&debugQuery=true -Original Message- From: Shalin Shekhar Mangar [mailto:[EMAIL PROTECTED]

Re: Deleting indices

2008-11-26 Thread Shalin Shekhar Mangar
Did you change your schema.xml after you indexed the documents? On Wed, Nov 26, 2008 at 6:08 PM, Raghunandan Rao < [EMAIL PROTECTED]> wrote: > I am not sure. It is showing in the debug logs as below. > > 0.5967079 = (MATCH) fieldWeight(name:2124 in 0), product of: 1.4142135 = > tf(termFreq(name:2

RE: Deleting indices

2008-11-26 Thread Raghunandan Rao
I am not sure. It is showing in the debug logs as below. 0.5967079 = (MATCH) fieldWeight(name:2124 in 0), product of: 1.4142135 = tf(termFreq(name:2124)=2) 1.1251632 = idf This is how I have done. I have a class NameDTO which contains all these variables. I have @Field annotation to these fields

Re: Keyword extraction

2008-11-26 Thread Shalin Shekhar Mangar
You might also be interested in http://wiki.apache.org/solr/TermVectorComponent On Wed, Nov 26, 2008 at 12:39 AM, Plaatje, Patrick < [EMAIL PROTECTED]> wrote: > Hi all, > > Strugling with a question I recently got from a collegue: is it possible > to extract keywords from indexed content? > > In

Re: Deleting indices

2008-11-26 Thread Shalin Shekhar Mangar
On Wed, Nov 26, 2008 at 5:01 PM, Raghunandan Rao < [EMAIL PROTECTED]> wrote: > Ok. > I have another query on search. > > I have given two fields to be indexed = true in xml. > > > required="false"/> > required="false"/> > > But when I try to search on non-indexed "name" field it is able to retr

RE: Keyword extraction

2008-11-26 Thread Plaatje, Patrick
Hi Aleksander, Thanx for clearing this up. I am confident that this is a way to explore for me as I'm just starting to grasp the matter. Do you know why I'm not getting any results with the query posted earlier then? It gives me the folowing only: Instead of delivering details of th

Re: CachedSqlEntityProcessor's purpose

2008-11-26 Thread Steffen B.
Hi Noble Paul, thanks for your quick response. Noble Paul നോബിള്‍ नोब्ळ् wrote: > > What i expect to happen is when you run the query > SELECT manufacturer,id FROM product_data WHERE type='manu' > > you must get all the rows from the DB in the table product_data > Unfortunately, that's not t

Re: Keyword extraction

2008-11-26 Thread Aleksander M. Stensby
I do not agree with you at all. The concept of MoreLikeThis is based on the fundamental idea of TF-IDF weighting, and not term frequency alone. Please take a look at: http://lucene.apache.org/java/2_4_0/api/org/apache/lucene/search/similar/MoreLikeThis.html As you can see, it is possible to use

RE: Keyword extraction

2008-11-26 Thread Scurtu Vitalie
Dear Partick, I had the same problem with MoreLikeThis function. After  briefly reading and analyzing the source code of moreLikeThis function in solr, I conducted: MoreLikeThis uses term vectors to ranks all the terms from a document by its frequency. According to its ranking, it will start to

RE: Deleting indices

2008-11-26 Thread Raghunandan Rao
Ok. I have another query on search. I have given two fields to be indexed = true in xml. But when I try to search on non-indexed "name" field it is able to retrieve records. How is this possible? -Original Message- From: Noble Paul നോബിള്‍ नोब्ळ् [mailto:[EMAIL PROTECTED] Sent: We

Re: CachedSqlEntityProcessor's purpose

2008-11-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
What i expect to happen is when you run the query SELECT manufacturer,id FROM product_data WHERE type='manu' you must get all the rows from the DB in the table product_data So it is likely that you get an OOM if the DB table has a lot of rows. processor="CachedSQLEntityProcessor" is wrong proces

Re: CachedSqlEntityProcessor's purpose

2008-11-26 Thread Steffen B.
I've been discussing this topic with Amit and also have some questions... Noble Paul നോബിള്‍ नोब्ळ् wrote: > > On Tue, Nov 25, 2008 at 11:35 PM, Amit Nithian <[EMAIL PROTECTED]> wrote: >> 2) In the example, there were two use cases, one that is like >> query="select >> * from Y where xid=${X.ID

Re: Deleting indices

2008-11-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
nope . you cannot update a document in Solr. You can only delete and add a new one On Wed, Nov 26, 2008 at 4:11 PM, Raghunandan Rao <[EMAIL PROTECTED]> wrote: > Ok. Can I update the index without deleting? I mean to update all names with > a new name. > In an index I have id, name, deptid as fi

RE: Deleting indices

2008-11-26 Thread Raghunandan Rao
Ok. Can I update the index without deleting? I mean to update all names with a new name. In an index I have id, name, deptid as fields. I need to update name field = "new" where name="old". -Original Message- From: Noble Paul നോബിള്‍ नोब्ळ् [mailto:[EMAIL PROTECTED] Sent: Wednesday, N

Re: Deleting indices

2008-11-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
yes On Wed, Nov 26, 2008 at 3:19 PM, Raghunandan Rao <[EMAIL PROTECTED]> wrote: > Hi, > > I need to update an index after I update data in the DB. I will first > update the DB and then call deleteByQuery in Solrj and then update > particular index. What happens to deleteByQuery method if there are

RE: Keyword extraction

2008-11-26 Thread Plaatje, Patrick
Hi All, as an addition to my previous post, no interestingTerms are returned when i execute the folowing url: http://localhost:8080/solr/select/?q=id=18477975&mlt.fl=text&mlt.interes tingTerms=list&mlt=true&mlt.match.include=true I get a moreLikeThis list though, any thoughts? Best, Patri

Deleting indices

2008-11-26 Thread Raghunandan Rao
Hi, I need to update an index after I update data in the DB. I will first update the DB and then call deleteByQuery in Solrj and then update particular index. What happens to deleteByQuery method if there are multiple ids found? For eg, I am using deleteByQuery("12"); Can I specify field n