Setting up priorities

2009-03-30 Thread Sajith Weerakoon
Hello, I am developing a search application using solr and now I want to increase the priority of certain fields. How can I do it? Can someone help me out? Thanks, Regards, Sajith Vimukthi Weerakoon.

Re: Setting up priorities

2009-03-30 Thread Markus Jelsma - Buyways B.V.
Fieldboosting on index time might help you out: http://wiki.apache.org/solr/UpdateXmlMessages#head-8315b8028923d028950ff750a57ee22cbf7977c6 - Markus Jelsma Buyways B.V. Tel. 050-3118123 Technisch ArchitectFriesestraatweg 217c Fax. 050-3118124 http://

Not getting the proper result.

2009-03-30 Thread Radha C.
Hi, I am having following analyzer set up in schema.xml I am indexing a database field which contains L.I.C and I am trying to search the field as follows but getting zero response. http://localhost:8080/solr/select/?q=LIC

Re: Not getting the proper result.

2009-03-30 Thread Grant Ingersoll
The StandardTokenizer splits on punctuation, so L.I.C. is likely becoming 'l', 'i', 'c', while LIC -> lic. One helpful tool is the Analysis page on the Solr admin: http://localhost:8983/solr/admin/analysis.jsp as it can help you figure out what is going on with analysis on both the query

Re: aka Replication Stall

2009-03-30 Thread Jeff Newburn
I apologize for the delay. The replication stalling out doesn't happen daily. I will paste the thread dump below to try to help. This is on a server that is currently locked on replication for a few hours. Any more information please let me know. There are no errors in the logs either so very s

keepOptimizedOnly solr1.4 trunk version 27/03/2009

2009-03-30 Thread sunnyfr
Hi, I would like to know more about keepOptimizedOnly, My problem is on the slaves's servers it's a bit slow after a replication and I would like to automatize an optimization after every commit. How can I do that ? Is it this option keepOptimizedOnly? Thanks a lot, -- View this message in co

Times Replicated Since Startup: 109 since yesterday afternoon?

2009-03-30 Thread sunnyfr
Hi, Can you explain me more about this replication script in solr 1.4. It does work but it always replicate everything from the master so it lost every cache everything to replicate it. I don't get really how it works ? Thanks a lot, -- View this message in context: http://www.nabble.com/Tim

Re: Times Replicated Since Startup: 109 since yesterday afternoon?

2009-03-30 Thread Akshay
Can you post your replicationhandler configuration? On Mon, Mar 30, 2009 at 8:17 PM, sunnyfr wrote: > > Hi, > > Can you explain me more about this replication script in solr 1.4. > It does work but it always replicate everything from the master so it lost > every cache everything to replicate it

Re: Strange anomaly(?) with string matching in query

2009-03-30 Thread Kurt Nordstrom
Does anybody have any further suggestions on what I might try in this situation? Any tools perhaps that might help me put my finger on Solr's pulse so I can figure out just what's going on in there at index and query time? -Kurt Kurt Nordstrom wrote: > > Changed the config so that both WordDe

DIH DateFormatTransformer ClassCastException

2009-03-30 Thread Giovanni De Stefano
Hello all, I have a little problem with DIH and DateFormatTransformer. My column in the DB contains an Oracle TIMESTAMP; the corresponding field is of type date in the Solr schema; I specified a DateFormatTransformer for the entity; the field definition is as follow: but I keep getting a Class

Re: Times Replicated Since Startup: 109 since yesterday afternoon?

2009-03-30 Thread sunnyfr
I've about 30 000 docs updated every 20mn. I just store id and text which is (title description) my index is about 11G -- View this message in context: http://www.nabble.com/Times-Replicated-Since-Startup%3A-109--since-yesterday-afternoon--tp22784943p22785606.html Sent from the Solr - User ma

Some Kind of Crazy Histogram

2009-03-30 Thread Jeff Newburn
I have noticed that I can¹t seem to make sense of the histogram. For every field the x-axis shows powers of 2 which make no sense for things like brand name. Am I looking at it wrong or is it having issues? -- Jeff Newburn Software Engineer, Zappos.com jnewb...@zappos.com - 702-943-7562

Re: NullPointerException while performing Merge

2009-03-30 Thread Michael McCandless
Do you have an index where this exception happens consistently, eg when you try to optimize? Can you post that somewhere? Also, which exact JRE version are you using? Mike On Sun, Mar 29, 2009 at 1:28 PM, Sameer Maggon wrote: > In our application, we are getting NullPointerExceptions very freq

How to round solr score ?

2009-03-30 Thread squaro
Hello, I would like to cut solr score to 3 or 4 digits . Indeed I would like to be able to sort by score, then by another critria ( price for example). So if two docs have score of 1.67989 and 1.6767, I would like to sort them by price. Do you have any idea how I could do that ? -- View this m

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

2009-03-30 Thread Grant Ingersoll
Fergus, I think the problem may actually be due to something that was introduced by a change to Solr's StopFilterFactory and the way it loads the stop words set. See https://issues.apache.org/jira/browse/SOLR-1095 I am in the process of testing it out and will let you know. -Grant On Mar

Re: Times Replicated Since Startup: 109 since yesterday afternoon?

2009-03-30 Thread Shalin Shekhar Mangar
On Mon, Mar 30, 2009 at 8:17 PM, sunnyfr wrote: > > Hi, > > Can you explain me more about this replication script in solr 1.4. > It does work but it always replicate everything from the master so it lost > every cache everything to replicate it. > I don't get really how it works ? > That's the n

Re: DIH DateFormatTransformer ClassCastException

2009-03-30 Thread Shalin Shekhar Mangar
On Mon, Mar 30, 2009 at 8:52 PM, Giovanni De Stefano < giovanni.destef...@gmail.com> wrote: > Hello all, > > I have a little problem with DIH and DateFormatTransformer. > > My column in the DB contains an Oracle TIMESTAMP; the corresponding field > is > of type date in the Solr schema; I specified

Re: OOM at MultiSegmentReader.norms

2009-03-30 Thread vivek sar
Thanks Otis and Mike. I'm indexing total of 9 fields, with 5 having norms turned on. I think I may not need it and will try use the omitNorms for them. How do I make use of RAMBuffer in Solr? I couldn't find anything on this on the Wiki - any pointer? Thanks, -vivek On Sat, Mar 28, 2009 at 1:09

Re: keepOptimizedOnly solr1.4 trunk version 27/03/2009

2009-03-30 Thread Shalin Shekhar Mangar
On Mon, Mar 30, 2009 at 8:14 PM, sunnyfr wrote: > > I would like to know more about keepOptimizedOnly, > My problem is on the slaves's servers it's a bit slow after a replication > and I would like to automatize an optimization after every commit. How can > I > do that ? Is it this option keepOpt

Re: Times Replicated Since Startup: 109 since yesterday afternoon?

2009-03-30 Thread sunnyfr
So except commit/optimize or replicate with a time poll less often, I can't change this ??? So replication when you have loads of data updated every 30mn is not adviced. Or I must replicate once a day ??? or ..? Shalin Shekhar Mangar wrote: > > On Mon, Mar 30, 2009 at 8:17 PM, sunnyfr wrote: >

Re: How to round solr score ?

2009-03-30 Thread Shalin Shekhar Mangar
On Mon, Mar 30, 2009 at 10:04 PM, squaro wrote: > > Hello, > > I would like to cut solr score to 3 or 4 digits . > Indeed I would like to be able to sort by score, then by another critria ( > price for example). > So if two docs have score of 1.67989 and 1.6767, I would like to sort them > by pri

Re: Times Replicated Since Startup: 109 since yesterday afternoon?

2009-03-30 Thread Shalin Shekhar Mangar
On Mon, Mar 30, 2009 at 10:31 PM, sunnyfr wrote: > > So except commit/optimize or replicate with a time poll less often, I can't > change this ??? > So replication when you have loads of data updated every 30mn is not > adviced. > Or I must replicate once a day ??? or ..? > > Yes, commits are exp

Re: How to round solr score ?

2009-03-30 Thread Grant Ingersoll
On Mar 30, 2009, at 1:07 PM, Shalin Shekhar Mangar wrote: On Mon, Mar 30, 2009 at 10:04 PM, squaro wrote: Hello, I would like to cut solr score to 3 or 4 digits . Indeed I would like to be able to sort by score, then by another critria ( price for example). So if two docs have score o

Re: DIH DateFormatTransformer ClassCastException

2009-03-30 Thread Giovanni De Stefano
Hello Shalin, thank you for your reply. Unfortunately I have to perform some kind of transformation otherwise the exception is: org.apache.solr.common.SolrException: Invalid Date String:'2008-07-12T22:00:26+0200' at org.apache.solr.schema.DateField.parseMath(DateField.java:167) at org.ap

Re: How to round solr score ?

2009-03-30 Thread Walter Underwood
I think what you want to do is add in a function query that gives values in that range. There is no need to round the scores. That doesn't do anything but throw away information. wunder On 3/30/09 10:07 AM, "Shalin Shekhar Mangar" wrote: > On Mon, Mar 30, 2009 at 10:04 PM, squaro wrote: > >>

Re: How to round solr score ?

2009-03-30 Thread Shalin Shekhar Mangar
On Mon, Mar 30, 2009 at 10:54 PM, Grant Ingersoll wrote: > > I don't there there is an existing way to round them. But it will be a >> useful contribution if you can write a function query for rounding. >> >> Look at http://wiki.apache.org/solr/FunctionQuery >> > > What did you have in mind, Shali

Re: How to round solr score ?

2009-03-30 Thread Shalin Shekhar Mangar
On Mon, Mar 30, 2009 at 11:06 PM, Walter Underwood wrote: > I think what you want to do is add in a function query that gives > values in that range. > The scale function won't work in this use-case because it will give you a double in the given range. So you cannot do sort by score and price. Fo

Re: How to round solr score ?

2009-03-30 Thread Shalin Shekhar Mangar
On Mon, Mar 30, 2009 at 11:07 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > > Yonik added a way to use the score of a query in function queries with > SOLR-939. Look at the "query" function on the wiki. Some very cool things > are possible now :) > Sorry, that should have been SOLR

Re: How to round solr score ?

2009-03-30 Thread Shalin Shekhar Mangar
On Mon, Mar 30, 2009 at 11:10 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > On Mon, Mar 30, 2009 at 11:06 PM, Walter Underwood > wrote: > >> I think what you want to do is add in a function query that gives >> values in that range. >> > > The scale function won't work in this use-c

Re: DIH DateFormatTransformer ClassCastException

2009-03-30 Thread Shalin Shekhar Mangar
On Mon, Mar 30, 2009 at 10:59 PM, Giovanni De Stefano < giovanni.destef...@gmail.com> wrote: > > Unfortunately I have to perform some kind of transformation otherwise the > exception is: > > org.apache.solr.common.SolrException: Invalid Date > String:'2008-07-12T22:00:26+0200' >at org.apache.s

Re: DIH DateFormatTransformer ClassCastException

2009-03-30 Thread Giovanni De Stefano
I was using a nightly build DIH 1.4 from last week, then I upgraded to the latest nightly build and still the same problem. :-( I look forward to hearing from you... P.S. in a previous post I asked something very similar and you replied to me suggesting to use Solrj for the integration with Solr

Re: OOM at MultiSegmentReader.norms

2009-03-30 Thread Yonik Seeley
On Mon, Mar 30, 2009 at 12:53 PM, vivek sar wrote: > I'm indexing total of 9 fields, with 5 having norms turned on. So that's 500MB for norms alone, plus memory for Lucene's term index (every 128th term by default). Solr also opens a new IndexReader/Searcher before closing the old one, so there

Spelling Component

2009-03-30 Thread Anoop Atre
Hi all, I'm new to Solr and have been reading up as much as possible, especially about implementing the spellcheck feature. The instructions I'm looking at are on the following links: > http://wiki.apache.org/solr/SpellCheckComponent > http://snipurl.com/elxmr [vufind tech list] Error I get when

Lower-cased string fieldtype?

2009-03-30 Thread Walter Underwood
I need a lower-cased string fieldtype (to use with the ElevationComponent), but I'm temporarily stuck. The LowerCaseFilter needs a tokenizer, but I don't want to tokenize. What am I missing? wunder

Re: Lower-cased string fieldtype?

2009-03-30 Thread Shalin Shekhar Mangar
On Tue, Mar 31, 2009 at 12:38 AM, Walter Underwood wrote: > I need a lower-cased string fieldtype (to use with the ElevationComponent), > but I'm temporarily stuck. The LowerCaseFilter needs a tokenizer, but I > don't want to tokenize. What am I missing? > KeywordTokenizer can help. -- Regards,

RE: Lower-cased string fieldtype?

2009-03-30 Thread Vauthrin, Laurent
I'm not sure if I did this the right way but here's what I ended up using: According to the comments: Note: I had to use the TextField instead of StrField. -Original Message- From: solr-user-return-20238-laurent.vauthrin=disney...

Birthday (that's "day" not "date") search query?

2009-03-30 Thread Development Team
Hi everyone, I have an index that stores birth-dates, and I would like to search for anybody whose birth-date is within X days of a certain month/day. For example, I'd like to know if anybody's birthday is coming up within a certain number of days, regardless of what year they were born. How w

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

2009-03-30 Thread Grant Ingersoll
Fregus, Is rev 643465 the absolute latest you tried that still performs? i.e. every revision after is slower? -Grant On Mar 30, 2009, at 12:45 PM, Grant Ingersoll wrote: Fergus, I think the problem may actually be due to something that was introduced by a change to Solr's StopFilterFac

Re: Lower-cased string fieldtype?

2009-03-30 Thread Walter Underwood
Thanks! I posted, went to get a sandwich, and came back to see two answers. The change works, and I can get the fix into production today. This list is magic. wunder On 3/30/09 12:13 PM, "Vauthrin, Laurent" wrote: > I'm not sure if I did this the right way but here's what I ended up > using: >

Re: DIH DateFormatTransformer ClassCastException

2009-03-30 Thread Shalin Shekhar Mangar
On Mon, Mar 30, 2009 at 11:39 PM, Giovanni De Stefano < giovanni.destef...@gmail.com> wrote: > I was using a nightly build DIH 1.4 from last week, then I upgraded to the > latest nightly build and still the same problem. :-( > > I remembered an old email related to Oracle timestamps: http://www.

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

2009-03-30 Thread Grant Ingersoll
Can you verify that rev 701485 still performs reasonably well? This is from October 2008 and I get similar results to the earlier rev. Am now trying some other versions between October and when you first reported the issue in November. -Grant On Mar 30, 2009, at 3:37 PM, Grant Ingersol

Hijacking Search Requests

2009-03-30 Thread Alex Wang
Hi everyone, We have a web application that queries a Solr server through http. What we would like to do is to customize the Solr server and hijack the search request. If the user search term matches certain rules, then redirect the user to a different page without even performing any search in

Re: Hijacking Search Requests

2009-03-30 Thread Grant Ingersoll
I think this can be done with a load balancer such that you don't even need to go to Solr, right? Or, do you mean you want different "results" from Solr itself? On Mar 30, 2009, at 4:31 PM, Alex Wang wrote: Hi everyone, We have a web application that queries a Solr server through http.

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

2009-03-30 Thread Fergus McMenemie
Grant, After all my playing about at boot camp, I gave things a rest. It was not till months later that got back to looking at solr again. So after 643465 (2008-Apr-01) the next version I tried was 694377 from (2008-Sep-11). Nothing in between. Yep so 643465 is the latest version I tried that st

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

2009-03-30 Thread Fergus McMenemie
>Can you verify that rev 701485 still performs reasonably well? This >is from October 2008 and I get similar results to the earlier rev. >Am now trying some other versions between October and when you first >reported the issue in November. OK. Can you tell me how to get a hold of revisio

RE: Hijacking Search Requests

2009-03-30 Thread Alex Wang
Thanks Grant. Yes, I was trying to persuade our architect to do this from the web application itself, but he prefers to centralize this functionality on the Solr server rather than having all client applications implement their own. Cheers! Alex >-Original Message- >From: Grant Inger

Wildcard searches

2009-03-30 Thread Vauthrin, Laurent
Hello again, I'm in the process of converting one of our services that was previously using Lucene to use Solr instead. The main focus here is to preserve backwards compatibility (even if some searches are not as efficient). There are currently two scenarios that are giving me problems right now.

Adding text document

2009-03-30 Thread nga pham
Hi All, I am new to Solr. Can you please tell me, how can I add a text document? Thank you, Nga

Querying Different Index Types in a single request

2009-03-30 Thread Todd Benge
Hi, We're in the early stages of converting a large scale lucene deployment to Solr. The primary reason is to take advantage of the distributed search capabilities. We have multiple sets of indices that serve different types of documents. In our existing deployment, we use MultiSearcher and cust

Re: Adding text document

2009-03-30 Thread Eric Pugh
I would work through this tutorial and then ask specific questions: http://lucene.apache.org/solr/tutorial.html Alternatively there are some commercial support options: http://wiki.apache.org/solr/Support Eric On Mar 30, 2009, at 6:36 PM, nga pham wrote: Hi All, I am new to Solr. Can you

Re: DIH DateFormatTransformer ClassCastException

2009-03-30 Thread Noble Paul നോബിള്‍ नोब्ळ्
Giovanni, guess this patch must help. could you plz verify? --Noble On Tue, Mar 31, 2009 at 1:36 AM, Shalin Shekhar Mangar wrote: > On Mon, Mar 30, 2009 at 11:39 PM, Giovanni De Stefano < > giovanni.destef...@gmail.com> wrote: > >> I was using  a nightly build DIH 1.4 from last week, then I upgr

Re: Querying Different Index Types in a single request

2009-03-30 Thread Yonik Seeley
On Mon, Mar 30, 2009 at 7:07 PM, Todd Benge wrote: > Is there any other way to query multiple index types in a single query > across a cluster? Splitting a homogeneous index into shards, querying across them, and combining the results is distributed search. If the shards are heterogeneous (have

Re: Hijacking Search Requests

2009-03-30 Thread Noble Paul നോബിള്‍ नोब्ळ्
you may write a servlet filter which is applied before the SolrDispatchFilter which applies the rules and do the redirect/forward On Tue, Mar 31, 2009 at 2:54 AM, Alex Wang wrote: > Thanks Grant. Yes, I was trying to persuade our architect to do this from the > web application itself, but he pr

Issue in Range Search Query

2009-03-30 Thread dabboo
Hi, I am searching for all the records in the index where author's last name starts with a or b. I am giving my query like au_last_name:[a* TO b*] But it is returning all the other records where last name starts with E, P or other letter. Please suggest how I can achieve this. I dont want to