Re: Sort Stability With Date Boosting and Rounding

2011-02-22 Thread Stephen Duncan Jr
No, the problem is that, due to rounding, sometimes the docs ARE considered ties, and therefore the secondary sort is used, but sometimes they don't round to exactly equal, and the tiebreaker isn't used, and the results get shuffled. Stephen Duncan Jr www.stephenduncanjr.com On Tue, Feb 22, 2011

Re: Sort Stability With Date Boosting and Rounding

2011-02-22 Thread Stephen Duncan Jr
The problem comes when you have results that are all the same natural score (because you've filtered them, with no primary search, for instance), and are very close together in time. Then, as you page through, the order changes. So the user experience is that they see duplicate documents, and mis

Re: Date Math

2011-02-22 Thread Chris Hostetter
: org.apache.lucene.queryParser.ParseException: Cannot parse 'last_modified:-DAY': ... : Are they not supported as a short-cut for "NOW-1DAY"? I'm using Solr 1.4. No, "-1DAY" is a valid DateMath string (to the DateMathParser) but as a field value you must specify a valid date string,

Re: UpdateProcessor and copyField

2011-02-22 Thread Teruhiko Kurosaka
Markus, I searched but I couldn't find a definite answer, so I posted this question. The article you quoted talks about implementing a copyField-like operation using UpdateProcessor. It doesn't talk about relationship between the copyField operation proper and UpdateProcessors. Kuro On 2/22/11

Re: hierarchical faceting, SOLR-792 - confused on config

2011-02-22 Thread Koji Sekiguchi
(11/02/23 8:26), kmf wrote: I'm using solr 4.0 and trying to implement a hierarchical faceting example. The example I'm trying to implement is taken from the webcast "Mastering the Power of Faceted Search." (http://www.lucidimagination.com/solutions/webcasts/faceting) Around minute 30, Chris Ho

hierarchical faceting, SOLR-792 - confused on config

2011-02-22 Thread kmf
I'm using solr 4.0 and trying to implement a hierarchical faceting example. The example I'm trying to implement is taken from the webcast "Mastering the Power of Faceted Search." (http://www.lucidimagination.com/solutions/webcasts/faceting) Around minute 30, Chris Hostetter gives a very nice "ti

Re: Sort Stability With Date Boosting and Rounding

2011-02-22 Thread Markus Jelsma
Hi, You're right, it's illegal syntax to use other functions in the ms function, which is a pity indeed. However, you reduce the score by 50% for each year. Therefore paging through the results shouldn't make that much of a difference because the difference in score with NOW+2 minutes has a ne

Re: Sort Stability With Date Boosting and Rounding

2011-02-22 Thread Geert-Jan Brits
You could always use a secondary sort as a tie-breaker, i.e: something unique like 'documentid' or something. That would ensure a stable sort. 2011/2/23 Stephen Duncan Jr > I'm trying to use > > http://wiki.apache.org/solr/SolrRelevancyFAQ#How_can_I_boost_the_score_of_newer_documents > as > a bf

RE: Sort Stability With Date Boosting and Rounding

2011-02-22 Thread David Yang
One suggestion: use logarithms to compress the large time range into something easier to compare: 1/log(ms(now,date) -Original Message- From: Stephen Duncan Jr [mailto:stephen.dun...@gmail.com] Sent: Tuesday, February 22, 2011 6:03 PM To: solr-user@lucene.apache.org Subject: Sort Stabili

Re: UpdateProcessor and copyField

2011-02-22 Thread Markus Jelsma
Yes. But did you actually search the mailing list or Solr's wiki? I guess not. Here it is: http://wiki.apache.org/solr/UpdateRequestProcessor > Can fields created by copyField instructions be processed by > UpdateProcessors? > Or only raw input fields can? > > So far my experiment is suggesting

RE: DIH and updating specific record

2011-02-22 Thread David Yang
Chris Hostetter answered this just recently: http://wiki.apache.org/solr/DataImportHandler#Accessing_request_paramete rs My addition: Pass a parameter like command=delta-import&idz=31415 And access it via 'sql where id=${dataimporter.request.idz}' If the idz is a string you might need to prequote

Sort Stability With Date Boosting and Rounding

2011-02-22 Thread Stephen Duncan Jr
I'm trying to use http://wiki.apache.org/solr/SolrRelevancyFAQ#How_can_I_boost_the_score_of_newer_documents as a bf parameter to my dismax handler. The problem is, the value of NOW can cause documents in a similar range (date value within a few seconds of each other) to sometimes round to be equal

Re: Passing parameters to DataImportHandler

2011-02-22 Thread Chris Hostetter
: It'd be nice to be able to pass HTTP parameters into DataImportHandler : that'd be passed into the SQL as parameters, is this possible? there is a specific sub-section about this in the docs... http://wiki.apache.org/solr/DataImportHandler#Accessing_request_parameters -Hoss

Re: Indexing languages, dataimporthandler

2011-02-22 Thread Teruhiko Kurosaka
Greg, You could use copyField to copy the column in question to 6 fields, one for each of your 6 languages, and hope they none of the analyzers do something reasonable without crashing. Or apply the white-space tokenizer and hope for the best? If the column has long enough text, you could try a l

RE: XML Stripping from DIH

2011-02-22 Thread Olson, Ron
Thanks a lot! I thought I'd looked on this page but didn't see this one, not sure why. I greatly appreciate it! Ron -Original Message- From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com] Sent: Sunday, February 20, 2011 5:59 AM To: solr-user@lucene.apache.org Subject: Re: XML Stri

DIH and updating specific record

2011-02-22 Thread Olson, Ron
Hi all- I am trying to determine if there is a way to tell Solr to update its index with a specific ID to a record in the database. All the examples and documentation seems to discuss using a "last updated" date/time field, but in this case modifying the table would not be an option. Instead, I

Re: Snipet in results

2011-02-22 Thread Leonardo Souza
http://wiki.apache.org/solr/HighlightingParameters [ ]'s Leonardo Souza °v° Linux user #375225 /(_)\ http://counter.li.org/ ^ ^ On Tue, Feb 22, 2011 at 3:39 PM, Rosa (Anuncios) < rosaemailanunc...@gmail.com> wrote: > Hi, > > I would like to have a google similar snipet of 2-3 lines of d

Indexing languages, dataimporthandler

2011-02-22 Thread Greg Georges
Hello all, I have just gone through the mailing list and have set up my different field type analysers for my 6 different languages in my shema.xml. Here is my question. I am using the dataimporthandler to import data from my database into my index. In my table, the documentname column's data c

UpdateProcessor and copyField

2011-02-22 Thread Teruhiko Kurosaka
Can fields created by copyField instructions be processed by UpdateProcessors? Or only raw input fields can? So far my experiment is suggesting the latter. T. "Kuro" Kurosaka

Sorting - bad performance

2011-02-22 Thread Jon Drukman
The performance factors wiki says: "If you do a lot of field based sorting, it is advantageous to add explicitly warming queries to the "newSearcher" and "firstSearcher" event listeners in your solrconfig which sort on those fields, so the FieldCache is populated prior to any queries being executed

Snipet in results

2011-02-22 Thread Rosa (Anuncios)
Hi, I would like to have a google similar snipet of 2-3 lines of docs in my search results. Something like: TITLE <- full title of doc Description <- that extract the sentence or some text before and after keywords with highlightining and merge a couple of these extracted piece together T

Re: Multiple Blocked threads on UnInvertedField.getUnInvertedField() & SegmentReader$CoreReaders.getTermsReader

2011-02-22 Thread Yonik Seeley
On Tue, Feb 22, 2011 at 9:13 AM, Rachita Choudhary wrote: > Hi Solr Users, > > We are upgrading from Solr 1.3 to Solr 1.4.1. > While using Solr 1.3 , we were seeing multiple blocking active threads on > "org.apache.lucene.store.FSDirectory$FSIndexInput.readInternal() ". > > To utilize the benefits

Tokenizer that Protects Phrases

2011-02-22 Thread David Yang
Hi, I am trying to tokenize a string field of products. Two different products are: "camera", "security camera". What I would like is for "security camera" to be treated differently to "camera" - and only be displayed when the search is for "security camera", otherwise, the results should only

Question about Nested Span Near Query

2011-02-22 Thread Ahsan |qbal
Hi All I had a requirement to implement queries that involves phrase proximity. like user should be able to search "ab cd" w/5 "de fg", both phrases as whole should be with in 5 words of each other. For this I implement a query parser that make use of nested span queries, so above query would be p

Re: Question About Highlighting

2011-02-22 Thread Ahsan |qbal
Hi All I even tried that (Appending &hl.usePhraseHighlighter=true) but it still does not work. Please help Regards Ahsan Iqbal On Fri, Feb 18, 2011 at 12:30 AM, Ahmet Arslan wrote: > > I had a requirement to implement phrase proximity like ["a > > b c" w/5 "d e f"] for > > this i have implemen

Re: Multiple Blocked threads on UnInvertedField.getUnInvertedField() & SegmentReader$CoreReaders.getTermsReader

2011-02-22 Thread Bill Bell
+1 for more investigation Bill Bell Sent from mobile On Feb 22, 2011, at 7:13 AM, Rachita Choudhary wrote: > Hi Solr Users, > > We are upgrading from Solr 1.3 to Solr 1.4.1. > While using Solr 1.3 , we were seeing multiple blocking active threads on > "org.apache.lucene.store.FSDirectory$FSI

Re: Configure 2 or more Tomcat instances.

2011-02-22 Thread Paul Libbrecht
Rajini, you need to make the (~3) ports defined in conf/server.xml different. paul Le 22 févr. 2011 à 12:15, rajini maski a écrit : > I have a tomcat6.0 instance running in my system, with > connector port-8090, shutdown port -8005 ,AJP/1.3 port-8009 and redirect > port-8443

Multiple Blocked threads on UnInvertedField.getUnInvertedField() & SegmentReader$CoreReaders.getTermsReader

2011-02-22 Thread Rachita Choudhary
Hi Solr Users, We are upgrading from Solr 1.3 to Solr 1.4.1. While using Solr 1.3 , we were seeing multiple blocking active threads on "org.apache.lucene.store.FSDirectory$FSIndexInput.readInternal() ". To utilize the benefits of NIO, on upgrading to Solr 1.4.1, we see other type of multiple bloc

Re: Datetime problems with dataimport

2011-02-22 Thread Adam Estrada
I logged an issue in Jira that relates to this and it looks like Yonik picked it up. https://issues.apache.org/jira/browse/SOLR-2286 Adam On Feb 22, 2011, at 9:07 AM, MOuli wrote: > > Ok i got it. > > It should look like -mm-ddThh:mm:ssZ > for example: 2011-02-22T15:07:00Z > -- > View

Re: Datetime problems with dataimport

2011-02-22 Thread MOuli
Ok i got it. It should look like -mm-ddThh:mm:ssZ for example: 2011-02-22T15:07:00Z -- View this message in context: http://lucene.472066.n3.nabble.com/Datetime-problems-with-dataimport-tp2545654p2552477.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Datetime problems with dataimport

2011-02-22 Thread MOuli
Can you give me an example? Should it looks like 2011-02-22'T'14:55:20 or 2011-02-22T14:55:20 or 2011-02-22 14:55:20. I tested every one of this formats, but got anyway the Exception. Invalid Date String:'2009-12-09'T'00:00:00' Invalid Date String:'2009-12-09 00:00:00' Invalid Date String:'2009-

disable replication in a persistent way

2011-02-22 Thread Ahmet Arslan
Hello, solr/replication?command=disablepoll disables replication on slave(s). However it is not persistent. After solr/tomcat restart, slave(s) will continue polling. Is there a built-in way to disable replication on slave side in a persistent manner? Currently I am using system property sub

Re: Any plan to make Field Collapsing available for distributed search?

2011-02-22 Thread Koji Sekiguchi
(11/02/22 13:46), Andy wrote: Hello, I'm looking into Field Collapsing. According to the documentation one limitation is that "distributed search support for result grouping has not yet been implemented." Just wondered if there's any plan to add distributed search support to field collapsing.

solr indexing

2011-02-22 Thread satya swaroop
Hi all, to my keen intrest on solr indexing mechanism i started mining the code of solr indexing (/update/extract), i read the indexing file formats, scoring procedure, i have some queries regarding this.. 1) the scoring is performed on the dynamic and precalculated value(doc boost, field bo

Re: Configure 2 or more Tomcat instances.

2011-02-22 Thread Jonathan DeMello
Hey Rajani, >From what I've seen, you just need to copy the Tomcat folder and change the following ports in server.xml: shutdown, connector,ajp. Then you can start them up independently. Regards, Jonathan On Tue, Feb 22, 2011 at 3:15 PM, rajini maski wrote: > I have a tomca

Configure 2 or more Tomcat instances.

2011-02-22 Thread rajini maski
I have a tomcat6.0 instance running in my system, with connector port-8090, shutdown port -8005 ,AJP/1.3 port-8009 and redirect port-8443 in server.xml (path = C:\Program Files\Apache Software Foundation\Tomcat 6.0\conf\server.xml) How do I configure one mor

Re: Faceting

2011-02-22 Thread Jan Høydahl
Hi, Even if the customer types a correct product name, how do you know that merchant A and merchant B both have registered that exact product in the same way? Merchant A may say as product name "White Sony LCD TV XY123" and the other says "Sony XY123 LCD TV", colour=white If you're serious ab

Re: Problem with XML encode UFT-8

2011-02-22 Thread Jan Høydahl
Hi, Please explain some more. a) What version of Solr? b) Are you trying to feed XML or PDF? c) What request handler are you feeding to? /update or /update/extract ? d) Can you copy/paste some more lines from the error log? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.co