Re: change base Scoring Algorithms

2010-03-30 Thread MitchK
Before you do so, you should have a look at function queries. Take a searchengine and look for some examples. I know there are some quite good ones to influence scoring by the creation-date, so that newer documents were scored higher than older ones. Kind regards - Mitch -- View this message in

Re: SOLR-1316 How To Implement this autosuggest component ???

2010-03-30 Thread Andy
--- On Tue, 3/30/10, Andrzej Bialecki wrote: > From: Andrzej Bialecki > Subject: Re: SOLR-1316 How To Implement this autosuggest component ??? > To: solr-user@lucene.apache.org > Date: Tuesday, March 30, 2010, 9:59 AM > On 2010-03-30 15:42, Robert Muir > wrote: > > On Mon, Mar 29, 2010 at 11:3

Re: Some indexing requests to Solr fail

2010-03-30 Thread Lance Norskog
How often do you commit? New searchers are only created after a commit. You notice that handleCommit is in the stack trace :) This means that commits are happening too often for the amount of other traffic currently happening, and so it can't finishing creating the searcher before the next commit s

Re: how to create this highlighter behaviour

2010-03-30 Thread Lance Norskog
The regular expression fragmenter might help you here. http://wiki.apache.org/solr/HighlightingParameters#hl.fragmenter On Mon, Mar 29, 2010 at 4:38 PM, Joe Calderon wrote: > hello *,  ive been using the highlighter and been pretty happy with > its results, however theres an edge case im not sur

Re: resetting stats

2010-03-30 Thread Trey Grainger
You can reload the core on which you want to reset the stats - this lets you keep the engine up and running without requiring you restart Solr. If you have an separate core for aggregating (i.e. a core that contains no data and has no caches) then the overhead for reloading that core is negligable

Re: resetting stats

2010-03-30 Thread Chris Hostetter
: Is there a way to reset the stats counters? For example in the Query handler : avgTimePerRequest is not much use after a while as it is an avg since the : server started. not at the moment ... but it would probably be fairly straight forward to add as a new option if you want to file a Jira is

Re: Switching data dir on the fly

2010-03-30 Thread Chris Hostetter
: I wish to copy the index on a different disk than the disk that solr : instance is using, then tell the solr server to switch from the current data : dir to the location where I copied the hadoop generated index (without : having search service interruptions). One way to do this would be to CRE

Re: Spatial / Local Solr radius

2010-03-30 Thread Mauricio Scheffer
Hi Michael I exchanged a few mails with jteam, ultimately I realized my longitudes' signs were inverted so I was mapping to China instead of U.S. Still a bug, but inverting those longitudes "fixed" the problem in my case since I'm not running world-wide searches. Before that I ran a test to determ

Re: Multiple QParserPlugins, Single RequestHandler

2010-03-30 Thread Erik Hatcher
On Mar 30, 2010, at 2:43 PM, Peter S wrote: I have an existing QParserPlugin subclass that does some tagging functionality (kind of a group alias thing). This is currently registered with the default queryHandler. I want to add another, quite separate plugin that writes an audit of every

DIH - Unable to connect to a DB using JDBC:ODBC bridge

2010-03-30 Thread bbarani
Hi, I am trying to index a DB (using SOLR) with JDBC:ODBC bridge driver but getting the below mentioned error org.apache.solr.handler.dataimport.DataImportHandlerException: Could not load driver: {MetaMatrix ODBC} Processing Document # 1 Caused by: java.lang.ClassNotFoundException: Unable to lo

Re: Spatial / Local Solr radius

2010-03-30 Thread Michael
Mauricio, I was wondering whether you had heard anything back from jteam regarding this issue. I have also noticed it and was wondering why It was happening. One thing I noticed is that this problem only appears for "sparse" datasets as compared to "dense" ones. For example, I have two datasets I

RE: Multiple QParserPlugins, Single RequestHandler

2010-03-30 Thread Peter S
Hi Erik, Thanks for your reply. My particular use case is this: I have an existing QParserPlugin subclass that does some tagging functionality (kind of a group alias thing). This is currently registered with the default queryHandler. I want to add another, quite separate plugin that

Registration is now open for Apache Lucene EuroCon - Prague, Czech Republic, 18-21 May, 2010.

2010-03-30 Thread Grant Ingersoll
(sorry for the miss post yesterday, this is what should have been sent) Registration is now open for Apache Lucene EuroCon - Prague, Czech Republic, 18-21 May, 2010. To sign up, please visit: http://lucene-eurocon.org/register.html. Sponsored by Lucid Imagination; all net proceeds benefit the A

DIH after import hooks

2010-03-30 Thread Blargy
Can you use a RunExecutableListener on DIH to run external scripts after a full-import/delta-import just like you can use on the DirectUpdateHandler2? If not, is there any alternative way to achieve this functionality? Thanks -- View this message in context: http://n3.nabble.com/DIH-after-impor

Re: Multiple QParserPlugins, Single RequestHandler

2010-03-30 Thread Erik Hatcher
No, not quite like that, but you can nest various query parser plugins. See http://www.lucidimagination.com/blog/2009/03/31/nested-queries-in-solr/ Or perhaps write a composite query parser plugin that runs through the chain of others as you wish. I'm curious, what's the use case?

RE: One item, multiple fields, and range queries

2010-03-30 Thread Chris Hostetter
: parallel arrays, one array per address-part field. The parallel array : alignment is effected via alignment of position increments. What's : missing from Solr/Lucene is the ability to constrain matches such that : the position increment of all matching address-part fields is the same. It e

Re: search within sentence or paragraph

2010-03-30 Thread Erik Hatcher
On Mar 30, 2010, at 12:36 PM, Ahmet Arslan wrote: Is it possible search for a combination of words within the same sentence or paragraph? Mark Miller's Qsol Parser can do that [1]. However it seems that temporarily it is not publicly available [2] [3]. [1]http://www.lucidimagination.co

Re: ReplicationHandler reports incorrect replication failures

2010-03-30 Thread Shawn Smith
Sure, sounds good. I created https://issues.apache.org/jira/browse/SOLR-1855 for a script to monitor slave replication health, and attached our current implementation. Improvements would be welcome... Shawn On Mon, Mar 29, 2010 at 12:10 PM, Jason Rutherglen wrote: > Shawn, > > I was working on

Re: search within sentence or paragraph

2010-03-30 Thread Ahmet Arslan
> Is it possible search for a combination of words within the > same > sentence or paragraph? Mark Miller's Qsol Parser can do that [1]. However it seems that temporarily it is not publicly available [2] [3]. [1]http://www.lucidimagination.com/blog/2009/02/22/exploring-query-parsers/ [2]http:/

Re: Absolutely empty resultset regardless of what I am searching for

2010-03-30 Thread MitchK
The problem was a wrong incrementToken-implementation. Now TermsComponent as well as Luke are showing expected responses for every field. However: What could be wrong, when some terms of a field are not searchable? Here is my query: solr/select/?q=titleSemantic:Me Let me show you a response of

exceptionhandling & error-reporting?

2010-03-30 Thread Alexander Rothenberg
Hi, we have setup solr 1.4 running in tomcat 6.2 on centos 5.3. Ouer webserver communicate with solr using the perl-module WebService::Solr (available on CPAN). This client uses a simple user-agent that requires JSON-syntax while parsing searchresults from solr, but when solr drops an exceptio

Re: spellcheck suggestion ordering and distance measures

2010-03-30 Thread Rob Casson
> 2) i'm not entirely clear on the order in which suggestions are > returned. for a search of "porgrams" against a subset of my data, i > get these suggestions...i've added my own levenshtein calculations, > provided they're correct: > > program: 3 > pulgram: 3 > porras: 2 > portrai

Multiple QParserPlugins, Single RequestHandler

2010-03-30 Thread Peter Sturge
Hi Solr Expoerts, Is it possible to 'chain' multiple QParserPlugins from a single RequestHandler? e.g. when a query request comes in for the default standard requestHandler, it sends the query request to: qpluginhandler_1 then: qpluginhandler_2 and finally: qpluginhandler

spellcheck suggestion ordering and distance measures

2010-03-30 Thread Rob Casson
poking around at the spellcheck component, and have a couple questions: 1) is there a way to return the distance measure with spellcheck.extendedResults? haven't poked too closely at the source, but it might be useful. 2) i'm not entirely clear on the order in which suggestions are returned. for

Re: Trouble compiling SOLR

2010-03-30 Thread Shawn Heisey
I found the jpackage repo. After building and installing the compat RPM mentioned in the following message, I was able to get ant 1.7 installed on CentOS from the repository. http://www.zarb.org/pipermail/jpackage-discuss/2008-July/012751.html I wasn't able to get the new .war working once I

Some indexing requests to Solr fail

2010-03-30 Thread Jon Poulton
Hi there, We have a setup in which our main application (running on a separate Tomcat instance on the same machine) uses SolrJ calls to an instance of Solr running on the same box. SolrJ is used both for indexing and searching Solr. Searching seems to be working fine, but quite frequently we see

Re: SOLR-1316 How To Implement this autosuggest component ???

2010-03-30 Thread Robert Muir
On Tue, Mar 30, 2010 at 9:59 AM, Andrzej Bialecki wrote: > > The problem is a bit more complicated. There are two issues: > Somehow I guessed this was the case, as admittedly I dont understand what it should do! > > * simple term-level completion often produces wrong results for multi-term > q

Re: SOLR-1316 How To Implement this autosuggest component ???

2010-03-30 Thread Andrzej Bialecki
On 2010-03-30 15:42, Robert Muir wrote: On Mon, Mar 29, 2010 at 11:34 PM, Andy wrote: Reading through this thread and SOLR-1316, there seems to be a lot of different ways to implement auto-complete in Solr. I've seen the mentions of: EdgeNGrams TermsComponent Faceting TST Patricia Tries Radix

Re: SOLR-1316 How To Implement this autosuggest component ???

2010-03-30 Thread Robert Muir
On Mon, Mar 29, 2010 at 11:34 PM, Andy wrote: > Reading through this thread and SOLR-1316, there seems to be a lot of > different ways to implement auto-complete in Solr. I've seen the mentions > of: > > EdgeNGrams > TermsComponent > Faceting > TST > Patricia Tries > RadixTree > DAWG > > Another

search within sentence or paragraph

2010-03-30 Thread Frederico Azeiteiro
Hi all, Is it possible search for a combination of words within the same sentence or paragraph? Ex: American and McDonalds Returns : "McDonalds is a American company" Don't returns: "...went to McDonalds. After that se saw the American flag..." Is this possible? Frederico Aze

Re: Absolutely empty resultset regardless of what I am searching for

2010-03-30 Thread MitchK
I have tried another thing: I have skipped the problematic ID 56 and set the query to SELECT... FROM... WHERE ID BETWEEN 60 AND 100 - now it works for the lines 60-83. That means my title-field has indexed the terms of the lines 60-83. The 84th line has no problematic letters. What a bother! --

Re: Absolutely empty resultset regardless of what I am searching for

2010-03-30 Thread MitchK
So, the CSV-update fails. I have no idea whats wrong with that file, but it shouts, that there is something wrong encapsuled. It seems to be the same mistake as it is mentioned here: http://markmail.org/message/lo3vztzezyuc6h3w#query:solr%20csv%20invalid%20char%20between%20encapsulated%20token%20e

Re: Optimize after delta-import (DIH)

2010-03-30 Thread Ahmet Arslan
> According to the wiki: http://wiki.apache.org/solr/DataImportHandler#Commands > the delta-import command will accept the same clean, commit > and optimize > parameters that the full-import command takes but I am my > index keeps saying > its not optimized. > > [java] INFO: [items] webapp=/solr p

Re: Drill down a solr result set by facets

2010-03-30 Thread gwk
Hi, You are using the dismax request handler, which only accepts a simple string in the q parameter, you can't specify other fields in it that way. In any case, using filter queries (fq) as suggested by Indika Tantrigoda is a better option as these are cached separately which is quite useful

Re: Absolutely empty resultset regardless of what I am searching for

2010-03-30 Thread Erik Hatcher
On Mar 30, 2010, at 2:14 AM, MitchK wrote: Excuse my language-correctness yesterday - I think one can see the long trying-to-fix-a-bug-work? :) Erick, I have found out how to delete the whole index - with the help of some http-requests. Afterwards I have started to reindex the data agai