Solrj no search results

2009-06-23 Thread pof
Hi, I'm using an EmbeddedSolrServer. Adding documents with the example jetty server example using this method worked fine: doc1.addField( "id", "id1"); doc1.addField( "name", "doc1"); doc1.addField( "price", 10); server.add(doc1) However now I have changed the schema.xml so I can use my own field

Changing the score of a document based on the value of a field

2009-06-23 Thread Martin Davidsson
The SolrRelevancyFAQ has a heading that's the same as my message's subject: http://wiki.apache.org/solr/SolrRelevancyFAQ#head-f013f5f2811e3ed28b200f326dd686afa491be5e There's a TODO on the wiki to provide an actual example. Does anybody happen to have an example handy that I could model my q

Re: building custom RequestHandlers

2009-06-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
this part of the doc explains what you shold do to write a custom requesthandler http://wiki.apache.org/solr/SolrPlugins#head-7c0d03515c496017f6c0116ebb096e34a872cb61 On Wed, Jun 24, 2009 at 3:35 AM, Julian Davchev wrote: > Is it just me or this is thread steal? nothing todo with what thread is >

Re: Initialize SOLR DataImportHandler

2009-06-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
yes , you will need to fire a command On Tue, Jun 23, 2009 at 9:51 PM, ice wrote: > > > We use the DataImportHandler for indexes from a RDBMS. Is there any way to > make sure that the import is run when the SOLR webapp/core starts up? Do we > need to send a command to SOLR to make this happen? >

Re: Function query using Map

2009-06-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
The five parameter feature is added in solr1.4 . which version of solr are you using? On Wed, Jun 24, 2009 at 12:57 AM, David Baker wrote: > > Hi, > > I'm trying to use the map function with a function query.  I want to map a > particular value to 1 and all other values to 0.  We currently use t

Re: Facets with an IDF concept

2009-06-23 Thread Grant Ingersoll
On Jun 23, 2009, at 6:23 PM, Chris Hostetter wrote: : Regardless of the semantics, it doesn't sound like DF would give you what you : want. It could be entirely possible that in some short timespan the number of : docs on Iran could match up w/ the number on Obama (maybe not for that :

Re: Query regarding Solr search options..

2009-06-23 Thread Otis Gospodnetic
Hello, Not quite "lines", but look at the various Highlighter options on the Wiki and in the example solrconfig.xml. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Silent Surfer > To: Solr User > Sent: Tuesday, June 23, 2009 11:04:53

Query regarding Solr search options..

2009-06-23 Thread Silent Surfer
Hi, Can Solr search be customized to provide N number of lines before and after the line that contains matches the keyword. For eg: Suppose i have a document with 10 lines, and 5th line contains the key word 'X' I am interested in. Now if I am fire a Solr search for the keyword 'X'. Is there

Re: Facets with an IDF concept

2009-06-23 Thread Otis Gospodnetic
Hi, Hm, I don't think facets (nor pure search/Solr) are the right tool for this job. I think you have to do what Ian said, which is to compute the baseline for various concepts of interest (Barack Obama and Iran in your example), and then compare. Look at point #2 on http://www.sematext.com/

Re: Search returning 0 results for "U2"

2009-06-23 Thread Otis Gospodnetic
John, This is simply the case of mismatching index-time and query-time analyzers. When you use Luke you get the match, but Luke doesn't use the tokenizer+filters you specified in Solr for your field. In your Solr installation, go to Solr Admin page, then to Analysis page, enter U2 and select

Re: qf boost Versus field boost for Dismax queries

2009-06-23 Thread Chris Hostetter
On Tue, 9 Jun 2009, ashokc wrote: : When 'dismax' queries are use, where is the best place to apply boost : values/factors? While indexing by supplying the 'boost' attribute to the : field, or in solrconfig.xml by specifying the 'qf' parameter with the same : boosts? What are the advantages/disad

Re: Solr relevancy score - conversion

2009-06-23 Thread Chris Hostetter
On Mon, 8 Jun 2009, Vijay_here wrote: : Would need an more proportionate score like rounded to 100% (95% relevant, : 80 % relevant and so on). Is there a way to make solr returns such scores of : such relevance. Any other approach to arrive at this scores also be : appreciated There is a reason

Re: Facets with an IDF concept

2009-06-23 Thread Chris Hostetter
: Regardless of the semantics, it doesn't sound like DF would give you what you : want. It could be entirely possible that in some short timespan the number of : docs on Iran could match up w/ the number on Obama (maybe not for that : particular example) in which case your "hot" item would no lon

Re: No wildcards with solr.ASCIIFoldingFilterFactory?

2009-06-23 Thread Mark Miller
Wildcard queries are not analyzed, so you are getting what you type - which doesnt match what went through an analyzer and into the index. I don't think Solr has a solution for this at the moment. I think Lucene has a special analyzer with deals with this to some degree, but I have never used i

Re: building custom RequestHandlers

2009-06-23 Thread Julian Davchev
Is it just me or this is thread steal? nothing todo with what thread is originally about. Cheers Bill Dueber wrote: > Is it possible to change the javascript output? I find some of the > information choices (e.g., that facet information is returned in a flat > list, with facet names in the even-n

Re: building custom RequestHandlers

2009-06-23 Thread Chris Hostetter
: So question is howto extend the class where to place the file, howto : recomplie, set in solrconfig.xml etc... so that it's all glued together : and can make use of it. I would start here... http://wiki.apache.org/solr/SolrPlugins ...and then ask specific questions as you encounter them.

Re: building custom RequestHandlers

2009-06-23 Thread Chris Hostetter
: Is it possible to change the javascript output? I find some of the : information choices (e.g., that facet information is returned in a flat : list, with facet names in the even-numbered indexes and number-of-items : following them in the odd-numbered indexes) kind of annoying. Did you look at

Solr Logging in Weblogic

2009-06-23 Thread Ryan Heinen
Has anyone been able to successfully configure logging from Solr in Weblogic? I am trying to increase the verbosity of the logs as I am seeing some strange behavior during indexing, but have not been able to make this work. Changes to Server -> Configuration -> Logging section in the Weblogic ad

Re: Auto suggest.. how to do mixed case

2009-06-23 Thread Mani Kumar
hi shalin, can you please share code or tutorial documents for (it'll be great help) 1. Prefix search on shingles 2. Exact (phrase) search on n-grams The regular prefix search also works. The good thing with these is that you can filter and different stored value is also possible. ?? thank

Re: building custom RequestHandlers

2009-06-23 Thread Julian Davchev
I am not sure we talk about same thing at all. I want to extend solr (java) so that I have another request handler in java And I can do for example /select?qt=myhandler&q=querystring Then in this myhandler class in java ot whoever I will parse querystring so I build the final correct query t

Re: THIS WEEK: PNW Hadoop / Apache Cloud Stack Users' Meeting, Wed Jun 24th, Seattle

2009-06-23 Thread Bradford Stephens
Greetings, I've gotten a few replies on this, but I'd really like to know who else is coming. Just send me a quick note :) Cheers, Bradford On Mon, Jun 22, 2009 at 5:40 PM, Bradford Stephens wrote: > Hey all, just a friendly reminder that this is Wednesday! I hope to see > everyone there again.

Function query using Map

2009-06-23 Thread David Baker
Hi, I'm trying to use the map function with a function query. I want to map a particular value to 1 and all other values to 0. We currently use the map function that has 4 parameters with no problem. However, for the map function with 5 parameters, I get a parse error. The following are t

RE: Question about index sizes.

2009-06-23 Thread Ensdorf Ken
That's a great question. And the answer is, of course, it depends. Mostly on the size of the documents you are indexing. 50 million rows from a database table with a handful of columns is very different from 50 million web pages, pdf documents, books, etc. We currently have about 50 million

Re: Upgrading 1.2.0 to 1.3.0 solr

2009-06-23 Thread Ryan Grange
Actually, it was a very straightforward installation. I just tweaked the configurations afterward to better support for the new 1.3.0 features I wanted to use (spelling suggestions and faceting). Ryan T. Grange, IT Manager DollarDays International, Inc. rgra...@dollardays.com (480)922-8155 x10

Question about index sizes.

2009-06-23 Thread Jim Adams
Can anyone give me a rule of thumb for knowing when you need to go to multicore or shards? How many records can be in an index before it breaks down? Does it break down? Is it 10 million? 20 million? 50 million? Thanks, Jim

Re: Facets with an IDF concept

2009-06-23 Thread Grant Ingersoll
On Jun 23, 2009, at 8:05 AM, Asif Rahman wrote: Hi Grant, I'll give a real life example of the problem that we are trying to solve. We index a large number of current news articles on a continuing basis. We tag these articles with news topics (e.g. Barack Obama, Iran, etc.). We then

Re: building custom RequestHandlers

2009-06-23 Thread Bill Dueber
Is it possible to change the javascript output? I find some of the information choices (e.g., that facet information is returned in a flat list, with facet names in the even-numbered indexes and number-of-items following them in the odd-numbered indexes) kind of annoying. On Tue, Jun 23, 2009 at

Initialize SOLR DataImportHandler

2009-06-23 Thread ice
We use the DataImportHandler for indexes from a RDBMS. Is there any way to make sure that the import is run when the SOLR webapp/core starts up? Do we need to send a command to SOLR to make this happen? -- View this message in context: http://www.nabble.com/Initialize-SOLR-DataImportHandler-tp2

Re: building custom RequestHandlers

2009-06-23 Thread Eric Pugh
Like most things JavaScript, I found that I had to just dig through it and play with it. However, the Reuters demo site was very easy to customize to interact with my own Solr instance, and I went from there. On Jun 23, 2009, at 11:30 AM, Julian Davchev wrote: Never used it.. I am just loo

Trie vs long string for sorting

2009-06-23 Thread Bill Dueber
I've having trouble understanding how the Trie type compares (speed- and memory-wise) with dealing with long *string* (as opposed to integers). My data are library call numbers, normalized to be comparable, resulting in (maximum) 21-character strings of the form "RK 052180H359~999~999" Now, these

Re: Data Import Handler

2009-06-23 Thread Shalin Shekhar Mangar
On Tue, Jun 23, 2009 at 7:12 PM, Mukerjee, Neiloy (Neil) < neil.muker...@alcatel-lucent.com> wrote: > With the data-config file filled out, I am receiving errors telling me that > the indexing of my database has failed. I think I have filled out everything > I need to in the data-config file and t

Re: spellcheck. limit the suggested words by some field

2009-06-23 Thread Julian Davchev
I seem to have found answer to this one by digging 30mins in archives. One approach is to use copyfield and store only stuff that is interesting e.g spell_city field that will have stuff only where type is city Second approach includes extending IndexBasedSpellchecker ..alas I can find nowhe

Re: building custom RequestHandlers

2009-06-23 Thread Julian Davchev
Never used it.. I am just looking in docs how can I extend solr but no luck so far :( Hoping for some docs or real extend example. Eric Pugh wrote: > Are you using the JavaScript interface to Solr? > http://wiki.apache.org/solr/SolrJS > > It may provide much of what you are looking for! > > Eri

Re: why EnglishPorterFilterFactory transforms germany to germani?

2009-06-23 Thread Walter Underwood
That is how Porter stemmers work. They do not produce dictionary stems. They produce a common token for different inflections of the same word. The stem for "germanies" is also "germani". Example sentence: "The two Germanies merged in 1990." More info here: http://tartarus.org/~martin/PorterStemm

Re: building custom RequestHandlers

2009-06-23 Thread Eric Pugh
Are you using the JavaScript interface to Solr? http://wiki.apache.org/solr/SolrJS It may provide much of what you are looking for! Eric On Jun 23, 2009, at 10:27 AM, Julian Davchev wrote: I am using solr and php quite nicely. Currently the work flow includes some manipulation on php side s

why EnglishPorterFilterFactory transforms germany to germani?

2009-06-23 Thread Julian Davchev
Hi, Might be normal but I am confused why EnglishPorterFilterFactory transforms germany to germani Cheers

building custom RequestHandlers

2009-06-23 Thread Julian Davchev
I am using solr and php quite nicely. Currently the work flow includes some manipulation on php side so I correctly format the query string and pass to tomcat/solr. I somehow want to build own request handler in java so I skip the whole apache/php request that is just for formating. This will saves

Re: Search returning 0 results for "U2"

2009-06-23 Thread John G. Moylan
To answer my own question, the issue was with the WordDelimiter filter. Issue now resolved. J On Tue, 2009-06-23 at 11:13 +0100, John G. Moylan wrote: > We are moving from Lucene indexer and readers to a Hybrid solution where > we still use the Lucene Indexer but use Solr for querying the index

Re: Numerical range faceting

2009-06-23 Thread gwk
Shalin Shekhar Mangar wrote: On Tue, Jun 23, 2009 at 4:55 PM, gwk wrote: I was wondering if someone is interested in a patch file and if so, where should I post it? This seems useful. Please open an issue and submit a patch. I'm sure there will be interest. Hi, I cleaned up th

RE: Data Import Handler

2009-06-23 Thread Mukerjee, Neiloy (Neil)
With the data-config file filled out, I am receiving errors telling me that the indexing of my database has failed. I think I have filled out everything I need to in the data-config file and that I have everything in the right directory. My details are described below, including locations of fil

Re: Solr Authentication Problem

2009-06-23 Thread Allahbaksh Asadullah
HI All, As I am using SVN build of solr 1.4 and in it I am not able to find this method. Whether there is some changed in solr1.4 java client api. Thanks in advance Regards, Allahbaksh 2009/6/23 Noble Paul നോബിള്‍ नोब्ळ् > I have raised an issue https://issues.apache.org/jira/browse/SOLR-1238 >

Re: SolrCore, reload, synonyms not reloaded

2009-06-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
a singlecore single system has no admin commands.But it is possible to setup a multicore with only one core and you will be able to reload the core On Tue, Jun 23, 2009 at 5:09 PM, ranjitr wrote: > > Hello, > > I was having a similar problem during indexing with my synonyms file. But I > was able

Re: Facets with an IDF concept

2009-06-23 Thread Ian Holsman
Asif Rahman wrote: Hi Grant, I'll give a real life example of the problem that we are trying to solve. We index a large number of current news articles on a continuing basis. We tag these articles with news topics (e.g. Barack Obama, Iran, etc.). We then use these tags to facet our queries.

Re: Numerical range faceting

2009-06-23 Thread Shalin Shekhar Mangar
On Tue, Jun 23, 2009 at 4:55 PM, gwk wrote: > > I was wondering if someone is interested in a patch file and if so, where > should I post it? > This seems useful. Please open an issue and submit a patch. I'm sure there will be interest. http://wiki.apache.org/solr/HowToContribute -- Regards,

Re: Facets with an IDF concept

2009-06-23 Thread Asif Rahman
Hi Grant, I'll give a real life example of the problem that we are trying to solve. We index a large number of current news articles on a continuing basis. We tag these articles with news topics (e.g. Barack Obama, Iran, etc.). We then use these tags to facet our queries. For example, we might

Re: Numerical range faceting

2009-06-23 Thread gwk
gwk wrote: Hi, I'm currently using facet.query to do my numerical range faceting. I basically use a fixed price range of €0 to €1 in steps of €500 which means 20 facet.queries plus an extra facet.query for anything above €1. I use the inclusive/exclusive query as per my question two

Re: SolrCore, reload, synonyms not reloaded

2009-06-23 Thread ranjitr
Hello, I was having a similar problem during indexing with my synonyms file. But I was able to resolve it using the steps you had outlined. Thanks! I am wondering if there is a way to reload the index with a new synonym file without Solr/Multi core support? I would really appreciate it if you co

Re: Facets with an IDF concept

2009-06-23 Thread Asif Rahman
Hi Kent, Your problem is close cousin of the problem that we're tackling. We have experience the same problem as you when calculating facets on MoreLikeThis queries, since those queries tend to match a lot of documents. We used one of the solutions that you mentioned, rank cutoff, to solve it.

Re: Facets with an IDF concept

2009-06-23 Thread Grant Ingersoll
On Jun 23, 2009, at 3:58 AM, Asif Rahman wrote: Hi again, I guess nobody has used facets in the way I described below before. Do any of the experts have any ideas as to how to do this efficiently and correctly? Any thoughts would be greatly appreciated. Thanks, Asif On Wed, Jun 17, 200

Re: ExtractRequestHandler - not properly indexing office docs?

2009-06-23 Thread Grant Ingersoll
Can you change the text field to be stored and then point the LukeRequestHandler at that field (/admin/luke) and report back? Also, can you post your full schema and config? Finally, can you get the example to work? On Jun 23, 2009, at 1:41 AM, cloax wrote: I've tried 'text' ( taken fro

Bug with QueryParser.

2009-06-23 Thread saurabhs_iitk
Hi, I have tried both queryParser and MultifieldQueryParser. Suppose you want to search Douglas Adams and give default operator as AND. Lets say on the field author. Instead of generating query like +(author:douglas author:dougla) +(author:adams author:adam) it generates +author:douglas +author:a

Search returning 0 results for "U2"

2009-06-23 Thread John G. Moylan
We are moving from Lucene indexer and readers to a Hybrid solution where we still use the Lucene Indexer but use Solr for querying the index. I am indexing our content using Lucene 2.3 and have a field called "contents" which is tokenized and stored. When I search the contents field for "U2" using

No wildcards with solr.ASCIIFoldingFilterFactory?

2009-06-23 Thread vladimirneu
Hi all, could somebody help me to understand why I can not search with wildcard if I use the solr.ASCIIFoldingFilterFactory? So I get results if I am searching for "münchen", "munchen" or "munchen*", but I get no results if I do the search for "münchen*". The original records contain the terms "

Re: Facets with an IDF concept

2009-06-23 Thread Kent Fitch
Hi Asif, I was holding back because we have a similar problem, but we're not sure how best to approach it, or even whether approaching it at all is the right thing to do. Background: - large index (~35m documents) - about 120k on these include full text book contents plus metadata, the rest are j

Re: Facets with an IDF concept

2009-06-23 Thread Asif Rahman
Hi again, I guess nobody has used facets in the way I described below before. Do any of the experts have any ideas as to how to do this efficiently and correctly? Any thoughts would be greatly appreciated. Thanks, Asif On Wed, Jun 17, 2009 at 12:42 PM, Asif Rahman wrote: > Hi all, > > We ha