Re: "begins with" searches

2009-10-26 Thread Avlesh Singh
You are right about the parsing of query terms without a double quote (solrQueryParser's defaultOperator has to be "AND" in your case). For the problem at hand, two things - 1. Do you have any reason for not doing a PhraseQuery (query terms enclosed in double quotes) on your "edgytext" field

RE: "begins with" searches

2009-10-26 Thread Bernadette Houghton
Thanks for this suggestion (thanks Gerald also: no, we're not using BlackLight-type prefixes). I've set up an edgytext fieldType in schema.xml thus - And defined a field name thus - The results are mixed - * searches such as "surname, f" and "surname, fre" (wit

Re: Using Solr for term-completion with counts

2009-10-26 Thread Jonathan Hendler
Yonik, Thanks. One question inline below: On Oct 26, 2009, at 5:30 PM, Yonik Seeley wrote: Can I do this through a facet query or another param ? Faceting should also work... the terms component is very much like the faceting component except that it always works over the complete index (in

Re: Solr Configuration Management

2009-10-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
2009/10/26 Licinio Fernández Maurelo : > Hi there, > > i must enhance solr config deploys. > > I have a configuration file per environment and per role (Master-Slave) so i > want to separate DataSource definitions from the solrconfig.xml . Where can > i put them? are you referring to DIH? > > Same

Re: Using Solr for term-completion with counts

2009-10-26 Thread Jonathan Hendler
Hi David, (and Yonik) Thanks for the quick responses. The book is quite comprehensive. Nice work. Looks like I misinterpreted my own results - totally a user error. (I guess that's a good way to introduce yourself to a mailing list. ) I had used the example on page 156. My error: documen

long startup time

2009-10-26 Thread Teruhiko Kurosaka
I've been testing Solr 1.4.0 (RC). After sometime, solr started to pause for a long time (a minutes or two) after printing: INFO: jetty-6.1.3 Sometime it starts immediately, but more often than not, it pasues. Is there any known cause of this kind of long pause? -kuro

field collapsing exception

2009-10-26 Thread Joe Calderon
found another exception, i cant find specific steps to reproduce besides starting with an unfiltered result and then given an int field with values (1,2,3) filtering by 3 triggers it sometimes, this is in an index with very frequent updates and deletes --joe java.lang.NullPointerException

Re: Using Solr for term-completion with counts

2009-10-26 Thread David Smiley @MITRE.org
Jon, there actually is an example of this in my book. Go to page 156. I looked and found "term-suggest" in the index. ~ David Smiley Author: http://www.packtpub.com/solr-1-4-enterprise-search-server/ Jonathan Hendler-3 wrote: > > Greetings all, > > We're happily migrating our MySQL fulltex

Re: relevancy and merging

2009-10-26 Thread Yonik Seeley
On Mon, Oct 26, 2009 at 5:40 PM, Paul Rosen wrote: > Is there any difference to the relevancy score for a document that has been > added directly to an index vs. the same document that got into the index > because of a merge? Nope. Anything else would be a bug. There are some subtleties such as

Re: Solr 1.4 (RC) performance on multi-CPU system

2009-10-26 Thread Yonik Seeley
On Mon, Oct 26, 2009 at 4:32 PM, Teruhiko Kurosaka wrote: > Are multiple CPUs utilized at indexing time as well, or just by searcher? Yes, multiple CPUs are utilized for indexing. If you're using SolrJ, and easy way to exploit this parallelism is to use http://lucene.apache.org/solr/api/org/apac

relevancy and merging

2009-10-26 Thread Paul Rosen
Is there any difference to the relevancy score for a document that has been added directly to an index vs. the same document that got into the index because of a merge? In other words, I'd like to build my index in pieces (since people in different cities will be working on parts of it), but I

Re: Using Solr for term-completion with counts

2009-10-26 Thread Yonik Seeley
On Mon, Oct 26, 2009 at 5:06 PM, Jonathan Hendler wrote: > Greetings all, > > We're happily migrating our MySQL fulltext search to SOLR/faceted search. > > We're doing a term suggest on a large text field and doing facet.sort=count. > The numbers returned represent total times the term shows up -

[Tutorial] Creating custom Transformers

2009-10-26 Thread Lucas F. A. Teixeira
Hello all, I've just blogged about how you can create custom transformers in java. This post is written in portuguese (brazilian), but I'm sure it can help some ppl (not only portuguese and brazilian ones). The link is: http://lucastex.com.br/2009/10/26/criando-um-transformer-customizado-para-o-s

Using Solr for term-completion with counts

2009-10-26 Thread Jonathan Hendler
Greetings all, We're happily migrating our MySQL fulltext search to SOLR/faceted search. We're doing a term suggest on a large text field and doing facet.sort=count. The numbers returned represent total times the term shows up - I'd like to have the numbers represent the total documents

Re: profiling solr

2009-10-26 Thread Mark Miller
The Netbeans profiler is also very good - available both in Netbeans and VisualVM. And of course Eclipse has a profiler - but its a little harder to get that off the ground. Grant Ingersoll wrote: > I usually use YourKit, but have also had success w/ JProfiler. > > > On Oct 26, 2009, at 3:31 PM, J

Re: profiling solr

2009-10-26 Thread Grant Ingersoll
I usually use YourKit, but have also had success w/ JProfiler. On Oct 26, 2009, at 3:31 PM, Joe Calderon wrote: as a curiosity ide like to use a profiler to see where within solr queries spend most of their time, im curious what tools if any others use for this type of task.. im using jetty a

RE: Solr 1.4 (RC) performance on multi-CPU system

2009-10-26 Thread Teruhiko Kurosaka
Thank you, Yonik. Are multiple CPUs utilized at indexing time as well, or just by searcher? -kuro > -Original Message- > From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf > Of Yonik Seeley > Sent: Monday, October 26, 2009 11:27 AM > To: solr-user@lucene.apache.org > Subject

Re: Highlighter throws StringIndexOutOfBoundsException on multivalued fields

2009-10-26 Thread Emmanuel Castro Santana
I am getting exactly the same problem here. In my schema.xml I set up a multivalued field 'barfield' of type 'text'. When I try to perform a search such as this: http://localhost/solr/coreFoo/select?q=Foo Bar&hl=on&hl.fl=barfield I get the StringIndexOutOfBoundsException problem. As I did not

profiling solr

2009-10-26 Thread Joe Calderon
as a curiosity ide like to use a profiler to see where within solr queries spend most of their time, im curious what tools if any others use for this type of task.. im using jetty as my servlet container so ideally ide like a profiler thats compatible with it --joe

Re: Solr 1.4 (RC) performance on multi-CPU system

2009-10-26 Thread Yonik Seeley
2009/10/26 Teruhiko Kurosaka : > Is Solr 1.4 (Release Candidate) suppose to take advantage > of muti-CPU (core) system? I.e. if more than one update or > search requests come in about the same time, they can be > automatically assigned to differnt CPUs if available > (and the OS does its job right)

Solr 1.4 (RC) performance on multi-CPU system

2009-10-26 Thread Teruhiko Kurosaka
Is Solr 1.4 (Release Candidate) suppose to take advantage of muti-CPU (core) system? I.e. if more than one update or search requests come in about the same time, they can be automatically assigned to differnt CPUs if available (and the OS does its job right)? BTW, the term "multicore" in Solr dis

Re: question about merging indexes

2009-10-26 Thread didier deshommes
On Sun, Oct 25, 2009 at 1:15 PM, Chris Hostetter wrote: > > : I need some help about the mergeindex command. I have 2 cores A and B > : that I want to merge into a new index RES. A has 100 docs and B 10 > : docs. All of B's docs are from A, except that one attribute is > : changed. The goal is to

Re: Solr ignoring maxFieldLength?

2009-10-26 Thread Yonik Seeley
On Mon, Oct 26, 2009 at 11:43 AM, Andrew Clegg wrote: > Yonik Seeley-2 wrote: >> >> If you could, it would be great if you could test commenting out the >> one in mainIndex and see if it inherits correctly from >> indexDefaults... if so, I can comment it out in the example and remove >> one other

Re: Solr ignoring maxFieldLength?

2009-10-26 Thread Andrew Clegg
Yonik Seeley-2 wrote: > > If you could, it would be great if you could test commenting out the > one in mainIndex and see if it inherits correctly from > indexDefaults... if so, I can comment it out in the example and remove > one other little thing that people could get wrong. > Yep, it seems

Re: Solr ignoring maxFieldLength?

2009-10-26 Thread Yonik Seeley
On Mon, Oct 26, 2009 at 11:00 AM, Andrew Clegg wrote: > Yonik Seeley-2 wrote: >> >> Sorry Andrew, this is something that's bitten people before. >> search for maxFieldLength and you will see *2* of them in your config >> - one for indexDefaults and one for mainIndex. >> The one in mainIndex is set

Re: Solr ignoring maxFieldLength?

2009-10-26 Thread Andrew Clegg
Yonik Seeley-2 wrote: > > Sorry Andrew, this is something that's bitten people before. > search for maxFieldLength and you will see *2* of them in your config > - one for indexDefaults and one for mainIndex. > The one in mainIndex is set at 1 and hence overrides the one in > indexDefaults.

Re: Solr ignoring maxFieldLength?

2009-10-26 Thread Yonik Seeley
Sorry Andrew, this is something that's bitten people before. search for maxFieldLength and you will see *2* of them in your config - one for indexDefaults and one for mainIndex. The one in mainIndex is set at 1 and hence overrides the one in indexDefaults. -Yonik http://www.lucidimagination.co

Re: Solr ignoring maxFieldLength?

2009-10-26 Thread Andrew Clegg
Yep, I just re-indexed it again to make double sure -- same problem unfortunately. My solrconfig.xml and schema.xml are attached. In case you want to see it in action on the same data I've got, I've tarred up my data and conf directories here: http://biotext.org.uk/static/solr-issue-example.ta

Re: Solr ignoring maxFieldLength?

2009-10-26 Thread Yonik Seeley
Yes, please show us your solrconfig.xml, and verify that you reindexed the document after changing maxFieldLength and restarting solr. I'll also see if I can reproduce a problem with maxFieldLength being ignored. -Yonik http://www.lucidimagination.com On Mon, Oct 26, 2009 at 7:11 AM, Andrew Cl

RE: Solr under tomcat - UTF-8 issue

2009-10-26 Thread Glock, Thomas
As it turns out I'm back to GET myself. I just noticed that tomcat as well, although ultimately plan to run under weblogic (not sure what the length on that url is and/or if there are limits on the flex client doing the GET) Reading the book (page 108) I noticed that my querys need to have more

Re: Problem searching for phrases with the word "to"

2009-10-26 Thread mike mulvaney
I realized this is a bug in Solr and its fixed in 1.4. I downloaded a recent nightly build and it fixed the problem. https://issues.apache.org/jira/browse/SOLR-879 Thanks for the help, Mike On Mon, Oct 26, 2009 at 4:18 PM, mike mulvaney wrote: > I thought the stopwords might be the problem too

Solr Configuration Management

2009-10-26 Thread Licinio Fernández Maurelo
Hi there, i must enhance solr config deploys. I have a configuration file per environment and per role (Master-Slave) so i want to separate DataSource definitions from the solrconfig.xml . Where can i put them? Same behaviour is desired for Master-Slave conf diffs. Any help would be much apprec

Re: copyField from multiple fields into one

2009-10-26 Thread Steinar Asbjørnsen
The "name"-field is populated. But I cannot see that solr gives me any suggestions based on that field. Seems to work fine with the "keyword"-field tho. Regards, Steinar Den 26. okt. 2009 kl. 10.38 skrev Avlesh Singh: It should have worked as expected. See if your "name" field is getting popul

Re: Solr Random field

2009-10-26 Thread Yonik Seeley
On Mon, Oct 26, 2009 at 7:47 AM, Pooja Verlani wrote: > No I dont have the field with this type and neither do I want to re-index .. > is it possible otherwise ? Your documents don't need the "random" field, only your schema does. The example schema already contains the following: Add this to yo

Re: "begins with" searches

2009-10-26 Thread Gerald Snyder
Are you using the field name suffixes like Blacklight?xxx_text, _xxx_facet, xxx_string? With the xxx_string field you can request "begins with" search, but you may need some different search term normalization than with a _text search. Gerald Snyder Florida Center for Library Automatio

Re: Solr Random field

2009-10-26 Thread Pooja Verlani
No I dont have the field with this type and neither do I want to re-index .. is it possible otherwise ? 2009/10/26 Noble Paul നോബിള്‍ नोब्ळ् > do you have a field whose type="random" . If yes then u can sort by that > field > > On Mon, Oct 26, 2009 at 3:35 PM, Pooja Verlani > wrote: > > Hi, > >

Solr ignoring maxFieldLength?

2009-10-26 Thread Andrew Clegg
Morning, Last week I was having a problem with terms visible in my search results in large documents not causing query hits: http://www.nabble.com/Result-missing-from-query%2C-but-match-shows-in-Field-Analysis-tool-td26029040.html#a26029351 Erick suggested it might be related to maxFieldLength,

Re: Constant Score Queries and Function Queries

2009-10-26 Thread Grant Ingersoll
On Oct 25, 2009, at 2:36 PM, Chris Hostetter wrote: : Fair enough, I guess I was just kind of expecting a constant score query + a : function query to result in a score of whatever the function query is. This : is a common trick to sort by a function, but it's easy enough to just ^0 the

Re: Solr Random field

2009-10-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
do you have a field whose type="random" . If yes then u can sort by that field On Mon, Oct 26, 2009 at 3:35 PM, Pooja Verlani wrote: > Hi, > I want a random sort type in the search results. The scenario is: > I want to return random results with no context relation to the query fired, > if I am n

Solr Random field

2009-10-26 Thread Pooja Verlani
Hi, I want a random sort type in the search results. The scenario is: I want to return random results with no context relation to the query fired, if I am not able to find any results relevant. I want something like: http://localhost:8083/solr/select/?q=*:*&sort=RANDOM. Please suggest. Regards, P

Re: copyField from multiple fields into one

2009-10-26 Thread Avlesh Singh
It should have worked as expected. See if your "name" field is getting populated. Cheers Avlesh 2009/10/26 Steinar Asbjørnsen > Hi all. > > I'm currently working on setting up spelling suggestion functionality. > What I'd like is to put the values of two fields ("keyword" and "name")into > the

copyField from multiple fields into one

2009-10-26 Thread Steinar Asbjørnsen
Hi all. I'm currently working on setting up spelling suggestion functionality. What I'd like is to put the values of two fields ("keyword" and "name") into the spell-field. Something like (from schema.xml): multiValued="true"/> ... As far as i can see I only get suggestions from the keyword

Re: Problem searching for phrases with the word "to"

2009-10-26 Thread mike mulvaney
I thought the stopwords might be the problem too, but I am using the same stopwords.txt in both instances, I think. The headline field is a "text" type file, and I am using the "text" definition from the example solr config:

Re: Problem searching for phrases with the word "to"

2009-10-26 Thread Avlesh Singh
> > My guess is that Solr is treating this as a range query. I've tried > escaping the word To with backslashes, but it doesn't seem to make a > difference. Is there a way to tell Solr that "to" is not a special word in > this instance? > Nope. Any occurrence of "to" in search term(s) does NOT ca

Re: "begins with" searches

2009-10-26 Thread Avlesh Singh
Read up of setting-up these kind searches here - http://www.lucidimagination.com/blog/2009/09/08/auto-suggest-from-popular-queries-using-edgengrams/ Cheers Avlesh On Mon, Oct 26, 2009 at 7:43 AM, Bernadette Houghton < bernadette.hough...@deakin.edu.au> wrote: > We need to offer "begins with" typ

Problem searching for phrases with the word "to"

2009-10-26 Thread mike mulvaney
I'm having trouble searching for phrases that have the word "to" in them. I have a bunch of articles indexed, and I need to be able to search the headlines like this: headline:"House Committee Leaders Ask FCC To Consider Spectrum in Broadband Plan" When I search like that, I get no hits. When I