Re: getting DIH to read my XML files: solved

2009-01-19 Thread Fergus McMenemie
Shalin, thanks for the pointer. The following data-config.xml worked. The trick was realising that EVERY entity tag needs to have its own datasource, I guess I had been assuming that it was implicit for certain processors. The whole thing is confusing in that there is both the dataSource element(

Cant get HTMLStripTransformer's stripHTML to work in DIH.

2009-01-19 Thread Fergus McMenemie
Hello all, I have the following DIH data-config.xml file. Adding HTMLStripTransformer and the associated stripHTML on the para tag seems to have broke things. I am using a nightly build from 12-jan-2009 The /record/sect1/para contains HTML sub tags which need to be discarded. Is my use of stri

Re: getting DIH to read my XML files: solved

2009-01-19 Thread Shalin Shekhar Mangar
Hi Fergus, The idea here is that if you do not give a name to your data source, then it is the 'default' data source and gets used automatically by all entities. If you decide to give a name to the data source, then it should be specified for each entity. Even when you have multiple data sources,

Re: Cant get HTMLStripTransformer's stripHTML to work in DIH.

2009-01-19 Thread Shalin Shekhar Mangar
This looks fine. Can you post the stack trace? On Mon, Jan 19, 2009 at 4:14 PM, Fergus McMenemie wrote: > Hello all, > > I have the following DIH data-config.xml file. Adding > HTMLStripTransformer and the associated stripHTML on the > para tag seems to have broke things. I am using a nightly >

Re: Cant get HTMLStripTransformer's stripHTML to work in DIH.

2009-01-19 Thread Fergus McMenemie
>This looks fine. Can you post the stack trace? > Yep, here is the juicy bit. Let me know if you need more. Jan 19, 2009 11:08:03 AM org.apache.catalina.startup.Catalina start INFO: Server startup in 2390 ms Jan 19, 2009 11:14:06 AM org.apache.solr.core.SolrCore execute INFO: [janesdocs] webapp=/s

Re: Cant get HTMLStripTransformer's stripHTML to work in DIH.

2009-01-19 Thread Fergus McMenemie
Hmmm, Just to clarify I retested the thing using the nightly as of today 18-jan-2009. The problem is still there and this traceback is from that nightly. >>This looks fine. Can you post the stack trace? >> >Yep, here is the juicy bit. Let me know if you need more. > >Jan 19, 2009 11:08:03 AM org

MoreLikeThis/These and Queries

2009-01-19 Thread Andrew Ingram
Hi, I'm using Solr's MoreLikeThese functionality for a rudimentary related products system, but we need it to only return related products that match certain criteria. For example, we don't want to see any related products that are discontinued. I'm having difficulty figuring out if there's a

Re: MoreLikeThis/These and Queries

2009-01-19 Thread Clas Rydergren
Hi, Have you tried to add a filter directly to the /solr/mlt?q=-request? Try to add "&fq=available:yes", and see if you can limit the MoreLikeThis-documents to documents that has "yes" in the "available"-field. I have had some success with this approach. /Clas, Frisim.com On Mon, Jan 19, 2009

Re: MoreLikeThis/These and Queries

2009-01-19 Thread Andrew Ingram
I think the problem might be that I'm using the standard handler with the mlt:true parameter. The MLT handler doesn't seem to be mentioned in my config file, do you know how I can enable it? Regards, Andrew Ingram Clas Rydergren wrote: Hi, Have you tried to add a filter directly to the /solr

Re: Cant get HTMLStripTransformer's stripHTML to work in DIH.

2009-01-19 Thread Shalin Shekhar Mangar
Ah, it needs a null check for multi valued fields. I've committed a fix to trunk. The next nightly build should have it. You can checkout and build from the trunk if need this immediately. On Mon, Jan 19, 2009 at 7:02 PM, Fergus McMenemie wrote: > Hmmm, > > Just to clarify I retested the thing u

Re: WebLogic 10 Compatibility Issue - StackOverflowError

2009-01-19 Thread Bruce Kissinger
I am running into the same problem. I found that I can successfully run the "ping" request. For example: http://localhost:7101/solr/admin/ping But all other requests to the Admin page fail. KSY wrote: > > I hit a major roadblock while trying to get Solr 1.3 running on WebLogic > 10.0. >

Re: MoreLikeThis/These and Queries

2009-01-19 Thread Clas Rydergren
Hi, Even if you use the /solr/select-version of MLT, I guess that just adding the fq-parameter may work. If you would like to add the MLT request handler, add something like title,data 1 as a request handler plugin in your solrconfig.xml file. If you are running on Tom

Re: MoreLikeThis/These and Queries

2009-01-19 Thread Andrew Ingram
Thanks, I'll try this. I tried using the /select version and the problem was that fq applies only to the original query rather than the mlt results which are effectively separate queries. Clas Rydergren wrote: Hi, Even if you use the /solr/select-version of MLT, I guess that just adding th

Re: MoreLikeThis/These and Queries

2009-01-19 Thread Clas Rydergren
Ah, I see. I have, more or less, only used the MoreLikeThis (single document) version, and the fq-filter is then applied to the (only) query that is made. Sorry. /Clas On Mon, Jan 19, 2009 at 4:42 PM, Andrew Ingram wrote: > Thanks, I'll try this. > > I tried using the /select version and the

Embedded Solr updates not showing until restart

2009-01-19 Thread edre...@ha
Hi, We're evaluating the use of Solr for use in a web application. I've got the web application configured to use an embedded instance of Solr for queries (setup as a slave), and a remote instance for writes (setup as a master). The replication scripts are running fine and the embedded slave do

Re: Word Delimiter struggles

2009-01-19 Thread David Shettler
Thank you Shalin, I'm in the process of implementing your suggestion, and it works marvelously. Had to upgrade to solr 1.3, and had to hack up acts_as_solr to function correctly. Is there a way to receive a search for a given field, and have solr know to automatically check the two fields? I sup

advice on minimal solr/jetty

2009-01-19 Thread Steve Conover
Hi everyone, I'd like to see how much I can reduce the startup time of jetty/solr. Right now I have it at about 3s - that's fast, but I'd like to see how close to zero I can get it. I've minimized my schema and solrconfig down to what I use (my solr needs are pretty vanilla). Now I'm looking at

OOME diagnosis - possible to disable caching?

2009-01-19 Thread James Brady
Hi all, I have 20 indices, each ~10GB in size, being searched by a single Solr slave instance (using the multicore features in a slightly old 1.2 dev build) I'm getting unpredictable, but inevitable, OutOfMemoryError from the slave, and I have no more physical memory to throw at the problem (HotSpo

Re: OOME diagnosis - possible to disable caching?

2009-01-19 Thread Mike Klaas
On 19-Jan-09, at 2:44 PM, James Brady wrote: Hi all, I have 20 indices, each ~10GB in size, being searched by a single Solr slave instance (using the multicore features in a slightly old 1.2 dev build) I'm getting unpredictable, but inevitable, OutOfMemoryError from the slave, and I have n

Re: Using Threading while Indexing.

2009-01-19 Thread Alexander Ramos Jardim
Your 3 instances are trying to acquire the physical lock to the index. If you want to use multi-threaded indexing, I would suggest http interface, as Solr will control the request queue for you and index as much docs as it can receive from your open threads (resource wise obviously). 2009/1/19 Sa

Re: Embedded Solr updates not showing until restart

2009-01-19 Thread Grant Ingersoll
Do they show up if you use non-embedded? That is, if you hit that slave over HTTP from your browser, are the changes showing up? On Jan 19, 2009, at 11:18 AM, edre...@ha wrote: Hi, We're evaluating the use of Solr for use in a web application. I've got the web application configured to

Re: Querying Solr Index for date fields

2009-01-19 Thread prerna07
We want boosting of results for ?q=dateField:[NOW-45DAYS TO NOW] and ?q=DateField:[NOW TO NOW+45DAYS] below mentioned fq tag gives me error dateField:[NOW-45DAYS TO NOW]^1.0 DateField:[NOW TO NOW+45DAYS]^1.0 Please suggest the syntax of fields defined in fq tag? tHAnks, Prerna Erik Hatcher

how can solr search angainst group of field

2009-01-19 Thread surfer10
Good days gentlemen. in my search engine i have 4 groups of text: 1) user address 2) user description 3) ... 4) ... I want to give users ability to search all of them with ability to conjunction selection for searching some of them. conjunction means that user should be able to search 1) and 2)

Searching for 'A*' is not returning me same result as 'a*'

2009-01-19 Thread Manupriya
Hi, I am using the following analyser for indexing and querying - --

Re: Help with Solr 1.3 lockups?

2009-01-19 Thread Lance Norskog
Java 1.5 has thread-locking bugs. Switching to Java 1.6 may cure this problem. On Thu, Jan 15, 2009 at 10:57 AM, Jerome L Quinn wrote: > > Hi, all. > > I'm running solr 1.3 inside Tomcat 6.0.18. I'm running a modified query > parser, tokenizer, highlighter, and have a CustomScoreQuery for dates