Composite POJO suport

2009-04-01 Thread Praveen Kumar Jayaram
- Regards, Praveen -- View this message in context: http://www.nabble.com/Composite-POJO-suport-tp22841854p22841854.html Sent from the Solr - User mailing list archive at Nabble.com.

How do I combine WhitespaceTokenizerFactory and EdgeNGramTokenizerFactory?

2009-04-01 Thread Praveen Kumar Jayaram
Hi folks, I am trying to use features of WhitespaceTokenizerFactory and EdgeNGramTokenizerFactory. My requirement is to search a String using substring and inword concepts. For example: Let us assume the String as "Praveen Kumar Jayaram". The query for "Kumar" will be successful if we use White

Re: Unexpected sorting results when sorting with mutivalued filed

2009-04-01 Thread tushar kapoor
Shalin Shekhar Mangar wrote: > > On Tue, Mar 31, 2009 at 2:18 PM, tushar kapoor < > tushar_kapoor...@rediffmail.com> wrote: > >> >> I have indexes with a multivalued field authorLastName. I query them with >> sort=authorLastName asc and get the results as - >> >> Index# authorLastName >> 1

Re: DIH Date conversion from a source column skews time

2009-04-01 Thread Noble Paul നോബിള്‍ नोब्ळ्
I guess dateFormat does the job properly but the returned value is changed according to timezone. can y try this out add an extra field which converts the date to toString() this would add an extra field as string to the index On Wed, Apr 1, 2009 at 11:31 PM, Wesley Small wrote: > Was there

Re: java.lang.ClassCastException: java.lang.Long using Solrj

2009-04-01 Thread Noble Paul നോബിള്‍ नोब्ळ्
The classcast exception is misleading. It happens because the response itself was some error response. debug it by setting the XmlResponseParser http://wiki.apache.org/solr/Solrj#head-12c26b2d7806432c88b26cf66e236e9bd6e91849 On Thu, Apr 2, 2009 at 4:21 AM, vivek sar wrote: > Hi, > >  I'm using s

Re: Runtime exception when adding documents using solrj

2009-04-01 Thread Shalin Shekhar Mangar
On Thu, Apr 2, 2009 at 2:34 AM, vivek sar wrote: > Thanks Shalin. > > I added that in the solrconfig.xml, but now I get this exception, > > org.apache.solr.common.SolrException: Not Found > Not Found > request: http://localhost:8080/solr/core0/update?wt=javabin&version=2.2 > > I do have the "core0

Re: spectrum of Lucene queries in solr?

2009-04-01 Thread Erik Hatcher
Paul, I'm not sure I understand what you're looking for exactly. Solr supports Lucene's QueryParser by default for /select?q=... so you get the breadth of what it supports including boolean, prefix, fuzzy, and more. QueryParser has never supported span queries though. There is also a d

java.lang.ClassCastException: java.lang.Long using Solrj

2009-04-01 Thread vivek sar
Hi, I'm using solrj (released v 1.3) to add my POJO objects (server.addbeans(...)), but I'm getting this exception, java.lang.ClassCastException: java.lang.Long at org.apache.solr.common.util.NamedListCodec.unmarshal(NamedListCodec.java:89) at org.apache.solr.client.solrj.impl

spectrum of Lucene queries in solr?

2009-04-01 Thread Paul Libbrecht
Hello list, I am surprised not to find any equivalent to the classical Lucene queries in Solr... I must have badly looked... E.g. where can I get a BooleanQuery, a PrefixQuery, a FuzzyQuery, or even a few spanqueries? thanks in advance paul smime.p7s Description: S/MIME cryptographic sig

Additive filter queries

2009-04-01 Thread Jeff Newburn
I have a design question for all of those who might be willing to provide an answer. We are looking for a way to do a type of additive filters. Our documents are comprised of a single item of a specified color. We will use shoes as an example. Each document contains a multivalued ³size² field w

Re: Runtime exception when adding documents using solrj

2009-04-01 Thread vivek sar
Thanks Shalin. I added that in the solrconfig.xml, but now I get this exception, org.apache.solr.common.SolrException: Not Found Not Found request: http://localhost:8080/solr/core0/update?wt=javabin&version=2.2 I do have the "core0" under the solr.home. The core0 directory also contains the conf

Re: Runtime exception when adding documents using solrj

2009-04-01 Thread Shalin Shekhar Mangar
On Thu, Apr 2, 2009 at 1:13 AM, vivek sar wrote: > Hi, > >  I'm trying to add the list of POJO objects (using annotations) using > solrj, but the "server.addBeans(...) " is throwing this exception, > > org.apache.solr.common.SolrException: Bad Request > Bad Request > request: http://localhost:8080

Re: Runtime exception when adding documents using solrj

2009-04-01 Thread vivek sar
Hi, I'm trying to add the list of POJO objects (using annotations) using solrj, but the "server.addBeans(...) " is throwing this exception, org.apache.solr.common.SolrException: Bad Request Bad Request request: http://localhost:8080/solr/core0/update?wt=javabin&version=2.2 Note, I'm using mult

Re: Quick Indexing Method???

2009-04-01 Thread Shalin Shekhar Mangar
On Wed, Apr 1, 2009 at 9:47 PM, Alex Vu wrote: > Hello, > > I am new to Solr.  I looked at getting started document. Can somebody show > me how to index text file.   I've tried other method, it just takes too much > time. > > I am aware that Solr take XML files.  I'm trying to find the > *quickies

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

2009-04-01 Thread Grant Ingersoll
On Apr 1, 2009, at 9:39 AM, Fergus McMenemie wrote: Grant, Redoing the work with your patch applied does not seem to make a difference! Is this the expected result? No, I didn't expect Solr 1095 to fix the problem. Overwrite = false + 1095, does, however, AFAICT by your last line, righ

Re: Merging Solr Indexes

2009-04-01 Thread Ning Li
There is a jira issue on supporting index merge: https://issues.apache.org/jira/browse/SOLR-1051. But I agree with Otis that you should go with a single index first. Cheers, Ning On Wed, Apr 1, 2009 at 12:06 PM, Otis Gospodnetic wrote: > > Hi, > > Yes, you can write to the same index from multi

Re: DIH; Hardcode field value/replacement based on source column

2009-04-01 Thread Wesley Small
Thanks for the feedback. The templateTransformer is pretty straightforward solution. Perfect. Wesley. > > On 4/1/09 12:14 AM, "Noble Paul നോബിള്‍ नोब्ळ्" wrote: > >> use TemplateTransformer >> >> >> >> >> On Tue, Mar 31, 2009 at 9:20 PM, Wesley Small >> wrote: >>> I am trying to find a

Re: DIH Date conversion from a source column skews time

2009-04-01 Thread Wesley Small
Was there any follow up to this issue I found? Is this a legitimate bug with the time of day changing? I could try to solve this by executing same xpath statement twice. However, when I do that, the first field original_air_date_d does not make it into the index. Is seems that you cannot hav

Re: Defining DataDir in Multi-Core

2009-04-01 Thread vivek sar
Hi, I tried the latest nightly build (04-01-09) - it takes the dataDir property now, but it's creating the Data dir at the wrong location. For ex., I've the following in solr.xml, but, it always seem to be creating the solr/data directory in the cwd (where I started the Tomc

Solr Stats and Their Meaning

2009-04-01 Thread solr
Is there any documentation for some of the Solr admin stats? I'm not sure if these numbers are good or bad. We have a pretty small index (numDocs : 25253, maxDoc : 25312) org.apache.solr.handler.StandardRequestHandler requests : 11 errors : 0 avgTimePerRequest : 80.36364 avgRequestsPerS

Re: Defining DataDir in Multi-Core

2009-04-01 Thread vivek sar
Thanks Shalin. Is it available in the latest nightly build? Is there any other way I can create cores dynamically (using CREATE service) which will use the same schema.xml and solrconfig.xml, but write to different data directories? Thanks, -vivek On Wed, Apr 1, 2009 at 1:55 AM, Shalin Shekhar

Re: Quick Indexing Method???

2009-04-01 Thread Alejandro Gonzalez
What about building an XML with text fields as everyones does ? :) On Wed, Apr 1, 2009 at 6:17 PM, Alex Vu wrote: > Hello, > > I am new to Solr. I looked at getting started document. Can somebody show > me how to index text file. I've tried other method, it just takes too > much > time. > >

Quick Indexing Method???

2009-04-01 Thread Alex Vu
Hello, I am new to Solr. I looked at getting started document. Can somebody show me how to index text file. I've tried other method, it just takes too much time. I am aware that Solr take XML files. I'm trying to find the *quickiest*method to index text, binary, or pcap file. Preferably, tex

Re: Wildcard searches

2009-04-01 Thread Otis Gospodnetic
Hi, Another option for 1) is to use n-grams with token begin/end symbols. Then you won't need to use wildcards at all, but you'll have a larger index. 2) may be added to Lucene in the near future, actually, I saw a related JIRA issue. But in the mean time, yes, you coul dimplement it via a c

Re: SingleInstanceLock: write.lock

2009-04-01 Thread Otis Gospodnetic
Hi, Are you sure there really is/was enough free space? Were you monitoring the disk space when this error happened? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: davidb > To: solr-user@lucene.apache.org > Sent: Tuesday, March 31, 20

Re: Merging Solr Indexes

2009-04-01 Thread Otis Gospodnetic
Hi, Yes, you can write to the same index from multiple threads. You still need to keep track of the index size manually, whether you create 1 or N indices/cores. I'd go with a single index first. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message

Re: Encoding problem

2009-04-01 Thread Rui Pereira
Thanks,I detected that same problem. I have CP 1252 system file encoding and was recording data-config.xml file in UTF-8. DIH was reading using the default encoding. One possible workarround was using InputStream and OutputStream like DIH, but the files won't be in UTF-8 if the system has different

Re: getting solr home path dynamically

2009-04-01 Thread Erik Hatcher
On Apr 1, 2009, at 10:55 AM, Radha C. wrote: But I am having trouble in identifying the xml location, I am having the input xml in $solrhome/inputdata/example.xml, Do you have any idea about how to get solrhome location dynamically by using any solrj API class? Using SolrJ remotely, you can

RE: getting solr home path dynamically

2009-04-01 Thread Radha C.
Hi, No luck, I tried as follows, my solr home is there out of of my solrj client. I think it is looking for the config at CWD, config = new SolrConfig(); String dir= config.getResourceLoader().getDataDir(); ( I used getInstanceDir() also ) //File f = new File( home, "solr

Re: Indexing fields of xml file using solrj

2009-04-01 Thread Giovanni De Stefano
Hello, you can try with: SolrConfig.config.getResourceLoader().getInstanceDir() Let me know if it works. Cheers, Giovanni On 4/1/09, Radha C. wrote: > > Hey No, > > Actually I did not look at your response email. But I saw your email after > I > responded to shalin and you gave me a correct

Re: FW: multicore

2009-04-01 Thread Marc Sturlese
>>how to have multiple cores ? You need a solr.xml file in the root of your solr home. In this solr.xml you will inicalize the cores. In this same folder you will have a folder per core with its /conf and /data. Every core has it's own solrconfig.xml and schema.xml. If you grap a nighlty build y

Re: how to improve concurrent request performance and stress testing

2009-04-01 Thread sunnyfr
Thanks for all this help, But I guess it can't be optimal with a lot of update, my slave get back from the master 20 000docs updated every 20minutes, it's made to try to warmup have a big cache and everything go fast with that amount of update I guess ...? zqzuk wrote: > > Hi, > > try to f

RE: Indexing fields of xml file using solrj

2009-04-01 Thread Radha C.
Hey No, Actually I did not look at your response email. But I saw your email after I responded to shalin and you gave me a correct answer. Thanks a lot. So I started coding it also, I thought to reply to u once I executed successfully. Here is my code, DirectXmlRequest xmlreq = new DirectXmlReque

FW: multicore

2009-04-01 Thread Neha Bhardwaj
From: Neha Bhardwaj [mailto:neha_bhard...@persistent.co.in] Sent: Wednesday, April 01, 2009 6:52 PM To: 'solr-user@lucene.apache.org' Subject: multicore Hi, I need to create multiple cores for my project. I need to know: how to have multiple cores ? can we start all cores from singl

Re: Indexing fields of xml file using solrj

2009-04-01 Thread Giovanni De Stefano
I understand Shalin is a guru and I am nobody but... http://lucene.apache.org/solr/api/org/apache/solr/client/solrj/request/DirectXmlRequest.html Is what you need if you want to use Solrj... :-) On 4/1/09, Radha C. wrote: > > Thanks shalin, > > I need to index the xml which is in solr's forma

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

2009-04-01 Thread Fergus McMenemie
Grant, Redoing the work with your patch applied does not seem to make a difference! Is this the expected result? I did run it again using the full file, this time using my Imac:- 643465took 22min 14sec 2008-04-01 734796 73min 58sec 2009-01-15

RE: Indexing fields of xml file using solrj

2009-04-01 Thread Radha C.
Thanks shalin, I need to index the xml which is in solr's format only. I want to index that xnl directly using solrj same like how we post using curl. Is there any API class is available for that? Can you please provide me any reference link? -Original Message- From: Shalin Shekhar Manga

Re: multicore

2009-04-01 Thread Giovanni De Stefano
Hello, the starting point is here: http://wiki.apache.org/solr/CoreAdmin Cheers, Giovanni On 4/1/09, Neha Bhardwaj wrote: > > Hi, > > I need to create multiple cores for my project. > > I need to know: > > how to have multiple cores ? > > can we start all cores from single startup file or we

multicore

2009-04-01 Thread Neha Bhardwaj
Hi, I need to create multiple cores for my project. I need to know: how to have multiple cores ? can we start all cores from single startup file or we need to start all independently? I need a way by which I can start all of them in one go. Thanks Neha DISCLAIMER == This e-

Re: Indexing fields of xml file using solrj

2009-04-01 Thread Shalin Shekhar Mangar
On Wed, Apr 1, 2009 at 5:17 PM, Radha C. wrote: > Hi All, > > I want to index the document fields in a xml file to index using solrj. I > know how to index the document fields using doc.addfield(). But I dont know > how to post the xml document instead of adding each field in solrj. > > Can I inde

Re: Indexing fields of xml file using solrj

2009-04-01 Thread Giovanni De Stefano
Hello, I believe what you want is DirectXMLRequest. http://lucene.apache.org/solr/api/org/apache/solr/client/solrj/request/DirectXmlRequest.html Cheers, Giovanni On 4/1/09, Radha C. wrote: > > Hi All, > > I want to index the document fields in a xml file to index using solrj. I > know how to

Indexing fields of xml file using solrj

2009-04-01 Thread Radha C.
Hi All, I want to index the document fields in a xml file to index using solrj. I know how to index the document fields using doc.addfield(). But I dont know how to post the xml document instead of adding each field in solrj. Can I index xml file using solrj? Can anyone help me in how to do th

RE: Problems with synonyms

2009-04-01 Thread Daniel Alheiros
Hi Leonardo, I've been using the synonym filter at index time (expand = true) and it works just fine. Also use OR as the default operator. Once you do it at index time there is no point doing it at query time (which in fact is likely to be the reason of your problems). Have a look at the Wik

DIH Date conversion from a source column skews time

2009-04-01 Thread Wesley Small
I have noticed that setting a dynamic date field from source column changes the time within the date. Can anyone confirm this? For example, the document I import has the following xml field. 2002-12-18T00:00:00Z In my data-inport-config file I define the following instructions: What is

RE: Runtime exception when adding documents using solrj

2009-04-01 Thread Radha C.
Thanks Paul, I resolved it, I missed one field declaration in schema.xml. Now I added, and it works. -Original Message- From: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com] Sent: Wednesday, April 01, 2009 3:52 PM To: solr-user@lucene.apache.org; cra...@ceiindia.com Subject: Re:

Re: performance tests with DataImportHandler and full-import

2009-04-01 Thread Noble Paul നോബിള്‍ नोब्ळ्
I guess Solr itself is hogging more memory. May be you can try reloading the core before each import. On Wed, Apr 1, 2009 at 3:19 PM, Marc Sturlese wrote: > > Hey there, > I am doing performance tests with full-import command from > DataImportHandler. I have configured 20 cores with 1 Gig index e

Re: Runtime exception when adding documents using solrj

2009-04-01 Thread Noble Paul നോബിള്‍ नोब्ळ्
Can u take a look at the Solr logs and see what is hapening? On Wed, Apr 1, 2009 at 3:19 PM, Radha C. wrote: > > Thanks Paul, > > I changed the URL but I am getting another error - Bad request , Any help > will be appriciated. > > Exception in thread "main" org.apache.solr.common.SolrException:

RE: Runtime exception when adding documents using solrj

2009-04-01 Thread Radha C.
Thanks Paul, I changed the URL but I am getting another error - Bad request , Any help will be appriciated. Exception in thread "main" org.apache.solr.common.SolrException: Bad Request Bad Request request: http://localhost:8080/solr/update?wt=javabin at org.apache.solr.client.solrj.imp

performance tests with DataImportHandler and full-import

2009-04-01 Thread Marc Sturlese
Hey there, I am doing performance tests with full-import command from DataImportHandler. I have configured 20 cores with 1 Gig index each (about a milion docs per index). If I start doing full-imports indexing from a mysql table SEQUENCIALY with cron jobs as frequently as possible it will work fin

Re: Runtime exception when adding documents using solrj

2009-04-01 Thread Noble Paul നോബിള്‍ नोब्ळ्
the url is wrong try this CommonsHttpSolrServer server = new CommonsHttpSolrServer("http://localhost:8080/solr/";); On Wed, Apr 1, 2009 at 2:04 PM, Radha C. wrote: > > Can anyone please tell me , what is the issue with the below java code.. > > -Original Message- > From: Radha C. [mailt

Re: Defining DataDir in Multi-Core

2009-04-01 Thread Shalin Shekhar Mangar
On Wed, Apr 1, 2009 at 1:48 PM, vivek sar wrote: > I'm using the latest released one - Solr 1.3. The wiki says passing > dataDir to CREATE action (web service) should work, but that doesn't > seem to be working. > That is a Solr 1.4 feature (not released yet). -- Regards, Shalin Shekhar Mangar.

RE: Runtime exception when adding documents using solrj

2009-04-01 Thread Radha C.
Can anyone please tell me , what is the issue with the below java code.. -Original Message- From: Radha C. [mailto:cra...@ceiindia.com] Sent: Wednesday, April 01, 2009 12:28 PM To: solr-user@lucene.apache.org Subject: RE: Runtime exception when adding documents using solrj I am using

Re: Merging Solr Indexes

2009-04-01 Thread vivek sar
Thanks Otis. Could you write to same core (same index) from multiple threads at the same time? I thought each writer would lock the index so other can not write at the same time. I'll try it though. Another reason of putting indexes in separate core was to limit the index size. Our index can grow

Re: Defining DataDir in Multi-Core

2009-04-01 Thread vivek sar
I'm using the latest released one - Solr 1.3. The wiki says passing dataDir to CREATE action (web service) should work, but that doesn't seem to be working. -vivek 2009/3/31 Noble Paul നോബിള്‍ नोब्ळ् : > which version of Solr are you using? if you are using one from trunk , > you can pass the

RE: Runtime exception when adding documents using solrj

2009-04-01 Thread Radha C.
I am using Solr 1.3 version _ From: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com] Sent: Wednesday, April 01, 2009 12:16 PM To: solr-user@lucene.apache.org; cra...@ceiindia.com Subject: Re: Runtime exception when adding documents using solrj which version of Solr are you usi