Re: solrj and CLOSE_WAIT's

2008-11-14 Thread Ian Holsman
Ryan McKinley wrote: not sure if it is something we can do better or part of HttpClient... From: http://www.nabble.com/CLOSE_WAIT-td19959428.html it seems to suggest you may want to call: con.closeIdleConnections(0L); But if you are creating a new MultiThreadedHttpConnectionManager for each r

Re: Fatal exception in solr 1.3+ replication

2008-11-14 Thread Mark Miller
Hey William, sorry about the trouble. I have to look at this further, but I think the issue is fixed if you grab the latest trunk build. Solr-465 should inadvertently fix things - before that patch, a deprecated constructor for solrsearcher was being called - this constructor caused the underly

Re: Newbie Question - getting search results from dataimport request handler

2008-11-14 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Sat, Nov 15, 2008 at 6:33 AM, Chris Hostetter <[EMAIL PROTECTED]> wrote: > > : > Is here a bug in DIH that caused these unrecognized fields to be ignored, > : > or is it possible the errors were logged (by DUH2 maybe? ... it's been a > : > while since i looked at the update code) but DIH didn't

Re: DataImportHandler, custom properties

2008-11-14 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Sat, Nov 15, 2008 at 5:19 AM, Lance Norskog <[EMAIL PROTECTED]> wrote: > These are what you may be asking: > 1) > Do you wish to read records from the database that are already indexed, and > you want to change the fields found and leave the rest of the Solr document? > This would certainly be a

Re: DataImportHandler not indexing all the records

2008-11-14 Thread Noble Paul നോബിള്‍ नोब्ळ्
There is no obvious problem I can be reasonably sure that the query select * from climatedata.ws_record limit 100 would have fetched only 615360 rows. This is a very reliable pice of information 615360 On Sat, Nov 15, 2008 at 12:41 AM, Giri <[EMAIL PROTECTED]> wrote: > Hi Noble, > thanks f

Re: Spellcheck.onlyMorePopular

2008-11-14 Thread Grant Ingersoll
Try spellcheck.onlyMorePopular. On Nov 14, 2008, at 1:53 PM, Jeff Newburn wrote: I am trying to get the onlyMorePopular variable to function correctly. I have tried adding both spellchecker.onlyMorePopular as well as sp.query.onlyMorePopular yet neither of these seem to change the spellin

Re: Newbie Question - getting search results from dataimport request handler

2008-11-14 Thread Chris Hostetter
: > Is here a bug in DIH that caused these unrecognized fields to be ignored, : > or is it possible the errors were logged (by DUH2 maybe? ... it's been a : > while since i looked at the update code) but DIH didn't notice them and : > reported success anyway? : : : If the data contains a field n

RE: Programatic way to know when an optimize is finished?

2008-11-14 Thread Lance Norskog
The 'optimize' http command blocks. If you script your automation, you can just call the http and then the next command in the script runs after the optimize finishes. Hours later, in our case. Lance -Original Message- From: Phillip Farber [mailto:[EMAIL PROTECTED] Sent: Friday, November

RE: DataImportHandler, custom properties

2008-11-14 Thread Lance Norskog
These are what you may be asking: 1) Do you wish to read records from the database that are already indexed, and you want to change the fields found and leave the rest of the Solr document? This would certainly be a worthwhile feature; there is a separate project to add 'altering existing documents

Re: XsltResponseWriter date handling

2008-11-14 Thread Erik Hatcher
Yeah, leaving it as UTC was fine. My date vernacular was off in my original question, sorry. Actually I was able to solve the problem a different way. I'm generating a SIMILE Timeline XML output from Solr, and it has a date- time-format option. Setting that to "iso8601" was all it took,

Re: delete oddity...

2008-11-14 Thread Erik Hatcher
On Nov 14, 2008, at 4:11 PM, Dan A. Dickey wrote: Note to whomever writes documentation: We all do :) Feel free to create a wiki account and edit the page if you like. Much appreciated in fact! You're right ... that's a confusing oddity about the command. Erik It would be n

Re: delete oddity...

2008-11-14 Thread Dan A. Dickey
On Friday 14 November 2008 15:11:46 Dan A. Dickey wrote: > Note to whomever writes documentation: > It would be nice to note in the documentation for doing a > that the has to be exactly , and not the whatever > that is specified in the schema.xml configuration file. For doing deletes > by id, o

Re: XsltResponseWriter date handling

2008-11-14 Thread Chris Hostetter
: for pragmatic "the desired output is straightforward XML" reasons. I need to : take a Solr date value in "2008-10-30T03:28:10.000Z" format and output it as a : GMT formatted date like "Oct 30 2008 03:28:10 GMT-0600". : : Anyone got the incantation handy to make such a conversion in XSLT? I can

delete oddity...

2008-11-14 Thread Dan A. Dickey
Note to whomever writes documentation: It would be nice to note in the documentation for doing a that the has to be exactly , and not the whatever that is specified in the schema.xml configuration file. For doing deletes by id, of course. :) The wiki at http://wiki.apache.org/solr/UpdateXmlMes

Re: Fatal exception in solr 1.3+ replication

2008-11-14 Thread Mark Miller
Looks like there might be an issue with the reopen - I'm not seeing what it could be offhand though. Have to find what could be closing a Directory unexpectedly...I'll try to take a further look over the weekend. - Mark William Pierce wrote: Folks: I am using the nightly build of 1.3 as of O

Re: DataImportHandler not indexing all the records

2008-11-14 Thread Giri
Hi Noble, thanks for the help, here are the details: the field "id" is unique, when I did a select distinct(id), it returned 1 million rows. --- db-data-config.xml note: I limit the resultset to 1 million in the select query -

Spellcheck.onlyMorePopular

2008-11-14 Thread Jeff Newburn
I am trying to get the onlyMorePopular variable to function correctly. I have tried adding both spellchecker.onlyMorePopular as well as sp.query.onlyMorePopular yet neither of these seem to change the spelling suggestion response. I am not sure if I simply do not understand what it is intended to

Re: Programatic way to know when an optimize is finished?

2008-11-14 Thread Shalin Shekhar Mangar
You can add a SolrEventListener to the postOptimize hook. On Fri, Nov 14, 2008 at 11:34 PM, Phillip Farber <[EMAIL PROTECTED]> wrote: > > I'd like to automate my indexing processes. Is there a slick method to > know when an optimize on an index has completed? > > Thanks, > > Phil > -- Regard

Re: Programatic way to know when an optimize is finished?

2008-11-14 Thread Alexander Ramos Jardim
You could intercept the optimize method execution with an advisor? 2008/11/14 Phillip Farber <[EMAIL PROTECTED]> > > I'd like to automate my indexing processes. Is there a slick method to > know when an optimize on an index has completed? > > Thanks, > > Phil > -- Alexander Ramos Jardim

Programatic way to know when an optimize is finished?

2008-11-14 Thread Phillip Farber
I'd like to automate my indexing processes. Is there a slick method to know when an optimize on an index has completed? Thanks, Phil

Fatal exception in solr 1.3+ replication

2008-11-14 Thread William Pierce
Folks: I am using the nightly build of 1.3 as of Oct 23 so as to use the replication handler. I am running on windows 2003 server with tomcat 6.0.14. Everything was running fine until I noticed that certain updated records were not showing up on the slave. Further investigation showed me t

Re: Newbe! Trying to run solr-1.3.0 under tomcat. Please help

2008-11-14 Thread Erik Hatcher
To be fair, my first message was about Solr trunk + Tomcat 5.5.27, but I just tried it by pointing to a Solr 1.3.0 official release and it worked fine as well. Erik On Nov 14, 2008, at 12:30 PM, Erik Hatcher wrote: Fergus, I just downloaded Tomcat 5.5.27, put a solr.xml file in co

Re: Newbe! Trying to run solr-1.3.0 under tomcat. Please help

2008-11-14 Thread Erik Hatcher
Fergus, I just downloaded Tomcat 5.5.27, put a solr.xml file in conf/Catalina/ localhost with the following: debug="0" crossContext="true" > And Solr started up just fine and it's admin, etc worked as expected. Oh, and on Mac OS X (of course!), version 10.5.5. Erik On N

Newbe! Trying to run solr-1.3.0 under tomcat. Please help

2008-11-14 Thread Fergus McMenemie
Hello all, Further to various messages. I just cannot get solr 1.3 to launch under OS X with tomcat. Solr 1.2 works fine with tomcat and I am OK with 1.3 under jetty. I have tried tomcat-5.5.20 and 5.2.27. I have tried solr 1.3.0 plus the nightly build. I have tried under OS X 10.5 and 10.4 (le

RE: STATS functions ....

2008-11-14 Thread souravm
Thanks Erik. Regards, Sourav -Original Message- From: Erik Hatcher [mailto:[EMAIL PROTECTED] Sent: Thursday, November 13, 2008 6:29 PM To: solr-user@lucene.apache.org Subject: Re: STATS functions StatsComponent is in trunk now, committed after the 1.3 release.

questions about Solr connection methods

2008-11-14 Thread Matt Mitchell
I'm implementing connection adapters in ruby/jruby and wondering how all of the different solr "connection" classes relate. Is the only difference between EmbeddedSolrServer and DirectSolrConnection, that EmbeddedSolrServer provides some higher level methods for adding, deleting etc.? Or is there

Re: troubles with delta import

2008-11-14 Thread Marc Sturlese
Hey Shalin! Now at least I am getting some errors in the log file :D... Hope now I will be able to find the problem. Thanks for everything! Shalin Shekhar Mangar wrote: > > Ok I found the problem. > > In debug mode, DataImportHandler does not commit documents since it is > meant > for debuggin

Re: troubles with delta import

2008-11-14 Thread Shalin Shekhar Mangar
Ok I found the problem. In debug mode, DataImportHandler does not commit documents since it is meant for debugging only. If you want to do a commit, add commit=true as a request parameter. On Fri, Nov 14, 2008 at 7:56 PM, Marc Sturlese <[EMAIL PROTECTED]>wrote: > > Hey, > That's the weird thing.

Re: troubles with delta import

2008-11-14 Thread Marc Sturlese
Hey, That's the weird thing... in the log everything seems to work fine: Nov 14, 2008 3:12:46 PM org.apache.solr.handler.dataimport.DataImportHandler processConfiguration INFO: Processing configuration from solrconfig.xml: {config=/opt/netbeans-5.5.1/enterprise3/apache-tomcat-5.5.17/bin/solr/conf

Re: troubles with delta import

2008-11-14 Thread Shalin Shekhar Mangar
Mark, even if the dataimport.properties is not present, DIH will create it. Are you seeing any exceptions in the log or in the debug mode? On Fri, Nov 14, 2008 at 7:03 PM, Marc Sturlese <[EMAIL PROTECTED]>wrote: > > Hey Shalin, > I have tryied 2 methods: > 1-First doing a full-import and after a

Re: Multi field queries

2008-11-14 Thread sunnyfr
Thanks Hoss, and about boosting boolean value or even number of view, does it work this way : boolean value : &qf=best_one^10 Number of view: pow(nb_views,0.01)^20 Otherwise about searching two words and have in first title who have exactly this two words in first it's just about mm parameter?

Re: troubles with delta import

2008-11-14 Thread Marc Sturlese
Hey Shalin, I have tryied 2 methods: 1-First doing a full-import and after a delta-import 2.-Start directly with the delta-import. In any of both cases the date of the import.properties file is updated. I have it placed in the same folder as schema.xml,data-config.xml and solrconfig.xml (is where

Re: troubles with delta import

2008-11-14 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Fri, Nov 14, 2008 at 4:35 PM, Marc Sturlese <[EMAIL PROTECTED]> wrote: > > Hey there, I am using dataimport with full-import successfully but there's no > way do make it work with delta-import. Aparently solr doesn't show any error > but it does not do what it is supose to. > I thing the problme

Re: DataImportHandler, custom properties

2008-11-14 Thread DODMax
> http://wiki.apache.org/solr/DataImportHandler#head-071ff018f44ecbdb1cf55afc4c2a857f44ea1ea4 > > > > ... > > The problem is that "namedesc" must be an existing column and I have no idea of column name in advance. To be more clear, what I want is to be able to retrive information which ar

Re: troubles with delta import

2008-11-14 Thread Shalin Shekhar Mangar
Hi Marc, Did you do a full-import first? If not, no value for last import time is written and the delta query may fail. We should fix this to use a sane default so that people do not need to full import first. You need to put both because we support both full and delta, both of which need differe

troubles with delta import

2008-11-14 Thread Marc Sturlese
Hey there, I am using dataimport with full-import successfully but there's no way do make it work with delta-import. Aparently solr doesn't show any error but it does not do what it is supose to. I thing the problme is with dataimport.properties because it is never updated. I have it placed in the

Re: solr1.3 dismax qf/bf boolean

2008-11-14 Thread Erik Hatcher
On Nov 14, 2008, at 5:44 AM, sunnyfr wrote: I read the wiki, but I'm still a bit confused. And have to say that result are not good and even sometime bring me back in head of list a title which even didn't contain words that I look for, like for q=tom jerry (my schema contain OR as default m

Re: Solrj queries

2008-11-14 Thread Erik Hatcher
AND must be entirely capitalized to set clauses on both sides as _required_. Erik On Nov 14, 2008, at 12:44 AM, Raghunandan Rao wrote: Yes. But is that how we do in Solrj by setting SolrQuery("text:Right And title:go"). Thanks a lot. -Original Message- From: Ryan McKinley

solr1.3 dismax qf/bf boolean

2008-11-14 Thread sunnyfr
Hi, I try to find an equilibrium between all my boost, but I'm a bit confused between qf and bf so I put : &qf=title^10 then I try to bring back in first or boost a lot a boolean field when it's true : &bf=isbest^10 or 100 or more doesn't bring back in head of list the best one ...??? same for

Re: solrj and CLOSE_WAIT's

2008-11-14 Thread Ian Holsman
Ryan McKinley wrote: not sure if it is something we can do better or part of HttpClient... From: http://www.nabble.com/CLOSE_WAIT-td19959428.html it seems to suggest you may want to call: con.closeIdleConnections(0L); But if you are creating a new MultiThreadedHttpConnectionManager for each r