Cannot get solr 1.3.0 to run properly with plesk 9.2.1 on CentOS

2009-08-14 Thread Aaron Aberg
My client is using a dedicated server with plesk for the control panel. The hosting provider says that anything done using the control panel is supported by their tech support, so if i try anything using SSH, it voids that warranty. Its easy to install a servlet through plesk anyway, I upload the w

Re: Solr 1.4 Replication scheme

2009-08-14 Thread Chris Hostetter
: > This is a relatively safe assumption in most cases, but one that couples the : > master update policy with the performance of the slaves - if the master gets : > updated (and committed to) frequently, slaves might face a commit on every : > 1-2 poll's, much more than is feasible given new sear

Re: Solr conditional adds/updates?

2009-08-14 Thread Jason Rutherglen
> It seems like this would require some sort of Java implementation? Yes, custom Java code would need to be written and tested etc. On Fri, Aug 14, 2009 at 3:35 PM, Archon810 wrote: > > It seems like this would require some sort of Java implementation? > Unfortunately I'm not a Java developer bu

Re: Solr conditional adds/updates?

2009-08-14 Thread Archon810
It seems like this would require some sort of Java implementation? Unfortunately I'm not a Java developer but I am in charge of implementing Solr. Any more detailed/straightforward instructions are very much appreciated. Thank you. Jason Rutherglen-2 wrote: > > You could implement optimistic c

Re: Solr conditional adds/updates?

2009-08-14 Thread Jason Rutherglen
You could implement optimistic concurrency? Where a version is stored in the document? Or using the date system you described. Override DirectUpdateHandler2.addDoc with the custom logic. It seems like we should have a way of performing this without custom code and/or an easier way to plug logic i

Which server parameters to tweak in Solr if I expect heavy writes and light reads?

2009-08-14 Thread Archon810
I am facing scalability issues designing a new Solr cluster and I need to master to be able to handle a relatively high rate of updates with almost no reads - they can be done via slaves. My existing Solr instance is occupying a huge amount of RAM, in fact it started swapping at only 4.5mil docs.

Solr conditional adds/updates?

2009-08-14 Thread Archon810
I have a fairly simple need to do a conditional update in Solr, which is easily accomplished in MySQL. For example, * I have 100 documents with a unique field called * I am POSTing 10 documents, some of which may be duplicate s, in which case Solr would update the existing records with

RE: UTF8 Problem with http request?

2009-08-14 Thread Ankit Bhatnagar
Cool :) -Original Message- From: gateway0 [mailto:reiterwo...@yahoo.de] Sent: Friday, August 14, 2009 4:52 PM To: solr-user@lucene.apache.org Subject: RE: UTF8 Problem with http request? Hi, thank you for your suggestions. I solved the problem now. It was the PHP function "strtolower

RE: UTF8 Problem with http request?

2009-08-14 Thread gateway0
Hi, thank you for your suggestions. I solved the problem now. It was the PHP function "strtolower()". As it turns out it can´t handle utf-8 strings. The solution is doing something like this in PHP: " $VALUE = "für"; $text = utf8_encode(strtolower(utf8_decode($VALUE))); " Thank you again "AN

RE: UTF8 Problem with http request?

2009-08-14 Thread Ankit Bhatnagar
My final two-cents- although not sure - use - encodeURIComponent(data) while creating the query refer - http://www.w3schools.com/jsref/jsref_encodeURIComponent.asp Ankit From: Ankit Bhatnagar [abhatna...@vantage.com] Sent: Friday, August 14, 2009 4:35

RE: UTF8 Problem with http request?

2009-08-14 Thread Ankit Bhatnagar
Or this // Setting the Content-Type header with charset header('Content-Type: text/html; charset=utf-8'); -Original Message- From: gateway0 [mailto:reiterwo...@yahoo.de] Sent: Friday, August 14, 2009 4:08 PM To: solr-user@lucene.apache.org Subject: RE: UTF8 Problem with http request? H

RE: UTF8 Problem with http request?

2009-08-14 Thread Ankit Bhatnagar
I guess in the header you could try setting the Charest something like this header('Content-Type: text/plain; charset=ISO-8859-1'); -Original Message- From: gateway0 [mailto:reiterwo...@yahoo.de] Sent: Friday, August 14, 2009 4:08 PM To: solr-user@lucene.apache.org Subject: RE: UTF8 Prob

RE: UTF8 Problem with http request?

2009-08-14 Thread gateway0
Hi, 1. I use PHP5 what you suggested is a java function I would guess. In PHP there is something like this: " urlencode(utf8_encode($url)); " But sadly that doesnt help. 2. I don´t use Spring Strange thing. ANKITBHATNAGAR wrote: > > Hey Sebastian, > > Did u try - > 1; > URLEncoder.encode

RE: UTF8 Problem with http request?

2009-08-14 Thread Ankit Bhatnagar
Hey Sebastian, Did u try - 1; URLEncoder.encode(url, "UTF-8"); 2:if you application is Spring based-try this CharacterEncoding org.springframework.web.filter.CharacterEncodingFilter

UTF8 Problem with http request?

2009-08-14 Thread gateway0
Hi, First of all I know that there is a utf8 problem with tomcat. So I updated the "server.xml" tomcat file with " " - So now the solr admin console returns an successful result for example: q=für result: " − 0 0 − on 0 für 10 2.2 − " - However if I use a http request through php5 I´l

Re: I think this is a "bug"

2009-08-14 Thread Shalin Shekhar Mangar
On Thu, Aug 13, 2009 at 8:21 PM, Chris Male wrote: > Hi Paul, > > Yes the comment does look very wrong. I'll open a JIRA issue and include a > fix. > > On Thu, Aug 13, 2009 at 4:43 PM, Paul Tomblin wrote: > > > I don't want to join yet another mailing list or register for JIRA, > > but I just n

Re: Using Lucene's payload in Solr

2009-08-14 Thread Bill Au
Thanks for sharing your code, Ken. It is pretty much the same code that I have written except that my custom QueryParser extends Solr's SolrQueryParser instead of Lucene's QueryParser. I am also using BFTQ instead of BTQ. I have tested it and do see the payload being used in the explain output.

ruby client and building spell check dictionary

2009-08-14 Thread Mike Anderson
I set up the spell check component with this code in the config file: > textSpell titleCheck solr.IndexBasedSpellChecker dictionary 0.7 which works great. I can build the dictionary from my browser "q="foo"&spellcheck.build=true&spellcheck.name=titleCheck" and I can also r

Re: A Buzzword Problem!!!

2009-08-14 Thread Grant Ingersoll
Do you need to know, when you match which type of word it was, or do you just need to know if there was a match? On Aug 14, 2009, at 5:17 AM, Ninad Raut wrote: Hi, I have a scenario in which I need to store Buzz words and their frequency in a particular document. Also along with the buzzwo

Re: Solr 1.4 Replication scheme

2009-08-14 Thread Yonik Seeley
On Fri, Aug 14, 2009 at 1:48 PM, Jason Rutherglen wrote: > This would be good! Especially for NRT where this problem is > somewhat harder. I think we may need to look at caching readers > per corresponding http session. For something like distributed search I was thinking of a simple reservation m

Re: Solr 1.4 Replication scheme

2009-08-14 Thread Jason Rutherglen
This would be good! Especially for NRT where this problem is somewhat harder. I think we may need to look at caching readers per corresponding http session. The pitfall is expiring them before running out of RAM. On Fri, Aug 14, 2009 at 6:34 AM, Yonik Seeley wrote: > Longer term, it might be nice

Re: Choosing between t and s field types

2009-08-14 Thread Yonik Seeley
On Fri, Aug 14, 2009 at 1:15 PM, Ninad Raut wrote: > TrieRange ... what are its features? What additional functionality they > provide? - a generally more efficient FieldCache structure (less memory) - faster range queries when precisionStep is utilized to index multiple tokens per value -Yonik h

Re: Choosing between t and s field types

2009-08-14 Thread Ninad Raut
TrieRange ... what are its features? What additional functionality they provide? On Fri, Aug 14, 2009 at 8:35 PM, Avlesh Singh wrote: > > > > I just checked and the default schema.xml for SOLR 1.3 > > (solr/conf/schema.xml.original) and i don't see tint, etc listed.So > either > > they''re new i

Re: Solr 1.4 Replication scheme

2009-08-14 Thread Yonik Seeley
On Fri, Aug 14, 2009 at 11:53 AM, Jibo John wrote: > Slightly off topic one question on the index file transfer mechanism > used in the new 1.4 Replication scheme. > Is my understanding correct that the transfer is over http?  (vs. rsync in > the script-based snappuller) Yes, that's correct.

Re: Solr 1.4 Replication scheme

2009-08-14 Thread Jibo John
Slightly off topic one question on the index file transfer mechanism used in the new 1.4 Replication scheme. Is my understanding correct that the transfer is over http? (vs. rsync in the script-based snappuller) Thanks, -Jibo On Aug 14, 2009, at 6:34 AM, Yonik Seeley wrote: Longer te

Re: Choosing between t and s field types

2009-08-14 Thread Avlesh Singh
> > I just checked and the default schema.xml for SOLR 1.3 > (solr/conf/schema.xml.original) and i don't see tint, etc listed.So either > they''re new in 1.4 and I don't know about them or they were manually > defined. > TrieRange fields are new and will make appearance in Solr 1.4. With 1.3 you ca

Re: Solr 1.4 Replication scheme

2009-08-14 Thread Yonik Seeley
Longer term, it might be nice to enable clients to specify what version of the index they were searching against. This could be used to prevent consistency issues across different slaves, even if they commit at different times. It could also be used in distributed search to make sure the index di

Re: Choosing between t and s field types

2009-08-14 Thread Constantijn Visinescu
I just checked and the default schema.xml for SOLR 1.3 (solr/conf/schema.xml.original) and i don't see tint, etc listed. So either they''re new in 1.4 and I don't know about them or they were manually defined. Can you post your schema.xml entries for tint? (along with any comments it might have?)

Re: [OT] Solr Webinar

2009-08-14 Thread Lucas F. A. Teixeira
webinar: https://admin.na4.acrobat.com/_a837485961/p23226399/ slides: http://www.lucidimagination.com/files/file/improving_findability.pdf []s, Lucas Frare Teixeira .·. - lucas...@gmail.com - blog.lucastex.com - twitter.com/lucastex On Fri, Aug 14, 2009 at 2:55 AM, Lukáš Vlček wrote: > Hello

Re: Choosing between t and s field types

2009-08-14 Thread Ninad Raut
Hi Constantijn, What are the t types viz;tint,tfloat etc. for? Is there a special use of these? On Fri, Aug 14, 2009 at 4:37 PM, Constantijn Visinescu wrote: > Accoridng to the documentation in schema.xml.original sint etc can be used > for both sorting and range queries? > > > sortMissin

Re: Choosing between t and s field types

2009-08-14 Thread Constantijn Visinescu
Accoridng to the documentation in schema.xml.original sint etc can be used for both sorting and range queries? On Fri, Aug 14, 2009 at 11:08 AM, Ninad Raut wrote: > Hi, > I want certain fields of type int,float and date to be sortable and I > should > be able to run my range queries a

A Buzzword Problem!!!

2009-08-14 Thread Ninad Raut
Hi, I have a scenario in which I need to store Buzz words and their frequency in a particular document. Also along with the buzzwords I have possible basewords, portar words associated with the buzzwords. Buzzword,Baseword,Portar word all need to be searchable. How can I use dynamic fields and my S

Choosing between t and s field types

2009-08-14 Thread Ninad Raut
Hi, I want certain fields of type int,float and date to be sortable and I should be able to run my range queries as well as facet queries on those fields. Now as far as I know sint,sfloat fieldtypes make the fields sortable and tint,tfloat,tdate allow range queries on the fields. I want both these

Re: Solr 1.4 Replication scheme

2009-08-14 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Fri, Aug 14, 2009 at 2:28 PM, KaktuChakarabati wrote: > > Hey Noble, > you are right in that this will solve the problem, however it implicitly > assumes that commits to the master are infrequent enough ( so that most > polling operations yield no update and only every few polls lead to an > act

Re: Solr 1.4 Replication scheme

2009-08-14 Thread KaktuChakarabati
Hey Noble, you are right in that this will solve the problem, however it implicitly assumes that commits to the master are infrequent enough ( so that most polling operations yield no update and only every few polls lead to an actual commit. ) This is a relatively safe assumption in most cases, bu

Re: Questions about XPath in data import handler

2009-08-14 Thread Andrew Clegg
Noble Paul നോബിള്‍ नोब्ळ्-2 wrote: > > yes. look at the 'flatten' attribute in the field. It should give you > all the text (not attributes) under a given node. > > I missed that one -- many thanks. Andrew. -- View this message in context: http://www.nabble.com/Questions-about-XPath-in-d

Re: Solr 1.4 Replication scheme

2009-08-14 Thread Noble Paul നോബിള്‍ नोब्ळ्
usually the pollInterval is kept to a small value like 10secs. there is no harm in polling more frequently. This can ensure that the replication happens at almost same time On Fri, Aug 14, 2009 at 1:58 PM, KaktuChakarabati wrote: > > Hey Shalin, > thanks for your prompt reply. > To clarity: > W

Re: Solr 1.4 Replication scheme

2009-08-14 Thread KaktuChakarabati
Hey Shalin, thanks for your prompt reply. To clarity: With the old script-based replication, I would snappull every x minutes (say, on the order of 5 minutes). Assuming no index optimize occured ( I optimize 1-2 times a day so we can disregard it for the sake of argument), the snappull would take

Re: Writing own request handler tutorial

2009-08-14 Thread Shalin Shekhar Mangar
On Thu, Aug 13, 2009 at 6:17 AM, darniz wrote: > > could anybody provide me with a complete data import handler example with > oracle if there is any. > Only the DataSource section in the configuration and the jdbc driver will be specific to Oracle. What is the problem you're facing? -- Regard

Re: Solr 1.4 Replication scheme

2009-08-14 Thread Shalin Shekhar Mangar
On Fri, Aug 14, 2009 at 8:39 AM, KaktuChakarabati wrote: > > In the old replication, I could snappull with multiple slaves > asynchronously > but perform the snapinstall on each at the same time (+- epsilon seconds), > so that way production load balanced query serving will always be > consistent.

Boolean logic in distributed searches

2009-08-14 Thread Matthew Painter
Hello, Firstly, my apologies for what I suspect is a very straightforward question. I have two Solr 1.3 indexes and am searching both through Solr's distributed searching. Searching works correctly, however boolean searches are being interepreted differently depending on whether or not I search