What are the Unicode encodings supported by Solr?

2009-05-06 Thread KK
Hi, I'd like to know about the different Unicode[/any other?] encodings supported by Solr for posting docs [thru Solrj in my case]. Is it that just UTF-8, UCN supported or other character encodings like NCR(decimal), NCR(hex) etc are supported as well? Now the problem is that during automating the

Phrase matching on a text field

2009-05-06 Thread Phil Chadwick
Hi, I'm trying to figure out why phrase matching on a text field only works some of the time. I have a SOLR index containing a document titled "FUTURE DIRECTIONS FOR INTEGRATED CATCHMENT". The "FOR" seems to be causing a problem... The title field is indexed as both s_title and t_title (string

Re: Using Solr to index a database

2009-05-06 Thread Amit Nithian
Each PRODUCT would be a document in your index with fields number, name and price. If you wanted to start off simple, your schema.xml could just define these three fields; however, for a search index, you may want to index name several ways (i.e. with and without stop words etc). The DIH is intell

RE: Solrconfig.xml

2009-05-06 Thread Francis Yakin
No error, attached is solrconfig.xml files( one is from 1.2.0 that works and the other is 1.3.0 that doesn't work) Thanks in advance. Francis -Original Message- From: Grant Ingersoll [mailto:gsing...@apache.org] Sent: Wednesday, May 06, 2009 4:56 PM To: solr-user@lucene.apache.org Sub

Re: Conditional/Calculated Fields (is it possible?)

2009-05-06 Thread Avlesh Singh
How about this - Lets say your domain objects had these three things you care about - P1, D and P2 (P1 is the price valid before D and P2 after this date). Index each such document twice (Please don't kill me for suggesting this). There are two fields which you should index with the document - epoc

Re: Conditional/Calculated Fields (is it possible?)

2009-05-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Thu, May 7, 2009 at 6:15 AM, Yonik Seeley wrote: > On Wed, May 6, 2009 at 7:32 AM, Andrew Ingram wrote: >> Basically, a product has two price values and a date, the product >> effectively has one price before the date and the other one after. >> This poses no problem for the site itself since

Re: When should I

2009-05-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
it is wise to optimize the index once in a while (daily may be). But it depends on how many commits you do in a day. Every commit causes fragmentation of index files and your search can become slow if you do not optimize it. But optimizing always is not recommended because it is time consuming and

Re: QueryElevationComponent : hot update of elevate.xml

2009-05-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
going forward the java based replication is going to be the preferred means replicating index. It does not support replicating files in the dataDir , it only supports replicating index files and conf files (files in conf dir). I was unaware of the fact that it was possible to put the elevate.xml in

Re: deltaImportQuery in child entity

2009-05-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
yeah the behavior you are observing is right. Now I have second thoughts on how it should be. I guess , if the deltaImportQuery is present in a child entity it should be used. you can open an issue --Noble On Thu, May 7, 2009 at 12:33 AM, Martin Davidsson wrote: > Hello, I have a data-config.xml

Re: Conditional/Calculated Fields (is it possible?)

2009-05-06 Thread Yonik Seeley
On Wed, May 6, 2009 at 7:32 AM, Andrew Ingram wrote: > Basically, a product has two price values and a date, the product > effectively has one price before the date and the other one after. > This poses no problem for the site itself since I can use conditional > logic, but I have no idea how to a

Re: Conditional/Calculated Fields (is it possible?)

2009-05-06 Thread Andrew Ingram
Hi Grant, The problem is that even if we're only displaying 16 products at a time, we're potentially sorting over a collection of thousands. This means it's pretty essential for the ordering from solr to be correct. - Andy Grant Ingersoll wrote: WARNING: Low level Solr hacking and brainstor

Re: Solrconfig.xml

2009-05-06 Thread Grant Ingersoll
Is there an error in the logs? On May 6, 2009, at 2:12 PM, Francis Yakin wrote: I just upgraded from 1.2.0 to 1.3.0 of solr. We have an existing data/index that I will be using from 1.2.0 to 1.3.0 and I use the default solrconfig.xml that come from 1.3.0. For some reason when I used solrco

Re: Conditional/Calculated Fields (is it possible?)

2009-05-06 Thread Grant Ingersoll
WARNING: Low level Solr hacking and brainstorming: I _wonder_ if you could plug in a FieldSelector that was aware of the date and then made the appropriate decision to return the correct price field. (On a side note, I'd love to see Solr support generic FieldSelector plugin capability) A

Re: Solr Plugins Simple Questions for the Simpleton

2009-05-06 Thread Grant Ingersoll
On May 6, 2009, at 3:25 PM, Jeff Newburn wrote: We are trying to implement a SearchCompnent plugin. I have been looking at QueryElevateComponent trying to weed through what needs to be done. My basic desire is to get the results back and manipulate them either by altering the actual resul

Re: Upgrading from 1.2.0 to 1.3.0

2009-05-06 Thread Grant Ingersoll
You need to upgrade the slaves first. Make backups, etc. beforehand as well. -Grant On May 5, 2009, at 10:05 AM, Francis Yakin wrote: What's the best way to upgrade solr from 1.2.0 to 1.3.0 ? We have the current index that our users search running on 1.2.0 Solr version. We would like

Re: Conditional/Calculated Fields (is it possible?)

2009-05-06 Thread Andrew Ingram
That is *very* clever and will almost certainly work. My only concern is that it doubles the overhead (and has a not insignificant effect on the complexity of my code) for what is essentially a minor feature. I'd like to keep this approach on the back-burner and see if a more conventional solut

Creating new QParserPlugin

2009-05-06 Thread KaktuChakarabati
Hello everyone, I am trying to write a new QParserPlugin+QParser, one that will work similar to how DisMax does, but will give me more control over the FunctionQuery-related part of the query processing (e.g in regards to a specified bf parameter). In specific, I want to be able to affect the way

Solr Plugins Simple Questions for the Simpleton

2009-05-06 Thread Jeff Newburn
We are trying to implement a SearchCompnent plugin. I have been looking at QueryElevateComponent trying to weed through what needs to be done. My basic desire is to get the results back and manipulate them either by altering the actual results or the facets. Questions: 1. Do the components fire

Solrconfig.xml

2009-05-06 Thread Francis Yakin
I just upgraded from 1.2.0 to 1.3.0 of solr. We have an existing data/index that I will be using from 1.2.0 to 1.3.0 and I use the default solrconfig.xml that come from 1.3.0. For some reason when I used solrconfig.xml from 1.2.0 it works and I can see the index and data, but I used solrconfig.

Re: solrcofig.xml - need some info

2009-05-06 Thread Raju444us
Hi Hoss, If i extend SolrQueryParser and override method getFieldQuery for some customization.Can I configure my new queryParser somthing like below explicit Do I need to place my new Parser class in solr/home/lib folder? Is this the right way to do thi

Re: Delete complete core without stopping Solr

2009-05-06 Thread Otis Gospodnetic
How about: delete by query *:* + optimize + unload I believe unloading the code will update solr.xml if it has that persist setting in it (but haven't tried it). This will leave all the other config and other files and dirs behind, though... Oits -- Sematext -- http://sematext.com/ -- Lucene -

deltaImportQuery in child entity

2009-05-06 Thread Martin Davidsson
Hello, I have a data-config.xml that is structured in the following fashion: deltaImportQuery="deltaParentImportQuery" deltaQuery="deltaParentQuery"> deltaImportQuery="deltaChildImportQuery" /> Is the deltaImportQuery attribute even allowed on the child entity? The behavior I

Re: How to index the documents in Apache Solr

2009-05-06 Thread Eric Pugh
I would also recommend starting with the out of the box Jetty Otherwise you are both trying to learn the basics of Solr and how to stand it up in Tomcat. It's not hard, but learn Solr basics first, then move to more advanced topics. Eric On May 6, 2009, at 9:57 AM, Erik Hatcher wrote

Delete complete core without stopping Solr

2009-05-06 Thread vivek sar
Hi, I'm using multi-core feature of Solr. Each Solr instance maintains multiple-core - each core of size 100G. I would like to delete older cores directory completely after 2 weeks (using file.delete). Currently, Solr loads all the cores that are listed in solr.xml. I was thinking of following,

Re: Master Slave data distribution | rsync fail issue

2009-05-06 Thread Bill Au
Are the user/group/permissions on the snapshot files the same for both cases (manual vs postCommit/postOptimize events)? Bill On Tue, May 5, 2009 at 12:54 PM, tushar kapoor < tushar_kapoor...@rediffmail.com> wrote: > > Hi, > > I am facing an issue while performing snapshot pulling thru Snappulle

Re: Conditional/Calculated Fields (is it possible?)

2009-05-06 Thread Erick Erickson
Would it work to index the item N times, where N is the number of discrete date ranges? Say you had a hat that was $10 from 1/1/09 to 6/30/09 and $11 from 7/1/09 to 12/30/09. Just index it twice with the dates something like valid_from, valid_to. Then form your queries so you were looking in the p

Re: Filter Query with multiple values

2009-05-06 Thread Stephane Bailliez
Sweet, thanks Erik ! On Wed, May 6, 2009 at 6:01 PM, Erik Hatcher wrote: > > On May 6, 2009, at 11:38 AM, Stephane Bailliez wrote: > > Hello, >> >> I cannot seem to find a way with the syntax to express multiple values for >> a >> filter query. >> >> I have documents with field 'type' : a, b,

Re: Filter Query with multiple values

2009-05-06 Thread Erik Hatcher
On May 6, 2009, at 11:38 AM, Stephane Bailliez wrote: Hello, I cannot seem to find a way with the syntax to express multiple values for a filter query. I have documents with field 'type' : a, b, c, d and I'd like to only search within documents a and b. One way to do it would be to wo

When should I

2009-05-06 Thread Eric Sabourin
Is the optimize xml command something which is only required when I delete all the docs? Or should I also send the optimize command following other operations? or daily? Thanks... Eric

Filter Query with multiple values

2009-05-06 Thread Stephane Bailliez
Hello, I cannot seem to find a way with the syntax to express multiple values for a filter query. I have documents with field 'type' : a, b, c, d and I'd like to only search within documents a and b. One way to do it would be to work on exclusion fq like: fq=-type:c&fq=-type:d but then all hell

Re: Conditional/Calculated Fields (is it possible?)

2009-05-06 Thread Matt Weber
I do not think this is possible. You will probably want to handle this logic on your side during indexing. Index the document with the fist price, then as that price expires, update the document with the new price. Thanks, Matt Weber eSr Technologies http://www.esr-technologies.com O

Re: How to index the documents in Apache Solr

2009-05-06 Thread Erik Hatcher
On May 6, 2009, at 5:11 AM, uday kumar maddigatla wrote: The link which shows the things in Jetty. But i'm using Tomcat. hi, If i run the command which is given in the link, it is tryinge to post the indexes at port number 8983. But in my case my tomcat is running on 8080. Where to chan

Re: QueryElevationComponent : hot update of elevate.xml

2009-05-06 Thread Nicolas Pastorino
On May 6, 2009, at 15:17 , Noble Paul നോബിള്‍ नोब्ळ् wrote: Why would you want to write it to the data dir? why can't it be in the same place (conf) ? Well, fact is that the QueryElevationComponent loads the configuration file ( elevate.xml ) either from the data dir, either from the con

Re: QueryElevationComponent : hot update of elevate.xml

2009-05-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
Why would you want to write it to the data dir? why can't it be in the same place (conf) ? On Wed, May 6, 2009 at 6:43 PM, Nicolas Pastorino wrote: > Hello, > > On May 6, 2009, at 15:02 , Noble Paul നോബിള്‍ नोब्ळ् wrote: > >> The elevate.xml is loaded from conf dir when the core is reloaded . if

Re: QueryElevationComponent : hot update of elevate.xml

2009-05-06 Thread Nicolas Pastorino
Hello, On May 6, 2009, at 15:02 , Noble Paul നോബിള്‍ नोब्ळ् wrote: The elevate.xml is loaded from conf dir when the core is reloaded . if you post the new xml you will have to reload the core. A simple solution would be to write a RequestHandler which extends QueryElevationComponent which c

Re: QueryElevationComponent : hot update of elevate.xml

2009-05-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
The elevate.xml is loaded from conf dir when the core is reloaded . if you post the new xml you will have to reload the core. A simple solution would be to write a RequestHandler which extends QueryElevationComponent which can be a listener for commit and call an super.inform() on that event On F

Re: QueryElevationComponent : hot update of elevate.xml

2009-05-06 Thread Nicolas Pastorino
Hi, On Apr 10, 2009, at 16:51 , Ryan McKinley wrote: On Apr 10, 2009, at 7:48 AM, Nicolas Pastorino wrote: Hello ! Browsing the mailing-list's archives did not help me find the answer, hence the question asked directly here. Some context first : Integrating Solr with a CMS ( eZ Publish

RE: what is the query syntax to search a value in more than one field.

2009-05-06 Thread Radha C.
Thanks much Avlesh . _ From: Avlesh Singh [mailto:avl...@gmail.com] Sent: Wednesday, May 06, 2009 5:01 PM To: solr-user@lucene.apache.org; cra...@ceiindia.com Subject: Re: what is the query syntax to search a value in more than one field. Query for "text" to be present in all the field

Conditional/Calculated Fields (is it possible?)

2009-05-06 Thread Andrew Ingram
Hi everyone, I'm working on the search schema for ecommerce products and I'm having an issue with the prices. Basically, a product has two price values and a date, the product effectively has one price before the date and the other one after. This poses no problem for the site itself since I can

Re: what is the query syntax to search a value in more than one field.

2009-05-06 Thread Avlesh Singh
Query for "text" to be present in all the fields: q=(+A:text +B:text +C:text) Query for "text" to be present in any of the fields: q=(A:text B:text C:text) Cheers Avlesh On Wed, May 6, 2009 at 4:43 PM, Radha C. wrote: > Hi, > > I need to search a text value in field A, field B, and field C. Ca

RE: what is the query syntax to search a value in more than one field.

2009-05-06 Thread Venkatesan A.
Excellent Radha -Original Message- From: Radha C. [mailto:cra...@ceiindia.com] Sent: Wednesday, May 06, 2009 4:43 PM To: solr-user@lucene.apache.org Subject: what is the query syntax to search a value in more than one field. Hi, I need to search a text value in field A, field B, and fi

Re: unable to run the solr in tomcat 5.0

2009-05-06 Thread Sami Siren
post.jar also supports specifying alternative url, see output from java -jar post.jar -help for more info. -- Sami Siren uday kumar maddigatla wrote: hi you mis understood my question. When i try to use the command java -post.jar *.*. It is trying to Post files in Solr which is there in 8

what is the query syntax to search a value in more than one field.

2009-05-06 Thread Radha C.
Hi, I need to search a text value in field A, field B, and field C. Can anybody tel me how to form the query. I am thinking of the option like q=A:text AND B:text AND C:text . Is it correct ? Thanks in advance.

Re: unable to run the solr in tomcat 5.0

2009-05-06 Thread Michael Ludwig
uday kumar maddigatla schrieb: When i try to use the command java -post.jar *.*. It is trying to Post files in Solr which is there in 8983 port. The post.jar seems to be hardcoded to port 8983, that's why I pointed you to the curl utilty, which lets you specify any port and address you can dre

Re: unable to run the solr in tomcat 5.0

2009-05-06 Thread uday kumar maddigatla
hi you mis understood my question. When i try to use the command java -post.jar *.*. It is trying to Post files in Solr which is there in 8983 port. If we use Jety then the default port number is 8983. But what about the thing that if we use tomcat which uses 8080 as port. If we use Jetty we ca

Re: unable to run the solr in tomcat 5.0

2009-05-06 Thread Michael Ludwig
uday kumar maddigatla schrieb: My intention is to use 8080 as port. Is there any other way taht Solr will post the files in 8080 port Solr doesn't post, it listens. Use the curl utility as indicated in the documentation. http://wiki.apache.org/solr/UpdateXmlMessages Michael Ludwig

Re: Using Solr to index a database

2009-05-06 Thread uday kumar maddigatla
Hi I too having the same doubt. I would like to check How Solr is index and search the data which is there in database. For example, lets say we have a table called PRODUCTS, and within that table, we have the following columns: NUMBER (product number) NAME (product name) PRICE How would w

Re: unable to run the solr in tomcat 5.0

2009-05-06 Thread uday kumar maddigatla
hi i know we can change the tomcat port number. But i don't want that. My intention is to use 8080 as port. Is there any other way taht Solr will post the files in 8080 port Michael Ludwig-4 wrote: > > uday kumar maddigatla schrieb: > >> The link which shows the things in Jetty. But i'm us

Re: unable to run the solr in tomcat 5.0

2009-05-06 Thread Michael Ludwig
uday kumar maddigatla schrieb: The link which shows the things in Jetty. But i'm using Tomcat. If i run the command which is given in the link, it is tryinge to post the indexes at port number 8983. But in my case my tomcat is running on 8080. Where to change the port. That's a basic Tomcat

Re: How to index the documents in Apache Solr

2009-05-06 Thread uday kumar maddigatla
The link which shows the things in Jetty. But i'm using Tomcat. hi, If i run the command which is given in the link, it is tryinge to post the indexes at port number 8983. But in my case my tomcat is running on 8080. Where to change the port. here is the error SimplePostTool: FATAL: Connect

Re: How to index the documents in Apache Solr

2009-05-06 Thread Michael Ludwig
uday kumar maddigatla schrieb: hi i installed the Apache Solr in tomcat 5.0. I'm able to see the admin page as well as welcome page Now i would like to index the documents. How? Did you have a look at the tutorial? It contains introductory documentation pertaining to what you want to achieve.

Re: How to index the documents in Apache Solr

2009-05-06 Thread Avlesh Singh
http://wiki.apache.org/solr/DataImportHandler Cheers Avlesh On Wed, May 6, 2009 at 2:28 PM, uday kumar maddigatla wrote: > > hi > > i installed the Apache Solr in tomcat 5.0. I'm able to see the admin page > as > well as welcome page > > Now i would like to index the documents. How? > > Help me

Re: unable to run the solr in tomcat 5.0

2009-05-06 Thread uday kumar maddigatla
hi thanks for your help. i got the solution. we need to place the examples/solr folder in bin folder of tomcat in order to run Now i'm able to run this. But how to index the files. The link which shows the things in Jetty. But i'm using Tomcat. If i run the command which is given in the link,

How to index the documents in Apache Solr

2009-05-06 Thread uday kumar maddigatla
hi i installed the Apache Solr in tomcat 5.0. I'm able to see the admin page as well as welcome page Now i would like to index the documents. How? Help me in this. -- View this message in context: http://www.nabble.com/How-to-index-the-documents-in-Apache-Solr-tp23402657p23402657.html Sent

Re: Encoding issue with solr querying

2009-05-06 Thread KK
Can someone tell me how to query for some raw unicode text[the one mentioned in my last mail] through SolrJ? Thanks, KK. On Tue, May 5, 2009 at 6:40 PM, KK wrote: > I have indexed some non-english pages in solr index. From the solr admin > interface I can query using the raw unicodes like this,

Re: unable to run the solr in tomcat 5.0

2009-05-06 Thread Michael Ludwig
uday kumar maddigatla schrieb: Hi, I'm new to this Solr. I got distribution of Solr. i placed the war file in tomcat/webapps. After that i don't know what to do. I got confused while reading The instalation notes which is given in wiki . It might be easier for you to follow the instructions i

Re: schema.xml: default values for @indexed and @stored

2009-05-06 Thread Michael Ludwig
Otis Gospodnetic schrieb: Attribute values for fields should be inherited from attribute values of their field types. Thanks, that answers my question pertaining to @indexed and @stored in the "fieldtype" and "field" elements in "schema.xml". Michael Ludwig

Re: Multi-index Design

2009-05-06 Thread Michael Ludwig
Matt Weber schrieb: http://wiki.apache.org/solr/MultipleIndexes Thanks, Mark. Your explanation and the pointer to the Wiki have clarified things for me. Michael Ludwig

Re: unable to run the solr in tomcat 5.0

2009-05-06 Thread KK
It would be easier for anyone to give you a precise answer if you can be more specific about the steps you followed for installing solr/tomcat and where exactly you got stuck. KK On Wed, May 6, 2009 at 11:58 AM, uday kumar maddigatla wrote: > > Hi, > > I'm new to this Solr. I got distribution of