Re: input XSLT

But these documents have to be converted to a particular format before being posted. Any XML document cannot be posted to Solr (with XSLT handled by Solr internally). DIH handles any xml format, but it operates in pull mode. On Fri, Mar 13, 2009 at 11:45 AM, Shalin Shekhar Mangar < shalinman...@g

Re: input XSLT

On Fri, Mar 13, 2009 at 11:36 AM, CIF Search wrote: > There is a fundamental problem with using 'pull' approach using DIH. > Normally people want a delta imports which are done using a timestamp > field. > Now it may not always be possible for application servers to sync their > timestamps (given

Re: How to correctly boost results in Solr Dismax query

Hi Pete, bq parameter works with q,alt query parameter. If you are passing the search criteria using q.alt query parameter then this bq parameter comes into picture. Also, q.alt doesnt support field boosting. If you want to boost the records with their field value then you must use q query param

Re: input XSLT

There is a fundamental problem with using 'pull' approach using DIH. Normally people want a delta imports which are done using a timestamp field. Now it may not always be possible for application servers to sync their timestamps (given protocol restrictions due to security reasons). Due to this Sol

Re: DIH use of the ?command=full-import entity= command option

On Fri, Mar 13, 2009 at 10:44 AM, Fergus McMenemie wrote: > If my data-config.xml contains multiple root level entities > what is the expected action if I call full-import without an > entity=XXX sub-command? > > Does it process all entities one after the other or only the > first? (It would be us

Re: CJKAnalyzer and Chinese Text sort

Thanks Hoss for your comments! I don't mind submitting it as a patch, shall I create a issue in Jira and submit the patch with that? Also, I didn't modify the core solr for locale based sorting; I just added the created a jar file with the class file & copied it over to the lib folder. As part o

Re: DIH use of the ?command=full-import entity= command option

If my data-config.xml contains multiple root level entities what is the expected action if I call full-import without an entity=XXX sub-command? Does it process all entities one after the other or only the first? (It would be useful IMHO if it only did the first.) >On Fri, Mar 13, 2009 at 3:17 AM

Re: DIH use of the ?command=full-import entity= command option

On Fri, Mar 13, 2009 at 3:17 AM, Fergus McMenemie wrote: > Hello, > > Can anybody describe the intended purpose, or provide a > few examples, of how the DIH entity= command option works. > > Am I supposed to build a data-conf.xml file which contains > many different alternate entities.. or >

Re: SolrJ : EmbeddedSolrServer and database data indexing

Is there any api in SolrJ that calls the dataImportHandler to execute commands like full-import and delta-import. Please help.. Ashish P wrote: > > Is it possible to index DB data directly to solr using EmbeddedSolrServer. > I tried using data-Config File and Full-import commad, it works. So >

Re: Issues with stale searchers.

On Thu, Mar 12, 2009 at 9:38 PM, Jeremy Carroll wrote: > If that's the case it is causing out of disk issues with Solr. We have a 187m > document count index which is about ~200Gb in size. Over a period of about a > week after optimizations, etc... the open file but deleted count grows very > l

SolrJ : EmbeddedSolrServer and database data indexing

Is it possible to index DB data directly to solr using EmbeddedSolrServer. I tried using data-Config File and Full-import commad, it works. So assuming using CommonsHttpServer will also work. But can I do it with EmbeddedSolrServer?? Thanks in advance... Ashish -- View this message in context:

RE: Issues with stale searchers.

If that's the case it is causing out of disk issues with Solr. We have a 187m document count index which is about ~200Gb in size. Over a period of about a week after optimizations, etc... the open file but deleted count grows very large. Causing the system to not be able to optimize due to lack

Re: OR/NOT query syntax

On Wed, Mar 11, 2009 at 9:56 PM, Andrew Wall wrote: > I'm attempting to write a solr query that ensures that if one field has a > particular value that another field also have a particular value. I've > arrived at this syntax, but it doesn't seem to work correctly. > > ((myField:superneat AND myOt

Re: Issues with stale searchers.

On Thu, Mar 12, 2009 at 6:29 PM, Jeremy Carroll wrote: > I have Solr 1.3 running on Apache Tomcat 5.5.27. I'm running into an issue > where searchers are opened up right away when tomcat starts, and never goes > away. This is causing read locks on the Lucene index holding open deleted > files d

Re: OR/NOT query syntax

I might be wrong on this, but since you can't do a query that's just a NOT statement, this wouldn't work either. I believe the NOT must negate results of a query, not the entire dataset. On Wed, Mar 11, 2009 at 6:56 PM, Andrew Wall wrote: > I'm attempting to write a solr query that ensures that

Re: DIH use of the ?command=full-import entity= command option

Wouldn't an entity be something such as a stream, or DB, a manifest- channel? The name source would be better to me but... there's the sQL data- sources. paul Le 12-mars-09 à 22:47, Fergus McMenemie a écrit : Can anybody describe the intended purpose, or provide a few examples, of how the

Issues with stale searchers.

I have Solr 1.3 running on Apache Tomcat 5.5.27. I'm running into an issue where searchers are opened up right away when tomcat starts, and never goes away. This is causing read locks on the Lucene index holding open deleted files during merges. This causes our server to run out of disk space in

Re: Programmatic access to other handlers

: I implement the interface and it returns me the current core. But how is it : different from doing request.getCore() from handleRequestBody()? And I don't i think ryan missunderstood your goal .. that's just a way for you to get access to your core prior to handling requests. : see how this c

Re: Programmatic access to other handlers

Thanks ryantxu for your answer. I implement the interface and it returns me the current core. But how is it different from doing request.getCore() from handleRequestBody()? And I don't see how this can give me access to other cores. I think that what I need is to get access to an instance of Core

DIH use of the ?command=full-import entity= command option

Hello, Can anybody describe the intended purpose, or provide a few examples, of how the DIH entity= command option works. Am I supposed to build a data-conf.xml file which contains many different alternate entities.. or Regards --

Re: Programmatic access to other handlers

If you are doing this in a RequestHandler, implement SolrCoreAware and you will get a callback with the Core http://wiki.apache.org/solr/SolrPlugins#head-8b3ac1fc3584fe1e822924b98af23d72b02ab134 On Mar 12, 2009, at 3:04 PM, Pascal Dimassimo wrote: I found this code to access other core fro

Re: Programmatic access to other handlers

I found this code to access other core from my custom requesthandler: CoreContainer.Initializer initializer = new CoreContainer.Initializer(); CoreContainer cores = initializer.initialize(); SolrCore otherCore = cores.getCore("otherCore"); It seems to work with some little testing. But is it a r

DIH outer joins

I have queries with outer joins defined in some entities and for the same root object I can have two or more lines with different objects, for example: Taking the following 3 tables, andquery defined in the entity with outer joins between tables: Table1 -> Table2 -> Table3 I can have the fol

Re: stemming (maybe?) question

On Thu, Mar 12, 2009 at 1:36 PM, Jon Drukman wrote: > is it possible to make solr think that "omeara" and "o'meara" are the same > thing? WordDelimiter would handle it if the document had "o'meara" (but you may or may not want the other stuff that comes with WordDelimiterFilter). You could also u

Adding authentication Token to the CommonsHttpSolrServer

Hi, We have installed the Solr in Tomcat server and enabled the security constraint at the Tomcat level.. We require to pass the authentication token(cookie) to the search call that is made using CommonsHttpSolrServer. Would like to know how can I add the token to the CommonsHttpSolrServer.

Re: Tomcat holding deleted snapshots until it's restarted

On Thu, Mar 12, 2009 at 1:34 PM, Marc Sturlese wrote: > : Just to clarify: > : a) what does the stats page show (in terms of the number of > : Searchers listed in the CORE section) after a couple of full imports? > > After 4 full-imports it will show 3 indexsearchers. I have also printed the > var

fl wildcards

If I wanted to hack Solr so that it has the ability to process wildcards for the field list parameter (fl), where would I look? (Perhaps I should look on the solr-dev mailing list, but since I am already on this one I thought I would start here). Thanks! -- -a "Ideally, a code library must

RE: Replication in 1.3

Thanks for the reply. Hopefully 1.4 will come soon enough so that we can still use Windows. -Original Message- From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf Of Yonik Seeley Sent: Thursday, March 12, 2009 9:55 AM To: solr-user@lucene.apache.org Subject: Re: Replication in 1.

stemming (maybe?) question

is it possible to make solr think that "omeara" and "o'meara" are the same thing? -jsd-

Re: Tomcat holding deleted snapshots until it's restarted

: Just to clarify: : a) what does the stats page show (in terms of the number of : Searchers listed in the CORE section) after a couple of full imports? After 4 full-imports it will show 3 indexsearchers. I have also printed the var "_searchers" from SolrCore.java and it shows me 3 indexsearche

Re: Tomcat holding deleted snapshots until it's restarted

: I have noticed that the first time I execute full import (having an old index : in the index folder) once it is done, the old indexsearcher will be closed: ... : The problem is that if I do another full-import... the old searcher will not : be closed, there will just appear the line:

Re: Replication in 1.3

On Thu, Mar 12, 2009 at 12:34 PM, Vauthrin, Laurent wrote: > Just so I'm clear on it, do you mean Windows replication via Cygwin is not > supported or not possible? Not really possible - the strategy the scripts use won't work on Windows because of the different filesystem semantics. Things lik

Re: Is wiki page still accurate

On Thu, Mar 12, 2009 at 10:04 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > On Thu, Mar 12, 2009 at 8:05 PM, Eric Pugh < > ep...@opensourceconnections.com> wrote: > >> Folks, >> >> Is this section title Full Import Example on >> http://wiki.apache.org/solr/DataImportHandler still ac

RE: Replication in 1.3

Just so I'm clear on it, do you mean Windows replication via Cygwin is not supported or not possible? If it's possible, I'm just curious if anyone else on the list has experience with it. Thanks, Laurent -Original Message- From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf Of

Re: Is wiki page still accurate

On Thu, Mar 12, 2009 at 8:05 PM, Eric Pugh wrote: > Folks, > > Is this section title Full Import Example on > http://wiki.apache.org/solr/DataImportHandler still accurate? The steps > referring to the example-solr-home.jar and the SOLR-469 patch seem out of > date with where 1.4 is today? > >

Solr 1.4: filter documens using fields

Hi all! I'm using StandardRequestHandler and I wanted to filter results by two fields in order to avoid duplicate results (in this case the documents are very similar, with differences in fields that are not returned in a query response). For example, considering the response: 285 186_

Re: Tomcat holding deleted snapshots until it's restarted

I have noticed that the first time I execute full import (having an old index in the index folder) once it is done, the old indexsearcher will be closed: 2009-03-12 13:05:06,200 [pool-7-thread-1] INFO org.apache.solr.core.SolrCore - [core_01] Registered new searcher searc...@c6692 main 2009-03-1

Programmatic access to other handlers

Hi, I've designed a "front" handler that will send request to other handlers and return a aggregated response. Inside this handler, I call other handlers like this (inside the method handleRequestBody): SolrCore core = req.getCore(); SolrRequestHandler mlt = core.getRequestHandler("/mlt"); Modi

Re: How to remove stemming from the analyzer - Finding "blah" when searching for "blah*"

Thank you! Next time I will remind not to change the words to make the example simpler... blah is not the same as Nefh :-) Thanks, Bruno 2009/3/12 Erik Hatcher > > On Mar 12, 2009, at 10:47 AM, Bruno Aranda wrote: > >> Doing this query: >> >> http://localhost:18080/solr/core_pub/select/?q=mit

Re: How to remove stemming from the analyzer - Finding "blah" when searching for "blah*"

On Mar 12, 2009, at 10:47 AM, Bruno Aranda wrote: Doing this query: http://localhost:18080/solr/core_pub/select/?q=mitab:Nefh Find 1 result. The term "Nefh" is found in the field "mitab". Doing: http://localhost:18080/solr/core_pub/select/?q=mitab:Nefh* Finds nothing. I have realised that

Re: How to remove stemming from the analyzer - Finding "blah" when searching for "blah*"

Thanks again. This is the default request handler: explicit Doing this query: http://localhost:18080/solr/core_pub/select/?q=mitab:Nefh Find 1 result. The term "Nefh" is found in the field "mitab". Doing: http://localhost:18080/solr/core_pub/select/?q=mitab:Nefh*

Is wiki page still accurate

Folks, Is this section title Full Import Example on http://wiki.apache.org/solr/DataImportHandler still accurate? The steps referring to the example-solr-home.jar and the SOLR-469 patch seem out of date with where 1.4 is today? Seems like the example-DIH stuff is simpler/more direct ex

Re: Solr 1.3; Data Import w/ Dynamic Fields

I was successful at distributing the Solr-1.4-DEV data import functionality within the Solr 1.3 war. 1. Copy the data import’s src directory from 1.4 to 1.3. 2. Made sure to used the data import’s build.xml already existing in Solr 1.3 3. Commented out all code within #SolrWriter.rollback method 4

Operators and Minimum Match with Dismax handler

Hi All, I have a question regarding the dismax handler and minimum match (mm=) I have an index which we are setting the default operator to AND. Am I right in saying that using the dismax handler, the default operator in the schema file is effectively ignored? (This is the conclusion I've made fr

RE: Combination of EmbeddedSolrServer and CommonHttpSolrServer

Hi Shalin Shekhar Mangar, Thanks for your inputs. Please see my comments below. I wish to know if there is any user who used EmbeddedSolrServer for indexing and CommonsHttpSolrServer for search. I have found that this combination offers better performance for indexing. Searching becomes f

Re: How to remove stemming from the analyzer - Finding "blah" when searching for "blah*"

What is the full query you're issuing to Solr and the corresponding request handler configuration? Chances are you're using the dismax query parser, which does not support wildcards. Other things to check, be sure you've tied the field to your new textIntact type, and that you're searching

How to correctly boost results in Solr Dismax query

Hi, I have managed to build an index in Solr which I can search on keyword, produce facets, query facets etc. This is all working great. I have implemented my search using a dismax query so it searches predetermined fields. However, my results are coming back sorted by score which appears to be c

Re: How to remove stemming from the analyzer - Finding "blah" when searching for "blah*"

Thanks for your answer, I am trying now with this custom text field: And still it does not find "blah" when using the wildcard and searching for "blah*". Am I missing something? Thanks, Bruno 2009/3/12 Erik Hatcher > Remove the

Re: How to remove stemming from the analyzer - Finding "blah" when searching for "blah*"

Remove the EnglishPorterFilterFactory from your "text" analyzer configuration (both index and query sides). And reindex all documents. Erik On Mar 12, 2009, at 8:28 AM, Bruno Aranda wrote: Hi, I am trying to disable stemming from the analyzer, but I am not sure how to do it. Fo

How to remove stemming from the analyzer - Finding "blah" when searching for "blah*"

Hi, I am trying to disable stemming from the analyzer, but I am not sure how to do it. For instance, I have a field that contains "blah", but when I search for "blah*" it cannot find it, whereas if I search for "bla*" it does. I was using the text type field, from the example schema.xml. How shou

Re: Custom path for solr lib and data folder

Hoss Assume my current working directory is C:/MyApplication/searchApp and in the solr.xml i am specifying C:/lib as shared lib, then the console output contains the following line: INFO: loading shared library: C:\MyApplication\searchApp\C:\lib Thanks con hossman wrote: > > Adding '" +

Re: Tomcat holding deleted snapshots until it's restarted

The old IndexSearcher is beeing closed correctly: 2009-03-12 13:05:06,200 [pool-7-thread-1] INFO org.apache.solr.core.SolrCore - [core_01] Registered new searcher searc...@c6692 main 2009-03-12 13:05:06,200 [pool-7-thread-1] INFO org.apache.solr.search.SolrIndexSearcher - Closing searc...@1c5cd

Re: Date Search with q query parameter

Hi, Date range query is working fine for me. This is the query I entered. q=productPublicationDate_product_dt:1993-02-01T12:00:00Z&version=2.2&start=0&rows=10&indent=on&qt=dismaxrequest It threw this exception: type Status report message Invalid Date String:'1993-02-01t12' description The re

Re: Date Search with q query parameter

On Thu, Mar 12, 2009 at 4:39 PM, dabboo wrote: > > Hi, > > I am able to rectify that exception but now what I am looking for is : How > I > can pass the value to the date field to search for the record of a specific > date value. e.g. I want to retrieve all the records of Jan 01, 2007. How I > wi

Re: Date Search with q query parameter

Hi, I am able to rectify that exception but now what I am looking for is : How I can pass the value to the date field to search for the record of a specific date value. e.g. I want to retrieve all the records of Jan 01, 2007. How I will pass the value with the column name. If I pass the value it

Re: Problem using DIH templatetransformer to create uniqueKey: solved

Folks, Template transformer will fail to return if a variable if undefined, however the regex transformer does still return. So where the following would fail:- This can be used instead:- So I guess we have the best of both worlds! Fergus. >Hmmm. Just gave that a go! No luck >But how many

Re: Solr 1.3 and Solr 1.4 difference?

here is the exhaustive list of all changes in 1.4 http://svn.apache.org/repos/asf/lucene/solr/trunk/CHANGES.txt On Thu, Mar 12, 2009 at 3:29 PM, Praveen Kumar Jayaram wrote: > > Hi > > What is the exact difference between Solr 1.3 and Solr 1.4 (Nightly build as > of now)?? > Heard SolrJ is not p

Solr 1.3 and Solr 1.4 difference?

Hi What is the exact difference between Solr 1.3 and Solr 1.4 (Nightly build as of now)?? Heard SolrJ is not part of Solr and performance is great in Solr 1.4 Please tell exactly what all going to differ in Solr 1.4 If possible please provide a pointer which describes the same. - Regards,

How to do Date Search in Solr

Hi, I am implementing date search criteria in Solr using q query parameter with dismax request. This is the data, I have. 2.4177726E-8 product_4100025 product_4100025 productIndex productIndex Fiction Fiction CE CE 0205583527 0205583527 9781592402939 9781592402939 Daughter of the Mountains Dau

Re: Date Search with q query parameter

Is your final query in this format ? col1:[2009-01-01T00:00:00Z+TO+2009-01-01T23:59:59Z] From: dabboo To: solr-user@lucene.apache.org Sent: Thursday, March 12, 2009 12:27:48 AM Subject: Date Search with q query parameter Hi, I am facing an issue with the dat

Highlighting the searched term in resultset

I was wondering if there is any way of highlighting the searched term in the resultset directly instead of having it as a separate "lst" element. Doing it through xsl transformation would be one way. Has anybody implemented any other better solution ? e.g iPhone iphone sell buy/str> 20

Date Search with q query parameter

Hi, I am facing an issue with the date field, I have in my records. e.g. I am using q query parameter and passing some string as search criteria like "test". While creating query with q parameter, how query forms is: column1:test | column2:test | column3:test . ... I have one column as date co