Re: uuid, COMB uuid, distributed farms

2011-01-04 Thread Dennis Gearon
Right, Lance, I meant in the field defintion. I appreciate your help and direction. Dennis Gearon Signature Warning It is always a good idea to learn from your own mistakes. It is usually a better idea to learn from others’ mistakes, so you do not have to make them yourself.

Re: Error when running simple queries to solr

2011-01-04 Thread Stevenson Cunanan
Hi, Thanks guys for the quick reply. I really appreciate it. in reply to Lance, I'm using apache-solr-1.4.1. My /opt/solr directory contains the following: - drwxr-xr-x 10 tomcat6 tomcat6 4096 2011-01-04 14:44 . - drwxr-xr-x 4 rootroot4096 2011-01-04 09:53 .. - lrwxrwxrwx 1 to

Re: [sqljdbc4.jar] Errors

2011-01-04 Thread Estrada Groups
I downloaded that driver today and will test it tomorrow. Thanks for the tip! Would you mind sending an XML code snippet if it's any different to load than the MS driver? Thanks, Adam Sent from my iPhone On Jan 4, 2011, at 11:34 PM, Gora Mohanty wrote: > On Wed, Jan 5, 2011 at 5:01 AM, Ada

Re: [sqljdbc4.jar] Errors

2011-01-04 Thread Gora Mohanty
On Wed, Jan 5, 2011 at 5:01 AM, Adam Estrada wrote: > Can anyone help me with the following error. I upgraded my database to SQL > Server 2008 SP2 and now I get the following error. It was working with SQL > Server 2005. > > > Caused by: java.lang.UnsupportedOperationException: Java Runtime Envir

Re: How to integrate Solr with C/CPP client

2011-01-04 Thread Gora Mohanty
On Wed, Jan 5, 2011 at 9:54 AM, prasad deshpande wrote: > It seems Solr/Lucene is completely developed in Java. > I want to integrate Solr with C/CPP client. Is it possible? If yes, how? [] Lucene has a C port called Lucy ( http://incubator.apache.org/lucy/ ) Solr can be accessed as a web se

How to integrate Solr with C/CPP client

2011-01-04 Thread prasad deshpande
It seems Solr/Lucene is completely developed in Java. I want to integrate Solr with C/CPP client. Is it possible? If yes, how? Thanks; Prasad

Re: [sqljdbc4.jar] Errors

2011-01-04 Thread Adam Estrada
I got the latest jar file from the MS website and then changed the authentication to Mixed Mode on my DB. That seems to have fixed it. My 2005 Server was Windows Authentication only and that worked so there are obviously quite a few differences between the versions of the DB. I learn something new

Re: [sqljdbc4.jar] Errors

2011-01-04 Thread Lance Norskog
Do you get a new JDBC driver jar with 2008? Look around the distribution or the MS web site. On Tue, Jan 4, 2011 at 7:06 PM, pankaj bhatt wrote: > Hi Adam, >           Can you try by downgrading your Java version to java 5. >         However i am using Java 6u13 with sqljdbc4.jar , i however do n

Re: Error when running simple queries to solr

2011-01-04 Thread Lance Norskog
Which Solr release is this? There is supposed to be a core/data directory, and inside that core/data/index with the index files. If you have no index, just make core/data and Solr will make core/data/index. LanceI On Tue, Jan 4, 2011 at 6:45 PM, Stevenson Cunanan wrote: > Hi, > > I'm very new t

Re: abort data import on errors

2011-01-04 Thread Lance Norskog
The DataImportHandler does this already. In fact you can set what happens on an indexing error. On Tue, Jan 4, 2011 at 4:59 PM, Tri Nguyen wrote: > I didn't want to issue the rollback command but have solr automatically > detect exceptions and rollback should there be exceptions. > > Probably th

Re: uuid, COMB uuid, distributed farms

2011-01-04 Thread Lance Norskog
'NOT NULL' in the schema is 'required=true' in a element. 'Search for NOT NULL' is a little odd: you search for a range and then negate the search, meaning for documents with nothing in that field. This standard query does it: -field:[* TO *] On Tue, Jan 4, 2011 at 2:49 PM, Dennis Gearon wrote:

Re: [sqljdbc4.jar] Errors

2011-01-04 Thread pankaj bhatt
Hi Adam, Can you try by downgrading your Java version to java 5. However i am using Java 6u13 with sqljdbc4.jar , i however do not get any error. If possible, can you pleease also try with some other version of Java 6. / Pankaj Bhatt. On Wed, Jan 5, 2011 at 5:01 AM, A

Error when running simple queries to solr

2011-01-04 Thread Stevenson Cunanan
Hi, I'm very new to solr and am still reading through the wiki. I am running a custom solr project made by colleague for our search; after placing it on opt/solr and adding the tomcat tomcat context fragment to point to docbase. I basically followed the instructions on http://wiki.apache.org/solr/

Re: DataImportHanlder - Multiple entities will step into each other

2011-01-04 Thread yu shen
Very detailed explanation, will look into it. Thanks. 2011/1/5 Erick Erickson > No, this is all #explicitly# defined in schema.xml. Solr has no required > fields. > If you're using the default schema.xml, the problem is that that file > defines > the id field with 'required="true"' option set, s

Re: DataImportHanlder - Multiple entities will step into each other

2011-01-04 Thread Erick Erickson
No, this is all #explicitly# defined in schema.xml. Solr has no required fields. If you're using the default schema.xml, the problem is that that file defines the id field with 'required="true"' option set, so any doc that does not have an id field is rejected. Id is used in the default schema in

RE: Custom match scoring

2011-01-04 Thread Chris Hostetter
: Yes, I already looked dismax which I'm using for other purposes, the big : deal for this problem is having summed only the best match of each field. In : dismax it sum all matches on each field. can you describe what you want in pusedo code? what you are describing sounds exactly like using t

Re: abort data import on errors

2011-01-04 Thread Tri Nguyen
I didn't want to issue the rollback command but have solr automatically detect exceptions and rollback should there be exceptions.   Probably there's an attribute I can configure to specify this for solr to understand.   Tri --- On Tue, 1/4/11, Markus Jelsma wrote: From: Markus Jelsma Subjec

Re: abort data import on errors

2011-01-04 Thread Markus Jelsma
http://wiki.apache.org/solr/UpdateXmlMessages#A.22rollback.22 > Hi, > > Is there a way to specify to abort (rollback) the data import should there > be an error/exception? > If everything runs smoothly, commit the data import. > > Thanks, > > Tri

abort data import on errors

2011-01-04 Thread Tri Nguyen
Hi,   Is there a way to specify to abort (rollback) the data import should there be an error/exception?   If everything runs smoothly, commit the data import.   Thanks,   Tri

Re: DataImportHanlder - Multiple entities will step into each other

2011-01-04 Thread yu shen
I tried the sql way, and not work as expected. According to my experiments, id is an implicit required field of solr. If I change id to table_id, and add field definition in schema.xml, while data importing, there will be an error reported. Please correct me if I am wrong. 2011/1/5 Lance Norskog

[sqljdbc4.jar] Errors

2011-01-04 Thread Adam Estrada
Can anyone help me with the following error. I upgraded my database to SQL Server 2008 SP2 and now I get the following error. It was working with SQL Server 2005. Caused by: java.lang.UnsupportedOperationException: Java Runtime Environment (JR E) version 1.6 is not supported by this driver. Use t

Re: uuid, COMB uuid, distributed farms

2011-01-04 Thread Dennis Gearon
Thanks Lance. I will be generating the COMB style of UUID external to Solr. Prevents a lot of index paging during INSERTS on DBs, maby eSolr too. So I would not use 'NEW' in the following, right? Just leave default out? Some sort of NOT NULL available in a Solr Schema? PHP code to make the CO

Re: Replication: the web application [/solr] .. likely to create a memory leak

2011-01-04 Thread Markus Jelsma
I don't have Windows :) > Is this on Windows or Unix? Windows will not delete a file that is still > open. > > On Tue, Jan 4, 2011 at 10:07 AM, Markus Jelsma > > wrote: > > Is it possible this problem has something to do with my old index files > > not being removed? This problem only surfaces

Re: problems with replication

2011-01-04 Thread Lance Norskog
Are the index files corrupted? Lucene includes a program CheckIndex which will verify that the index data structures are not corrupted. Lance Norskog On Tue, Jan 4, 2011 at 7:50 AM, Roxana Angheluta wrote: > Thanks for replying. > > I am not able to reproduce it, it does not happen at every repl

Re: Replication: the web application [/solr] .. likely to create a memory leak

2011-01-04 Thread Lance Norskog
Is this on Windows or Unix? Windows will not delete a file that is still open. On Tue, Jan 4, 2011 at 10:07 AM, Markus Jelsma wrote: > Is it possible this problem has something to do with my old index files not > being removed? This problem only surfaces in my setup when i restart with > replicat

Re: DataImportHanlder - Multiple entities will step into each other

2011-01-04 Thread Lance Norskog
This SQL syntax should do it: "select id, field as table_id, field". On Tue, Jan 4, 2011 at 5:59 AM, yu shen wrote: > Thanks for the prompt reply. Let me try. Delete is not a big deal for the > moment. > > 2011/1/4 Matti Oinas > >> I managed to do that by using TemplateTransformer >> >> >>   >>

Re: uuid, COMB uuid, distributed farms

2011-01-04 Thread Lance Norskog
http://wiki.apache.org/solr/UniqueKey On Mon, Jan 3, 2011 at 6:55 PM, pankaj bhatt wrote: > HI Dennis, >      I have used UUID in context of an application where an installation id > (UUID) is generated by the code. It caters to around 10K users. >      I have not used it in context of SOLR. > >

Re: Advice on Exact Matching?

2011-01-04 Thread Jonathan Rochkind
There is a hacky kind of thing that Bill Dueber figured out for using multiple fields and dismax to BOOST "exact" matches, but include all matches in the result set. You have to duplicate your data in a second non-tokenized field. Then you use dismax pf to super boost matches on the non-tokeni

Re: Luke for inspecting indexes on remote solr servers?

2011-01-04 Thread Stephen Boesch
i am interested in the LukeRequestHandler in fact having been pointed to it will try to find a comprehensive list of solr request handlers for future reference. as regards the -X our linux box does not have xwindows installed for security reasons, which is why did not try that approach. 2011/1

Re: Advice on Exact Matching?

2011-01-04 Thread Chris Hostetter
: I am trying to make sure that when I search for text—regardless of : what that text is—that I get an exact match. I'm *still* getting some : issues, and this last mile is becoming very painful. The solr field, : for which I'm setting this up on, is pasted below my explanation. I : appreciate

Re: Luke for inspecting indexes on remote solr servers?

2011-01-04 Thread Peter Karich
Am 04.01.2011 21:43, schrieb Ahmet Arslan: >> Is that supported? Pointer(s) >> to how to do it? > perhaps http://wiki.apache.org/solr/LukeRequestHandler ? or via ssh u...@host -X ;-)

Re: Luke for inspecting indexes on remote solr servers?

2011-01-04 Thread Ahmet Arslan
> Is that supported?  Pointer(s) > to how to do it? perhaps http://wiki.apache.org/solr/LukeRequestHandler ?

Re: Sub query using SOLR?

2011-01-04 Thread Jonathan Rochkind
Yeah, I don't believe there's any good way to do it in Solr 1.4. You can make two queries, first make your 'sub' query, get back the list of values, then construct the second query where you do "{!field v=field_name} val1 OR val2 OR val3 OR valN" Kind of a pain, and there is a maximum n

Replication: abort-fetch and restarting

2011-01-04 Thread Markus Jelsma
Hi, It seems abort-fetch nicely removes the index directory which i'm replicating to which is fine. Restarting, however, does not trigger the the same feature as the abort-fetch command does. At least, that's what my tests seems to tell me. Shouldn't a restart of Solr nicely clean up the mess b

RE: Sub query using SOLR?

2011-01-04 Thread Steven A Rowe
Hi Barani, I haven't tried it myself, but the limited JOIN functionality provided by SOLR-2272 sounds very similar to what you want to do: https://issues.apache.org/jira/browse/SOLR-2272 Steve > -Original Message- > From: bbarani [mailto:bbar...@gmail.com] > Sent: Tuesday, January 0

Re: Sub query using SOLR?

2011-01-04 Thread Dennis Gearon
Essentially, a subuery is an AND expression where you ask the database to find the identifier or set of identifiers to then use in the query outside the subquery. The data that you put into a Solr index is flattened, denormalized. So take the suquery field values and put them in an AND part of

Re: Sub query using SOLR?

2011-01-04 Thread dan whelan
Something like this might work. It's two dismax queries joined by an AND q=_query_:"{!dismax mm='100%25' qf='query fields and boosts for one query' v=$q1}" AND _query_:"{!dismax mm='100%25' qf='query fields and boosts for second query' v=$q2}"&q1=query one&q2=query two Just change the qf para

Re: Sub query using SOLR?

2011-01-04 Thread Estrada Groups
I am +1 on the interest on how to do this! Adam On Jan 4, 2011, at 1:26 PM, bbarani wrote: > > Hi, > > I am trying to use subquery in SOLR, is there a way to implement this using > SOLR query syntax? > > Something like > > Related_id: IN query(field=ud, q=”type:IT AND manager_12:dave”) >

Sub query using SOLR?

2011-01-04 Thread bbarani
Hi, I am trying to use subquery in SOLR, is there a way to implement this using SOLR query syntax? Something like Related_id: IN query(field=ud, q=”type:IT AND manager_12:dave”) The thing I really want is to use output of one query to be the input of another query. Not sure if it is possible

Re: Replication: the web application [/solr] .. likely to create a memory leak

2011-01-04 Thread Markus Jelsma
Is it possible this problem has something to do with my old index files not being removed? This problem only surfaces in my setup when i restart with replication on the slave. I can confirm that for some reason my replicated indexes get messed up only when i start restarting Tomcat several times

Re: searching against unstemmed text

2011-01-04 Thread Jonathan Rochkind
Do you have to do anything special to search against a field in Solr? No, that's what Solr does. Please be more specific about what you are trying to do, what you expect to happen, and what happens instead. If your Solr field is analyzed to stem, then indeed you can only match stemmed token

Solr and UIMA #2

2011-01-04 Thread Tommaso Teofili
Hi all, just a quick notice to let you know that a new component to consume UIMA objects to a (local or remote) Solr instance is available inside UIMA sandbox [1]. Note that this "writes" to Solr from UIMA pipelines (push) while in SOLR-2129 [2] Solr "asks" UIMA to extract metadata while indexing d

Re: problems with replication

2011-01-04 Thread Roxana Angheluta
Thanks for replying. I am not able to reproduce it, it does not happen at every replication. I just see the errors in the logs. At this point I have multiple errors in the logs and I am trying to analyze them systematically. See other examples below, this time from the slave. I suspect they are

searching against unstemmed text

2011-01-04 Thread Wodek Siebor
I'm trying to search using "text_rev" field, which is by default enabled in the schema.xml, but it doesn't work at all. Do I have to do anything special here. I want to search using wildcards and searching against "text" field works fine, except I can only find results against stemmed text. Than

Re: Replication: the web application [/solr] .. likely to create a memory leak

2011-01-04 Thread Yonik Seeley
On Tue, Jan 4, 2011 at 9:34 AM, Robert Muir wrote: >    [junit] WARNING: test class left thread running: > Thread[MultiThreadedHttpConnectionManager cleanup,5,main] I suppose we should move MultiThreadedHttpConnectionManager to CoreContainer. -Yonik http://www.lucidimagination.com

RE: Setting up Solr for PDFs on JBoss

2011-01-04 Thread Olson, Ron
This is what I have; I didn't alter it so I believe it's the default: text true ignored_ true links ignored_ -Original Message- From: Grant Ingersoll [mailto:gsing...@apache.org] Sent: Monday, January 03, 2011 8:10 PM To:

Re: Replication: the web application [/solr] .. likely to create a memory leak

2011-01-04 Thread Robert Muir
On Tue, Jan 4, 2011 at 9:23 AM, Markus Jelsma wrote: > Hi, > > Anyone seen this before when stopping of restarting Solr 1.4.1 running as > slave under Tomcat 6? > > SEVERE: The web application [/solr] appears to have started a thread named > [MultiThreadedHttpConnectionManager cleanup] but has fai

Replication: the web application [/solr] .. likely to create a memory leak

2011-01-04 Thread Markus Jelsma
Hi, Anyone seen this before when stopping of restarting Solr 1.4.1 running as slave under Tomcat 6? SEVERE: The web application [/solr] appears to have started a thread named [MultiThreadedHttpConnectionManager cleanup] but has failed to stop it. This is very likely to create a memory leak. I

Re: DataImportHanlder - Multiple entities will step into each other

2011-01-04 Thread yu shen
Thanks for the prompt reply. Let me try. Delete is not a big deal for the moment. 2011/1/4 Matti Oinas > I managed to do that by using TemplateTransformer > > > > > ... > > > ... > > > Only problem is that delta import fails to perform delete to the > index. It seems that Templat

Re: DataImportHanlder - Multiple entities will step into each other

2011-01-04 Thread Matti Oinas
I managed to do that by using TemplateTransformer ... ... Only problem is that delta import fails to perform delete to the index. It seems that TemplateTransformer is not used when performing delete so delete by id doesn't work. 2011/1/4 yu shen : > Hi All, > > I have a dat

DataImportHanlder - Multiple entities will step into each other

2011-01-04 Thread yu shen
Hi All, I have a dataimporthandler config file as below. It contains multiple entities: All data are from a database. Problem is item/company and other entity all have the field 'id', with value start from 1 to n.

Re: Does Solr/Lucene support Localization/Internationalization

2011-01-04 Thread prasad deshpande
My Primary interest is in Solr. Thanks, Prasad On Tue, Jan 4, 2011 at 6:25 PM, Erick Erickson wrote: > First, it's no big deal, but it's better to just post to one list only. > I'm not sure whether your primary interest is in Solr or Lucene > > See: http://lucene.apache.org/java/3_0_3/api/al

Re: Does Solr/Lucene support Localization/Internationalization

2011-01-04 Thread Erick Erickson
First, it's no big deal, but it's better to just post to one list only. I'm not sure whether your primary interest is in Solr or Lucene See: http://lucene.apache.org/java/3_0_3/api/all/index.html for a list of Lucene Analyzers for various

Does Solr/Lucene support Localization/Internationalization

2011-01-04 Thread prasad deshpande
> > Hello, > > I am completely new for Solr/lucene. I am going through documents provided > by Apache. > Can any one tell me that Lucene/Solr supports indexing and searching for > other than English language? > > It seems Solr/Lucene is completely developed in Java. > I want to integrate Solr/Lucen

Re: Setting up Solr for PDFs on JBoss

2011-01-04 Thread Jak Akdemir
In JBoss, duplicate libraries will be ignored as you mentioned. You may start to find libraries used in JBoss with "find -name *.jar". I don't know any other resource than wiki. It says remove the libraries below. - xercesImpl-2.8.1.jar - xml-apis-1.3.03.jar http://wiki.apache.org/solr/Sol

Re: use query to set filter on fields

2011-01-04 Thread Raymi
I'm not sure, whether I made myself very clear. I don't think that it is difficult to evaluate the query. Here's a (very inefficient) algorithm in pseudocode that would do, what I have in mind: query = ... foreach (term in query) foreach (field in SOLR.config.fields) result = SOLR.query(

Re: use query to set filter on fields

2011-01-04 Thread Ahmet Arslan
> I'm not sure, whether I made myself very clear. I don't > think that it is difficult to evaluate the query. Here's a > (very inefficient) algorithm in pseudocode that would do, > what I have in mind: > > query = ... > > foreach (term in query) >   foreach (field in SOLR.config.fields) >     res

Re: use query to set filter on fields

2011-01-04 Thread Raymi
No, I don't. But since I'll store documents in solr having "color" set to "red", "green", "blue" and "manufacturer" set to "ford", "bmw" etc. the information is available. Okey information is available but the difficult part is recognize those things from the free form text query. There is no s

Re: use query to set filter on fields

2011-01-04 Thread Ahmet Arslan
> No, I don't. > But since I'll store documents in solr having "color" set > to "red", > "green", "blue" and "manufacturer" set to "ford", "bmw" > etc. the > information is available. Okey information is available but the difficult part is recognize those things from the free form text query. T

Re: use query to set filter on fields

2011-01-04 Thread Raymi
I'm evaluating SOLR and have a question about query processing. Is it possible to set filters on fields according to the terms entered in the query? I know that I can use dismax to search in multiple fields. However, what I want to achieve for a given query is the following: - parse all terms in

Re: use query to set filter on fields

2011-01-04 Thread Ahmet Arslan
> I'm evaluating SOLR and have a question about query > processing. Is it possible to set filters on fields > according to the terms entered in the query? I know that I > can use dismax to search in multiple fields. However, what I > want to achieve for a given query is the following: > - parse a

use query to set filter on fields

2011-01-04 Thread Raymi
Hi, I'm evaluating SOLR and have a question about query processing. Is it possible to set filters on fields according to the terms entered in the query? I know that I can use dismax to search in multiple fields. However, what I want to achieve for a given query is the following: - parse all

Re: Must require quote with single word token query?

2011-01-04 Thread Chamnap Chhorn
Very late reply, actually. I can't manage it to work with local params using my text_keyword field and multi word query. What i do to achieve is to do full text searching. If the query matches the keyphrase, it will be in higher position. Are they other ways to work around? On Wed, Nov 24, 2010