Re: K-Stemmer for Solr 3.1

Hi Otis, conclusion, if we check that the license agreement is included in all source files and as a seperate license file then we are clear about KStem itself. What about the modifications from Lucid, do you know if they publish under GPL? Bernd - BASE - Bielefeld Academic Search Engine htt

Re: indexing directed graph

On Thu, May 19, 2011 at 9:12 AM, Otis Gospodnetic wrote: > Maybe Gora was referring to Siren: http://search-lucene.com/?q=siren+-sami [...] That does look interesting, but is not what I was referring to. I seem to remember a discussion on this list some 3-4 months about someone wanting to make a

Re: Solr Range Facets

Hi Chris, I made a mistake in explaining the second part of my question. If you notice the faceted result, you will notice for results for the 2nd May 2011 there are 4 results, but when I query for the 2nd May I should get only 1 result since after apply the offset all the remaining results s

Re: indexing directed graph

Maybe Gora was referring to Siren: http://search-lucene.com/?q=siren+-sami Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: dani.b.angelov > To: solr-user@lucene.apache.org > Sent: Tue,

Re: K-Stemmer for Solr 3.1

Hm, maybe I was wrong. I don't see any mention of *GPL on KStem download page. I only see http://ciir.cs.umass.edu/downloads/agreements/general.html. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Messa

Re: K-Stemmer for Solr 3.1

I see KStem being mentioned lately. It's been 5+ years since I looked at the original KStem stuff, but I recall there being a license issue with the *original* KStem. I think it was under some flavour of GPL and that was the reason why we didn't include it in Lucene/Solr back then. I say this

Re: filter cache and negative filter query

: What I don't like is that it systematically uses the positive version. : Sometimes the negative version will give many less results (for example, : in some cases I filter by documents not having a given field, and there : are very few of them). I think it would be much better that solr the

Re: Too slow indexing while using 2 different data sources

On Thu, May 19, 2011 at 6:59 AM, deniz wrote: > Is it normal to observe slow speed while using an URL datasource and also a > DB? it was something around 30 seconds with only DB source, but when I add > URL datasource too, then it takes 24 - 25 mins to index exactly the same > amount of docs [

Re: Too slow indexing while using 2 different data sources

Some details? well i think its clear but still here is the part of my solrconfig dbconfig.xml database JdbcDataSource com.mysql.jdbc.Driver jdbc:mysql://abcd/efgh some some url_data URLD

Re: Too slow indexing while using 2 different data sources

Hmmm, could you provide some more details? You might want to review: http://wiki.apache.org/solr/UsingMailingLists Best Erick On Wed, May 18, 2011 at 9:29 PM, deniz wrote: > Is it normal to observe slow speed while using an URL datasource and also a > DB? it was something around 30 seconds with

Re: [POLL] How do you (like to) do logging with Solr

[ ] I always use the JDK logging as bundled in solr.war, that's perfect [X ] I sometimes use log4j or another framework and am happy with re-packaging solr.war [ ] Give me solr.war WITHOUT an slf4j logger binding, so I can choose at deploy time [x ] Let me choose whether to bundle a binding

Too slow indexing while using 2 different data sources

Is it normal to observe slow speed while using an URL datasource and also a DB? it was something around 30 seconds with only DB source, but when I add URL datasource too, then it takes 24 - 25 mins to index exactly the same amount of docs Is there anyway of overcoming this thing? or i have to

Re: lucene parser, negative OR operands

: Thanks Yonik. I recall hearing about this before, but was vague on the : details, thanks for supplying some and refreshing my memory. matching in Lucene is addative ... queries must match *something*, a clause ofa boolean query can be the negation of a query, but that only defines how documen

Re: Field collapsing on multiple fields and/or ranges?

Ah, my mistake. Thanks alot, this would be a really cool feature :) For now I'm resorting to like making more then one query and cross referencing the two separate queries. -- View this message in context: http://lucene.472066.n3.nabble.com/Field-collapsing-on-multiple-fields-and-or-ranges-tp

RE: Solr Range Facets

: Thanks for explaining the point system, please find below the complete Sorry .. that part was ment to be a joke, I think i was really tired when i wrote that. The key take away: details matter. : 4 : 63 :

Fuzzy search and solr 4.0

Hi, I want to do a fuzzy search that compare a phrase to a field in solr. For example: "abc company ltda" will be compared to "abc comp", "abc corporation", "def company ltda", "nothing to match here". The thing is the it has to always returns documents sorted by its score. I've found some good

Re: Using Boost fields for a sum total score.

You might look at edismax on the 3.1 and trunk, it calculates scores a bit differently. You could always just form the query yourself in the app and not use dismax I think. Best Erick On Wed, May 18, 2011 at 6:06 PM, ronveenstra wrote: > I have a sizable index with a main "content" field, and 5

Re: Storing, indexing and searching XML documents in Solr

You're right, you can't store an XML document directly in Solr. You have to pull it apart and index it such that you can get whatever information back you need. How you flatten data depends entirely upon your needs. The high-level idea is that you want to create fields such that text searches work

Re: [POLL] How do you (like to) do logging with Solr

: An alternative to manually repackage solr.war as in #1, is Hoss' : suggestion in SOLR-2487 of a new ANT option to build Solr artifacts : without the JUL binding. More specificly, i'm advocating a new ANT property that would let you specify (by path) whatever SLF4J binding jar you want to inc

Re: [POLL] How do you (like to) do logging with Solr

I usually build solr using 'ant test dist' to run tests and build the .war and other jars, in particular the dataimporthandler. Having an alternate ant option to build without the binding would work for me. If/when I get around to changing logging mechanisms, I wouldn't be able to use the bin

Two XPathEntityProcessor questions

Hi, Can anyone tell me if the XPathEntityProcessor handles expresions like this: xpath="/a/b[c='value']/d/e That is, return a node that has a predecessor with a given text value? I would like to map various XPath expressions of that form to the same document in the index (I have a unique key co

Using Boost fields for a sum total score.

I have a sizable index with a main "content" field, and 5 defined boost fields (boost_low, boost_med, boost_high, boost_max, and boost_neg). The idea and hope was to allow searches on the content field to be influenced/boosted by the boosting fields if the search term was present. I had set up

Re: Storing, indexing and searching XML documents in Solr

You might want to create a field that's analyzed using HtmlStripCharFilter - this will index all the non-tag/non-attribute text in the document, and if you store the value, will store the entire XML document as well. I've done some work on an XmlStripCharFilter, which does the same thing (onl

Re: [POLL] How do you (like to) do logging with Solr

Hi, If you've setup your Tomcat with log4j logging, and want to add Solr, within the same logging config, you need to: #1. Remove slf4j-jdk14-1.6.1.jar from solr.war (unpack, remove, repack) #2. Download slf4j-log4j12-1.6.1.jar (from slf4j.org) and place it in e.g. tomcat/shared/lib If solr.w

Re: Storing, indexing and searching XML documents in Solr

Great document. I can see how to import the data direct from the database. However it seems as though I need to write xpath's in the config to extract the fields that I wish to transform into an solr document. So it seems that there is no way of storing the document structure in solr as is? 2011

Re: Storing, indexing and searching XML documents in Solr

The data is being imported directly from mysql. The document is however indeed a good starting place. Thanks 2011/5/18 Yury Kats > On 5/18/2011 4:19 PM, Judioo wrote: > > > Any help is greatly appreciated. Pointers to documentation that address > my > > issues is even more helpful. > > I think t

Re: Storing, indexing and searching XML documents in Solr

On 5/18/2011 4:19 PM, Judioo wrote: > Any help is greatly appreciated. Pointers to documentation that address my > issues is even more helpful. I think this would be a good start: http://wiki.apache.org/solr/DataImportHandler#Usage_with_XML.2BAC8-HTTP_Datasource

Re: Replication Clarification Please

Alexander, sorry for the delay in replying. I wanted to test out a few hunches that I had before I get back to you. Hurray!!! I was able to resolve the issue. The problem was with the cache settings in the solrconfig.xml. It was taking almost 15-20 minutes to warm up the caches on each commit, as

Storing, indexing and searching XML documents in Solr

Hi, I'm new to solr so apologies if the solution is already documented. I have installed and populated a solr index using the examples as a template with a version of the data below. I have XML in the form of 123898-2092099098982 Blu-Ray 2011-05-05T11:25:35+0500

Re: Field collapsing on multiple fields and/or ranges?

Ahh, that's because you opened a Solr not a Lucene issue ;) The "modules" (incl. new grouping module) are under Lucene. That's fine, we can leave it as a Solr issue. Mike http://blog.mikemccandless.com On Wed, May 18, 2011 at 4:10 PM, arian487 wrote: > https://issues.apache.org/jira/browse/SO

Re: Field collapsing on multiple fields and/or ranges?

https://issues.apache.org/jira/browse/SOLR-2526 modules/grouping was not a valid component so I just put it in search. Thanks! -- View this message in context: http://lucene.472066.n3.nabble.com/Field-collapsing-on-multiple-fields-and-or-ranges-tp2929793p2958408.html Sent from the Solr - User m

Re: Field collapsing on multiple fields and/or ranges?

Start here: https://issues.apache.org/jira/browse/LUCENE Create an account (it's free), open an issue and set the component to "modules/grouping", fill in the fields, and submit it :) Then maybe make a patch and attach it! Genericizing the per-doc grouping key is important; we have an issue open

Re: Disable IDF scoring on certain fields

I believe I have applied the patch correctly. However, I cannot seem to figure out where the similarity class I create should reside. Any tips on that? Thanks, Brian Lamb On Tue, May 17, 2011 at 4:00 PM, Brian Lamb wrote: > Thank you Robert for pointing this out. This is not being used for > au

Re: Field collapsing on multiple fields and/or ranges?

Thanks for the reply! How exactly do I open an issue? -- View this message in context: http://lucene.472066.n3.nabble.com/Field-collapsing-on-multiple-fields-and-or-ranges-tp2929793p2958277.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Field collapsing on multiple fields and/or ranges?

As far as I know this is not possible today with either Solr's 4.0 grouping impl or the new grouping module (soon to be grouping in Solr 3.x). I'm not sure about the patch on SOLR-236 though. But it's an interesting use case; it's a compound group key, right? You want to group by a tuple (X, Y).

Re: Field collapsing on multiple fields and/or ranges?

bump -- View this message in context: http://lucene.472066.n3.nabble.com/Field-collapsing-on-multiple-fields-and-or-ranges-tp2929793p2958029.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: JSON delete error with latest branch_3x

Thanks Yonik, all my app's test cases now pass again. --Paul On Wed, May 18, 2011 at 2:04 PM, Yonik Seeley wrote: > OK, I just fixed this on branch_3x. > Trunk is fine (it was an error in the 3x backport that wasn't caught > because the test doesn't go through the complete solr stack to the > u

Re: JSON delete error with latest branch_3x

OK, I just fixed this on branch_3x. Trunk is fine (it was an error in the 3x backport that wasn't caught because the test doesn't go through the complete solr stack to the update handkler). -Yonik http://www.lucenerevolution.org -- Lucene/Solr User Conference, May 25-26, San Francisco On Wed, Ma

Re: Anyone familiar with Solandra or Lucandra?

This will be possible once triggers are finished for cassandra, then we can hook into CF inserts and auto index in solandra. On Tue, May 17, 2011 at 5:10 PM, kenf_nc wrote: > Ah. I see. That reduces its usefulness to me some. The multi-master aspect > is > still a big draw of course. But I was h

Re: JSON delete error with latest branch_3x

On Wed, May 18, 2011 at 1:24 PM, Paul Dlug wrote: > I updated to the latest branch_3x (r1124339) and I'm now getting the > error below when trying a delete by query or id. Adding documents with > the new format works as do the commit and optimize commands. Possible > regression due to SOLR-2496? >

JSON delete error with latest branch_3x

I updated to the latest branch_3x (r1124339) and I'm now getting the error below when trying a delete by query or id. Adding documents with the new format works as do the commit and optimize commands. Possible regression due to SOLR-2496? curl 'http://localhost:8988/solr/update/json?wt=json' -H 'C

Re: [POLL] How do you (like to) do logging with Solr

On 5/17/2011 10:00 AM, Chris Hostetter wrote: : If I understand what you've said above correctly, removing the binding in : solr.war would make it inherit the binding in jetty/tomcat/whatever, is that : right? That sounds like an awesome plan to me. The example jetty server can : be configured

Re: Does every Solr request-response require a running server?

On Wed, May 18, 2011 at 11:14 AM, Gabriele Kahlout wrote: > > > On Wed, May 18, 2011 at 5:09 PM, Yonik Seeley > wrote: >> >> On Wed, May 18, 2011 at 10:50 AM, Gabriele Kahlout >> wrote: >> > Hello, >> > >> > I'm wondering if Solr Test framework at the end of the day always runs >> > an >> > embe

Re: Set operations on multiple queries with different qf parameters

Don't know of any other documentation. There might be some minimal page on the wiki somewhere, but I can never find it either although I have some memory of seeing it once, it didn't have anything that the blog post didn't. I think 'mm' _should_ work as a LocalParam in a nested query, I use it

Re: Does every Solr request-response require a running server?

On Wed, May 18, 2011 at 5:09 PM, Yonik Seeley wrote: > On Wed, May 18, 2011 at 10:50 AM, Gabriele Kahlout > wrote: > > Hello, > > > > I'm wondering if Solr Test framework at the end of the day always runs an > > embedded/jetty server (which is the only way to interact with solr, i.e. > no > > web

Re: Does every Solr request-response require a running server?

On Wed, May 18, 2011 at 10:50 AM, Gabriele Kahlout wrote: > Hello, > > I'm wondering if Solr Test framework at the end of the day always runs an > embedded/jetty server (which is the only way to interact with solr, i.e. no > web server --> no solr) or in the tests they interact without one, callin

Re: lucene parser, negative OR operands

On 5/17/2011 8:00 PM, Yonik Seeley wrote: This doesn't have to do with Solr's support of pure-negative top-level queries, but does have to do with a long standing confusion of how the lucene queryparser works with some of the operators (i.e. not really boolean logic). In a Lucene BooleanQuery, c

Re: UIMA analysisEngine path

2011/5/17 chamara > Hi > My solr version is 3.1.0. I actually figured out what my problem was. I > used the guide > > https://svn.apache.org/repos/asf/lucene/dev/trunk/solr/contrib/uima/README.txt > and > it seems that i have placed the code snippet inside an another xml element > not under conf

Does every Solr request-response require a running server?

Hello, I'm wondering if Solr Test framework at the end of the day always runs an embedded/jetty server (which is the only way to interact with solr, i.e. no web server --> no solr) or in the tests they interact without one, calling directly the under line methods? The latter seems to be the case

Re: Exact match

There's a JIRA issue assigned to this feature: https://issues.apache.org/jira/browse/SOLR-1980 However, it's not yet implemented. Anyone? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com On 17. mai 2011, at 15.51, Alex Grilo wrote: > Hi, > > Can I make a query that re

Re: I need an available solr lucene consultant

I am interested in hearing more about this opportunity. Feel free to contact me at b...@csrinstitute.net. Thanks Bill -- View this message in context: http://lucene.472066.n3.nabble.com/I-need-an-available-solr-lucene-consultant-tp2954023p2957137.html Sent from the Solr - User mailing list arc

Re: Anyone having these Replication issues as well?

Thanks Markus, for your patience with getting the response in as well the comments. This is my Dev environment, I'm actually going to be setting up a new master-slave configuration in a different environment today. I'll see if it's environment specific or not. One thing I didn't mention, wasn't su

Re: I need to improve highlighting

yeah but you just got me to check again, what I thought was ignoring my setting of hl.fragsize and always using the default ended up just returning a smaller field higher ranked, so when I set it to 1000 and saw the same as what I saw with 100 was the just the off chance that there was only 100 to

Re: I need to improve highlighting

Just checking, but have you tried setting hl.fragsize= as suggested here: http://wiki.apache.org/solr/HighlightingParameters#hl.fragsize ? If that's not the problem, please show us the results of attaching &debugQuery=on to the request, that may shed some light on the problem. Best Erick On Wed

Re: I need to improve highlighting

> Bryan, on Q2 - what about using xpath like 'str/em' ? How do I do that? The highlighting result, at least in the solr installation I have (3. something) returns the em as escaped markup. Is there an xpath parameter or configuration I can set for highlighting, or a way to change the elements to

Re: how to work cache and improve performance phrase query included wildcard

See below: On Wed, May 18, 2011 at 8:15 AM, Jason, Kim wrote: > Hi, all > > I have two questions. > First, > I'm wondering how filterCache, queryResultCache, documentCache are applied. > After searching query1  OR query2 OR query3 ... , I searched query0  OR > query2 OR query3 ... . > Just query1

Re: I need to improve highlighting

Bryan, on Q2 - what about using xpath like 'str/em' ? Regards Stefan On Wed, May 18, 2011 at 2:25 PM, bryan rasmussen wrote: > Hi, > > If I do a search > http://localhost:8983/solr/tester/select/?q=kongeriget&hl=true then in > the subtree I get > > - > > Aftale mellem kongeriget Danmark og ko

Re: sorting on date field in facet query

Can you provide an example of what you are trying to do? Are you referring to ordering the result set or the facet information? Best Erick On Wed, May 18, 2011 at 7:21 AM, Dmitry Kan wrote: > Hello list, > > Is it possible to sort on date field in a facet query in SOLR 3.1? > > -- > Regards, > >

Re: How to test Solr Integartion - how to get EmbeddedSolrServer?

You've probably seen this page: http://wiki.apache.org/solr/HowToContribute, but here it is for reference Go ahead and open a JIRA at https://issues.apache.org/jira/browse/SOLR (you need to create an account) and attach your changes as a patch. That gets it into the system and folks can start

I need to improve highlighting

Hi, If I do a search http://localhost:8983/solr/tester/select/?q=kongeriget&hl=true then in the subtree I get − Aftale mellem kongeriget Danmark og kongeriget Sverige What I need to do is to either 1. Return all of all_text which should be possible by setting hl.fragsize=0 but I still ne

Re: Updating a multi-valued field

Nope. If you're replacing any field of an indexed document it's really a delete/add. Best Erick On Wed, May 18, 2011 at 2:45 AM, karanveer singh wrote: > I've been using ExternalFileField for external scoring so far, so that > the external field gets "updated" and not "deleted and added" > > Now

how to work cache and improve performance phrase query included wildcard

Hi, all I have two questions. First, I'm wondering how filterCache, queryResultCache, documentCache are applied. After searching query1 OR query2 OR query3 ... , I searched query0 OR query2 OR query3 ... . Just query1 and query0 are difference. But query time was not fast. When are the caches ap

Re: How to list/see all the indexed terms of a particular field in a document?

Gnanam, have a look to http://wiki.apache.org/solr/LukeRequestHandler Regards Stefan On Wed, May 18, 2011 at 1:30 PM, Gnanakumar wrote: > So this cannot be queried/listed using Apache Solr? > > -Original Message- > From: Gabriele Kahlout [mailto:gabri...@mysimpatico.com] > Sent: Wednesd

Re: Using solandra

Karan, this data-import script is made especially for importing the demo-data. To index xml documents (like you'd do it normally w/ solr) use for example http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/example/exampledocs/post.sh - and don't forget to adjust the URL, according to your soland

RE: How to list/see all the indexed terms of a particular field in a document?

So this cannot be queried/listed using Apache Solr? -Original Message- From: Gabriele Kahlout [mailto:gabri...@mysimpatico.com] Sent: Wednesday, May 18, 2011 3:36 PM To: solr-user@lucene.apache.org; gna...@zoniac.com Subject: Re: How to list/see all the indexed terms of a particular field

Re: Using solandra

Thanks Stefan! I got it started. Also, is there a way to import xml documents? When I run 2-import-data.sh with only xml documents in the data directory, it gives me the following : Loading data to solandra, note: this importer uses a slow xml parser Exception in thread "main" java.lang.RuntimeEx

sorting on date field in facet query

Hello list, Is it possible to sort on date field in a facet query in SOLR 3.1? -- Regards, Dmitry Kan

Re: Using solandra

Karan, following the Readme (https://github.com/tjake/Solandra#readme) it's: >From the Solandra base directory: $ mkdir /tmp/cassandra-data $ ant $ cd solandra-app $ ./start-solandra.sh Regards Stefan On Wed, May 18, 2011 at 12:40 PM, karanveer singh wrote: > I've recently switched from solr+c

Using solandra

I've recently switched from solr+cassandra to solandra. When I try to run solandra using java -jar start.jar in solandra-app, it gives me the following error: java.lang.ExceptionInInitializerError at lucandra.CassandraUtils.startupServer(CassandraUtils.java:249) at solandra.SolandraInitializer.i

Re: How to list/see all the indexed terms of a particular field in a document?

ant luke? On Wed, May 18, 2011 at 11:47 AM, Gnanakumar wrote: > Hi, > > I'm using Apache Solr v3.1. > > How do I list/get to see all the indexed terms of a particular field in a > document (by passing Unique Key ID of the document)? > > For example, I've the following "field" definition in schem

How to list/see all the indexed terms of a particular field in a document?

Hi, I'm using Apache Solr v3.1. How do I list/get to see all the indexed terms of a particular field in a document (by passing Unique Key ID of the document)? For example, I've the following "field" definition in schema.xml: In this case, I expect/want to list/see all the indexed terms of a

Re: How to test Solr Integartion - how to get EmbeddedSolrServer?

Thinking more about it, I can solve my immediate problem by just copy-pasting the classes I need into my own project packages (KISS like here ). I'd however suggest to refactor Solr code structure to be much more defaults-compliant making it easier fo

Re: filter cache and negative filter query

Mmm... I had wondered whether solr reused filters this way (not having both the positive and negative versions) and I'm glad to see it does indeed reuse them. What I don't like is that it systematically uses the positive version. Sometimes the negative version will give many less results (for exa

questions about request logging

Dear list, the poll about solr logging directed my interest to my log files. Right out of the box the jetty request logs have all information needed for the GET requests but only the path of POST requests. Is it possible to have the POST requests logged the same way the GET requests are logged?

Re: solr/home property seting

Why you have putted your solr home inside the Tomcat's webapps directory. This is not the correct way.Put your Solr home somewhere other place outside the servlet container and set your solr/home path accordingly as solr/home /opt/solr/home java.lang.String - Th