DIH load only selected documents with XPathEntityProcessor

2011-01-06 Thread Bernd Fehling
Hello list, is it possible to load only selected documents with XPathEntityProcessor? While loading docs I want to drop/skip/ignore documents with missing URL. Example: first title identifier_01 http://www.foo.com/path/bar.html second title

Re: DataImportHanlder - Multiple entities will step into each other

2011-01-06 Thread Matti Oinas
Forgot to mention that delete works fine with TemplateTransformer when you are using it to create unique values for uniqueid field in solr and that same field is defined as pk in data config. schema.xml .. uuid data-config.xml .. DIH performs delete by getting value from field de

Re: DataImportHanlder - Multiple entities will step into each other

2011-01-06 Thread Matti Oinas
Concat doesn't work as expected. Doing SELECT concat('blog-',id) as uuid instead of template transformer the uuid in the index would be something like [...@d760bb instead of blog-1 I haven't tested if DIH can perform delete when using concat but at least you can not delete by uuid from any

Re: schema.xml in other than conf folder

2011-01-06 Thread Shanmugavel SRD
Erick, Thanks for your response. Our production environment is a read only file system. It is not allowing to modify or create new files under conf folder at runtime. So copy config through replication is not working for us. Thanks, SRD -- View this message in context: http://lucene.472066.n3.

Re: Will Result Grouping return documents that don't contain the specified "group.field"?

2011-01-06 Thread Yonik Seeley
On Thu, Jan 6, 2011 at 5:55 PM, Andy wrote: > So by default Solr will not return documents that don't contain the specified > group.field? Solr will. Documents without a value for that field should be grouped under the "null" value. -Yonik http://www.lucidimagination.com

Re: Will Result Grouping return documents that don't contain the specified "group.field"?

2011-01-06 Thread Andy
Is there anyway to configure Solr such that: 1) Documents that contain the specified "group.field" will be returned and grouped by "group.field", AND 2) Documents that don't contain the specified "group.field" will just be returned as "normal" search results without any grouping Any way to achi

Re: Will Result Grouping return documents that don't contain the specified "group.field"?

2011-01-06 Thread Erick Erickson
Correct. Given the fact that Solr only requires fields in documents where required="true", how could it? The behavior of "just put everything in a bucket that doesn't have field X" would produce some "interesting" results Best Erick On Thu, Jan 6, 2011 at 5:55 PM, Andy wrote: > So by defaul

Re: schema.xml in other than conf folder

2011-01-06 Thread Erick Erickson
Why do you want to do this? What is the use case? There is already a provision for copying modified slave configurations from the master and renaming it in the process, would that suffice? Best Erick On Thu, Jan 6, 2011 at 11:37 AM, Shanmugavel SRD wrote: > > I want to place the schema.xml in a

Re: forward slash not working in my solr search

2011-01-06 Thread Erick Erickson
String type is unanalyzed. So what you put in the index better be exactly what you query for, capitalization, spaces (internal and leading and trailing etc). So you are NOT searching the exact same thing, the spaces are different. String type is quite literal, and exact means exact. You really ha

RE: Will Result Grouping return documents that don't contain the specified "group.field"?

2011-01-06 Thread Andy
So by default Solr will not return documents that don't contain the specified group.field? --- On Thu, 1/6/11, Bob Sandiford wrote: > From: Bob Sandiford > Subject: RE: Will Result Grouping return documents that don't contain the > specified "group.field"? > To: "solr-user@lucene.apache.org"

RE: Will Result Grouping return documents that don't contain the specified "group.field"?

2011-01-06 Thread Bob Sandiford
What if you put in a default value for the group_id field in the solr schema - would that work for you? e.g. something like 'unknown' Then you'll get all those with no original group_id value still grouped together, and you can figure out at display time what you want to do with them. Bob San

solrconfig luceneMatchVersion 2.9.3

2011-01-06 Thread Johannes Goll
Hi, our index files have been created using Lucene 2.9.3 and solr 1.4.1. I am trying to use a patched version of the current trunk (solr 1.5.0 ? ). The patched version works fine with newly generated index data but not with our existing data: After adjusting the solrconfig.xml - I added the lin

Will Result Grouping return documents that don't contain the specified "group.field"?

2011-01-06 Thread Andy
I want to group my results by a field named "group_id". However, some of my documents don't contain the field "group_id". But I still want these documents to be returned as part of the results as long as they match the main query "q". Do I need to do anything to tell Solr that I want those doc

Re: solr on third party hosting account throws java.lang.RuntimeException: Cannot create directory: /usr/local/tomcat/a

2011-01-06 Thread Darniz
Ok got it The problem was very simple, thanks to post i just have to comment the following line in solrconfig.xml ${solr.data.dir:./solr/data} and that seems to do the trick Thanks guys -- View this message in context: http://lucene.472066.n3.nabble.com/solr-on-third-party-hosting-account-t

Re: Including Small Amounts of New Data in Searches (MultiSearcher ?)

2011-01-06 Thread Stephen Boesch
Thanks Yonik, Using a stable release of Solr what would you suggest to do - given MultiSearch's demise and the other work is still ongoing? 2011/1/6 Yonik Seeley > On Thu, Jan 6, 2011 at 12:37 PM, Stephen Boesch wrote: > > Solr/lucene newbie here .. > > > > We would like searches against a so

Re: solr on third party hosting account throws java.lang.RuntimeException: Cannot create directory: /usr/local/tomcat/a

2011-01-06 Thread Darniz
Thanks thats the bottle neck i am strugging with. i have configured the jndi lookup for solr home many times on my pc no issues, but just a bit clueless on how to go with a remote machine. here is te exact snipped i have in my web.xml please have a look and tell me is there something wrong with

Re: Including Small Amounts of New Data in Searches (MultiSearcher ?)

2011-01-06 Thread Yonik Seeley
On Thu, Jan 6, 2011 at 12:37 PM, Stephen Boesch wrote: > Solr/lucene newbie here .. > > We would like searches against a solr/lucene index to immediately be able to > view data that was added.  I stress "small" amount of new data given that > any significant amount would require excessive  latency

Including Small Amounts of New Data in Searches (MultiSearcher ?)

2011-01-06 Thread Stephen Boesch
Solr/lucene newbie here .. We would like searches against a solr/lucene index to immediately be able to view data that was added. I stress "small" amount of new data given that any significant amount would require excessive latency. Looking around, i'm wondering if the direction would be a Mult

Re: Fuzzy search and field weighting/boosting

2011-01-06 Thread lazymanc
Wow, a fast response and exactly what I needed, much appreciated! No doubt they'll be more questions to follow over the coming weeks, cheers :) -- View this message in context: http://lucene.472066.n3.nabble.com/Fuzzy-search-and-field-weighting-boosting-tp2206091p2206738.html Sent from the Solr

Re: utf-8 tomcat and solr problem

2011-01-06 Thread Yonik Seeley
On Thu, Jan 6, 2011 at 2:23 AM, Julian Hille wrote: > Hi, > > if i search for a german umlaut like ä or ö i get something like weird > conversions from latin to utf in query response. The encoding of the result > is ok, > but not the "you queried for this" part. There is my "ä" wrong encoded.  

Re: Fuzzy search and field weighting/boosting

2011-01-06 Thread Ahmet Arslan
--- On Thu, 1/6/11, lazymanc wrote: > From: lazymanc > Subject: Fuzzy search and field weighting/boosting > To: solr-user@lucene.apache.org > Date: Thursday, January 6, 2011, 5:12 PM > > I'm completely new to this but I've managed to set up a > Solr instance that is > pulling data from a MySql

schema.xml in other than conf folder

2011-01-06 Thread Shanmugavel SRD
I want to place the schema.xml in a place other than conf folder. Is it possible? This is as part of master and slave configuration. I want to place all the files which will be common between master and slave in a particular location. Can anyone help me on this? -- View this message in context:

Re: search terms as substring of query

2011-01-06 Thread Ahmet Arslan
--- On Thu, 1/6/11, Amdebirhan, Samson, VF-Group wrote: > From: Amdebirhan, Samson, VF-Group > Subject: search terms as substring of query > To: solr-user@lucene.apache.org > Date: Thursday, January 6, 2011, 5:41 PM > Hi all, > > > > I'm configuring  solr to index some documents. > > >

utf-8 tomcat and solr problem

2011-01-06 Thread Julian Hille
Hi, if i search for a german umlaut like ä or ö i get something like weird conversions from latin to utf in query response. The encoding of the result is ok, but not the "you queried for this" part. There is my "ä" wrong encoded. There it seems like it had been interpreted from latin to utf 8.

Re: Define your own function query

2011-01-06 Thread Ahmet Arslan
>    I would like to know if it is possible to > define your own function query > (like a plugin, instead of the already defined ones in > here) > that I could later on use as insde "bf"? If so which is the > class That I am > supposed to extend? http://w

Define your own function query

2011-01-06 Thread dante stroe
Hello, I would like to know if it is possible to define your own function query (like a plugin, instead of the already defined ones in here) that I could later on use as insde "bf"? If so which is the class That I am supposed to extend? thank you, Dan

RE: (FQ) Filter Query Caching Differences with OR and AND?

2011-01-06 Thread Em
Jonathan I think you are right. A parser should not know anything about internal caching etc. However, I can imagine that this could probably become a SearchComponent (as far as I know SearchComponents can use the filterCache) that manages its own filterCache. With an own component we may provi

search terms as substring of query

2011-01-06 Thread Amdebirhan, Samson, VF-Group
Hi all, I'm configuring solr to index some documents. I index these fields: aaa/1.0/sample-1 When I search for 'aaa/1.0/sample-1word' or 'wordaaa/1.0/sample-1' solr doesn't find any document. If I search for 'aaa/1.0/sample-1' or a substring of 'aaa/1.0/sample-1' I obviously g

Re: [Solr4.0] Release Date

2011-01-06 Thread Mattmann, Chris A (388J)
Hey Adam, The Solr/Lucene people decided that with versions post the Solr/Lucene merge that they would sync the Solr version with the Lucene version (meaning there is no 1.5 release or plans for it, which IMHO as I noted before is confusing). Here's a pointer to a former discussion thread about

Fuzzy search and field weighting/boosting

2011-01-06 Thread lazymanc
I'm completely new to this but I've managed to set up a Solr instance that is pulling data from a MySql database. The records are "artists" (e.g. bands, performers, musicians, etc) with the following schema: id text This was based on the example sche

Re: Searching similar values for same field results in different results

2011-01-06 Thread PeterKerk
That was it! thanks! -- View this message in context: http://lucene.472066.n3.nabble.com/Searching-similar-values-for-same-field-results-in-different-results-tp2199269p2206087.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Searching similar values for same field results in different results

2011-01-06 Thread Juan Grande
You have a problem with the analysis chain. When you do a query, the EnglishPorterFilter is cutting off the last part of your word, but you're not doing the same when indexing. I think that removing that filter from the chain will solve your problem. Remember that there are two different analysis

Re: [Solr4.0] Release Date

2011-01-06 Thread Robert Muir
On Thu, Jan 6, 2011 at 9:20 AM, Estrada Groups wrote: > Thanks Grant! Ridiculous question #2. What is the difference between 3.1 and > 4.0? I am very confused about this... > Hopefully this will help: 3.1 is a minor release from Lucene 3.0. It contains new features and API stability from Lucene

RE: (FQ) Filter Query Caching Differences with OR and AND?

2011-01-06 Thread Jonathan Rochkind
Disclaimer: I am not actually familiar with the solr code, all of the below is extrapolation from being pretty familiar with Solr's behavior. Yeah, it would be nice, but it would be a lot harder to code for solr. Right now, the thing putting and retrieving entries into/from the filter cache

Re: [Solr4.0] Release Date

2011-01-06 Thread Estrada Groups
Thanks Grant! Ridiculous question #2. What is the difference between 3.1 and 4.0? I am very confused about this... Adam Sent from my iPhone On Jan 6, 2011, at 8:15 AM, Grant Ingersoll wrote: > I think 3.1 will be next, but I don't see a date yet. I would hope sometime > soon, but I haven't

Re: Searching similar values for same field results in different results

2011-01-06 Thread PeterKerk
@iorixxx: I ran: http://localhost:8983/solr/db/update/?optimize=true This is the response: 0 58 Then I ran: http://localhost:8983/solr/db/select/?indent=on&facet=on&q=*:*&facet.field=themes_raw This is response: 366

Re: Sorting within grouped results?

2011-01-06 Thread Juan Grande
Did you try adding the parameter "group.sort=popularity+desc" to the URL? I think that's what you want, according to http://wiki.apache.org/solr/FieldCollapsing. Good luck Juan Grande On Thu, Jan 6, 2011 at 3:30 AM, Andy wrote: > I want to group my results by a field named "group_id". > > Acco

Re: [Solr4.0] Release Date

2011-01-06 Thread Grant Ingersoll
I think 3.1 will be next, but I don't see a date yet. I would hope sometime soon, but I haven't checked the outstanding issues recently. On Jan 5, 2011, at 11:36 PM, Adam Estrada wrote: > I know this is a bit premature but does anyone have an anticipated release > date for Solr4.0? I looked at

Re: forward slash not working in my solr search

2011-01-06 Thread Grijesh.singh
use as pharase it will work like "Computer / IT" for you Here IT is a stopword when you are trying query as category:Computer / IT parsed as category:Computer :IT but IT is a stopword for default search field what you have selected so second query removed and only category:Computer is showing

Re: forward slash not working in my solr search

2011-01-06 Thread dhanesh
On 1/6/2011 2:06 PM, Grijesh.singh wrote: check with debugQuery=on and also with analysis.jsp ,what happening with your query term and indexed terms. - Grijesh When I debug the query, I got the parsedquery as category:Computer Here is debugged output category:Computer / IT category:Comp

Re: get score value

2011-01-06 Thread Grijesh.singh
add parameter fl=*,score with your query url, It will return all fields with score of every document - Grijesh -- View this message in context: http://lucene.472066.n3.nabble.com/get-score-value-tp2204353p2204458.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: forward slash not working in my solr search

2011-01-06 Thread Grijesh.singh
check with debugQuery=on and also with analysis.jsp ,what happening with your query term and indexed terms. - Grijesh -- View this message in context: http://lucene.472066.n3.nabble.com/forward-slash-not-working-in-my-solr-search-tp2204326p2204436.html Sent from the Solr - User mailing list

Re: (FQ) Filter Query Caching Differences with OR and AND?

2011-01-06 Thread Em
By SUBTRACT you mean: Add those docs that apply to fq1 or fq2 but not to fq1 AND fq2 (those, that apply to one of these fqs but not to both)? Lance Norskog-2 wrote: > > AND/OR/NOT/SUBTRACT combinations for filters would certainly be a > useful feature. > > On Wed, Jan 5, 2011 at 11:36 PM, Em

Re: forward slash not working in my solr search

2011-01-06 Thread dhanesh
On 1/6/2011 1:37 PM, Grijesh.singh wrote: First you have to check that your indexing process can cause of removing the whitespace - Grijesh While indexing to server I added the category as 'Computer / IT', but when I search with same keyword I am not getting any result. But when I changed t

Re: forward slash not working in my solr search

2011-01-06 Thread Grijesh.singh
First you have to check that your indexing process can cause of removing the whitespace - Grijesh -- View this message in context: http://lucene.472066.n3.nabble.com/forward-slash-not-working-in-my-solr-search-tp2204326p2204336.html Sent from the Solr - User mailing list archive at Nabble.c

forward slash not working in my solr search

2011-01-06 Thread dhanesh
Hi, Can anybody help me to sort out an issue of forward slash in solr search . I've a category combo box and I'm searching based on the category. Everything working fine except forward slash My category is "Computer / IT" and its not showing the result. But when I removed the leading and triali