Re: SolrCloud questions

2011-06-10 Thread Upayavira
Mohammad, There are two sides to using SolrCloud in production - the SolrCloud code, and the Solr 4.0 code that it is a part of. You can reduce the risk of being caught out by Solr/Lucene 4.0 changes (e.g. index structure changes) by using a Lucene 3.0 index format within Solr 4.0. While there's

WordDelimiter and stemEnglishPossessive doesn't work

2011-06-10 Thread roySolr
Hello, I have some problem with the wordDelimiter. My data looks like this: mcdonald's#burgerking#Free record shop#h&m I want to tokenize this on #. After that it has to split on whitespace. I use the wordDelimiter for that(can't use 2 tokenizers) Now this works but there is one problem, it rem

getTransformer error

2011-06-10 Thread bryan rasmussen
Hi, I am trying to transforrm the results using xslt - I store my xslts in conf/xslt/ I call them in the querystring with the parameters &wt=xslt&tr=result.xsl And get back an error: getTransformer fails in getContentType java.lang.RuntimeException: getTransformer fails in getContentType ...

Re: how can I return function results in my query?

2011-06-10 Thread Jason Toy
Ahmet, that doesnt return the idf data in my results, unless I am doing something wrong. When you run any function you get the results of the function back? Can you show me an example query you run ? //http://wiki.apache.org/solr/FunctionQuery#idf On Thu, Jun 9, 2011 at 9:23 AM, Jason Toy

Re: how can I return function results in my query?

2011-06-10 Thread Markus Jelsma
Ah, function results are not returned in the result set. You must either use debugQuery to get the value or the TermVectorComponent to get idf for existing terms. > Ahmet, that doesnt return the idf data in my results, unless I am > doing something wrong. When you run any function you get the r

replication/search on separate LANs

2011-06-10 Thread dan sutton
Hi All, I'm wondering if anyone had experience on replicating and searching over separate LANs? currently we do both over the same one. So each slave would have 2 Ethernet cards, 1/LAN and the master just one. We're currently building and replicating a daily index, this is quite large about 15M

Re: getTransformer error

2011-06-10 Thread bryan rasmussen
Ok I guess it is nonetheless a stylesheet problem, as a basic hello world outputting stylesheet works. thanks, Bryan Rasmussen On Fri, Jun 10, 2011 at 10:12 AM, bryan rasmussen wrote: > Hi, > I am trying to transforrm the results using xslt - I store my xslts in > conf/xslt/ > > I call them in t

Re: how can I return function results in my query?

2011-06-10 Thread Jason Toy
Markus, Thanks for this info, I'll use debugQuery to test for now. It seems strange that I can't have arbitrary function results returned with my data. Is this an obstacle on the lucene or solr side? Jason On Fri, Jun 10, 2011 at 5:59 AM, Markus Jelsma wrote: > Ah, function results are not ret

Re: how can I return function results in my query?

2011-06-10 Thread Markus Jelsma
Jason, Solr cannot add results of functions to the resultset for now. I don't know about a ticket (but i'd think there is one) but it's also highly desired in returning distances in spatial queries. Check Jira if you need to know more. Take care, debugQuery can add significant delay. If you nee

Re: how can I return function results in my query?

2011-06-10 Thread Yonik Seeley
On Thu, Jun 9, 2011 at 9:23 AM, Jason Toy wrote: > I want to be able to run a query  like idf(text, 'term') and have that data > returned with my search results.  I've searched the docs,but I'm unable to > find how to do it.  Is this possible and how can I do that ? In trunk, there's a very new f

Re: how can I return function results in my query?

2011-06-10 Thread Ahmet Arslan
> Ahmet, that doesnt return the idf > data in my results, unless I am > doing something wrong.  When you run any function you > get the results > of the function back? I have never used Relevance Functions but there is an example [1] in the wiki where result of the function query is reflected int

Re: how can I return function results in my query?

2011-06-10 Thread Markus Jelsma
Nice! Will SOLR-1298 with aliasing also work with an external file field since that can be a source of a function query as well? > On Thu, Jun 9, 2011 at 9:23 AM, Jason Toy wrote: > > I want to be able to run a query like idf(text, 'term') and have that > > data returned with my search results.

Re: how can I return function results in my query?

2011-06-10 Thread Yonik Seeley
On Fri, Jun 10, 2011 at 8:31 AM, Markus Jelsma wrote: > Nice! Will SOLR-1298 with aliasing also work with an external file field since > that can be a source of a function query as well? Haven't tried it, but it definitely should! -Yonik http://www.lucidimagination.com

Re: Processing/Indexing CSV

2011-06-10 Thread Erick Erickson
Well, here's a place to start if you want to patch the code: http://wiki.apache.org/solr/HowToContribute If you do want to take this on, hop on over to the dev list and start a discussion. I'd start with some posts on that list before entering or working on a JIRA issue, just ask for some guidanc

Re: how to Index and Search non-Eglish Text in solr

2011-06-10 Thread Erick Erickson
Well, no. Specifying both indexed and stored as "false" is essentially a no-op, you'd never find anything! But even with indexed="true", this solution has problems. It's essentially using a single field to store text from different languages. The problem is that tokenization, stemming etc. behaves

Re: WordDelimiter and stemEnglishPossessive doesn't work

2011-06-10 Thread Erick Erickson
Hmmm, that is confusing. the stemEnglishPossessive=0 actually leaves the 's' in the index, just not attached to the word. The admin/analysis page can help show this Setting it equal to 1 removes it entirely from the stream. If you set catenateWords=1, you'll get "mcdonalds" in your index if s

Re: Processing/Indexing CSV

2011-06-10 Thread Helmut Hoffer von Ankershoffen
Hi, thanks for the Intro, will do next week :-) greetings from berlin On Fri, Jun 10, 2011 at 2:49 PM, Erick Erickson wrote: > Well, here's a place to start if you want to patch the code: > > http://wiki.apache.org/solr/HowToContribute > > If you do want to take this on, hop on over to the dev

Getting all field names in a Solr index via SolrJ

2011-06-10 Thread Public Network Services
Hi... I would like to get a list of all field names in a Solr index, much like the web admin can list all these fields in Schema Browser. It sounds trivial, but still looking around as to how it would best be implemented. If I run a query with the wildcard string ("*:*"), not all field names are

Re: Getting all field names in a Solr index via SolrJ

2011-06-10 Thread Stefan Matheis
If you really want to have _all_ defined (and therefore possible fields) you should have a look to http://wiki.apache.org/solr/LukeRequestHandler Regards Stefan On Fri, Jun 10, 2011 at 5:48 PM, Public Network Services wrote: > Hi... > > I would like to get a list of all field names in a Solr ind

Re: Getting all field names in a Solr index via SolrJ

2011-06-10 Thread Public Network Services
Sure, but how does the web admin do it without Luke? On Fri, Jun 10, 2011 at 6:53 PM, Stefan Matheis < matheis.ste...@googlemail.com> wrote: > If you really want to have _all_ defined (and therefore possible > fields) you should have a look to > http://wiki.apache.org/solr/LukeRequestHandler > >

Re: wildcard search

2011-06-10 Thread Thomas Fischer
Hi Ahmet, >>> I don't use it myself (but I will soon), so I >>> may be wrong, but did you try >>> to use the ComplexPhraseQueryParser : >>> >>> ComplexPhraseQueryParser >>> QueryParser which >>> permits complex phrase query syntax eg "(john >>> jon jonathan~) peters*". >>> >>> It seem

Re: Default query parser operator

2011-06-10 Thread Brian Lamb
It could, it would be a little bit clunky but that's the direction I'm heading. On Tue, Jun 7, 2011 at 6:05 PM, lee carroll wrote: > Hi Brian could your front end app do this field query logic? > > (assuming you have an app in front of solr) > > > > On 7 June 2011 18:53, Jonathan Rochkind wrote:

Document has fields with different update frequencies: how best to model

2011-06-10 Thread lee carroll
Hi, We have a document type which has fields which are pretty static. Say they change once every 6 month. But the same document has a field which changes hourly What are the best approaches to index this document ? Eg Hotel ID (static) , Hotel Description (static and costly to get from a url etc),

FastVectorHighlighter and hl.fragsize parameter set to zero causes exception

2011-06-10 Thread Burton-West, Tom
According to the documentation on the Solr wiki page, setting the hl.fragsize parameter to "0" indicates that the whole field value should be used (no fragmenting). However the FastVectorHighlighter throws an exception message fragCharSize(0) is too small. It must be 18 or higher. java.lang.

Re: Getting all field names in a Solr index via SolrJ

2011-06-10 Thread Ahmet Arslan
> Sure, but how does the web admin do > it without Luke? admin/analysis.jsp uses luke too.

Heads Up - Index File Format Change on Trunk

2011-06-10 Thread Simon Willnauer
Hey folks, I just committed LUCENE-3108 (Landing DocValues on Trunk) which adds a byte to FieldInfo. If you are running on trunk you must / should re-index any trunk indexes once you update to the latest trunk. its likely if you open up old trunk (4.0) indexes, you will get an exception related t

Re: Getting all field names in a Solr index via SolrJ

2011-06-10 Thread Erick Erickson
note the URL above (esp LukeRequestHandler). Best Erick On Fri, Jun 10, 2011 at 12:04 PM, Public Network Services wrote: > Sure, but how does the web admin do it without Luke? > > > On Fri, Jun 10, 2011 at 6:53 PM, Stefan Matheis < > matheis.ste...@googlemail.com> wrote: > >> If you really want

Re: wildcard search

2011-06-10 Thread Ahmet Arslan
> I tried to follow this recipe, adapting it to the solr 3.2 > I am testing right now. > The first try gave me a message > >      [java] !!! Couldn't get > license file for > /Installer/solr/apache-solr-3.2.0/solr/lib/ComplexPhrase-1.0.jar >      [java] At least one file does not > have a lice

Re: Getting all field names in a Solr index via SolrJ

2011-06-10 Thread Ahmet Arslan
> > Sure, but how does the web admin do > > it without Luke? > > admin/analysis.jsp uses luke too. > Sorry I wrote it wrong. I was referring /admin/schema.jsp

Re: Document has fields with different update frequencies: how best to model

2011-06-10 Thread Jay Luker
Take a look at ExternalFileField [1]. It's meant for exactly what you want to do here. FYI, there is an issue with caching of the external values introduced in v1.4 but, thankfully, resolved in v3.2 [2] --jay [1] http://lucene.apache.org/solr/api/org/apache/solr/schema/ExternalFileField.html [2

FYI: How to build and start Apache Solr admin app from source with Maven

2011-06-10 Thread Way Cool
Hi, guys, FYI: Here is the link to how to build and start Apache Solr admin app from source with Maven just in case you might be interested: http://thetechietutorials.blogspot.com/2011/06/how-to-build-and-start-apache-solr.html Have fun. YH

Re: Getting all field names in a Solr index via SolrJ

2011-06-10 Thread Public Network Services
Yes. So the consensus is that it can only be done via Luke. I would expect it to be easier than that. Thanks! On Fri, Jun 10, 2011 at 9:05 PM, Ahmet Arslan wrote: > > > Sure, but how does the web admin do > > > it without Luke? > > > > admin/analysis.jsp uses luke too. > > > > Sorry I wrote it

Re: Getting all field names in a Solr index via SolrJ

2011-06-10 Thread Ahmet Arslan
> Yes. So the consensus is that it can > only be done via Luke. I would expect > it to be easier than that. If you use &numTerms=0 things will be fast. By the way if you dont care about dynamic fields, you can extract field names from schema.xml too (via ShowFileRequestHandler)

Re: Getting all field names in a Solr index via SolrJ

2011-06-10 Thread Public Network Services
I do need all the fields, including the dynamic ones. Thanks very much for all he advice. On Fri, Jun 10, 2011 at 10:58 PM, Ahmet Arslan wrote: > > > Yes. So the consensus is that it can > > only be done via Luke. I would expect > > it to be easier than that. > > If you use &numTerms=0 things

Re: FastVectorHighlighter and hl.fragsize parameter set to zero causes exception

2011-06-10 Thread Koji Sekiguchi
Hi Tom, (11/06/11 2:01), Burton-West, Tom wrote: According to the documentation on the Solr wiki page, setting the hl.fragsize parameter to "0" indicates that the whole field value should be used (no fragmenting). However the FastVectorHighlighter throws an exception message fragCharSize(0

Re: AW: How to deal with many files using solr external file field

2011-06-10 Thread Chris Hostetter
: We took a deeper look at what happened, when an "external-file-field"-Request is sent to SOLR: : : * SOLR looks if there is a file for the requested query, e.g. "trousers" Something smells fishy here. ExternalFileField is designed to let you load values for a field (for use in functions) fr

Re: Getting all field names in a Solr index via SolrJ

2011-06-10 Thread Chris Hostetter
: Yes. So the consensus is that it can only be done via Luke. I would expect : it to be easier than that. Luke != LukeRequestHandler LukeRequestHandler is built into solr, and is *exactly* how the web ui of Solr lists all the fields. http://wiki.apache.org/solr/LukeRequestHandler -Hoss

Problem with DictionaryCompoundWordTokenFilterFactory in Solr 3.2

2011-06-10 Thread Bernhard Schulz
Hello everybody! I am facing a problem with Solr's DictionaryCompoundWordTokenFilterFactory and hope you have some advice for me. I am using the latest version Solr 3.2. (Had the same problem with Solr 3.1) In the schema, I am using the settings like Now, when I am analyzing the word "leders

Solr Cloud shard shutdown problem

2011-06-10 Thread Jamie Johnson
When I am running multiple solr instances setup in a sharded implementation I am noticing that if I shut down 1 of the shards I get the following message when a query is executed: HTTP ERROR 503 Problem accessing /solr/select/. Reason: no servers hosting shard: -