Re: Is SOLR best suited to this application - Finding co-ordinates

2012-08-01 Thread Spadez
Normalising the data is a good idea, and it would be easy to do since I would only have around 50,000 entires BUT it is a bit complicated with addresses I think. Lets say I store the data in this form: London, England Swindon, Wiltshire, England Wiltshire England England What happens if someone

Re: Solr upgrade from 1.4 to 3.6

2012-08-01 Thread Chantal Ackermann
Hi Kalyan, that is becouse SolrJ uses "javabin" as format which has class version numbers in the serialized objects that do not match. Set the format to XML ("wt" parameter) and it will work (maybe JSON would, as well). Chantal Am 31.07.2012 um 20:50 schrieb Manepalli, Kalyan: > Hi all, >

auto completion search with solr using NGrams in SOLR

2012-08-01 Thread aniljayanti
I want to implement an auto completion search with solr using NGrams. If the user is searching for names of employees, then auto completion should be applied. ie., if types "j" then need to show the names starts with "j" if types "ja" then need to show the names starts with "ja" if types "jac" th

Urgent: Facetable but not Searchable Field

2012-08-01 Thread jayakeerthi s
All, We have a requirement, where we need to implement 2 fields as Facetable, but the values of the fields should not be Searchable. Please let me know is this feature Supported in Solr If yes what would be the Configuration to be done in Schema.xml and Solrconfig.xml to achieve the same. This i

Re: Urgent: Facetable but not Searchable Field

2012-08-01 Thread Michael Kuhlmann
On 01.08.2012 13:58, jayakeerthi s wrote: We have a requirement, where we need to implement 2 fields as Facetable, but the values of the fields should not be Searchable. Simply don't search for it, then it's not searchable. Or do I simply don't understand your question? As long as Dismax doesn

Re: Urgent: Facetable but not Searchable Field

2012-08-01 Thread Yonik Seeley
On Wed, Aug 1, 2012 at 7:58 AM, jayakeerthi s wrote: > We have a requirement, where we need to implement 2 fields as Facetable, > but the values of the fields should not be Searchable. The user fields "uf" feature of the edismax parser may work for you: http://wiki.apache.org/solr/ExtendedDisMax

AW: auto completion search with solr using NGrams in SOLR

2012-08-01 Thread Markus Klose
Your configuration of the fieldtype looks quite ok. In what field are you searching? "text"? " empname " ? "autocomplete_text"? If you are searching in "autocomplete_text " how do you add content to it? Is there another copyfield statement? If you are searching in "text" what fieldtype has that

termFrequncy off and still use fastvector highlighter?

2012-08-01 Thread abhayd
hi We would like to turn off TF for a field but we still want to use fast vector highlighter. How would we do that? -- View this message in context: http://lucene.472066.n3.nabble.com/termFrequncy-off-and-still-use-fastvector-highlighter-tp3998590.html Sent from the Solr - User mailing list a

Re: Urgent: Facetable but not Searchable Field

2012-08-01 Thread Jack Krupansky
The "indexed" and "stored" field attributes are independent, so you can define a facet field as "stored" but not "indexed" (stored="true" indexed="false"), so that the field can be faceted but not indexed. In addition, you can also use a copyField to copy the original values for an indexed fie

Re: Urgent: Facetable but not Searchable Field

2012-08-01 Thread Michael Kuhlmann
On 01.08.2012 15:40, Jack Krupansky wrote: The "indexed" and "stored" field attributes are independent, so you can define a facet field as "stored" but not "indexed" (stored="true" indexed="false"), so that the field can be faceted but not indexed. ? A field must be indexed to be used for face

Re: Urgent: Facetable but not Searchable Field

2012-08-01 Thread Jack Krupansky
Oops. Obviously facet fields must be indexed. Not sure what I was thinking at the moment. -- Jack Krupansky -Original Message- From: Michael Kuhlmann Sent: Wednesday, August 01, 2012 8:54 AM To: solr-user@lucene.apache.org Subject: Re: Urgent: Facetable but not Searchable Field On 01

Cloud and cores

2012-08-01 Thread Pierre GOSSÉ
Hi all, I'm playing around with SolrCloud and followed indications I found at http://wiki.apache.org/solr/SolrCloud/ - Started Instance 1 with embedded zk - Started Instances 2 3 and 4 using Instance 1 as zk server. Everything works fine. Then, using CoreAdmin, I add a secon

Map Complex Datastructure with Solr

2012-08-01 Thread Thomas Gravel
Hi, how can I map these complex Datastructure in Solr? Document - Groups - Group_ID - Group_Name - . - Title - Chapter - Chapter_Title - Chapter_Content Or Product - Groups - Group_ID - Group_Name - .

Re: Map Complex Datastructure with Solr

2012-08-01 Thread Jack Krupansky
The general rule is to flatten the structures. You have a choice between sharing common fields between tables, such as "title", or adding a prefix/suffix to qualify them, such as "document_title" vs. "product_title". You also have the choice of storing different tables in separate Solr cores/c

Re: Memory leak?? with CloseableThreadLocal with use of Snowball Filter

2012-08-01 Thread Robert Muir
On Tue, Jul 31, 2012 at 2:34 PM, roz dev wrote: > Hi All > > I am using Solr 4 from trunk and using it with Tomcat 6. I am noticing that > when we are indexing lots of data with 16 concurrent threads, Heap grows > continuously. It remains high and ultimately most of the stuff ends up > being moved

RE: Cloud and cores

2012-08-01 Thread Pierre GOSSÉ
It may have something to do with SOLR-3425, but I'm not that sure it fits. I made some more tests. Case 1 : with SolrCloud I can create a new core on one of the server by the admin GUI or by CREATE directive in URL. The data folder is created (but no conf folder, I believe zk conf is used). How

StandardTokenizerFactory is behaving differently in Solr 3.6?

2012-08-01 Thread raonalluri
I have a field type like the following: This type is behaving differently in Solr 3.3 and 3.6. In 3.3, the following doesn't return any records because there is no author called 'Gerri Killis'. But there is an author called ''Gerri Jonathan'. /sele

Re: Map Complex Datastructure with Solr

2012-08-01 Thread Thomas Gravel
Thanks for the answer. Ich have to explain, where the problem is... you may have at the shop solutions products and articles. The product is the parent of all articles... in json... { "product_name": "tank top", "article_list": [ { "color": "red", "pri

Re: Map Complex Datastructure with Solr

2012-08-01 Thread Alexandre Rafalovitch
Sorry, that did not explain the problem, just more info about data layout. What are you actually trying to get out of SOLR? Are you saying you want parent's details repeated in every entry? Are you saying that you want to be able to find entries and from there, being able to find specific parent.

Re: Map Complex Datastructure with Solr

2012-08-01 Thread Thomas Gravel
hm ok I think i have to write my example data and the queries I want to make + the response I expect... Data: { "product_id": "xyz76", "product_name": "tank top", "brand": "adidas", "description":"this is the long description of the product", "short_descrip

Exact match on few fields, fuzzy on others

2012-08-01 Thread Pranav Prakash
Hi Folks, I am using Solr 3.4 and my document schema has attributes - title, transcript, author_name. Presently, I am using DisMax to search for a user query across transcript. I would also like to do an exact search on author_name so that for a query "Albert Einstein", I would want to get all the

4.0 Strange Commit/Replication Issue

2012-08-01 Thread Briggs Thompson
Hello all, I am running 4.0 alpha and have encountered something I am unable to explain. I am indexing content to a master server, and the data is replicating to a slave. The odd part is that when searching through the UI, no documents show up on master with a standard *:* query. All cache types a

Solr spellcheck for words with quotes

2012-08-01 Thread Shri Kanish
Hi , I use solr as search engine for our application. WE have a title "Pandora's star". When I give a query as http://localhost:8983/solr/select?q=pandora's star&spellcheck=true &spellcheck.collate=true   I get response as below, - - -   1   10   17 -   pandora's       tex

Re: 4.0 Strange Commit/Replication Issue

2012-08-01 Thread Tomás Fernández Löbbe
Could your autocommit in the master be using "openSearcher=false"? If you go to the Master admin, do you see that the searcher has all the segments that you see in the filesystem? On Wed, Aug 1, 2012 at 4:24 PM, Briggs Thompson wrote: > Hello all, > > I am running 4.0 alpha and have encountere

Re: StandardTokenizerFactory is behaving differently in Solr 3.6?

2012-08-01 Thread raonalluri
I noticed, escape character which is in the query, is getting ignored in solr 3.6. For the following 3.3 gives results where 'Featuring Chimp' is matched. But in 3.6, it gives results where Featuring or Chimp or Featuring Chimp is matched. Any idea what is the difference between my 3.3 and 3.6 env

Re: 4.0 Strange Commit/Replication Issue

2012-08-01 Thread Briggs Thompson
That is the problem. I wasn't aware of that new feature in 4.0. Thanks for the quick response Tomás. -Briggs On Wed, Aug 1, 2012 at 3:08 PM, Tomás Fernández Löbbe wrote: > Could your autocommit in the master be using "openSearcher=false"? If you > go to the Master admin, do you see that the sea

Re: StandardTokenizerFactory is behaving differently in Solr 3.6?

2012-08-01 Thread Jack Krupansky
Which query parser do you have set in your request handler? There was a problem with edismax in 3.6 with the WordDelimiterFilter, that sounds exactly like your symptom. The workaround is to enclose the term in quotes (to make it a phrase), otherwise the terms would be "OR"ed rather than "AND"e

Re: StandardTokenizerFactory is behaving differently in Solr 3.6?

2012-08-01 Thread raonalluri
Jack, thanks a lot for your reply. We are using LuceneQParser query parser. I agree, if I phrase the string by adding double quotes, I am good. But I am checking if there is any fix for this without changing the query. As we are in production environment, we need to change the quries in different

Re: StandardTokenizerFactory is behaving differently in Solr 3.6?

2012-08-01 Thread Jack Krupansky
This may simply be a matter of changing the default query operator from "OR" to "AND". Try adding &q.op=AND to your request. -- Jack Krupansky -Original Message- From: raonalluri Sent: Wednesday, August 01, 2012 4:26 PM To: solr-user@lucene.apache.org Subject: Re: StandardTokenizerFac

Re: Exact match on few fields, fuzzy on others

2012-08-01 Thread Jack Krupansky
Try edismax with the PF2 option, which will automatically boost documents that contains occurrences of adjacent terms as you have suggested. See: http://wiki.apache.org/solr/ExtendedDisMax -- Jack Krupansky -Original Message- From: Pranav Prakash Sent: Wednesday, August 01, 2012 1:21

Re: Memory leak?? with CloseableThreadLocal with use of Snowball Filter

2012-08-01 Thread roz dev
Thanks Robert for these inputs. Since we do not really Snowball analyzer for this field, we would not use it for now. If this still does not address our issue, we would tweak thread pool as per eks dev suggestion - I am bit hesitant to do this change yet as we would be reducing thread pool which c

Re: Memory leak?? with CloseableThreadLocal with use of Snowball Filter

2012-08-01 Thread Simon Willnauer
On Thu, Aug 2, 2012 at 7:53 AM, roz dev wrote: > Thanks Robert for these inputs. > > Since we do not really Snowball analyzer for this field, we would not use > it for now. If this still does not address our issue, we would tweak thread > pool as per eks dev suggestion - I am bit hesitant to do th