Re: Field for 'species' data?

2014-07-04 Thread Alexandre Rafalovitch
Do that with a custom update request processor. Just remember Solr is there to find things not to preserve structure. So mangle your data until you can find it. Also check if SirenDB would fit your requirements if you want to encode the information as complex structure. Regards, Alex

Re: How to get related facets using Solr query ?

2014-07-04 Thread shamik
Thanks for the pointer Eric. You are right, I forgot to include "IJK" under AB. Also, facet field names are different. Unfortunately, I'm using Solrcloud and facet pivot doesn't seem to work in a distributed mode. I'll get back some result if I use distrib=false, but then it's not the right data.

Re: Field for 'species' data?

2014-07-04 Thread Dan Bolser
I think I need to lookup the given species value in a taxonomy, build the 'path' and pass the result to the path hierarchy tokenizer or similar. I figure I'll do this with a field analyzer. On 4 Jul 2014 22:30, "Jack Krupansky" wrote: > I haven't fully digested your species hierarchy requirements

Re: Field for 'species' data?

2014-07-04 Thread Jack Krupansky
I haven't fully digested your species hierarchy requirements, but you can do just about anything in a Solr update processor. So you can parse the string and then put pieces into different fields to represent portions of the hierarchy. Then at query time, your application facet navigation is simp

Re: java.net.SocketException: Connection reset

2014-07-04 Thread heaven
Today this had happened again + this one: null:java.net.SocketException: Broken pipe at java.net.SocketOutputStream.socketWrite0(Native Method) at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113) at java.net.SocketOutputStream.write(SocketOutputStream.jav

Re: multilingual search

2014-07-04 Thread Paul Libbrecht
> 1. Modify the qf parameter directly by either adding the "_xx" language > suffix to each field in qf, or replacing the "xx" for any qf fields that > already have an "_xx" suffix. > 2. Have separate "qf_xx" parameters which are customized for specific > languages and then copy the language-spec

Re: multilingual search

2014-07-04 Thread Jack Krupansky
Indeed, a Solr search component to customize the incoming query for query language can work as well. Add it to the search components before the "query" component, have it call the language detection code on the q parameter, and then modify the "qf" parameter based on the language discovered.

Re: Field for 'species' data?

2014-07-04 Thread Dan Bolser
The problem is that each document has a single species (or super-species, or sub-species), and needs to get information about it's place in the hierarchy 'elsewhere', i.e. in an externally encoded hierarchy. I don't, for example, have data in this format: SPECIES: "Hordeum / Hordeum vulgare / Hord

Re: multilingual search

2014-07-04 Thread Paul Libbrecht
To do just what Jack described, I often write a solr query component that does "query expansion". Based on some parameters I can recognize to be a language hint (e.g. the language of the environment they search in, the browser's accept-language) I reformulate the query into a query in the fields

Solr 4.7 Payload

2014-07-04 Thread Ranjith Venkatesan
Hi all, I am evaluating Payload of lucene. I am using solr4.7.2 for this. I could able to index with payload, but i couldnt able to retrieve payload from DocsAndPositionsEnum. It is returning just null. But terms.hasPayloads() is returning true. And i can able to see payload value in luke (image a

Re: multilingual search

2014-07-04 Thread Jack Krupansky
What leads you to believe that the user is not interested in occurrences of the French phrase in English text? I mean, we English-speakers and writers like to use French phrases to show how sophisticated we are! It's part of our... raison d'être. If I do a Google search for "raison d'être", it

multilingual search

2014-07-04 Thread benjelloun
Hello, what i need to do is to detect language of my fields then when i search with "/select RequestHandler" how can i define for a search to detect the language of words to choose which field_langid use. my conf: true NomDocument,ContenuDocument,Postit, langua

Re: Using solr for image retrieval - very long response time

2014-07-04 Thread Yossi Biton
1. debugQuery shows almost all of the time spent in query. 2. i cant look right now at the heap, but i remember i allocated 4gb for the JVM and it's far from being fully used. Regarding GC im not sure how to check it (gc.log ?). 3. The whole index fits in memory during the query. On Jul 4, 2014

Re: Using solr for image retrieval - very long response time

2014-07-04 Thread Jack Krupansky
I would expect an excessively long query (greater than dozens or low hundreds of terms) to run significantly slower, but 100 seconds does seem excessively slow even for a 1000-term query. Add the debugQuery=true parameter to your query request and checking the timing section to see if the time

Using solr for image retrieval - very long response time

2014-07-04 Thread Yossi Biton
Hello there, Recently I was trying to implement the bag-of-words model for image retrieval by using Solr. Shortly this model consists of extracting "visual words" from images and then use tf-idf schema for fast querying (usually include also re-ranking stage). I found solr as a suitable platform (

Re: How to get related facets using Solr query ?

2014-07-04 Thread Erik Hatcher
Why isn't IJK not under AB too? Are the "Facet" field names different? Pivot facets looks like what you want. facet.pivot=field1,field2 if they are different field names. Erik > On Jul 3, 2014, at 20:15, Shamik Bandopadhyay wrote: > > Hi, > > I've trying construct a facet query to or

Re: Listening on SolrCloud events

2014-07-04 Thread Ugo Matrangolo
Hi, thank you very much for the answers. I think the best way is to write a little Zookeeper watcher myself and react on event of interest. Thank you, Ugo On Thu, Jul 3, 2014 at 9:42 PM, Jeff Wartes wrote: > If you¹re using SolrJ, CloudSolrServer exposes the information you need > directly,