Re: highlighter not respecting sentence boundry

2012-06-04 Thread abhayd
Any help on this one? Seems like highlighting component does not always start the snippet from starting of snippet. I tried several options. Has anyone successfully got this working? -- View this message in context: http://lucene.472066.n3.nabble.com/highlighter-not-respecting-sentence-bound

Re: Can't index sub-entitties in DIH

2012-06-04 Thread Gora Mohanty
On 5 June 2012 08:26, Rafael Taboada wrote: > Hi Gora. > > My apologizes for this subject. It wasn't my intention to be rude or > something like that. No need to apologize. I was hoping to make it easier for people to help you. > As I said about mapping database columns with solr fields, it work

Re: I got ERROR, Unable to execute query

2012-06-04 Thread Jihyun Suh
That's why I made a new DB for dataimport test. So my tables have no access or activity. Those are just dormant ones. -- My current suspicion is that there is activity in that t

Re: Can't index sub-entitties in DIH

2012-06-04 Thread Rafael Taboada
Hi Gora. My apologizes for this subject. It wasn't my intention to be rude or something like that. As I said about mapping database columns with solr fields, it works in mysql. Maybe I'm wrong with some config file because I'm new with Solr. By the way, it is a great product. But I've just tried

Correct way to deal with source data that may include a multivalued field that needs to be used for sorting?

2012-06-04 Thread Aaron Daubman
Greetings, I have "dirty" source data where some documents being indexed, although unlikely, may contain multivalued fields that are also required for sorting. In previous versions of Solr, sorting on this field worked fine (possibly because few or no multivalued fields were ever encountered?), ho

Re: Unable to delete by range in SOLR

2012-06-04 Thread Joe
Thanks for the response Jack! That wasn't exactly right. But the following modification does work: curl "http://myURL/update?commit=true"; -H 'Content-type:application/json' -d '{"delete": {"query":"id:[0 TO 1730887464]"}}' -- View this message in context: http://lucene.472066.n3.nabble.com/Un

Re: Fuzzy Suggester

2012-06-04 Thread alioral
usePrefix value is set true in JaspellLookup class. This value needs to be set to false in order to enable matchAlmost method which I believe performs fuzzy search. @Override public List lookup(String key, boolean onlyMorePopular, int num) { List res = new ArrayList(); List list;

Re: Unable to delete by range in SOLR

2012-06-04 Thread Jack Krupansky
Delete by query. See: http://wiki.apache.org/solr/UpdateJSON curl "http://myURL/update?commit=true"; -H 'Content-type:application/json' -d '{"delete": {"query":"[* TO 1730887464]"}}' -- Jack Krupansky -Original Message- From: Joe Sent: Monday, June 04, 2012 5:12 PM To: solr-user

Unable to delete by range in SOLR

2012-06-04 Thread Joe
I have an instance of SOLR 3.6 running, with JSON as the default updateHandler. I am able to delete individual documents with the following: curl "http://myURL/update?commit=true"; -H 'Content-type:application/json' -d '{"delete": {"id":"1730887464"}}' What is the right way to delete a rang

Re: pass custom parameters from client to solr

2012-06-04 Thread Ahmet Arslan
> Thanks for your reply, that was > helpful. Is there any restriction on how many > parameters i can pass ? I think there are some max limits on GET and POST methods. You can use both using solrJ. POST method enables longer parameters. http://lucene.apache.org/solr/api/org/apache/solr/client/sol

Sorting performance

2012-06-04 Thread Gau
Here is the usecase: I am using synonym expansion at query time to get results. this is essentially a name search, so a search for Jim may be expanded at query time for James, Jung, Jimmy, etc. So ranking fields like TF, IDF, Norms do not mean anything to me. I just reset them to zero. so all the

Sorting performance

2012-06-04 Thread Gau
Here is the usecase: I am using synonym expansion at query time to get results. this is essentially a name search, so a search for Jim may be expanded at query time for James, Jung, Jimmy, etc. So ranking fields like TF, IDF, Norms do not mean anything to me. I just reset them to zero. so all the

Re: pass custom parameters from client to solr

2012-06-04 Thread srinir
Thanks for your reply, that was helpful. Is there any restriction on how many parameters i can pass ? also can i pass some data (as we pass the document to be indexed, when we call the update url) along with the parameters which the solr server will use for search. -- View this message in conte

Re: Can't index sub-entitties in DIH

2012-06-04 Thread Gora Mohanty
On 4 June 2012 22:27, Rafael Taboada wrote: > > Hi folks, > > I've just solved using outer joins like this: > > >         >         >         >         > > Any idea why I can't index using sub-entities? [...] Dear Rafael, No offence meant, but please take a look at http://wiki.apache.org/so

ExtendedDisMax Question - Strange behaviour

2012-06-04 Thread André Maldonado
I'm doing a query with edismax. When I don't tell solr which fields I want to do the search (so it does in default field), it returns 2752 documents. ex: http://000.000.0.0:/solr/select/?q=apartamento+moema+praia+churrasqueira&version=2.2&start=0&rows=10&indent=on&defType=dismax&mm=75%25

Re: seeing errors during replication process on slave boxes - read past EOF

2012-06-04 Thread geeky2
hello, i have shell scripts that handle all of the operational tasks. example: curl -v http://${SERVER}.bogus.com:${PORT}/somecore/dataimport -F command=full-import -F clean=${CLEAN} -F commit=${COMMIT} -F optimize=${OPTIMIZE} -- View this message in context: http://lucene.472066.n3.nabble.

Re: I got ERROR, Unable to execute query

2012-06-04 Thread Jack Krupansky
My current suspicion is that there is activity in that table that is preventing DIH access. I mean, like maybe the table is being updated when DIH is failing. Maybe somebody is emptying the table and then regenerating it and your DIH run is catching the table when it is being emptied. Or someth

Re: Can't index sub-entitties in DIH

2012-06-04 Thread Rafael Taboada
Hi folks, I've just solved using outer joins like this: Any idea why I can't index using sub-entities? Thanks in advance On Mon, Jun 4, 2012 at 11:13 AM, Rafael Taboada wrote: > Hi folks, > > I'm using DIH in order to index my Oracle database but I'm h

SolrCloud question: recommended technique for initiating a full re-index

2012-06-04 Thread Jack Krupansky
If someone has a running SolrCloud with data in the index, what is the recommended technique for initiating a full-re-index? A delete by query for *:*? Deleting data files? Is the Lucene IndexWriter.deleteAll method surfaced somehow in Solr since it is supposed to be much faster than IW.deleteD

Re: seeing errors during replication process on slave boxes - read past EOF

2012-06-04 Thread Jack Krupansky
"started a re-index on the master " Out of curiosity, how did you do that? Did you delete files or do a deleteQuery for "*:*" or what? Did the delete step have time to propagate to the slaves before documents were added? I am just curious - I don't know what the proper technique is for init

Can't index sub-entitties in DIH

2012-06-04 Thread Rafael Taboada
Hi folks, I'm using DIH in order to index my Oracle database but I'm having some issues. Right now, I can't index fields from sub-entities. I have in my db-data-config.xml: My schema.xml is:

Re: Add HTTP-header from ResponseWriter

2012-06-04 Thread Jack Krupansky
There is some commented-out code in SolrDispatchFilter.doFilter: // add info to http headers //TODO: See SOLR-232 and SOLR-267. /*try { NamedList solrRspHeader = solrRsp.getResponseHeader(); for (int i=0; i((javax.servlet.http.HttpServletResponse) response).addHeader(("Solr-" + solrRsp

Re: Round Robin concept in distributed Solr

2012-06-04 Thread ratabora
Thanks Erick, While it probably does not have any major impact on performance, I think solely to avoid a single point of failure on the main shard it makes sense to load balance it. Regards, Ryan Tabora On Jun 4, 2012, at 2:51 AM, Erick Erickson [via Lucene] wrote: > The "main" shard has some

Re: How to use SolrJ index a file or a FileInputStream with some other attributes?

2012-06-04 Thread Jack Krupansky
More specifically, you probably want ContentStreamUpdateRequest: http://lucene.apache.org/solr/api/org/apache/solr/client/solrj/request/ContentStreamUpdateRequest.html With an example here: http://wiki.apache.org/solr/ContentStreamUpdateRequestExample -- Jack Krupansky -Original Message

Re: pass custom parameters from client to solr

2012-06-04 Thread Ahmet Arslan
> I would like to pass  a bunch of custom parameters to > turn on/off or set > thresholds for various custom implementations we have in our > solr. What > would be the best way to pass these custom parameters to > solr server from > the client ? The client is a Java based application and > hence we

Re: How to use SolrJ index a file or a FileInputStream with some other attributes?

2012-06-04 Thread Ahmet Arslan
> How to use SolrJ index a file or a > FileInputStream with some other > attributes? > > Please give me some example. Here are two good resources: http://www.lucidimagination.com/blog/2012/02/14/indexing-with-solrj/ http://wiki.apache.org/solr/Solrj

Add HTTP-header from ResponseWriter

2012-06-04 Thread Markus Jelsma
Hi, There has been discussion before on how to add/set a HTTP-header from a ResponseWriter. That was about adding the number of found documents for a CSVResponseWriter. We also need to set the number of found documents, in this case for the JSONResponseWriter. or any ResponseWriter. Is there an

Re: Round Robin concept in distributed Solr

2012-06-04 Thread Erick Erickson
The "main" shard has some extra work to do. Namely 1> create the sub-requests 2> collate the results from all the sub-requests (including itself). But this work is generally a small amount of the actual work being done, so it's often unnoticeable. That said, I'd just put all my slaves behind a lo

Re: Solr with UIMA

2012-06-04 Thread Tommaso Teofili
Hi all, 2012/6/1 Jack Krupansky > Is it failing on the first document? I see "uid 5", suggests that it is > not. If not, how is this document different from the others? > > I see the exception > org.apache.uima.resource.**ResourceInitializationExceptio**n, suggesting > that some file cannot be l

pass custom parameters from client to solr

2012-06-04 Thread srinir
Hi I would like to pass a bunch of custom parameters to turn on/off or set thresholds for various custom implementations we have in our solr. What would be the best way to pass these custom parameters to solr server from the client ? The client is a Java based application and hence we are plannin