Re: Tf-Idf for a specific query

2014-02-07 Thread David Miller
Thanks Mikhai, It seems that, this was what I was looking for. Being new to this, I wasn't aware of such a use of facets. Now I can probably combine the term vectors and facets to fit my scenario. Regards, Dave On Fri, Feb 7, 2014 at 2:43 PM, Mikhail Khludnev wrote: > David, > > I can imagin

Index a new record in MySQL

2014-02-07 Thread PeriS
Hi, How do I approach the issue of firing the DIH without it having to index the whole DB when adding a new record? It appears that when a new record is added the delta query on DIH doesn’t pick up the record. And I don’t want to run a full index on the DB when adding 1 single row. Any suggesti

Re: After upgrading indexer to SolrJ 4.6.1: o.a.solr.servlet.SolrDispatchFilter - Unknown type 19

2014-02-07 Thread Brett Hoerner
On Fri, Feb 7, 2014 at 6:15 PM, Mark Miller wrote: > You have to update the other nodes to 4.6.1 as well. > I'm not sure I follow, all of the Solr instances in the cluster are 4.6.1 to my knowledge? Thanks, Brett

Re: After upgrading indexer to SolrJ 4.6.1: o.a.solr.servlet.SolrDispatchFilter - Unknown type 19

2014-02-07 Thread Mark Miller
Hey, yeah, blew it on this one. Someone just reported it the other day - the way that a bug was fixed was not back and forward compatible. The first implementation was wrong. You have to update the other nodes to 4.6.1 as well. I’m going to look at some scripting test that can help check fo

After upgrading indexer to SolrJ 4.6.1: o.a.solr.servlet.SolrDispatchFilter - Unknown type 19

2014-02-07 Thread Brett Hoerner
I have Solr 4.6.1 on the server and just upgraded my indexer app to SolrJ 4.6.1 and indexing ceased (indexer returned "No live servers for shard" but the real root from the Solr servers is below). Note that SolrJ 4.6.1 is fine for the query side, just not adding documents. 21:35:21.508 [qtp14184

Re: Tf-Idf for a specific query

2014-02-07 Thread Mikhail Khludnev
David, I can imagine that "DF for resultset" is facets! On Fri, Feb 7, 2014 at 11:26 PM, David Miller wrote: > Hi Mikhail, > > The DF seems to be based on the entire document set. What I require is > based on a the results of a single query. > > Suppose my Solr query returns a set of 50K docume

Re: Tf-Idf for a specific query

2014-02-07 Thread David Miller
Hi Mikhail, The DF seems to be based on the entire document set. What I require is based on a the results of a single query. Suppose my Solr query returns a set of 50K documents from a superset of 10Million documents, I require to calculate the DF just based on the 50K documents. But currently it

Swap space,JVM-Memory,Physical memory on Solr Admin UI explanation

2014-02-07 Thread Vijay Balakrishnan
Hi, I am using solr 4.6.1 on a Windows 7 server right now with 32 GB RAM.I have a SolrCloud with 3 shards, 2 replicas and an embedded Zookeeper on the 1 box.I have allocated -Xmx5GB RAM to each Solr instance when starting up with -XX:MaxNewSize:1636m I see the Swap space(32.5G/64GB),JVM-Memory(52

SOLR 4.6 and Highlight Snippets with spannear

2014-02-07 Thread Puneet Pawaia
Hi. I am using Solr 4.6 with XmlQueryParser from Jira. I have noticed that if I have a spannear query, then no highlights snippets are returned. I have tried both regular highlighter as well as fast vector highlighter. Is there any limitation of the highlighters with respect to spannear queries? Re

Re: ExtendedDismax and NOT operator

2014-02-07 Thread Geert Van Huychem
Yes, it is. Geert Van Huychem IT Consultant iFrameWorx BVBA Mobile: +32 497 27 69 03 E-mail: ge...@iframeworx.be Site: http://www.iframeworx.be LinkedIn: http://www.linkedin.com/in/geertvanhuychem On Fri, Feb 7, 2014 at 6:44 PM, Alexei Martchenko wrote: > Just to clarify: the actual url is pro

Re: ExtendedDismax and NOT operator

2014-02-07 Thread Alexei Martchenko
Just to clarify: the actual url is properly space-escaped? http://localhost:8983/solr/distrib/select?q=term1%20NOT%20 term2&start=0&rows=0&qt=edismax_basic&debugQuery=true alexei martchenko Facebook | Linkedin| S

Re: Need help for integrating solr-4.5.1 with UIMA

2014-02-07 Thread Jack Krupansky
The UIMA component is not very error-friendly - NPE gets thrown for missing or misspelled parameter names. Basically, you have to look at the source code based on that stack trace to find out which parameter was missing. -- Jack Krupansky -Original Message- From: rashi gandhi Sent: F

Group.Facet issue in Sharded Solr Setup

2014-02-07 Thread rks_lucene
Am facing an issue with counts when using group.facets in my sharded solr. (Groups do not overlap across shards and for various reasons I cannot use group.truncate) Now, the problem being faced is that for items ranking lower in the faceted list sorted by count, the group facet counts are coming

Re: ExtendedDismax and NOT operator

2014-02-07 Thread Jack Krupansky
I suspect that's a bug. The phrase boost code should have the logic to exclude negated terms. File a Jira. Thanks for reporting this. -- Jack Krupansky -Original Message- From: Geert Van Huychem Sent: Friday, February 7, 2014 9:40 AM To: solr-user@lucene.apache.org Subject: Extended

Re: Solr and Polygon/Radius based spatial searches

2014-02-07 Thread leevduhl
David, Thanks for the response, the info should be very helpful! Lee -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-and-Polygon-Radius-based-spatial-searches-tp4115121p4116068.html Sent from the Solr - User mailing list archive at Nabble.com.

Inconsistent results in a distributed configuration

2014-02-07 Thread felipefrbr
I´m getting inconsistent results in a distributed configuration. Using stats command over a single core containing about 3 milion docs I´ve got 452660794509326.7 (a double type field). On the other hand, when partitioning the data into 2 or 4 cores I am getting a different result: 452660794509

ExtendedDismax and NOT operator

2014-02-07 Thread Geert Van Huychem
Hi This is my config: edismax body title^30 introduction^15 body^10 0 Executing the following link: http://localhost:8983/solr/distrib/select?q=term1 NOT term2&start=0&rows=0&qt=edismax_basic&debugQuery=true gives me as debuginfo: (+(DisjunctionMaxQuery

Re: Facet pivot and distributed search

2014-02-07 Thread Trey Grainger
FYI, the last distributed pivot facet patch functionally works, but there are some sub-optimal data structures being used and some unnecessary duplicate processing of values. As a result, we found that for certain worst-case scenarios (i.e. data is not randomly distributed across Solr cores and req

Re: Need help for integrating solr-4.5.1 with UIMA

2014-02-07 Thread rashi gandhi
Hi, I tried almost all combinations in solrconfig.xml for using UIMA with solr. But each time i am indexing data to solr, getting this excpetion 113701 [http-bio-8080-exec-1] ERROR org.apache.solr.core.SolrCore û org.apache.solr.common.SolrException: org.apache.uima.resource.ResourceInitializati

Re: SolrCloud: problems with delete

2014-02-07 Thread ku3ia
autocommit and /update/?commit=true works fine. I tell about, for example, I send 807632 docs to index to my 3 shard cluster - everything is fine, but when I'm trying to remove them, using POST request with small number of ids, lets say 100 per request - some docs are still on index, but seems must

Re: SolrCloud: problems with delete

2014-02-07 Thread Furkan KAMACI
Hi; What is your commit policy? Check this is works or not: *solr/update?commit=true* If it works then could you write your* autocommit configuration*? Thanks; Furkan KAMACI 2014-02-07 13:23 GMT+02:00 ku3ia : > Hi all! > Does SolrCloud correct delete documents? When I send many requests via PO

Solr Composite Unique key from existing fields in schema

2014-02-07 Thread Anurag Verma
Hi, I am developing a search application using SOLR. I don't have primary key in any table. Composite key is being used in my application. How do i implement composite key as unique key in this case. please help. i am struggling. -- Thanks & Regards Anurag Verma Arise! Awake! And stop not ti

Re: solr joins

2014-02-07 Thread Mikhail Khludnev
On Fri, Feb 7, 2014 at 3:32 PM, anand chandak wrote: > Thanks Mikhail, curious why was scoring left out of solr ? Have no idea. I've never been involved in query-time join. > And if there's any plan to port it ? > I suppose there is no plan until someone raise a jira. > Also, if you can plea

Re: solr joins

2014-02-07 Thread anand chandak
Thanks Mikhail, curious why was scoring left out of solr ? And if there's any plan to port it ? Also, if you can please elaborate on the segmented vs toplevel Thanks, Anand On 2/7/2014 4:53 PM, Mikhail Khludnev wrote: Basically, i am trying to understand where and how solr joins differ from

Re: solr joins

2014-02-07 Thread Mikhail Khludnev
>> Basically, i am trying to understand where and how solr joins differ from >> lucene joins. Any pointers, much appreciated ? >> >> Hello Anand, I'm keen for index-time joins (aka block joins), thus I've never looked into query-time ones. I even didn't ever know that there are two different query

SolrCloud: problems with delete

2014-02-07 Thread ku3ia
Hi all! Does SolrCloud correct delete documents? When I send many requests via POST with small number of ids – there are some documents left in index, which not deleted. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-problems-with-delete-tp4116026.html S

Re: MoreLikeThis

2014-02-07 Thread rubenboada
Hi iorixxx, Sorry for the delay in replying. The code is the below: /public void performSearch(DSpaceObject dso) throws SearchServiceException { if(queryResults != null) { return; } this.queryArgs = prepareDefaultFilters(getView()); this.quer

Re: Intercept updates and cascade loading of Index.

2014-02-07 Thread soodyogesh
Thanks for insights. This helps indeed, however im not sure how do i get delta on commit. I guess I need to do some custom query to get what has changed since last update or sort of like that. I would experiment around that, if anyone does that please share. -- View this message in context:

Re: Tf-Idf for a specific query

2014-02-07 Thread Mikhail Khludnev
Hello Dave you can get DF from http://wiki.apache.org/solr/TermsComponent (invert it yourself) then, for certain term you can get number of occurrences per document by http://wiki.apache.org/solr/FunctionQuery#tf On Fri, Feb 7, 2014 at 3:58 AM, David Miller wrote: > Hi Guys.. > > I require to

Re: Facet pivot and distributed search

2014-02-07 Thread Geert Van Huychem
Thx! Geert Van Huychem IT Consultant iFrameWorx BVBA Mobile: +32 497 27 69 03 E-mail: ge...@iframeworx.be Site: http://www.iframeworx.be LinkedIn: http://www.linkedin.com/in/geertvanhuychem On Fri, Feb 7, 2014 at 8:55 AM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > Yes this is a o