Delete Documents

2015-07-17 Thread naga sharathrayapati
Hey, I understand that "DocExpirationUpdateProcessorFactory" in the config.xml can be specified to delete documents based on the expiration. I would like to understand whether there is a chance of these deleted documents getting re-indexed? Solr 5.2 Thanks

Re: solr blocking and client timeout issue

2015-07-17 Thread Jeremy Ashcraft
I turned on GC logging and verified that its definitely being caused by a GC pause. I tried the tuning option from the article and get this warning: OpenJDK 64-Bit Server VM warning: Failed to reserve shared memory (errno = 1). any recommendations on how to get rid of that warning, and sho

Re: solr blocking and client timeout issue

2015-07-17 Thread Jeremy Ashcraft
thanks! i will definitely try some of those and let you know how it turns out On 7/17/2015 4:14 PM, Shawn Heisey wrote: On 7/17/2015 4:39 PM, Jeremy Ashcraft wrote: Solr 4.4.0 /usr/bin/java -version java version "1.7.0_25" OpenJDK Runtime Environment (rhel-2.3.10.4.el6_4-x86_64) OpenJDK 64-Bi

Re: solr blocking and client timeout issue

2015-07-17 Thread Shawn Heisey
On 7/17/2015 4:39 PM, Jeremy Ashcraft wrote: > Solr 4.4.0 > > /usr/bin/java -version > java version "1.7.0_25" > OpenJDK Runtime Environment (rhel-2.3.10.4.el6_4-x86_64) > OpenJDK 64-Bit Server VM (build 23.7-b01, mixed mode) > > CentOS6 > > /usr/bin/java -Xms1G -Xmx4G -Dsolr.solr.home=/opt/solr

Re: Programmatically find out if node is overseer

2015-07-17 Thread Chris Hostetter
: Hello - i need to run a thread on a single instance of a cloud so need : to find out if current node is the overseer. I know we can already : programmatically find out if this replica is the leader of a shard via : isLeader(). I have looked everywhere but i cannot find an isOverseer. I At o

Re: Programmatically find out if node is overseer

2015-07-17 Thread Vincenzo D'Amore
Hi, in solrj I did this to find leaders url : CloudSolrServer solr = (CloudSolrServer) Configurazione.getSolrServer(); String collection = "collection1"; Map collectionAliases = solr.getZkStateReader().getAliases().getCollectionAliasMap(); if (collectionAliases.containsKey(collection)) { corename

Re: solr blocking and client timeout issue

2015-07-17 Thread Jeremy Ashcraft
Solr 4.4.0 /usr/bin/java -version java version "1.7.0_25" OpenJDK Runtime Environment (rhel-2.3.10.4.el6_4-x86_64) OpenJDK 64-Bit Server VM (build 23.7-b01, mixed mode) CentOS6 /usr/bin/java -Xms1G -Xmx4G -Dsolr.solr.home=/opt/solr/solr -Djetty.logs=/opt/solr/logs -Djetty.home=/opt/solr -Djava.

Re: solr blocking and client timeout issue

2015-07-17 Thread Shawn Heisey
On 7/17/2015 4:02 PM, Jeremy Ashcraft wrote: > having an issue where solr becomes unresponsive for unknown reasons. > Client requests timeout for minutes at a time (sometimes only some > requests time out while others work fine). The logs don't reveal any > clues, other than just a big gap > y

solr blocking and client timeout issue

2015-07-17 Thread Jeremy Ashcraft
having an issue where solr becomes unresponsive for unknown reasons. Client requests timeout for minutes at a time (sometimes only some requests time out while others work fine). The logs don't reveal any clues, other than just a big gap example: INFO - 2015-07-17 14:39:57.195; org.apache

Re: SolrCloud 5.2.1 - collection creation error

2015-07-17 Thread Aaron Gibbons
I started from scratch with fresh Ubuntu machines and just wiped them and tried again. I run my Ansible playbook (below) to install Java 8 (Tried Oracle this time and even tried installing it manually) and SolrCloud 5.2.1 as described previously. Solr cloud appears to be working fine but I still g

Re: Programmatically find out if node is overseer

2015-07-17 Thread Shalin Shekhar Mangar
On Sat, Jul 18, 2015 at 1:00 AM, Shai Erera wrote: >> >> Also, ideally, there shouldn't be a point where you have multiple active >> Overseers in a single cluster. >> > > In the reference guide, CLUSTERSTATUS shows as if the overseer role can > return more than one node. Does it mean that these no

Re: Programmatically find out if node is overseer

2015-07-17 Thread Shai Erera
> > Also, ideally, there shouldn't be a point where you have multiple active > Overseers in a single cluster. > In the reference guide, CLUSTERSTATUS shows as if the overseer role can return more than one node. Does it mean that these nodes were designated potential 'overseers', but OVERSEERSTATUS

Re: Programmatically find out if node is overseer

2015-07-17 Thread Shalin Shekhar Mangar
Just for the record, SOLR-5859 only affects people who used the overseer roles feature released in 4.7 and no one else. This was fixed in 4.8 On Sat, Jul 18, 2015 at 12:18 AM, Anshum Gupta wrote: > It shouldn't happen unless you're using an older version of Solr (< 4.8) in > which case, you might

Re: Programmatically find out if node is overseer

2015-07-17 Thread Anshum Gupta
It shouldn't happen unless you're using an older version of Solr (< 4.8) in which case, you might end up hitting SOLR-5859 . On Fri, Jul 17, 2015 at 11:29 AM, wrote: > Hi Anshum what do you mean by: > >ideally, there shouldn't be a point where you

Re: Programmatically find out if node is overseer

2015-07-17 Thread solr . user . 1507
Hi Anshum what do you mean by: >ideally, there shouldn't be a point where you have multiple active Overseers in a single cluster How can multiple Overseers happen? And what are the consequences? Regards > On 17 Jul 2015, at 19:37, Anshum Gupta wrote: > > ideally, there shouldn't be a point whe

Re: Programmatically find out if node is overseer

2015-07-17 Thread Anshum Gupta
As Shai mentioned, OVERSEERSTATUS is the most straight forward and recommended way to go. It basically does what Erick suggested i.e. get the first entry from '/overseer_elect/leader' in zk. Also, ideally, there shouldn't be a point where you have multiple active Overseers in a single cluster. On

Re: Programmatically find out if node is overseer

2015-07-17 Thread Erick Erickson
good point Shai! On Thu, Jul 16, 2015 at 9:36 PM, Shai Erera wrote: > An easier way (IMO) and more 'official' is to use the CLUSTERSTATUS ( > https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-api18) > or OVERSEERSTATUS ( > https://cwiki.apache.org/confluence/display/

Question about indexing html file

2015-07-17 Thread Huiying Ma
Hi everyone, I'm a new user for solr and I need to index some html files based on the tags and the classes and then complete a web interface to fulfill the search document search function. Now I have some question about how to index those html files using my own rules. I have checked the documents

Re: DIH question: importing string containing comma-delimited list into a multiValued field

2015-07-17 Thread Shawn Heisey
On 7/17/2015 8:23 AM, Bill Au wrote: > One of my database column is a varchar containing a comma-delimited list of > values. I wold like to import these values into a multiValued field. I > figure that I will need to write a ScriptTransformer to do that. Is there > a better way? DIH provides th

DIH question: importing string containing comma-delimited list into a multiValued field

2015-07-17 Thread Bill Au
One of my database column is a varchar containing a comma-delimited list of values. I wold like to import these values into a multiValued field. I figure that I will need to write a ScriptTransformer to do that. Is there a better way? Bill

Re: Multiple boost queries on a specific field

2015-07-17 Thread bengates
Hello, I'm using q.alt because q=*:* provides 0 result, since it is not compatible with the Dismax parser. The "real terms" is irrelevant here, since I want to boost some documents, either on the whole collection, either after defining some filter queries. My queries have nothing to deal with a fu

Re: Analytics on Solr logs

2015-07-17 Thread Erik Hatcher
Yes, that’s how it is generally done - adding extra Solr-ignoring parameters to the requests. — Erik Hatcher, Senior Solutions Architect http://www.lucidworks.com > On Jul 17, 2015, at 5:47 AM, marotosg wrote: > > Hi, > > i have a use case where We would lik

Analytics on Solr logs

2015-07-17 Thread marotosg
Hi, i have a use case where We would like to know what are the users searching for. Most commonly used criteria etc. One requirement is related to the user who is searching. We need to know who is making each search but this is not criteria itself. It is just analysis information. I was wondering

Extracting article keywords using tf-idf algorithm

2015-07-17 Thread Ali Nazemian
Dear Lucene/Solr developers, Hi, I decided to develop a plugin for Solr in order to extract main keywords from article. Since Solr already did the hard-working for calculating tf-idf scores I decided to use that for the sake of better performance. I know that UpdateRequestProcessor is the best suit