zero-day exploit security issue

2017-10-13 Thread Xie, Sean
Is there a tracking to address this issue for SOLR 6.6.x and 7.x? https://lucene.apache.org/solr/news.html#12-october-2017-please-secure-your-apache-solr-servers-since-a-zero-day-exploit-has-been-reported-on-a-public-mailing-list Sean Confidentiality Notice:: This email, including attachments,

HTTP HEAD method is gone?

2017-10-09 Thread Xie, Sean
After upgrading from 6.5.1 to 6.6.1, the http HEAD method requesting /favicon.ico returns the 404. Http GET method is still working as it returns 200 OK. Before the upgrading, both HEAD and GET give http 200 OK response. Any settings to adjust? Thanks Sean Confidentiality Notice:: This email

Re: DocValues error when upgrading to 6.6.1 from 6.5

2017-10-03 Thread Xie, Sean
schema. At least that's my guess Best, Erick On Thu, Sep 21, 2017 at 11:56 AM, Xie, Sean wrote: > Hi, > > When I upgrade the existing SOLR from 6.5.1 to 6.6.1, I’m getting: > cannot change DocValues type from SORTED to SORTED_SET for field

DocValues error when upgrading to 6.6.1 from 6.5

2017-09-21 Thread Xie, Sean
Hi, When I upgrade the existing SOLR from 6.5.1 to 6.6.1, I’m getting: cannot change DocValues type from SORTED to SORTED_SET for field “…..” During the upgrades, there is no change on schema and schema version (we are using schema version 1.5 so seDocValuesAsStored defaults are not taking into

Re: solr in memory testing

2017-08-08 Thread Xie, Sean
There is MiniSolrCloudCluster that you can use for testing. This is from solr-test-framework: https://github.com/apache/lucene-solr/tree/master/solr/test-framework. On 8/8/17, 7:54 AM, "Thaer Sammar" wrote: Hi, We are using solr 6.6, and we are looking for guidance documentation o

RE: CDCR - how to deal with the transaction log files

2017-07-28 Thread Xie, Sean
You don't need to start cdcr on target cluster. Other steps are exactly what I did. After disable buffer on both target and source, the tlog files are purged according to the specs. -- Thank you Sean From: Patrick Hoeffel mailto:patrick.hoef...@polarisalpha.com>> Date: Friday, Jul 28, 2017, 4

Re: CDCR - how to deal with the transaction log files

2017-07-12 Thread Xie, Sean
Try run second data import or any other indexing jobs after the replication of the first data import is completed. My observation is during the replication period (when there is docs in queue), tlog clean up will not triggered. So when queue is 0, and submit second batch and monitor the queue a

Re: Tlogs not being deleted/truncated

2017-07-11 Thread Xie, Sean
Please see my previous thread. I have to disable buffer on source cluster and a scheduled hard commit with scheduled logscheduler to make it work. -- Thank you Sean From: jmyatt mailto:jmy...@wayfair.com>> Date: Tuesday, Jul 11, 2017, 1:56 PM To: solr-user@lucene.apache.org mailto:solr-user@lu

Re: CDCR - how to deal with the transaction log files

2017-07-10 Thread Xie, Sean
u proves otherwise . What version of Solr are you running? I'll try reproducing this problem at my end and see if it's a documentation gap or a bug. On Mon, Jul 10, 2017 at 7:15 PM, Xie, Sean wrote: > Yes. Documents are being sent to target. Monitorin

RE: ZooKeeper transaction logs

2017-07-10 Thread Xie, Sean
. Sean On 7/10/17, 6:43 AM, "Avi Steiner" wrote: I did use this class using batch file (from Windows server), but it still does not remove anything. I sent number of snapshots to keep as 3, but I have more in my folder. -Original Message- From: Xie, Sean [m

Re: CDCR - how to deal with the transaction log files

2017-07-10 Thread Xie, Sean
CdcrUpdateLogSynchroizer does not continue to do the clean if this value is -1. Sean On 7/10/17, 5:18 PM, "Varun Thacker" wrote: After disabling the buffer are you still seeing documents being replicated to the target cluster(s) ? On Mon, Jul 10, 2017 at 1:07 PM, Xie, S

RE: CDCR - how to deal with the transaction log files

2017-07-10 Thread Xie, Sean
th version 6.2. No solution to date. -Original Message- From: Xie, Sean [mailto:sean@finra.org] Sent: Sunday, July 09, 2017 9:41 PM To: solr-user@lucene.apache.org Subject: [EXTERNAL] Re: CDCR - how to deal with the transaction log files Did anothe

RE: CDCR - how to deal with the transaction log files

2017-07-10 Thread Xie, Sean
, 9:08 AM, "Michael McCarthy" wrote: We have been experiencing this same issue for months now, with version 6.2. No solution to date. -Original Message- From: Xie, Sean [mailto:sean@finra.org] Sent: Sunday, July 09, 2017 9:41 PM To: solr-user@lucene.

Re: CDCR - how to deal with the transaction log files

2017-07-09 Thread Xie, Sean
updateLogSynchronizer already set at run at every 10 seconds, but seems it didn’t help. Any help? Thanks Sean On 7/8/17, 1:14 PM, "Xie, Sean" wrote: I have monitored the CDCR process for a while, the updates are actively sent to the target without a problem. However the tlog size and files

Re: ZooKeeper transaction logs

2017-07-09 Thread Xie, Sean
You can try run purge manually see if it is working: org.apache.zookeeper.server.PurgeTxnLog. And use a cron job to do clean up. On 7/9/17, 11:07 AM, "Avi Steiner" wrote: Hello I'm using Zookeeper 3.4.6 The ZK log data folder keeps growing with transaction logs files (lo

Re: CDCR - how to deal with the transaction log files

2017-07-08 Thread Xie, Sean
o catch up. If you don't have the remote DC online and do not intend to bring it online soon, you should turn CDCR off. Best, Erick On Fri, Jul 7, 2017 at 9:35 PM, Xie, Sean wrote: > Once enabled CDCR, update log stores an unlimited number of entries. Th

CDCR - how to deal with the transaction log files

2017-07-07 Thread Xie, Sean
Once enabled CDCR, update log stores an unlimited number of entries. This is causing the tlog folder getting bigger and bigger, as well as the open files are growing. How can one reduce the number of open files and also to reduce the tlog files? If it’s not taken care properly, sooner or later t

Re: Live update the zookeeper for SOLR

2017-06-29 Thread Xie, Sean
pointing to the new IP. Any suggestion? Thanks Sean On 6/16/17, 3:34 PM, "Xie, Sean" wrote: Solr is configured with the zookeeper ensemble as mentioned below. I will provide logs in a later time. From: Shawn Heisey mailto:apa...@elyograg.org>> Date

Re: Live update the zookeeper for SOLR

2017-06-16 Thread Xie, Sean
Live update the zookeeper for SOLR On 6/16/2017 9:05 AM, Xie, Sean wrote: > Is there a way to keep SOLR alive when zookeeper instances (3 instance > ensemble) are rolling updated one at a time? It seems SOLR cluster use > one of the zookeeper instance and when the communication is broken i

Live update the zookeeper for SOLR

2017-06-16 Thread Xie, Sean
Is there a way to keep SOLR alive when zookeeper instances (3 instance ensemble) are rolling updated one at a time? It seems SOLR cluster use one of the zookeeper instance and when the communication is broken in between, it won’t be able to reconnect to another zookeeper instance and keep itself

Re: How to do CDCR with basic auth?

2017-05-14 Thread Xie, Sean
? Thanks Sean On 5/14/17, 3:09 PM, "Xie, Sean" wrote: So I have configured two clusters (source and target) with basic auth with solr:SolrRocks, but when starting the source node, log is showing it couldn’t read the authentication info. I already added the –Dbasicauth=solr

How to do CDCR with basic auth?

2017-05-14 Thread Xie, Sean
So I have configured two clusters (source and target) with basic auth with solr:SolrRocks, but when starting the source node, log is showing it couldn’t read the authentication info. I already added the –Dbasicauth=solr:SolrRocks to the JVM of the solr instance. Not sure where else I can config

Re: CDCR with SSL enabled

2017-05-01 Thread Xie, Sean
From the QUEUE action, the output is: 0 0 34741356 2 stopped On 5/2/17, 1:43 AM, "Xie, Sean" wrote: Does CDCR support SSL encrypted SolrCloud? I have two clusters started with SSL, and CDCR setup instruction is followed on source and target. However, from the sol

CDCR with SSL enabled

2017-05-01 Thread Xie, Sean
Does CDCR support SSL encrypted SolrCloud? I have two clusters started with SSL, and CDCR setup instruction is followed on source and target. However, from the solr.log, I’m not able to see CDCR is occurring. Not sure what has been setup incorrectly. From the solr.log, I can’t find useful info

clusterstate.json not updated in zookeeper after creating the collection using API

2017-04-06 Thread Xie, Sean
Hi I created collection in a SolrCloud cluster (6.3.0), but found the clusterstate.json is not updated in zookeeper. It’s empty. I’m able to query cluster state using API: admin/collections?action=CLUSTERSTATUS&wt=json Any reason why clusterstate.json is not updated? Thanks Sean Confidential

solr lost connection to zookeeper

2017-03-23 Thread Xie, Sean
When Solr lost the connection to Zookeeper, is there any way to have Solr reconnect to it after zookeeper is back online? Does Solr must be restarted to re-initiate the connection? Thanks Sean Confidentiality Notice:: This email, including attachments, may include non-public, proprietary, co

Re: creating collection using collection API with SSL enabled SolrCloud

2017-02-09 Thread Xie, Sean
igured the "urlScheme" cluster property (i.e. urlScheme=https) ? https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-CLUSTERPROP:ClusterProperties Thanks Hrishikesh On Thu, Feb 9, 2017 at 8:23 AM, Xie, Sean wrot

creating collection using collection API with SSL enabled SolrCloud

2017-02-09 Thread Xie, Sean
Hi All, When trying to create the collection using the API when there are a few replicas, I’m getting error because the call seems to trying to use HTTP for the replicas. https://IP_1:8983/solr/admin/collections?action=CREATE&name=My_COLLECTION&numShards=1&replicationFactor=1&collection.configN

Re: CharacterUtils is removed from lucene-analyzers-common >6.1

2016-12-15 Thread Xie, Sean
Thanks for pointing out the java.lang.Character. I did find the existence of org.apache.lucene.analysis.CharacterUtils, but I was not able to find the needed methods in it. Sean On 12/15/16, 8:58 PM, "Shawn Heisey" wrote: On 12/15/2016 6:20 PM, Xie, Sean wrote: > We hav

CharacterUtils is removed from lucene-analyzers-common >6.1

2016-12-15 Thread Xie, Sean
Dear user group, We have implemented some customized filter/tokenizer, that is using org.apache.lucene.analysis.util.CharacterUtils. After upgrading to Solr 6.3, the class is no longer available. Is there any reason the utility class is removed? What I had to do is copy the class implementatio