Re: New leader/replica solution for HDFS

2015-03-04 Thread longsan
Our updating requests is very heavy. So we met several performance problems: 1)replicas can not catch up the index speed of leader after run some moment and had to recover, but very slow and often failed. 2)data inconsistent between leader/replica, you got different results when do same query twice

Re: New leader/replica solution for HDFS

2015-03-04 Thread longsan
I'm happy to hear that. It's good option for Solr + HDFS solution. This can avoid much performance issues. -- View this message in context: http://lucene.472066.n3.nabble.com/New-leader-replica-solution-for-HDFS-tp4188735p4191082.html Sent from the Solr - User mailing list archive at Nabble.com

Re: Solrcloud performance issues

2015-02-24 Thread longsan
why you use 15 replicas? more replicas more slower. -- View this message in context: http://lucene.472066.n3.nabble.com/Solrcloud-performance-issues-tp4186035p4188738.html Sent from the Solr - User mailing list archive at Nabble.com.

New leader/replica solution for HDFS

2015-02-24 Thread longsan
We used HDFS as our Solr index storage and we really have a heavy update load. We had met much problems with current leader/replica solution. There is duplicate index computing on Replilca side. And the data sync between leader/replica is always a problem. As HDFS already provides data replication

Re: CloudSolrServer has thread safe issue?

2014-01-21 Thread longsan
Thanks. You are right. It's the key. -- View this message in context: http://lucene.472066.n3.nabble.com/CloudSolrServer-has-thread-safe-issue-tp4112423p4112618.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: solr cloud + hdfs issue

2014-01-21 Thread longsan
thanks. i think it's a good option for me. -- View this message in context: http://lucene.472066.n3.nabble.com/solr-cloud-hdfs-issue-tp4111593p4112422.html Sent from the Solr - User mailing list archive at Nabble.com.

CloudSolrServer has thread safe issue?

2014-01-21 Thread longsan
Hi , i'm using SolrJ to do some indexing work with CloudSolrServer class. It's strange that when i start several threads (each thread add 1 documents) to add documents, the result is just only 1 can be indexed finally. But if i change the thread num as 1, everything is ok. Even if it'

solr cloud + hdfs issue

2014-01-15 Thread longsan
Hi, i'm newer for solr cloud. i met a question here. we use hdfs as file storage service and use Solr cloud to provide indexing service and query service. But solr cloud will replicate index/data files between leader and replica. And the hdfs replicates the files too. i think it wil waste disk s