Re: Bootstrap performance.

2015-04-21 Thread Robert Coli
On Mon, Apr 20, 2015 at 8:09 PM, Dikang Gu wrote: > Why do you say steaming is single threaded? I see a lot of background > streaming threads running, for example: > Imprecise : "Each stream is a single thread". As I said, first place to look is throttles... but I would not be surprised if the

Re: Bootstrap performance.

2015-04-20 Thread Dikang Gu
Hi Rob, Why do you say steaming is single threaded? I see a lot of background streaming threads running, for example: "STREAM-IN-/10.210.165.49" daemon prio=10 tid=0x7f81fc001000 nid=0x107075 runnable [0x7f836b256000] "STREAM-IN-/10.213.51.57" daemon prio=10 tid=0x7f81f0002000 nid=0x1

bootstrap performance.

2015-04-20 Thread Big Bear

Re: Bootstrap performance.

2015-04-20 Thread Robert Coli
On Mon, Apr 20, 2015 at 6:08 PM, Dikang Gu wrote: > When I bring in a new node into the cluster, it introduces significant > load to the cluster. For the new node, the cpu usage is 100%, but disk > write io is only around 50MB/s, while we have 10G network. > > Does it sound normal to you? > Have

Bootstrap performance.

2015-04-20 Thread Dikang Gu
Hi guys, We have a 100+ nodes cluster, each node has about 400G data, and is running on a flash disk. We are running 2.1.2. When I bring in a new node into the cluster, it introduces significant load to the cluster. For the new node, the cpu usage is 100%, but disk write io is only around 50MB/s,