Re: [Qemu-devel] [RFC V6 00/33] QCOW2 deduplication core functionality

2013-02-11 Thread Stefan Hajnoczi
On Mon, Feb 11, 2013 at 03:50:10AM +0100, Benoît Canet wrote: > As you can read dedup keep me awake at night. > > I still think that there is a need for a deduplication implementation > that would perform nearly as fast as regular qcow2. > > I though about this: http://en.wikipedia.org/wiki/Norma

Re: [Qemu-devel] [RFC V6 00/33] QCOW2 deduplication core functionality

2013-02-10 Thread Benoît Canet
Hello Stefan, As you can read dedup keep me awake at night. I still think that there is a need for a deduplication implementation that would perform nearly as fast as regular qcow2. I though about this: http://en.wikipedia.org/wiki/Normal_distribution. Not all block are equals for deduplicatio

Re: [Qemu-devel] [RFC V6 00/33] QCOW2 deduplication core functionality

2013-02-08 Thread Eric Blake
On 02/08/2013 06:49 AM, Stefan Hajnoczi wrote: > On Wed, Feb 06, 2013 at 01:31:33PM +0100, Benoît Canet wrote: >> This patchset create the core infrastructure for deduplication and enable it. > > Here is a high-level overview of qcow2 dedup for others reviewing this series: Awesome. Benoît, how

Re: [Qemu-devel] [RFC V6 00/33] QCOW2 deduplication core functionality

2013-02-08 Thread Stefan Hajnoczi
On Wed, Feb 06, 2013 at 01:31:33PM +0100, Benoît Canet wrote: > This patchset create the core infrastructure for deduplication and enable it. Here is a high-level overview of qcow2 dedup for others reviewing this series: Data structures --- Deduplication adds one new on-disk structur

[Qemu-devel] [RFC V6 00/33] QCOW2 deduplication core functionality

2013-02-06 Thread Benoît Canet
This patchset create the core infrastructure for deduplication and enable it. One can compile and install https://github.com/wernerd/Skein3Fish and use the --enable-skein-dedup configure option in order to use the faster skein HASH. Images must be created with "-o dedup=[skein|sha256]" in order t