Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-08-27 Thread Vladimir Sementsov-Ogievskiy
On 24.06.2015 03:21, John Snow wrote: On 06/17/2015 10:29 AM, Vladimir Sementsov-Ogievskiy wrote: On 12.06.2015 22:34, John Snow wrote: ... (9) Data consistency We need to discuss the data safety element to this. I think that atomically before the first write is flushed to disk, the dirty

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-08-26 Thread Stefan Hajnoczi
On Wed, Aug 26, 2015 at 09:26:20AM +0300, Vladimir Sementsov-Ogievskiy wrote: > On 12.06.2015 13:36, Stefan Hajnoczi wrote: > >On Fri, Jun 12, 2015 at 12:58:35PM +0300, Denis V. Lunev wrote: > >>On 11/06/15 23:06, Stefan Hajnoczi wrote: > >>>The load/store API is not scalable when bitmaps are 1 MB

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-08-25 Thread Vladimir Sementsov-Ogievskiy
On 12.06.2015 13:36, Stefan Hajnoczi wrote: On Fri, Jun 12, 2015 at 12:58:35PM +0300, Denis V. Lunev wrote: On 11/06/15 23:06, Stefan Hajnoczi wrote: The load/store API is not scalable when bitmaps are 1 MB or larger. For example, a 500 GB disk image with 64 KB granularity requires a 1 MB bitm

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-07-08 Thread John Snow
On 07/08/2015 08:24 AM, Vladimir Sementsov-Ogievskiy wrote: > Sorry for long delay with next version. And unfortunately it will be > longer, because now I'm very busy with other work and I'll be on > vocation from July 15 till August 3. That's fine! On my end, I'm still aware of your migration

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-07-08 Thread Vladimir Sementsov-Ogievskiy
On 24.06.2015 03:21, John Snow wrote: On 06/17/2015 10:29 AM, Vladimir Sementsov-Ogievskiy wrote: On 12.06.2015 22:34, John Snow wrote: On 06/08/2015 11:21 AM, Vladimir Sementsov-Ogievskiy wrote: v2: - rebase on my 'Dirty bitmaps migration' series - remove 'print dirty bitmap', 'query-d

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-06-23 Thread John Snow
On 06/17/2015 10:29 AM, Vladimir Sementsov-Ogievskiy wrote: > On 12.06.2015 22:34, John Snow wrote: >> >> On 06/08/2015 11:21 AM, Vladimir Sementsov-Ogievskiy wrote: >>> v2: >>> - rebase on my 'Dirty bitmaps migration' series >>> - remove 'print dirty bitmap', 'query-dirty-bitmap' and use md5

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-06-17 Thread Vladimir Sementsov-Ogievskiy
On 12.06.2015 22:34, John Snow wrote: On 06/08/2015 11:21 AM, Vladimir Sementsov-Ogievskiy wrote: v2: - rebase on my 'Dirty bitmaps migration' series - remove 'print dirty bitmap', 'query-dirty-bitmap' and use md5 for testing like with dirty bitmaps migration - autoclean features v1:

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-06-12 Thread John Snow
On 06/08/2015 11:21 AM, Vladimir Sementsov-Ogievskiy wrote: > v2: > - rebase on my 'Dirty bitmaps migration' series > - remove 'print dirty bitmap', 'query-dirty-bitmap' and use md5 for >testing like with dirty bitmaps migration > - autoclean features > > v1: > > The bitmaps are saved in

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-06-12 Thread Stefan Hajnoczi
On Fri, Jun 12, 2015 at 12:58:35PM +0300, Denis V. Lunev wrote: > On 11/06/15 23:06, Stefan Hajnoczi wrote: > >The load/store API is not scalable when bitmaps are 1 MB or larger. > > > >For example, a 500 GB disk image with 64 KB granularity requires a 1 MB > >bitmap. If a guest has several disk i

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-06-12 Thread Denis V. Lunev
On 11/06/15 23:06, Stefan Hajnoczi wrote: The load/store API is not scalable when bitmaps are 1 MB or larger. For example, a 500 GB disk image with 64 KB granularity requires a 1 MB bitmap. If a guest has several disk images of this size, then multiple megabytes must be read to start the guest

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-06-11 Thread Stefan Hajnoczi
The load/store API is not scalable when bitmaps are 1 MB or larger. For example, a 500 GB disk image with 64 KB granularity requires a 1 MB bitmap. If a guest has several disk images of this size, then multiple megabytes must be read to start the guest and written out to shut down the guest. By

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-06-11 Thread Stefan Hajnoczi
On Thu, Jun 11, 2015 at 02:22:35PM +0300, Vladimir Sementsov-Ogievskiy wrote: > On 10.06.2015 18:27, Stefan Hajnoczi wrote: > >On Mon, Jun 08, 2015 at 06:21:18PM +0300, Vladimir Sementsov-Ogievskiy wrote: > >>QCow2 header is extended by fields 'nb_dirty_bitmaps' and > >>'dirty_bitmaps_offset' like

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-06-11 Thread Vladimir Sementsov-Ogievskiy
On 10.06.2015 18:27, Stefan Hajnoczi wrote: On Mon, Jun 08, 2015 at 06:21:18PM +0300, Vladimir Sementsov-Ogievskiy wrote: QCow2 header is extended by fields 'nb_dirty_bitmaps' and 'dirty_bitmaps_offset' like with snapshots. Proposed command line syntax is the following: -dirty-bitmap [option1=

Re: [Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-06-10 Thread Stefan Hajnoczi
On Mon, Jun 08, 2015 at 06:21:18PM +0300, Vladimir Sementsov-Ogievskiy wrote: > QCow2 header is extended by fields 'nb_dirty_bitmaps' and > 'dirty_bitmaps_offset' like with snapshots. > > Proposed command line syntax is the following: > > -dirty-bitmap [option1=val1][,option2=val2]... Two questi

[Qemu-devel] [PATCH v2 RFC 0/8] block: persistent dirty bitmaps

2015-06-08 Thread Vladimir Sementsov-Ogievskiy
v2: - rebase on my 'Dirty bitmaps migration' series - remove 'print dirty bitmap', 'query-dirty-bitmap' and use md5 for testing like with dirty bitmaps migration - autoclean features v1: The bitmaps are saved into qcow2 file format. It provides both 'internal' and 'external' dirty bitmaps f