[PATCH v9 11/12] migration/multifd: Add integration tests for multifd with Intel DSA offloading.

2024-12-24 Thread Yichen Wang
From: Hao Xiang * Add test case to start and complete multifd live migration with DSA offloading enabled. * Add test case to start and cancel multifd live migration with DSA offloading enabled. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Reviewed-by

[PATCH v9 02/12] util/dsa: Add idxd into linux header copy list.

2024-12-24 Thread Yichen Wang
Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- scripts/update-linux-headers.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/update-linux-headers.sh b/scripts/update-linux-headers.sh index 99a8d9fa4c..9128c7499b 100755 --- a/scripts/update-linux

[PATCH v9 06/12] util/dsa: Implement zero page checking in DSA task.

2024-12-24 Thread Yichen Wang
task must contain at least two individual tasks. There are times we need to submit a single task and hence a single DSA task submission is also required. Signed-off-by: Hao Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- include/qemu/dsa.h | 36

[PATCH v9 03/12] util/dsa: Implement DSA device start and stop logic.

2024-12-24 Thread Yichen Wang
From: Hao Xiang * DSA device open and close. * DSA group contains multiple DSA devices. * DSA group configure/start/stop/clean. Signed-off-by: Hao Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- include/qemu/dsa.h | 99 util

[PATCH v9 10/12] util/dsa: Add unit test coverage for Intel DSA task submission and completion.

2024-12-24 Thread Yichen Wang
From: Hao Xiang * Test DSA start and stop path. * Test DSA configure and cleanup path. * Test DSA task submission and completion path. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- tests/unit/meson.build | 6 + tests/unit/test-dsa.c | 504

[PATCH v9 09/12] migration/multifd: Enable DSA offloading in multifd sender path.

2024-12-24 Thread Yichen Wang
accelerator. The sender thread submits a batch of pages to DSA hardware and waits for the DSA completion thread to signal for work completion. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- migration/multifd-zero-page.c | 149 ++ migration/multifd.c

[PATCH v9 05/12] util/dsa: Implement DSA task asynchronous completion thread model.

2024-12-24 Thread Yichen Wang
m DSA task completion checking. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- include/qemu/dsa.h | 1 + util/dsa.c | 272 - 2 files changed, 272 insertions(+), 1 deletion(-) diff --git a/include/qemu/dsa.h b/in

[PATCH v9 00/12] Use Intel DSA accelerator to offload zero page checking in multifd live migration.

2024-12-24 Thread Yichen Wang
dd unit test coverage for Intel DSA task submission and completion. migration/multifd: Add integration tests for multifd with Intel DSA offloading. Yichen Wang (1): util/dsa: Add idxd into linux header copy list. Yuan Liu (1): migration/doc: Add DSA zero page detection doc .../migrat

[PATCH v9 04/12] util/dsa: Implement DSA task enqueue and dequeue.

2024-12-24 Thread Yichen Wang
From: Hao Xiang * Use a safe thread queue for DSA task enqueue/dequeue. * Implement DSA task submission. * Implement DSA batch task submission. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- include/qemu/dsa.h | 29 +++ util/dsa.c | 186

[PATCH v9 07/12] util/dsa: Implement DSA task asynchronous submission and wait for completion.

2024-12-24 Thread Yichen Wang
Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- include/qemu/dsa.h | 14 + util/dsa.c | 125 +++-- 2 files changed, 135 insertions(+), 4 deletions(-) diff --git a/include/qemu/dsa.h b/include/qemu/

[PATCH v9 12/12] migration/doc: Add DSA zero page detection doc

2024-12-24 Thread Yichen Wang
From: Yuan Liu Signed-off-by: Yuan Liu Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- .../migration/dsa-zero-page-detection.rst | 290 ++ docs/devel/migration/features.rst | 1 + 2 files changed, 291 insertions(+) create mode 100644 docs/devel

[PATCH v9 08/12] migration/multifd: Add new migration option for multifd DSA offloading.

2024-12-24 Thread Yichen Wang
ned off by default. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Acked-by: Dr. David Alan Gilbert --- hmp-commands.hx| 2 +- include/qemu/dsa.h | 13 + migration/migration-hmp-cmds.c | 20 +++- migration/options.c

[PATCH v9 01/12] meson: Introduce new instruction set enqcmd to the build system.

2024-12-24 Thread Yichen Wang
From: Hao Xiang Enable instruction set enqcmd in build. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- meson.build | 14 ++ meson_options.txt | 2 ++ scripts/meson-buildoptions.sh | 3 +++ 3 files changed, 19

Re: [PATCH v8 08/12] migration/multifd: Add new migration option for multifd DSA offloading.

2024-12-23 Thread Yichen Wang
On Tue, Dec 3, 2024 at 6:12 PM Yichen Wang wrote: > > From: Hao Xiang > > Intel DSA offloading is an optional feature that turns on if > proper hardware and software stack is available. To turn on > DSA offloading in multifd live migration by setting: > > zero-page-det

Re: [External] Re: [PATCH v8 09/12] migration/multifd: Enable DSA offloading in multifd sender path.

2024-12-19 Thread Yichen Wang
On Tue, Dec 17, 2024 at 9:56 AM Fabiano Rosas wrote: > > Yichen Wang writes: > > > From: Hao Xiang > > > > Multifd sender path gets an array of pages queued by the migration > > thread. It performs zero page checking on every page in the array. > > The pa

[PATCH v8 09/12] migration/multifd: Enable DSA offloading in multifd sender path.

2024-12-03 Thread Yichen Wang
accelerator. The sender thread submits a batch of pages to DSA hardware and waits for the DSA completion thread to signal for work completion. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- migration/multifd-zero-page.c | 149 ++ migration/multifd.c

[PATCH v8 05/12] util/dsa: Implement DSA task asynchronous completion thread model.

2024-12-03 Thread Yichen Wang
m DSA task completion checking. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- include/qemu/dsa.h | 1 + util/dsa.c | 272 - 2 files changed, 272 insertions(+), 1 deletion(-) diff --git a/include/qemu/dsa.h b/in

[PATCH v8 10/12] util/dsa: Add unit test coverage for Intel DSA task submission and completion.

2024-12-03 Thread Yichen Wang
From: Hao Xiang * Test DSA start and stop path. * Test DSA configure and cleanup path. * Test DSA task submission and completion path. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- tests/unit/meson.build | 6 + tests/unit/test-dsa.c | 503

[PATCH v8 08/12] migration/multifd: Add new migration option for multifd DSA offloading.

2024-12-03 Thread Yichen Wang
ned off by default. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Acked-by: Dr. David Alan Gilbert --- hmp-commands.hx| 2 +- include/qemu/dsa.h | 13 + migration/migration-hmp-cmds.c | 20 +++- migration/options.c

[PATCH v8 01/12] meson: Introduce new instruction set enqcmd to the build system.

2024-12-03 Thread Yichen Wang
From: Hao Xiang Enable instruction set enqcmd in build. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- meson.build | 14 ++ meson_options.txt | 2 ++ scripts/meson-buildoptions.sh | 3 +++ 3 files changed, 19

[PATCH v8 02/12] util/dsa: Add idxd into linux header copy list.

2024-12-03 Thread Yichen Wang
Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- scripts/update-linux-headers.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/update-linux-headers.sh b/scripts/update-linux-headers.sh index 99a8d9fa4c..9128c7499b 100755 --- a/scripts/update-linux

[PATCH v8 07/12] util/dsa: Implement DSA task asynchronous submission and wait for completion.

2024-12-03 Thread Yichen Wang
Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 14 + util/dsa.c | 125 +++-- 2 files changed, 135 insertions(+), 4 deletions(-) diff --git a/include/qemu/dsa.h b/include/qemu/dsa.h index a9aa394e5b..49723

[PATCH v8 12/12] migration/doc: Add DSA zero page detection doc

2024-12-03 Thread Yichen Wang
From: Yuan Liu Signed-off-by: Yuan Liu Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- .../migration/dsa-zero-page-detection.rst | 290 ++ docs/devel/migration/features.rst | 1 + 2 files changed, 291 insertions(+) create mode 100644 docs/devel

[PATCH v8 00/12] Use Intel DSA accelerator to offload zero page checking in multifd live migration.

2024-12-03 Thread Yichen Wang
ation/multifd: Add new migration option for multifd DSA offloading. migration/multifd: Enable DSA offloading in multifd sender path. util/dsa: Add unit test coverage for Intel DSA task submission and completion. migration/multifd: Add integration tests for multifd with Intel DSA off

[PATCH v8 11/12] migration/multifd: Add integration tests for multifd with Intel DSA offloading.

2024-12-03 Thread Yichen Wang
From: Hao Xiang * Add test case to start and complete multifd live migration with DSA offloading enabled. * Add test case to start and cancel multifd live migration with DSA offloading enabled. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Reviewed-by

[PATCH v8 04/12] util/dsa: Implement DSA task enqueue and dequeue.

2024-12-03 Thread Yichen Wang
From: Hao Xiang * Use a safe thread queue for DSA task enqueue/dequeue. * Implement DSA task submission. * Implement DSA batch task submission. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- include/qemu/dsa.h | 29 +++ util/dsa.c | 186

[PATCH v8 03/12] util/dsa: Implement DSA device start and stop logic.

2024-12-03 Thread Yichen Wang
From: Hao Xiang * DSA device open and close. * DSA group contains multiple DSA devices. * DSA group configure/start/stop/clean. Signed-off-by: Hao Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 99 util/dsa.c | 280

[PATCH v8 06/12] util/dsa: Implement zero page checking in DSA task.

2024-12-03 Thread Yichen Wang
task must contain at least two individual tasks. There are times we need to submit a single task and hence a single DSA task submission is also required. Signed-off-by: Hao Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 36 ++- util/dsa.c | 238

Re: [External] Re: [PATCH v7 09/12] migration/multifd: Enable DSA offloading in multifd sender path.

2024-12-02 Thread Yichen Wang
On Tue, Nov 26, 2024 at 5:23 AM Fabiano Rosas wrote: > > Yichen Wang writes: > > > On Thu, Nov 21, 2024 at 12:52 PM Fabiano Rosas wrote: > >> > >> Yichen Wang writes: > >> > >> > From: Hao Xiang > >> > > >> > Multif

Re: [External] Re: [PATCH v7 00/12] Use Intel DSA accelerator to offload zero page checking in multifd live migration.

2024-11-25 Thread Yichen Wang
On Tue, Nov 19, 2024 at 1:31 PM Fabiano Rosas wrote: > > Yichen Wang writes: > > > v7 > > * Rebase on top of f0a5a31c33a8109061c2493e475c8a2f4d022432; > > * Fix a bug that will crash QEMU when DSA initialization failed; > > * Use a more generalized accel-p

Re: [External] Re: [PATCH v7 09/12] migration/multifd: Enable DSA offloading in multifd sender path.

2024-11-25 Thread Yichen Wang
On Thu, Nov 21, 2024 at 12:52 PM Fabiano Rosas wrote: > > Yichen Wang writes: > > > From: Hao Xiang > > > > Multifd sender path gets an array of pages queued by the migration > > thread. It performs zero page checking on every page in the array. > > The pa

Re: [External] Re: [PATCH v7 06/12] util/dsa: Implement zero page checking in DSA task.

2024-11-25 Thread Yichen Wang
On Mon, Nov 25, 2024 at 7:53 AM Fabiano Rosas wrote: > > Yichen Wang writes: > > > From: Hao Xiang > > > > Create DSA task with operation code DSA_OPCODE_COMPVAL. > > Here we create two types of DSA tasks, a single DSA task and > > a batch DSA task.

[PATCH v7 11/12] migration/multifd: Add integration tests for multifd with Intel DSA offloading.

2024-11-14 Thread Yichen Wang
From: Hao Xiang * Add test case to start and complete multifd live migration with DSA offloading enabled. * Add test case to start and cancel multifd live migration with DSA offloading enabled. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- tests/qtest

[PATCH v7 06/12] util/dsa: Implement zero page checking in DSA task.

2024-11-14 Thread Yichen Wang
task must contain at least two individual tasks. There are times we need to submit a single task and hence a single DSA task submission is also required. Signed-off-by: Hao Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 44 ++-- util/dsa.c | 254

[PATCH v7 07/12] util/dsa: Implement DSA task asynchronous submission and wait for completion.

2024-11-14 Thread Yichen Wang
Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 14 + util/dsa.c | 125 +++-- 2 files changed, 135 insertions(+), 4 deletions(-) diff --git a/include/qemu/dsa.h b/include/qemu/dsa.h index cb407b8b49..82848

[PATCH v7 02/12] util/dsa: Add idxd into linux header copy list.

2024-11-14 Thread Yichen Wang
Signed-off-by: Yichen Wang --- scripts/update-linux-headers.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/update-linux-headers.sh b/scripts/update-linux-headers.sh index 99a8d9fa4c..9128c7499b 100755 --- a/scripts/update-linux-headers.sh +++ b/scripts/update

[PATCH v7 12/12] migration/doc: Add DSA zero page detection doc

2024-11-14 Thread Yichen Wang
From: Yuan Liu Signed-off-by: Yuan Liu Signed-off-by: Yichen Wang --- .../migration/dsa-zero-page-detection.rst | 290 ++ docs/devel/migration/features.rst | 1 + 2 files changed, 291 insertions(+) create mode 100644 docs/devel/migration/dsa-zero-page

[PATCH v7 03/12] util/dsa: Implement DSA device start and stop logic.

2024-11-14 Thread Yichen Wang
From: Hao Xiang * DSA device open and close. * DSA group contains multiple DSA devices. * DSA group configure/start/stop/clean. Signed-off-by: Hao Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 103 + util/dsa.c | 280

[PATCH v7 00/12] Use Intel DSA accelerator to offload zero page checking in multifd live migration.

2024-11-14 Thread Yichen Wang
for Intel DSA task submission and completion. migration/multifd: Add integration tests for multifd with Intel DSA offloading. Yichen Wang (1): util/dsa: Add idxd into linux header copy list. Yuan Liu (1): migration/doc: Add DSA zero page detection doc .../migration/dsa-zero-

[PATCH v7 09/12] migration/multifd: Enable DSA offloading in multifd sender path.

2024-11-14 Thread Yichen Wang
accelerator. The sender thread submits a batch of pages to DSA hardware and waits for the DSA completion thread to signal for work completion. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- migration/multifd-zero-page.c | 129 ++ migration/multifd.c

[PATCH v7 08/12] migration/multifd: Add new migration option for multifd DSA offloading.

2024-11-14 Thread Yichen Wang
turned off by default. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- hmp-commands.hx| 2 +- include/qemu/dsa.h | 13 + migration/migration-hmp-cmds.c | 19 ++- migration/options.c| 30 ++

[PATCH v7 04/12] util/dsa: Implement DSA task enqueue and dequeue.

2024-11-14 Thread Yichen Wang
From: Hao Xiang * Use a safe thread queue for DSA task enqueue/dequeue. * Implement DSA task submission. * Implement DSA batch task submission. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 29 +++ util/dsa.c | 202

[PATCH v7 10/12] util/dsa: Add unit test coverage for Intel DSA task submission and completion.

2024-11-14 Thread Yichen Wang
From: Hao Xiang * Test DSA start and stop path. * Test DSA configure and cleanup path. * Test DSA task submission and completion path. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- tests/unit/meson.build | 6 + tests/unit/test-dsa.c | 503

[PATCH v7 01/12] meson: Introduce new instruction set enqcmd to the build system.

2024-11-14 Thread Yichen Wang
From: Hao Xiang Enable instruction set enqcmd in build. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- meson.build | 14 ++ meson_options.txt | 2 ++ scripts/meson-buildoptions.sh | 3 +++ 3 files changed, 19 insertions(+) diff --git a

[PATCH v7 05/12] util/dsa: Implement DSA task asynchronous completion thread model.

2024-11-14 Thread Yichen Wang
m DSA task completion checking. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 1 + util/dsa.c | 274 - 2 files changed, 274 insertions(+), 1 deletion(-) diff --git a/include/qemu/dsa.h b/include/qemu/dsa.h index

Re: [External] Re: [PATCH v6 08/12] migration/multifd: Add new migration option for multifd DSA offloading.

2024-10-15 Thread Yichen Wang
On Fri, Oct 11, 2024 at 10:14 AM Dr. David Alan Gilbert wrote: > > * Yichen Wang (yichen.w...@bytedance.com) wrote: > > From: Hao Xiang > > Please split the cpuid stuff out into a separate patch; it feels like > it should be in some x86 specific place. DSA is an Intel f

Re: [External] Re: [PATCH v6 00/12] Use Intel DSA accelerator to offload zero page checking in multifd live migration.

2024-10-15 Thread Yichen Wang
On Fri, Oct 11, 2024 at 7:14 AM Fabiano Rosas wrote: > > Yichen Wang writes: > > > Still doesn't build without DSA: > > qemu/include/qemu/dsa.h: In function > ‘buffer_is_zero_dsa_batch_sync’: > /home/fabiano/kvm/qemu/include/qemu/dsa.h:183:16: error: ‘errp’

Re: [External] Re: [PATCH v6 00/12] Use Intel DSA accelerator to offload zero page checking in multifd live migration.

2024-10-15 Thread Yichen Wang
On Fri, Oct 11, 2024 at 9:32 AM Peter Xu wrote: > > On Wed, Oct 09, 2024 at 04:45:58PM -0700, Yichen Wang wrote: > > The doc update is still missing under docs/, we may need that for a final > merge. > I will work with Intel to prepare a doc in my next patch. > Are you usi

[PATCH v6 03/12] util/dsa: Implement DSA device start and stop logic.

2024-10-09 Thread Yichen Wang
From: Hao Xiang * DSA device open and close. * DSA group contains multiple DSA devices. * DSA group configure/start/stop/clean. Signed-off-by: Hao Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 103 + util/dsa.c | 282

[PATCH v6 05/12] util/dsa: Implement DSA task asynchronous completion thread model.

2024-10-09 Thread Yichen Wang
m DSA task completion checking. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 1 + util/dsa.c | 274 - 2 files changed, 274 insertions(+), 1 deletion(-) diff --git a/include/qemu/dsa.h b/include/qemu/dsa.h index

[PATCH v6 09/12] migration/multifd: Enable DSA offloading in multifd sender path.

2024-10-09 Thread Yichen Wang
accelerator. The sender thread submits a batch of pages to DSA hardware and waits for the DSA completion thread to signal for work completion. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- migration/multifd-zero-page.c | 133 ++ migration/multifd.c

[PATCH v6 04/12] util/dsa: Implement DSA task enqueue and dequeue.

2024-10-09 Thread Yichen Wang
From: Hao Xiang * Use a safe thread queue for DSA task enqueue/dequeue. * Implement DSA task submission. * Implement DSA batch task submission. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 29 +++ util/dsa.c | 202

[PATCH v6 08/12] migration/multifd: Add new migration option for multifd DSA offloading.

2024-10-09 Thread Yichen Wang
feature is turned off by default. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- hmp-commands.hx| 2 +- include/qemu/dsa.h | 13 + migration/migration-hmp-cmds.c | 19 ++- migration/options.c| 30

[PATCH v6 12/12] migration/multifd: Add integration tests for multifd with Intel DSA offloading.

2024-10-09 Thread Yichen Wang
From: Hao Xiang * Add test case to start and complete multifd live migration with DSA offloading enabled. * Add test case to start and cancel multifd live migration with DSA offloading enabled. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- tests/qtest

[PATCH v6 06/12] util/dsa: Implement zero page checking in DSA task.

2024-10-09 Thread Yichen Wang
task must contain at least two individual tasks. There are times we need to submit a single task and hence a single DSA task submission is also required. Signed-off-by: Hao Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 45 ++-- util/dsa.c | 254

[PATCH v6 10/12] migration/multifd: Add migration option set packet size.

2024-10-09 Thread Yichen Wang
Signed-off-by: Yichen Wang --- migration/migration-hmp-cmds.c | 7 ++ migration/multifd-zlib.c | 6 -- migration/multifd-zstd.c | 6 -- migration/options.c| 39 ++ migration/options.h| 1 + qapi/migration.json

[PATCH v6 07/12] util/dsa: Implement DSA task asynchronous submission and wait for completion.

2024-10-09 Thread Yichen Wang
Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 14 + util/dsa.c | 125 +++-- 2 files changed, 135 insertions(+), 4 deletions(-) diff --git a/include/qemu/dsa.h b/include/qemu/dsa.h index 89841a6ffa..a3b50

[PATCH v6 00/12] Use Intel DSA accelerator to offload zero page checking in multifd live migration.

2024-10-09 Thread Yichen Wang
tifd sender path. migration/multifd: Add migration option set packet size. util/dsa: Add unit test coverage for Intel DSA task submission and completion. migration/multifd: Add integration tests for multifd with Intel DSA offloading. Yichen Wang (1): util/dsa: Add idxd into linux heade

[PATCH v6 11/12] util/dsa: Add unit test coverage for Intel DSA task submission and completion.

2024-10-09 Thread Yichen Wang
From: Hao Xiang * Test DSA start and stop path. * Test DSA configure and cleanup path. * Test DSA task submission and completion path. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- tests/unit/meson.build | 6 + tests/unit/test-dsa.c | 503

[PATCH v6 02/12] util/dsa: Add idxd into linux header copy list.

2024-10-09 Thread Yichen Wang
Signed-off-by: Yichen Wang --- scripts/update-linux-headers.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/update-linux-headers.sh b/scripts/update-linux-headers.sh index c34ac6454e..5aba95d9cb 100755 --- a/scripts/update-linux-headers.sh +++ b/scripts/update

[PATCH v6 01/12] meson: Introduce new instruction set enqcmd to the build system.

2024-10-09 Thread Yichen Wang
From: Hao Xiang Enable instruction set enqcmd in build. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- meson.build | 14 ++ meson_options.txt | 2 ++ scripts/meson-buildoptions.sh | 3 +++ 3 files changed, 19 insertions(+) diff --git a

Re: [External] [PATCH] migration/multifd: Fix build for qatzip

2024-09-10 Thread Yichen Wang
build issues. No need to copy stable as it just landed 9.2. > > Cc: Yichen Wang > Cc: Bryan Zhang > Cc: Hao Xiang > Cc: Yuan Liu > Fixes: 80484f9459 ("migration: Introduce 'qatzip' compression method") > Signed-off-by: Peter Xu > --- > >

Re: [External] Re: [PATCH v5 10/13] migration/multifd: Enable DSA offloading in multifd sender path.

2024-09-09 Thread Yichen Wang
On Wed, Jul 17, 2024 at 7:41 AM Fabiano Rosas wrote: > > Yichen Wang writes: > > > From: Hao Xiang > > > > Multifd sender path gets an array of pages queued by the migration > > thread. It performs zero page checking on every page in the array. > > The pa

Re: [External] RE: [PATCH v5 01/13] meson: Introduce new instruction set enqcmd to the build system.

2024-09-09 Thread Yichen Wang
On Mon, Jul 15, 2024 at 8:02 AM Liu, Yuan1 wrote: > > > -Original Message- > > From: Yichen Wang > > Sent: Friday, July 12, 2024 5:53 AM > > To: Paolo Bonzini ; Marc-André Lureau > > ; Daniel P. Berrangé ; > > Thomas Huth ; Philippe Mathieu-Daudé &g

Re: [External] Re: [PATCH v5 08/13] migration/multifd: Add new migration option for multifd DSA offloading.

2024-09-06 Thread Yichen Wang
On Wed, Jul 24, 2024 at 7:50 AM Markus Armbruster wrote: > > Fabiano Rosas writes: > > > Yichen Wang writes: > > > >> On Thu, Jul 11, 2024 at 2:53 PM Yichen Wang > >> wrote: > >> > >>> diff --git a/migration/options.c b/migration/opt

Re: [External] Re: [PATCH v9 3/5] migration: Add migration parameters for QATzip

2024-09-05 Thread Yichen Wang
On Wed, Sep 4, 2024 at 11:11 PM Prasad Pandit wrote: > > On Sat, 31 Aug 2024 at 04:58, Yichen Wang wrote: > > +/* > > + * 1: best speed, ... 9: best compress ratio > > + * There is some nuance here. Refer to QATzip documentation to understand > > + * the mappin

[PATCH v9 5/5] tests/migration: Add integration test for 'qatzip' compression method

2024-08-30 Thread Yichen Wang
From: Bryan Zhang Adds an integration test for 'qatzip'. Reviewed-by: Fabiano Rosas Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- tests/qtest/migration-test.c | 27 +++ 1 file changed, 27 insertions(+) diff --git a/t

[PATCH v9 1/5] docs/migration: add qatzip compression feature

2024-08-30 Thread Yichen Wang
From: Yuan Liu add Intel QATzip compression method introduction Reviewed-by: Nanhai Zou Reviewed-by: Peter Xu Reviewed-by: Fabiano Rosas Signed-off-by: Yuan Liu Signed-off-by: Yichen Wang --- docs/devel/migration/features.rst | 1 + docs/devel/migration/qatzip-compression.rst

[PATCH v9 3/5] migration: Add migration parameters for QATzip

2024-08-30 Thread Yichen Wang
From: Bryan Zhang Adds support for migration parameters to control QATzip compression level. Acked-by: Markus Armbruster Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- migration/migration-hmp-cmds.c | 4 migration/options.c| 34

[PATCH v9 2/5] meson: Introduce 'qatzip' feature to the build system

2024-08-30 Thread Yichen Wang
From: Bryan Zhang Add a 'qatzip' feature, which is automatically disabled, and which depends on the QATzip library if enabled. Reviewed-by: Fabiano Rosas Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- meson.build

[PATCH v9 0/5] Implement QATzip compression method

2024-08-30 Thread Yichen Wang
ests/qtest/migration-test.c| 27 ++ 14 files changed, 667 insertions(+), 3 deletions(-) create mode 100644 docs/devel/migration/qatzip-compression.rst create mode 100644 migration/multifd-qatzip.c -- Yichen Wang

[PATCH v9 4/5] migration: Introduce 'qatzip' compression method

2024-08-30 Thread Yichen Wang
an Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- hw/core/qdev-properties-system.c | 2 +- migration/meson.build| 1 + migration/multifd-qatzip.c | 394 +++ migration/multifd.h | 5 +- qapi/migration.json

Re: [External] Re: [PATCH v8 4/5] migration: Introduce 'qatzip' compression method

2024-08-23 Thread Yichen Wang
On Thu, Aug 22, 2024 at 4:06 AM Prasad Pandit wrote: > > Hello, > > On Tue, 20 Aug 2024 at 22:40, Yichen Wang wrote: > > +static int qatzip_send_setup(MultiFDSendParams *p, Error **errp) > > +{ > > +QatzipData *q; > > +QzSessionParamsDeflate_T

Re: [External] Re: [PATCH v8 3/5] migration: Add migration parameters for QATzip

2024-08-21 Thread Yichen Wang
On Wed, Aug 21, 2024 at 4:56 AM Prasad Pandit wrote: > > On Tue, 20 Aug 2024 at 22:40, Yichen Wang wrote: > > Adds support for migration parameters to control QATzip compression > > level and to enable/disable software fallback when QAT hardware is > > unavailable. This

[PATCH v8 5/5] tests/migration: Add integration test for 'qatzip' compression method

2024-08-20 Thread Yichen Wang
From: Bryan Zhang Adds an integration test for 'qatzip'. Reviewed-by: Fabiano Rosas Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- tests/qtest/migration-test.c | 27 +++ 1 file changed, 27 insertions(+) diff --git a/t

[PATCH v8 3/5] migration: Add migration parameters for QATzip

2024-08-20 Thread Yichen Wang
Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- migration/migration-hmp-cmds.c | 4 migration/options.c| 34 ++ migration/options.h| 1 + qapi/migration.json| 18 ++ 4 files

[PATCH v8 0/5] Implement QATzip compression method

2024-08-20 Thread Yichen Wang
igration/options.h | 1 + qapi/migration.json | 21 ++ scripts/meson-buildoptions.sh | 3 + tests/qtest/migration-test.c| 27 ++ 14 files changed, 667 insertions(+), 3 deletions(-) create mode 100644 docs/devel/migration/qatzip-compression.rst create mode 100644 migration/multifd-qatzip.c -- Yichen Wang

[PATCH v8 4/5] migration: Introduce 'qatzip' compression method

2024-08-20 Thread Yichen Wang
ao Xiang Signed-off-by: Yichen Wang --- hw/core/qdev-properties-system.c | 2 +- migration/meson.build| 1 + migration/multifd-qatzip.c | 394 +++ migration/multifd.h | 5 +- qapi/migration.json | 3 + 5 files changed,

[PATCH v8 2/5] meson: Introduce 'qatzip' feature to the build system

2024-08-20 Thread Yichen Wang
From: Bryan Zhang Add a 'qatzip' feature, which is automatically disabled, and which depends on the QATzip library if enabled. Reviewed-by: Fabiano Rosas Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- meson.build

[PATCH v8 1/5] docs/migration: add qatzip compression feature

2024-08-20 Thread Yichen Wang
From: Yuan Liu add Intel QATzip compression method introduction Reviewed-by: Nanhai Zou Reviewed-by: Peter Xu Signed-off-by: Yuan Liu Signed-off-by: Yichen Wang --- docs/devel/migration/features.rst | 1 + docs/devel/migration/qatzip-compression.rst | 165

[PATCH v7 1/5] docs/migration: add qatzip compression feature

2024-08-14 Thread Yichen Wang
From: Yuan Liu add Intel QATzip compression method introduction Signed-off-by: Yuan Liu Reviewed-by: Nanhai Zou Reviewed-by: Peter Xu Reviewed-by: Yichen Wang --- docs/devel/migration/features.rst | 1 + docs/devel/migration/qatzip-compression.rst | 165 2

[PATCH v7 3/5] migration: Add migration parameters for QATzip

2024-08-14 Thread Yichen Wang
Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Acked-by: Markus Armbruster --- migration/migration-hmp-cmds.c | 4 migration/options.c| 34 ++ migration/options.h| 1 + qapi/migration.json| 18 ++ 4 files

[PATCH v7 4/5] migration: Introduce 'qatzip' compression method

2024-08-14 Thread Yichen Wang
From: Bryan Zhang Adds support for 'qatzip' as an option for the multifd compression method parameter, and implements using QAT for 'qatzip' compression and decompression. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Acked-by: Markus Armb

[PATCH v7 2/5] meson: Introduce 'qatzip' feature to the build system

2024-08-14 Thread Yichen Wang
From: Bryan Zhang Add a 'qatzip' feature, which is automatically disabled, and which depends on the QATzip library if enabled. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- meson.build | 10 ++ meson_options.txt

[PATCH v7 5/5] tests/migration: Add integration test for 'qatzip' compression method

2024-08-14 Thread Yichen Wang
From: Bryan Zhang Adds an integration test for 'qatzip'. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- tests/qtest/migration-test.c | 27 +++ 1 file changed, 27 insertions(+) diff --git a/t

[PATCH v7 0/5] Implement QATzip compression method

2024-08-14 Thread Yichen Wang
ptions.sh | 3 + tests/qtest/migration-test.c| 27 ++ 14 files changed, 667 insertions(+), 3 deletions(-) create mode 100644 docs/devel/migration/qatzip-compression.rst create mode 100644 migration/multifd-qatzip.c -- Yichen Wang

[PATCH v6 1/5] docs/migration: add qatzip compression feature

2024-07-15 Thread Yichen Wang
From: Yuan Liu add Intel QATzip compression method introduction Signed-off-by: Yuan Liu Reviewed-by: Nanhai Zou Reviewed-by: Peter Xu Reviewed-by: Yichen Wang --- docs/devel/migration/features.rst | 1 + docs/devel/migration/qatzip-compression.rst | 251 2

[PATCH v6 4/5] migration: Introduce 'qatzip' compression method

2024-07-15 Thread Yichen Wang
From: Bryan Zhang Adds support for 'qatzip' as an option for the multifd compression method parameter, and implements using QAT for 'qatzip' compression and decompression. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- hw/core/qdev

[PATCH v6 5/5] tests/migration: Add integration test for 'qatzip' compression method

2024-07-15 Thread Yichen Wang
From: Bryan Zhang Adds an integration test for 'qatzip'. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang Reviewed-by: Fabiano Rosas --- tests/qtest/migration-test.c | 31 +++ 1 file changed, 31 insertions(+) diff --g

[PATCH v6 3/5] migration: Add migration parameters for QATzip

2024-07-15 Thread Yichen Wang
Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- migration/migration-hmp-cmds.c | 4 migration/options.c| 34 ++ migration/options.h| 1 + qapi/migration.json| 18 ++ 4 files changed, 57 insertions

[PATCH v6 0/5] Implement QATzip compression method

2024-07-15 Thread Yichen Wang
| 21 ++ scripts/meson-buildoptions.sh | 3 + tests/qtest/meson.build | 4 + tests/qtest/migration-test.c| 31 ++ 15 files changed, 749 insertions(+), 3 deletions(-) create mode 100644 docs/devel/migration/qatzip-compression.rst create mode 100644 migration/multifd-qatzip.c -- Yichen Wang

[PATCH v6 2/5] meson: Introduce 'qatzip' feature to the build system

2024-07-15 Thread Yichen Wang
From: Bryan Zhang Add a 'qatzip' feature, which is automatically disabled, and which depends on the QATzip library if enabled. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- meson.build | 10 ++ meson_options.txt

Re: [External] Re: [PATCH v5 4/5] migration: Introduce 'qatzip' compression method

2024-07-13 Thread Yichen Wang
On Fri, Jul 12, 2024 at 7:17 AM Fabiano Rosas wrote: > > Yichen Wang writes: > > > From: Bryan Zhang > > > > Adds support for 'qatzip' as an option for the multifd compression > > method parameter, and implements using QAT for 'qatzip' com

[PATCH v5 13/13] migration/multifd: Add integration tests for multifd with Intel DSA offloading.

2024-07-11 Thread Yichen Wang
From: Hao Xiang * Add test case to start and complete multifd live migration with DSA offloading enabled. * Add test case to start and cancel multifd live migration with DSA offloading enabled. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- tests/qtest

[PATCH v5 12/13] util/dsa: Add unit test coverage for Intel DSA task submission and completion.

2024-07-11 Thread Yichen Wang
From: Hao Xiang * Test DSA start and stop path. * Test DSA configure and cleanup path. * Test DSA task submission and completion path. Signed-off-by: Bryan Zhang Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- tests/unit/meson.build | 6 + tests/unit/test-dsa.c | 503

[PATCH v5 11/13] migration/multifd: Add migration option set packet size.

2024-07-11 Thread Yichen Wang
Signed-off-by: Yichen Wang --- migration/migration-hmp-cmds.c | 7 +++ migration/multifd-zlib.c | 6 -- migration/multifd-zstd.c | 6 -- migration/multifd.c| 6 -- migration/multifd.h| 3 --- migration/options.c| 38

[PATCH v5 10/13] migration/multifd: Enable DSA offloading in multifd sender path.

2024-07-11 Thread Yichen Wang
accelerator. The sender thread submits a batch of pages to DSA hardware and waits for the DSA completion thread to signal for work completion. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- include/qemu/dsa.h| 4 +- migration/migration.c | 2 +- migration/multifd

Re: [PATCH v5 08/13] migration/multifd: Add new migration option for multifd DSA offloading.

2024-07-11 Thread Yichen Wang
On Thu, Jul 11, 2024 at 2:53 PM Yichen Wang wrote: > diff --git a/migration/options.c b/migration/options.c > index 645f55003d..f839493016 100644 > --- a/migration/options.c > +++ b/migration/options.c > @@ -29,6 +29,7 @@ > #include "ram.h" > #include "

[PATCH v5 06/13] util/dsa: Implement zero page checking in DSA task.

2024-07-11 Thread Yichen Wang
task must contain at least two individual tasks. There are times we need to submit a single task and hence a single DSA task submission is also required. Signed-off-by: Hao Xiang Signed-off-by: Bryan Zhang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 18 util/dsa.c | 247

[PATCH v5 04/13] util/dsa: Implement DSA task enqueue and dequeue.

2024-07-11 Thread Yichen Wang
From: Hao Xiang * Use a safe thread queue for DSA task enqueue/dequeue. * Implement DSA task submission. * Implement DSA batch task submission. Signed-off-by: Hao Xiang Signed-off-by: Yichen Wang --- include/qemu/dsa.h | 46 ++ util/dsa.c | 222

  1   2   >