RE: [EXT] Re: [PATCH v6 09/12] app/mldev: enable support for inference batches

2023-03-16 Thread Srikanth Yalavarthi
> -Original Message- > From: Thomas Monjalon > Sent: 16 March 2023 23:18 > To: Srikanth Yalavarthi > Cc: dev@dpdk.org; Shivah Shankar Shankar Narayan Rao > ; Jerin Jacob Kollanukkaran > ; Anup Prabhu ; Prince Takkar > ; Parijat Shukla > Subject: [EXT] Re:

Re: [PATCH v6 09/12] app/mldev: enable support for inference batches

2023-03-16 Thread Thomas Monjalon
11/03/2023 16:09, Srikanth Yalavarthi: > @@ -528,8 +533,8 @@ ml_request_initialize(struct rte_mempool *mp, void > *opaque, void *obj, unsigned > req->niters = 0; > > /* quantize data */ > - rte_ml_io_quantize(t->cmn.opt->dev_id, t->model[t->fid].id, > -t->

[PATCH v6 09/12] app/mldev: enable support for inference batches

2023-03-11 Thread Srikanth Yalavarthi
Enabled support to execute multiple batches of inferences per each enqueue request. Input and reference for the test should be appropriately provided for multi-batch run. Number of batches can be specified through "--batches" option. Signed-off-by: Srikanth Yalavarthi Acked-by: Anup Prabhu ---