> -----Original Message----- > From: Srikanth Yalavarthi <[email protected]> > Sent: Tuesday, February 7, 2023 9:20 PM > To: Srikanth Yalavarthi <[email protected]> > Cc: [email protected]; Shivah Shankar Shankar Narayan Rao > <[email protected]>; Jerin Jacob Kollanukkaran > <[email protected]>; Anup Prabhu <[email protected]>; Prince Takkar > <[email protected]>; Parijat Shukla <[email protected]> > Subject: [PATCH v4 08/12] app/mldev: enable support for queue pairs and > size > > Added support to create multiple queue-pairs per device to enqueue and > dequeue inference requests. Number of queue pairs to be created can be > specified through "--queue_pairs" option. > Support is also enabled to control the number of descriptors per each queue > pair through "--queue_size" option. Inference requests for a model are > distributed across all available queue-pairs. > > Signed-off-by: Srikanth Yalavarthi <[email protected]> > --- > app/test-mldev/ml_options.c | 40 ++++++++++--- > app/test-mldev/ml_options.h | 4 ++ > app/test-mldev/test_common.c | 2 +- > app/test-mldev/test_inference_common.c | 79 > +++++++++++++++++++++----- app/test-mldev/test_inference_common.h > | 1 + > 5 files changed, 102 insertions(+), 24 deletions(-) > Acked-by: Anup Prabhu <[email protected]>
<<attachment: winmail.dat>>
