On 5/15/2025 3:31 AM, Jacek Lawrynowicz wrote:
From: Karol Wachowski <[email protected]>Add new inference_timeout_ms parameter that allows specifying maximum allowed duration in milliseconds that inference can take before triggering a recovery. Calculate maximum number of heartbeat retries based on ratio between inference timeout and tdr timeout. Signed-off-by: Karol Wachowski <[email protected]> Signed-off-by: Jacek Lawrynowicz <[email protected]>
Reviewed-by: Jeff Hugo <[email protected]>
