Thanks Cody. It looks like the API will be:
```
  trt_target = tvm.target.Target("tensorrt -use_fp16=True 
-implicit_batch_mode=False")
  mod = partition_for_tensorrt(mod, params=params, target=trt_target)
  exe = vm.compile(mod, target=["cuda", trt_target], params=params)
```
(and similarly for the other build APIs).

If the default TRT options are good then there's no need for any additional 
targets at all:
```
  mod = partition_for_tensorrt(mod, params=params)
  exe = vm.compile(mod, target="cuda", params=params)
```





---
[Visit 
Topic](https://discuss.tvm.apache.org/t/byoc-how-backwards-compatible-does-the-tensorrt-partition-for-tensorrt-function-need-to-be/12957/4)
 to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, [click 
here](https://discuss.tvm.apache.org/email/unsubscribe/8aff0c21ed6bf9a4137a8fa2abf4f25a07789c6bd1d1d6c633c485d361e18fbb).

Reply via email to