I am studying the source code of TVM, and I am confused about the constant kMaxNumGPUs (=32) in /src/runtime/cuda/cuda_module.h. To my mind, when we run the compiled model, we can only choose 1 GPU card. If this is true, why TVM runtime set the kMaxNumGPUs to 32 and keeps the memory allocation status of kMaxNumGPUs GPU cards ?
--- [Visit Topic](https://discuss.tvm.apache.org/t/confussed-about-kmaxnumgpus-in-runtime/11536/1) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/fb34c5aabf744bdffc8e730528899e50627cb0bbe973042e696e52077858e94e).