The GitHub Actions job "Nightly Docker Update" on tvm.git/main has failed.
Run started by GitHub user areusch (triggered by areusch).

Head commit for run:
45bef4579cc6411eff7fc3344b76ee0ce13d32e7 / Guan-Ming (Wesley) Chiu 
<[email protected]>
[CUDA] Fix cuModuleUnload crash during interpreter shutdown (#18624)

## Related

#18614 ci error

## Why

The CUDAModuleNode destructor was using CUDA_DRIVER_CALL and CUDA_CALL
macros that call LOG(FATAL) (throw an exception) when CUDA operations
fail.

During interpreter shutdown, the CUDA context can become invalid,
causing CUDA_ERROR_ILLEGAL_ADDRESS when cuModuleUnload is called.
Throwing exceptions in destructors is undefined behavior and causes
crashes.

## How
1. Removed the throwing macros from the destructor
2. Check cudaSetDevice return value and skip cleanup if it fails
3. Ignore errors from cuModuleUnload - during shutdown these are benign
since the OS will reclaim resources anyway

Report URL: https://github.com/apache/tvm/actions/runs/20585403978

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to