tqchen opened a new pull request, #57: URL: https://github.com/apache/tvm-ffi/pull/57
This PR updates the TVMFFIObject ABI to use strong_ref_count/weak_ref_count into u32 and which can be packed into the first u64 field in the object header. This change will open up further optimizations that combines weak/strong into a single u64 atomic that skips the need of extra atomic reading of weak value during deletion. The technique was recently in torch We also reordered the counter to be first since most rc ops are frequent and it would be more cache friendly. We do give up the same type_index first location with TVMFFIAny, which is OK as they optimize for different goals. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
