pitrou opened a new issue, #48105: URL: https://github.com/apache/arrow/issues/48105
### Describe the enhancement requested OSS-Fuzz will trigger an out-of-memory crash if the allocated memory goes beyond a predefined limit (usually 2560 MB, though that can be configured). For Parquet and IPC, it is legitimate to allocate a lot of memory when decompressing data, though, so that can happen on both valid and invalid input files. Unfortunately, OSS-Fuzz checks for this memory limit *not* by instrumenting `malloc` and having it return NULL when the limit is reached, but by checking allocated memory periodically from a separate thread. This can be solved by implementing our custom allocator with an upper limit, exactly how the mupdf project did in https://github.com/google/oss-fuzz/issues/1830 ### Component(s) C++, Continuous Integration, Parquet -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
