nealrichardson opened a new issue, #44662: URL: https://github.com/apache/arrow/issues/44662
### Describe the enhancement requested #5811 added support for ignoring files based on a prefix. According to the discussion in https://github.com/apache/arrow/pull/5811#discussion_r346521605, this simple approach was chosen because some toolchains we supported at the time (2019) did not have regex support, but that is no longer the case. The value of more expressive file ignoring is that it is more efficient than trying and excluding files that are invalid, especially on cloud file systems. See https://lists.apache.org/thread/1gdw6wbkofmpc782ot0082b388gv4vwf for an example. Related issues: https://github.com/apache/arrow/issues/25800, https://github.com/apache/arrow/issues/22970, https://github.com/apache/arrow/issues/23231 ### Component(s) C++ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
