morningman opened a new issue, #17947: URL: https://github.com/apache/doris/issues/17947
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Description Currently, if user modify the file on hdfs directly, no through hive. The changes of file will not be noticed by Doris and user will get wrong data. One approach is to refresh the catalog at fixed rate. But this will have to refresh all catalog and invalidate all caches. So I suggest to set TTL(Time-to-Live) config of File Cache, so that the stale file info will be invalidated automatically after expiring. ### Use case 1. create catalog with new property ``` create catalog hive( ..., "file_meta_cache_ttl_second" = "60" ); And file cache of all tables in this catalog will be expired after 60 seconds. You can also set `file_meta_cache_ttl_second` to 0 to disable file cache. ### Related issues _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
