Hi Community, With the current metadata in carbondata file footer, we can add more metadata to footer file to Improve carbon maintainability. we can add info like who has written the file and what is the carbon version in which this file is written, which will help to identify or fix any performance bugs in that version or any other functional issue and may be compatibility.
This is required because now carbon is has SDK support, file format, and have multiple version support.So by writing these info it would be easy to identify and fix any bugs. Currently we can write the above info in file footer and include these info in cli tool summary. May be later we can expose a DDL which will help us to get these info in beeline session only instead of running the java command separately for cli tool. For SDK we can expose two APIs for writing and reading these info which will allow to write these info and read these info and get details in some proper format string format. Any suggestiom or inputs are welcomed. Regards, Akash
