yadav-ankit opened a new issue, #12935:
URL: https://github.com/apache/iceberg/issues/12935
### Feature Request / Improvement
I am using iceberg sink connector to write files to s3 using HMS.
At present its not possible to search data or metadata files in s3 as file
names of iceberg data and metadata files only contains UUID and when number of
files is above 999 then its not possible in AWS s3 console to sort the files
for general troubleshooting...
We need to add a feature to add timestamp in file names.
i have gone through the codebase of iceberg and here are my findings
the file name is used and created at the core libraries of iceberg where
manifest files are being initilized. (.withPath(manifest.path())
```
public static DataFile fromManifest(ManifestFile manifest) {
return DataFiles.builder(PartitionSpec.unpartitioned())
.withPath(manifest.path())
.withFormat(FileFormat.AVRO)
.withRecordCount(manifest.addedFilesCount() +
manifest.existingFilesCount())
.withFileSizeInBytes(manifest.length())
.build();
}
```
We need to alter the manifest files path somehow.
### Query engine
None
### Willingness to contribute
- [ ] I can contribute this improvement/feature independently
- [ ] I would be willing to contribute this improvement/feature with
guidance from the Iceberg community
- [x] I cannot contribute this improvement/feature at this time
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
