dentiny opened a new issue, #13011:
URL: https://github.com/apache/iceberg/issues/13011

   ### Query engine
   
   _No response_
   
   ### Question
   
   Puffin file is introduced in iceberg V3, which serves as a container file to 
store any types of blobs.
   According to the [spec](https://iceberg.apache.org/puffin-spec/),
   ```
   A Puffin file contains arbitrary pieces of information (here called 
"blobs"), along with metadata necessary to 
   interpret them.
   ```
   It reads to me, as long as the new introduced blob type doesn't break the 
following requirement, it's a valid blob.
   (1) the query engine (i.e. self-made one) could parse and understand the 
blob within
   (2) it doesn't break compatibility with existing iceberg spec (for example, 
a self-made compression algorithm could break system who has no idea how to 
decompress).
   
   One example I'm thinking is customized index upon data files.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to