dentiny opened a new issue, #1392:
URL: https://github.com/apache/iceberg-rust/issues/1392

   ### Is your feature request related to a problem or challenge?
   
   My workflow looks like
   - Accumulate arrow batches in-memory, flush to local filesystem when it 
reaches certain threshold
   - Periodically import local parquet files to iceberg table
   
   iceberg-rust doesn't provide a util function or class to generate 
`DataFile`, which is needed for fast append action (apart from 
`DataFileWriter`), so I have to read the whole arrow batches and write it with 
`DataFileWriter`, which is definitely inefficient.
   
   I would like to expose `DataFileBuilder` as a public struct, so I could 
construct these fields myself.
   
   ### Describe the solution you'd like
   
   Expose `DataFileBuilder` as public
   
   ### Willingness to contribute
   
   I can contribute to this feature independently


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to