sdd commented on code in PR #1017:
URL: https://github.com/apache/iceberg-rust/pull/1017#discussion_r2180719880
##########
crates/iceberg/src/arrow/caching_delete_file_loader.rs:
##########
@@ -308,28 +319,233 @@ impl CachingDeleteFileLoader {
Ok(result)
}
- /// Parses record batch streams from individual equality delete files
- ///
- /// Returns an unbound Predicate for each batch stream
async fn parse_equality_deletes_record_batch_stream(
- streams: ArrowRecordBatchStream,
+ mut stream: ArrowRecordBatchStream,
+ equality_ids: HashSet<i32>,
) -> Result<Predicate> {
- // TODO
+ let mut result_predicate = AlwaysTrue;
+
+ while let Some(record_batch) = stream.next().await {
+ let record_batch = record_batch?;
+
+ if record_batch.num_columns() == 0 {
+ return Ok(AlwaysTrue);
+ }
- Err(Error::new(
- ErrorKind::FeatureUnsupported,
- "parsing of equality deletes is not yet supported",
- ))
+ let batch_schema_arrow = record_batch.schema();
+ let batch_schema_iceberg =
arrow_schema_to_schema(batch_schema_arrow.as_ref())?;
+
+ let mut datum_columns_with_names: Vec<_> = record_batch
Review Comment:
As far as I can tell, `arrow_struct_to_literal` is not used anywhere, but it
is `pub`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
