This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/github_actions/codeql-action-9d88a12d2b
in repository https://gitbox.apache.org/repos/asf/iceberg.git
discard 4d9ea86f0f Build: Bump the codeql-action group across 1 directory with
3 updates
add 9f5d7ef800 Build: Bump com.google.errorprone:error_prone_annotations
from 2.50.0 to 2.51.0 (#18736)
add f692dc75a4 Build: Bump at.yawk.lz4:lz4-java from 1.11.3 to 1.12.1
(#18735)
add 470372c17c Build: Bump zizmorcore/zizmor-action from 0.6.4 to 0.8.0
(#18734)
add 701788da71 Build: Bump actions/setup-python from 7.0.0 to 7.1.0
(#18733)
add 9bc62f77e4 Build: Bump io.grpc:grpc-netty-shaded from 1.85.0 to 1.85.1
(#18732)
add 4b8214af3c Build: Bump mkdocs-material from 9.7.7 to 9.8.0 (#18730)
add 08ddb14e04 Build: Bump datamodel-code-generator from 0.85.0 to 0.86.0
(#18729)
add 8a00c9531f Build: Bump astral-sh/setup-uv from 10.3.0 to 10.3.2
(#18728)
add 2742348d7c Build: Bump org.roaringbitmap:RoaringBitmap from 1.6.24 to
1.6.25 (#18727)
add e58bb8aaef Build: Bump software.amazon.awssdk:bom from 2.56.0 to
2.57.3 (#18741)
add 66a6c2478b Core: Use Iceberg relocated VisibleForTesting (#18654)
add cbfabba93b Spark 4.1: Add per-task scanDuration metric (#17562)
add c583efe6e9 Build, GCP: Bump
com.google.cloud.gcs.analytics:gcs-analytics-core from 1.5.0 to 1.6.0 (#18686)
add 9fffeb63b1 Flink: Backport: Fix ConvertEqualityDeletes key
serialization for temporal equality fields (#18610) (#18720)
add 605e426148 Build: Fix Gradle wrapper download failure handling (#18634)
add 65b3ef316a Spark 4.2: Add scanDuration read metric (#18751)
add c2c460586c Arrow, Spark: Skip unprojected shredded variants in
vectorized Parquet reads (#18434)
add ebf2ff8a93 Core: Support projecting content stats in the V4 file
planner (#18740)
add 6951360ec8 Parquet: Read file metrics from natively encrypted files
(#18535)
add f5704ee94b Core: v4: Prune leaf manifests with no live files in
FilePlanner (#18725)
add 3ad26de2bd Spec: Add stats-only fields to table metadata (#18405)
add e9a7f39661 Flink: Support Lookup Join using full in-memory lookup
cache (#18144)
add e3d031483c Flink: Resolve the record serializer without loading the
table (#18525)
add 04dd1750b9 Flink: Fix range distribution with truncate on binary
columns (#18696)
add ae869756da Core: Skip concurrent DV validation for added data files
(#18626)
add 866bca5d62 Flink: ConvertEqualityDeletes: Fix index consistency after
a failure or restore (#18674)
add 5a2ccf5ba8 Spec: fix formatting of geospatial CRS examples (#17724)
add e055c68fff Core: Add MutableBitmap.merge (#18704)
add b71a64ddc2 Spark: [3/N] Support sending referenced-by to all endpoints
(#13979)
add c484d46fde Core, Spark: Rethrow ValidationException from REST 400
responses (#18473)
add 66a1417a76 Flink: Backport Support Lookup Join using full in-memory
lookup cache (#18766)
add 6383a3df85 Flink: Backport: resolving the record serializer without
loading the table (#18525) (#18781)
add 22ed06b979 Data, Spark 4.2: Add format model TCK coverage for
vectorized reads (#17610)
add 5f2976d1ed Flink: Backport: ConvertEqualityDeletes: Fix index
consistency after a failure or restore (#18674) (#18777)
add d303e7e880 Spec: Clarify row-level delete sections after v4
equality-delete prohibition (#18301)
add 0c3465b541 Flink: Fix DynamicSink silently dropping commits after
stateless restart (#18303)
add ea73769d12 Spark 3.5, 4.0, 4.1: Backport format model TCK coverage for
vectorized reads (#18790)
add cb5f345a26 Spark 3.5: Backport custom snapshot property from session
configuration (#14545) (#18792)
add f72900ee02 Spark 3.5: Backport apply session snapshot properties to
maintenance actions and procedures (#18801)
add 7b8cbc7fef Flink: BackPort fix DynamicSink silently dropping commits
after stateless restart (#18805)
add b59c059430 Flink: Fix DynamicIcebergSink TableMetadataCache resolving
retired field ids (#18517)
add 9f04b05090 Nessie: Check namespace existence at the ref HEAD in
listNamespaces (#18035)
add 753c82df65 Flink: Allow configuring a branch for rewrite data files
action (#18661)
add 30c246a03b Core: Fix the timestamp race in
TestFindFiles#testAsOfTimestamp (#18779)
add d2df5101dc Spark 4.1: Backport: Fix predicate pushdown on changelog
metadata column (#18148) (#18808)
add b56b4bf9d6 Core: Basic fields and schemas for column files (#16285)
add 94f318dc99 Core: Scope V4ManifestReader row ID assignment to each
iterator (#18795)
add 428fe57eb9 Build: Use Google Maven Central mirror on GitHub Actions
(#18653)
add dd17f677d8 Flink: Dynamic Sink: Create the namespace when the catalog
reports it as a missing table (#18582)
add cd8ea3f5bc Flink: Backport: Dynamic Sink: Create the namespace when
the catalog reports it as a missing table (#18582) (#18814)
add 2e847c044a MR: Keep computed block locations in
IcebergSplit.getLocations (#18036)
add 4e2a9bda37 ORC: Fix NPE when reading/writing variant type with ORC
format (#18387)
add 9203eaff9e Arrow: Fix valuesRead accumulation in
VectorizedDeltaEncodedValuesReader (#17121)
add 0cb5041b9c Spec: Add support for default expression values (#16777)
add cd4c24c9ad Flink: Backport: Allow IcebergSink rewrite data files to
target a different branch (#18815)
add cdc8b637ac Build: Bump the codeql-action group across 1 directory with
3 updates
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (4d9ea86f0f)
\
N -- N -- N
refs/heads/dependabot/github_actions/codeql-action-9d88a12d2b (cdc8b637ac)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.baseline/checkstyle/checkstyle.xml | 2 +-
.github/workflows/docs-ci.yml | 2 +-
.github/workflows/open-api.yml | 2 +-
.github/workflows/site-ci.yml | 2 +-
.github/workflows/zizmor.yml | 2 +-
.../org/apache/iceberg/catalog/LoadContext.java | 19 +
.../arrow/vectorized/VectorizedReaderBuilder.java | 6 +
.../VectorizedDeltaEncodedValuesReader.java | 4 +-
.../vectorized/TestVectorizedReaderBuilder.java | 135 ++++
.../TestVectorizedDeltaEncodedValuesReader.java | 72 ++
aws-bundle/runtime-deps.txt | 90 +--
build.gradle | 11 +
.../java/org/apache/iceberg/CachingCatalog.java | 10 +
.../main/java/org/apache/iceberg/ColumnFile.java | 72 ++
.../java/org/apache/iceberg/ColumnFileStruct.java | 166 +++++
.../main/java/org/apache/iceberg/FilePlanner.java | 26 +-
.../apache/iceberg/MergingSnapshotProducer.java | 11 +
.../main/java/org/apache/iceberg/TrackedFile.java | 9 +-
.../org/apache/iceberg/TrackedFileAdapters.java | 10 +
.../java/org/apache/iceberg/TrackedFileStruct.java | 27 +-
.../java/org/apache/iceberg/TrackingBuilder.java | 15 +-
.../java/org/apache/iceberg/TrackingStruct.java | 3 +-
.../java/org/apache/iceberg/V4ManifestReader.java | 63 +-
.../apache/iceberg/mumbling/MumblingBitmap.java | 111 ++-
.../org/apache/iceberg/mumbling/MutableBitmap.java | 4 +
.../org/apache/iceberg/rest/ErrorHandlers.java | 3 +
.../responses/PlanTableScanResponseParser.java | 2 +-
.../java/org/apache/iceberg/StatsTestUtil.java | 1 +
.../org/apache/iceberg/TestColumnFileStruct.java | 132 ++++
.../java/org/apache/iceberg/TestFilePlanner.java | 170 ++++-
.../java/org/apache/iceberg/TestFindFiles.java | 3 +-
.../test/java/org/apache/iceberg/TestRowDelta.java | 25 +-
.../java/org/apache/iceberg/TestTrackedFile.java | 5 +-
.../apache/iceberg/TestTrackedFileAdapters.java | 13 +-
.../org/apache/iceberg/TestTrackedFileStruct.java | 34 +-
.../org/apache/iceberg/TestTrackingBuilder.java | 39 +
.../org/apache/iceberg/TestTrackingStruct.java | 14 +-
.../org/apache/iceberg/TestV4ManifestReader.java | 168 ++++-
.../java/org/apache/iceberg/V4TestComparators.java | 38 +-
.../java/org/apache/iceberg/V4TestHelpers.java | 63 +-
.../apache/iceberg/hadoop/TestCachingCatalog.java | 66 ++
.../iceberg/mumbling/TestMumblingBitmap.java | 440 ++++++++++++
.../org/apache/iceberg/rest/TestErrorHandlers.java | 49 ++
.../apache/iceberg/data/BaseFormatModelTests.java | 10 +-
.../org/apache/iceberg/data/DataGenerator.java | 2 +-
.../org/apache/iceberg/data/DataGenerators.java | 4 +-
.../apache/iceberg/data/ReadFormatModelTests.java | 286 ++++----
docs/docs/flink-configuration.md | 8 +
docs/docs/flink-maintenance.md | 13 +-
docs/docs/flink-queries.md | 22 +
docs/docs/flink-writes.md | 5 +
...namicRecordSerializerDeserializerBenchmark.java | 7 +-
.../iceberg/flink/FlinkDynamicTableFactory.java | 2 +
.../flink/maintenance/api/RewriteDataFiles.java | 4 +
.../maintenance/api/RewriteDataFilesConfig.java | 17 +
.../operator/EqualityConvertCommitter.java | 56 +-
.../maintenance/operator/EqualityConvertPlan.java | 19 +-
.../operator/EqualityConvertPlanner.java | 132 ++--
.../operator/EqualityConvertReader.java | 11 +-
.../maintenance/operator/StructLikeSerializer.java | 9 +
.../org/apache/iceberg/flink/sink/IcebergSink.java | 39 +-
.../flink/sink/dynamic/DynamicCommittable.java | 24 +-
.../sink/dynamic/DynamicCommittableSerializer.java | 24 +-
.../flink/sink/dynamic/DynamicCommitter.java | 77 +-
.../flink/sink/dynamic/DynamicIcebergSink.java | 16 +-
.../dynamic/DynamicRecordInternalSerializer.java | 26 +-
.../sink/dynamic/DynamicRecordInternalType.java | 13 +-
.../flink/sink/dynamic/DynamicRecordProcessor.java | 8 +-
.../sink/dynamic/DynamicWriteResultAggregator.java | 8 +-
.../iceberg/flink/sink/dynamic/JobOperatorKey.java | 12 +-
.../flink/sink/dynamic/TableMetadataCache.java | 15 +-
.../flink/sink/dynamic/TableSerializerCache.java | 95 ++-
.../iceberg/flink/sink/dynamic/TableUpdater.java | 13 +-
.../iceberg/flink/source/IcebergTableSource.java | 60 +-
.../lookup/IcebergFullCachingLookupFunction.java | 223 ++++++
.../flink/source/lookup/IcebergLookupOptions.java | 41 ++
.../flink/source/lookup/IcebergLookupReader.java | 124 ++++
.../flink/source/lookup/InMemoryLookupCache.java | 69 ++
.../flink/data/TestFlinkOrcReaderWriter.java | 46 ++
.../api/TestConvertEqualityDeletes.java | 108 +++
.../api/TestConvertEqualityDeletesE2E.java | 109 ++-
.../maintenance/api/TestRewriteDataFiles.java | 35 +-
.../api/TestRewriteDataFilesConfig.java | 2 +
.../maintenance/operator/OperatorTestBase.java | 10 +-
.../operator/TestEqualityConvertCommitter.java | 198 +++++-
.../operator/TestEqualityConvertDVWriter.java | 16 +-
.../operator/TestEqualityConvertPlanner.java | 338 ++++++++-
.../operator/TestEqualityConvertReader.java | 64 ++
.../sink/TestIcebergSinkTableMaintenance.java | 86 +++
.../DynamicRecordInternalSerializerTestBase.java | 2 +-
.../dynamic/TestDynamicCommittableSerializer.java | 39 +-
.../flink/sink/dynamic/TestDynamicCommitter.java | 233 +++++-
.../flink/sink/dynamic/TestDynamicIcebergSink.java | 33 +
.../TestDynamicRecordInternalSerializer.java | 52 +-
.../sink/dynamic/TestDynamicRecordProcessor.java | 2 +-
.../dynamic/TestDynamicWriteResultAggregator.java | 8 +-
.../sink/dynamic/TestTableSerializerCache.java | 122 +++-
.../flink/sink/dynamic/TestTableUpdater.java | 61 ++
.../iceberg/flink/source/TestFlinkSourceSql.java | 2 +-
.../flink/source/TestIcebergLookupJoinSql.java | 369 ++++++++++
.../iceberg/flink/source/TestIcebergSourceSql.java | 2 +-
.../iceberg/flink/source/TestSourceSqlBase.java} | 54 +-
.../apache/iceberg/flink/source/TestSqlBase.java | 99 +--
.../flink/source/lookup/TestIcebergLookup.java | 318 +++++++++
...namicRecordSerializerDeserializerBenchmark.java | 7 +-
.../iceberg/flink/FlinkDynamicTableFactory.java | 2 +
.../flink/maintenance/api/RewriteDataFiles.java | 4 +
.../maintenance/api/RewriteDataFilesConfig.java | 17 +
.../operator/EqualityConvertCommitter.java | 56 +-
.../maintenance/operator/EqualityConvertPlan.java | 19 +-
.../operator/EqualityConvertPlanner.java | 132 ++--
.../operator/EqualityConvertReader.java | 11 +-
.../maintenance/operator/StructLikeSerializer.java | 9 +
.../org/apache/iceberg/flink/sink/IcebergSink.java | 39 +-
.../flink/sink/dynamic/DynamicCommittable.java | 24 +-
.../sink/dynamic/DynamicCommittableSerializer.java | 24 +-
.../flink/sink/dynamic/DynamicCommitter.java | 77 +-
.../flink/sink/dynamic/DynamicIcebergSink.java | 16 +-
.../dynamic/DynamicRecordInternalSerializer.java | 26 +-
.../sink/dynamic/DynamicRecordInternalType.java | 10 +-
.../flink/sink/dynamic/DynamicRecordProcessor.java | 8 +-
.../sink/dynamic/DynamicWriteResultAggregator.java | 7 +-
.../iceberg/flink/sink/dynamic/JobOperatorKey.java | 12 +-
.../flink/sink/dynamic/TableMetadataCache.java | 15 +-
.../flink/sink/dynamic/TableSerializerCache.java | 95 ++-
.../iceberg/flink/sink/dynamic/TableUpdater.java | 13 +-
.../iceberg/flink/source/IcebergTableSource.java | 60 +-
.../lookup/IcebergFullCachingLookupFunction.java | 223 ++++++
.../flink/source/lookup/IcebergLookupOptions.java | 41 ++
.../flink/source/lookup/IcebergLookupReader.java | 124 ++++
.../flink/source/lookup/InMemoryLookupCache.java | 69 ++
.../flink/data/TestFlinkOrcReaderWriter.java | 46 ++
.../api/TestConvertEqualityDeletes.java | 108 +++
.../api/TestConvertEqualityDeletesE2E.java | 111 ++-
.../maintenance/api/TestRewriteDataFiles.java | 35 +-
.../api/TestRewriteDataFilesConfig.java | 2 +
.../maintenance/operator/OperatorTestBase.java | 10 +-
.../operator/TestEqualityConvertCommitter.java | 198 +++++-
.../operator/TestEqualityConvertDVWriter.java | 16 +-
.../operator/TestEqualityConvertPlanner.java | 338 ++++++++-
.../operator/TestEqualityConvertReader.java | 64 ++
.../sink/TestIcebergSinkTableMaintenance.java | 86 +++
.../DynamicRecordInternalSerializerTestBase.java | 2 +-
.../dynamic/TestDynamicCommittableSerializer.java | 39 +-
.../flink/sink/dynamic/TestDynamicCommitter.java | 233 +++++-
.../flink/sink/dynamic/TestDynamicIcebergSink.java | 33 +
.../TestDynamicRecordInternalSerializer.java | 52 +-
.../sink/dynamic/TestDynamicRecordProcessor.java | 2 +-
.../dynamic/TestDynamicWriteResultAggregator.java | 8 +-
.../sink/dynamic/TestTableSerializerCache.java | 122 +++-
.../flink/sink/dynamic/TestTableUpdater.java | 61 ++
.../iceberg/flink/source/TestFlinkSourceSql.java | 2 +-
.../flink/source/TestIcebergLookupJoinSql.java | 369 ++++++++++
.../iceberg/flink/source/TestIcebergSourceSql.java | 2 +-
.../iceberg/flink/source/TestSourceSqlBase.java} | 54 +-
.../apache/iceberg/flink/source/TestSqlBase.java | 97 +--
.../flink/source/lookup/TestIcebergLookup.java | 318 +++++++++
...namicRecordSerializerDeserializerBenchmark.java | 7 +-
.../iceberg/flink/FlinkDynamicTableFactory.java | 2 +
.../flink/maintenance/api/RewriteDataFiles.java | 4 +
.../maintenance/api/RewriteDataFilesConfig.java | 17 +
.../operator/EqualityConvertCommitter.java | 56 +-
.../maintenance/operator/EqualityConvertPlan.java | 19 +-
.../operator/EqualityConvertPlanner.java | 132 ++--
.../org/apache/iceberg/flink/sink/IcebergSink.java | 39 +-
.../flink/sink/dynamic/DynamicCommittable.java | 24 +-
.../sink/dynamic/DynamicCommittableSerializer.java | 24 +-
.../flink/sink/dynamic/DynamicCommitter.java | 77 +-
.../flink/sink/dynamic/DynamicIcebergSink.java | 16 +-
.../dynamic/DynamicRecordInternalSerializer.java | 26 +-
.../sink/dynamic/DynamicRecordInternalType.java | 10 +-
.../flink/sink/dynamic/DynamicRecordProcessor.java | 8 +-
.../sink/dynamic/DynamicWriteResultAggregator.java | 7 +-
.../iceberg/flink/sink/dynamic/JobOperatorKey.java | 12 +-
.../flink/sink/dynamic/TableMetadataCache.java | 117 ++-
.../flink/sink/dynamic/TableSerializerCache.java | 95 ++-
.../iceberg/flink/sink/dynamic/TableUpdater.java | 13 +-
.../flink/sink/shuffle/SortKeySerializer.java | 3 +-
.../iceberg/flink/source/IcebergTableSource.java | 60 +-
.../lookup/IcebergFullCachingLookupFunction.java | 223 ++++++
.../flink/source/lookup/IcebergLookupOptions.java | 41 ++
.../flink/source/lookup/IcebergLookupReader.java | 124 ++++
.../flink/source/lookup/InMemoryLookupCache.java | 69 ++
.../flink/data/TestFlinkOrcReaderWriter.java | 46 ++
.../api/TestConvertEqualityDeletes.java | 108 +++
.../api/TestConvertEqualityDeletesE2E.java | 111 ++-
.../maintenance/api/TestRewriteDataFiles.java | 35 +-
.../api/TestRewriteDataFilesConfig.java | 2 +
.../operator/TestEqualityConvertCommitter.java | 198 +++++-
.../operator/TestEqualityConvertDVWriter.java | 16 +-
.../operator/TestEqualityConvertPlanner.java | 338 ++++++++-
.../sink/TestIcebergSinkTableMaintenance.java | 86 +++
.../DynamicRecordInternalSerializerTestBase.java | 2 +-
.../dynamic/TestDynamicCommittableSerializer.java | 39 +-
.../flink/sink/dynamic/TestDynamicCommitter.java | 233 +++++-
.../flink/sink/dynamic/TestDynamicIcebergSink.java | 66 ++
.../TestDynamicRecordInternalSerializer.java | 52 +-
.../sink/dynamic/TestDynamicRecordProcessor.java | 2 +-
.../dynamic/TestDynamicWriteResultAggregator.java | 8 +-
.../flink/sink/dynamic/TestTableMetadataCache.java | 176 +++++
.../sink/dynamic/TestTableSerializerCache.java | 122 +++-
.../flink/sink/dynamic/TestTableUpdater.java | 61 ++
.../shuffle/TestSortKeySerializerPrimitives.java | 4 +-
.../iceberg/flink/source/TestFlinkSourceSql.java | 2 +-
.../flink/source/TestIcebergLookupJoinSql.java | 369 ++++++++++
.../iceberg/flink/source/TestIcebergSourceSql.java | 2 +-
.../{TestSqlBase.java => TestSourceSqlBase.java} | 54 +-
.../apache/iceberg/flink/source/TestSqlBase.java | 97 +--
.../flink/source/lookup/TestIcebergLookup.java | 318 +++++++++
format/spec.md | 65 +-
gcp-bundle/runtime-deps.txt | 12 +-
.../org/apache/iceberg/gcp/gcs/TestGcsFileIO.java | 5 -
gradle.properties | 2 +-
gradle/libs.versions.toml | 10 +-
gradlew | 11 +-
kafka-connect/build.gradle | 2 +-
.../kafka-connect-runtime/runtime-deps.txt | 101 +--
.../apache/iceberg/mr/mapreduce/IcebergSplit.java | 7 +-
.../apache/iceberg/mr/TestIcebergInputFormats.java | 14 +
.../apache/iceberg/nessie/NessieIcebergClient.java | 6 +-
.../apache/iceberg/nessie/TestMultipleClients.java | 14 +
open-api/requirements.txt | 2 +-
.../iceberg/orc/OrcSchemaWithTypeVisitor.java | 6 +-
.../org/apache/iceberg/parquet/ParquetUtil.java | 24 +-
.../apache/iceberg/parquet/TestParquetUtil.java | 104 +++
site/requirements.txt | 2 +-
.../extensions/TestRewriteManifestsProcedure.java | 17 +
.../apache/iceberg/spark/SparkSQLProperties.java | 3 +
.../java/org/apache/iceberg/spark/SparkUtil.java | 14 +
.../org/apache/iceberg/spark/SparkWriteConf.java | 4 +
.../actions/BaseSnapshotUpdateSparkAction.java | 8 +
.../actions/RemoveDanglingDeletesSparkAction.java | 6 +-
.../spark/actions/RewriteDataFilesSparkAction.java | 4 +-
.../apache/iceberg/spark/actions/SparkActions.java | 3 +-
.../apache/iceberg/spark/TestSparkWriteConf.java | 48 ++
.../actions/TestRemoveDanglingDeleteAction.java | 3 +-
.../spark/actions/TestRewriteDataFilesAction.java | 47 ++
.../spark/actions/TestRewriteManifestsAction.java | 26 +
.../spark/data/TestSparkVectorizedFormatModel.java | 208 ++++++
.../apache/iceberg/spark/sql/TestCreateTable.java | 6 -
.../apache/iceberg/spark/data/TestOrcWrite.java | 21 +
.../iceberg/spark/data/TestSparkOrcReader.java | 68 ++
.../spark/data/TestSparkVectorizedFormatModel.java | 207 ++++++
.../apache/iceberg/spark/sql/TestCreateTable.java | 6 -
.../iceberg/spark/sql/TestSparkVariantRead.java | 48 ++
.../spark/extensions/TestChangelogTable.java | 19 +
.../apache/iceberg/spark/source/BaseReader.java | 10 +
.../iceberg/spark/source/BatchDataReader.java | 5 +-
.../apache/iceberg/spark/source/RowDataReader.java | 5 +-
.../spark/source/SparkChangelogScanBuilder.java | 46 ++
.../org/apache/iceberg/spark/source/SparkScan.java | 2 +
.../iceberg/spark/source/metrics/ScanDuration.java | 78 ++
.../spark/source/metrics/TaskScanDuration.java} | 7 +-
.../apache/iceberg/spark/data/TestOrcWrite.java | 21 +
.../iceberg/spark/data/TestSparkOrcReader.java | 68 ++
.../spark/data/TestSparkVectorizedFormatModel.java | 207 ++++++
.../iceberg/spark/source/TestSparkReadMetrics.java | 65 ++
.../spark/source/metrics/TestScanDuration.java | 75 ++
.../apache/iceberg/spark/sql/TestCreateTable.java | 6 -
.../iceberg/spark/sql/TestSparkVariantRead.java | 48 ++
.../extensions/IcebergSparkSessionExtensions.scala | 2 +
.../analysis/LoadContextTableCatalog.scala | 59 ++
.../analysis/ResolveReferencedByViews.scala | 256 +++++++
.../spark/sql/catalyst/analysis/ResolveViews.scala | 3 +-
.../logical/views/UnResolvedRelationFromView.scala | 50 ++
.../extensions/TestReferencedByViewChain.java | 788 +++++++++++++++++++++
.../java/org/apache/iceberg/spark/BaseCatalog.java | 7 +
.../org/apache/iceberg/spark/SparkCatalog.java | 41 +-
.../apache/iceberg/spark/SparkSQLProperties.java | 5 +
.../apache/iceberg/spark/SparkSessionCatalog.java | 68 +-
.../iceberg/spark/SparkSupportsLoadContext.java | 78 ++
.../apache/iceberg/spark/source/BaseReader.java | 10 +
.../iceberg/spark/source/BatchDataReader.java | 5 +-
.../apache/iceberg/spark/source/RowDataReader.java | 5 +-
.../org/apache/iceberg/spark/source/SparkScan.java | 2 +
.../iceberg/spark/source/metrics/ScanDuration.java | 78 ++
.../spark/source/metrics/TaskScanDuration.java} | 7 +-
.../spark/sql/catalyst/analysis/ViewUtil.scala | 82 +++
.../iceberg/spark/TestSparkSessionCatalog.java | 45 ++
.../apache/iceberg/spark/data/TestOrcWrite.java | 21 +
.../iceberg/spark/data/TestSparkOrcReader.java | 68 ++
.../spark/data/TestSparkVectorizedFormatModel.java | 207 ++++++
.../iceberg/spark/source/TestSparkCatalog.java | 6 +
.../iceberg/spark/source/TestSparkReadMetrics.java | 65 ++
.../spark/source/metrics/TestScanDuration.java | 75 ++
.../apache/iceberg/spark/sql/TestCreateTable.java | 6 -
.../iceberg/spark/sql/TestSparkVariantRead.java | 48 ++
287 files changed, 15579 insertions(+), 1665 deletions(-)
create mode 100644
arrow/src/test/java/org/apache/iceberg/arrow/vectorized/parquet/TestVectorizedDeltaEncodedValuesReader.java
create mode 100644 core/src/main/java/org/apache/iceberg/ColumnFile.java
create mode 100644 core/src/main/java/org/apache/iceberg/ColumnFileStruct.java
create mode 100644
core/src/test/java/org/apache/iceberg/TestColumnFileStruct.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/source/lookup/IcebergFullCachingLookupFunction.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/source/lookup/IcebergLookupOptions.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/source/lookup/IcebergLookupReader.java
create mode 100644
flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/source/lookup/InMemoryLookupCache.java
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/source/TestIcebergLookupJoinSql.java
copy
flink/{v2.3/flink/src/test/java/org/apache/iceberg/flink/source/TestSqlBase.java
=>
v1.20/flink/src/test/java/org/apache/iceberg/flink/source/TestSourceSqlBase.java}
(74%)
create mode 100644
flink/v1.20/flink/src/test/java/org/apache/iceberg/flink/source/lookup/TestIcebergLookup.java
create mode 100644
flink/v2.2/flink/src/main/java/org/apache/iceberg/flink/source/lookup/IcebergFullCachingLookupFunction.java
create mode 100644
flink/v2.2/flink/src/main/java/org/apache/iceberg/flink/source/lookup/IcebergLookupOptions.java
create mode 100644
flink/v2.2/flink/src/main/java/org/apache/iceberg/flink/source/lookup/IcebergLookupReader.java
create mode 100644
flink/v2.2/flink/src/main/java/org/apache/iceberg/flink/source/lookup/InMemoryLookupCache.java
create mode 100644
flink/v2.2/flink/src/test/java/org/apache/iceberg/flink/source/TestIcebergLookupJoinSql.java
copy
flink/{v2.3/flink/src/test/java/org/apache/iceberg/flink/source/TestSqlBase.java
=>
v2.2/flink/src/test/java/org/apache/iceberg/flink/source/TestSourceSqlBase.java}
(74%)
create mode 100644
flink/v2.2/flink/src/test/java/org/apache/iceberg/flink/source/lookup/TestIcebergLookup.java
create mode 100644
flink/v2.3/flink/src/main/java/org/apache/iceberg/flink/source/lookup/IcebergFullCachingLookupFunction.java
create mode 100644
flink/v2.3/flink/src/main/java/org/apache/iceberg/flink/source/lookup/IcebergLookupOptions.java
create mode 100644
flink/v2.3/flink/src/main/java/org/apache/iceberg/flink/source/lookup/IcebergLookupReader.java
create mode 100644
flink/v2.3/flink/src/main/java/org/apache/iceberg/flink/source/lookup/InMemoryLookupCache.java
create mode 100644
flink/v2.3/flink/src/test/java/org/apache/iceberg/flink/source/TestIcebergLookupJoinSql.java
copy
flink/v2.3/flink/src/test/java/org/apache/iceberg/flink/source/{TestSqlBase.java
=> TestSourceSqlBase.java} (74%)
create mode 100644
flink/v2.3/flink/src/test/java/org/apache/iceberg/flink/source/lookup/TestIcebergLookup.java
create mode 100644
parquet/src/test/java/org/apache/iceberg/parquet/TestParquetUtil.java
create mode 100644
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/data/TestSparkVectorizedFormatModel.java
create mode 100644
spark/v4.0/spark/src/test/java/org/apache/iceberg/spark/data/TestSparkVectorizedFormatModel.java
create mode 100644
spark/v4.1/spark/src/main/java/org/apache/iceberg/spark/source/metrics/ScanDuration.java
copy
spark/{v3.5/spark/src/main/java/org/apache/iceberg/spark/source/metrics/TaskNumDeletes.java
=>
v4.1/spark/src/main/java/org/apache/iceberg/spark/source/metrics/TaskScanDuration.java}
(89%)
create mode 100644
spark/v4.1/spark/src/test/java/org/apache/iceberg/spark/data/TestSparkVectorizedFormatModel.java
create mode 100644
spark/v4.1/spark/src/test/java/org/apache/iceberg/spark/source/metrics/TestScanDuration.java
create mode 100644
spark/v4.2/spark-extensions/src/main/scala/org/apache/spark/sql/catalyst/analysis/LoadContextTableCatalog.scala
create mode 100644
spark/v4.2/spark-extensions/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveReferencedByViews.scala
create mode 100644
spark/v4.2/spark-extensions/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/views/UnResolvedRelationFromView.scala
create mode 100644
spark/v4.2/spark-extensions/src/test/java/org/apache/iceberg/spark/extensions/TestReferencedByViewChain.java
create mode 100644
spark/v4.2/spark/src/main/java/org/apache/iceberg/spark/SparkSupportsLoadContext.java
create mode 100644
spark/v4.2/spark/src/main/java/org/apache/iceberg/spark/source/metrics/ScanDuration.java
copy
spark/{v3.5/spark/src/main/java/org/apache/iceberg/spark/source/metrics/TaskNumDeletes.java
=>
v4.2/spark/src/main/java/org/apache/iceberg/spark/source/metrics/TaskScanDuration.java}
(89%)
create mode 100644
spark/v4.2/spark/src/test/java/org/apache/iceberg/spark/data/TestSparkVectorizedFormatModel.java
create mode 100644
spark/v4.2/spark/src/test/java/org/apache/iceberg/spark/source/metrics/TestScanDuration.java
