Acehaidrey opened a new pull request, #11564: URL: https://github.com/apache/iceberg/pull/11564
# Add unit test for create_changelog_view time range behavior ## Problem After upgrading to Iceberg 1.5 and Spark 3.5.1, the `create_changelog_view` procedure occasionally returns records that were inserted outside (before) the specified time range. Specifically: - When querying for recent changes (e.g. last 10 minutes) - The view sometimes includes records from 3-5 hours ago - Re-running the same query returns the expected 0 records - This inconsistency wasn't present in Iceberg 1.3 ## Changes Added a unit test `testChangelogViewOutsideTimeRange` to `TestChangelogTable` that: 1. Inserts test records into the table 2. Waits for a time period to ensure those records are "old" 3. Creates a changelog view with a time range that starts *after* the inserts 4. Verifies the view returns 0 records (expected behavior) 5. The test helps validate that records outside the specified time window are not incorrectly included ## Testing - Added unit test directly targeting the time range filtering behavior - Test runs as part of the existing TestChangelogTable suite - Follows existing test patterns and conventions ## Related Issue # none added yet ## Additional Context - This test was added to help investigate reported production issues where changelog views were inconsistently including historical records - The test provides a reproducible way to verify time range filtering behavior -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
