dependabot[bot] opened a new pull request, #3788: URL: https://github.com/apache/iceberg-python/pull/3788
Bumps [daft](https://github.com/Eventual-Inc/Daft) from 0.7.21 to 0.7.23. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/Eventual-Inc/Daft/releases";>daft's releases</a>.</em></p> <blockquote> <h2>v0.7.23</h2> <!-- raw HTML omitted --> <h2>What's Changed</h2> <h3>✨ Features</h3> <ul> <li>feat(iceberg): inject DataFile column stats into DataSourceTask for predicate short-circuit by <a href="https://github.com/jiangxt2";><code>@jiangxt2</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7301";>Eventual-Inc/Daft#7301</a></li> </ul> <h3>🐛 Bug Fixes</h3> <ul> <li>fix(dataframe): preserve explain() plan for all write sinks by <a href="https://github.com/desmondcheongzx";><code>@desmondcheongzx</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/6580";>Eventual-Inc/Daft#6580</a></li> </ul> <h3>🚀 Performance</h3> <ul> <li>perf: Optimize stats aggregation within Swordfish by <a href="https://github.com/srilman";><code>@srilman</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7359";>Eventual-Inc/Daft#7359</a></li> </ul> <h3>📖 Documentation</h3> <ul> <li>docs: migrate tutorials and examples to <a href="https://github.com/daft";><code>@daft</code></a>.func / <a href="https://github.com/daft";><code>@daft</code></a>.cls by <a href="https://github.com/everettVT";><code>@everettVT</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/6729";>Eventual-Inc/Daft#6729</a></li> </ul> <h3>✅ Tests</h3> <ul> <li>test(iceberg): cover read_iceberg against a local catalog by <a href="https://github.com/jackylee-ch";><code>@jackylee-ch</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7357";>Eventual-Inc/Daft#7357</a></li> </ul> <h3>🔧 Maintenance</h3> <ul> <li>chore: Update dashboard frontend dependencies by <a href="https://github.com/srilman";><code>@srilman</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7360";>Eventual-Inc/Daft#7360</a></li> <li>chore: Ignore Dependabot warnings in benchmarks by <a href="https://github.com/srilman";><code>@srilman</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7361";>Eventual-Inc/Daft#7361</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/Eventual-Inc/Daft/compare/v0.7.22...untagged-8f79647338339e50cd69";>https://github.com/Eventual-Inc/Daft/compare/v0.7.22...untagged-8f79647338339e50cd69</a></p> <h2>v0.7.22</h2> <!-- raw HTML omitted --> <h2>What's Changed</h2> <h3>✨ Features</h3> <ul> <li>feat(catalog): support Gravitino Iceberg REST catalogs by <a href="https://github.com/kyo-tom";><code>@kyo-tom</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7245";>Eventual-Inc/Daft#7245</a></li> <li>feat(io): add HDFS support via OpenDAL services-hdfs by <a href="https://github.com/Lucas61000";><code>@Lucas61000</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7202";>Eventual-Inc/Daft#7202</a></li> <li>feat(io): export HdfsConfig from daft.io by <a href="https://github.com/Lucas61000";><code>@Lucas61000</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7298";>Eventual-Inc/Daft#7298</a></li> <li>feat(sql): support CREATE TABLE statement by <a href="https://github.com/Lucas61000";><code>@Lucas61000</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7186";>Eventual-Inc/Daft#7186</a></li> <li>feat(functions): add try_divide for PySpark parity by <a href="https://github.com/BABTUNA";><code>@BABTUNA</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7210";>Eventual-Inc/Daft#7210</a></li> <li>feat(file): trace media file reads by <a href="https://github.com/everettVT";><code>@everettVT</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7312";>Eventual-Inc/Daft#7312</a></li> <li>feat(file): trace video frame decoding by <a href="https://github.com/everettVT";><code>@everettVT</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7313";>Eventual-Inc/Daft#7313</a></li> <li>feat(sql): support read_parquet ignore_corrupt_files by <a href="https://github.com/jackylee-ch";><code>@jackylee-ch</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7133";>Eventual-Inc/Daft#7133</a></li> <li>feat(sql): resolve read_iceberg io_config from table properties and default config by <a href="https://github.com/jackylee-ch";><code>@jackylee-ch</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7273";>Eventual-Inc/Daft#7273</a></li> <li>feat(sql): support ignore_corrupt_files in read_csv by <a href="https://github.com/jackylee-ch";><code>@jackylee-ch</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7264";>Eventual-Inc/Daft#7264</a></li> </ul> <h3>🐛 Bug Fixes</h3> <ul> <li>fix(core): handle all-null list literals by <a href="https://github.com/everySympathy";><code>@everySympathy</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7168";>Eventual-Inc/Daft#7168</a></li> <li>fix(parquet): honor row-group constraints in count_rows() count pushdown by <a href="https://github.com/FANNG1";><code>@FANNG1</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7288";>Eventual-Inc/Daft#7288</a></li> <li>fix: Gravitino catalog S3 credential key mismatch and _has_table error handling by <a href="https://github.com/jiangxt2";><code>@jiangxt2</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7279";>Eventual-Inc/Daft#7279</a></li> <li>fix(io): decode video with a single PyAV generator so .mkv/.webm yield frames by <a href="https://github.com/AnayGarodia";><code>@AnayGarodia</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7229";>Eventual-Inc/Daft#7229</a></li> <li>fix(io): support writing to hdfs:// URLs that include a port by <a href="https://github.com/Lucas61000";><code>@Lucas61000</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7307";>Eventual-Inc/Daft#7307</a></li> <li>fix(ai): route OpenAI chat completions parse through beta namespace by <a href="https://github.com/colin-ho";><code>@colin-ho</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/6995";>Eventual-Inc/Daft#6995</a></li> <li>fix: truncate default IOConfig fields in explain() output by <a href="https://github.com/shreynath";><code>@shreynath</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7327";>Eventual-Inc/Daft#7327</a></li> </ul> <h3>♻️ Refactor</h3> <ul> <li>refactor(shuffle): migrate repartition onto shared backend and unify pipeline dispatch by <a href="https://github.com/BABTUNA";><code>@BABTUNA</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7275";>Eventual-Inc/Daft#7275</a></li> <li>refactor(io): migrate Delta Lake scans to DataSource by <a href="https://github.com/ihopenre-eng";><code>@ihopenre-eng</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7300";>Eventual-Inc/Daft#7300</a></li> <li>refactor(io): migrate Hudi scans to DataSource by <a href="https://github.com/Lucas61000";><code>@Lucas61000</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7324";>Eventual-Inc/Daft#7324</a></li> <li>refactor: migrate IcebergScanOperator to DataSource by <a href="https://github.com/Lucas61000";><code>@Lucas61000</code></a> in <a href="https://redirect.github.com/Eventual-Inc/Daft/pull/7311";>Eventual-Inc/Daft#7311</a></li> </ul> <h3>📖 Documentation</h3> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/Eventual-Inc/Daft/commit/1d287b53e823912c8fe955913816e303123aba13";><code>1d287b5</code></a> docs: migrate tutorials and examples to <a href="https://github.com/daft";><code>@daft</code></a>.func / <a href="https://github.com/daft";><code>@daft</code></a>.cls (<a href="https://redirect.github.com/Eventual-Inc/Daft/issues/6729";>#6729</a>)</li> <li><a href="https://github.com/Eventual-Inc/Daft/commit/583445d3e59e1897153cd6040bac588a510ead01";><code>583445d</code></a> chore: Ignore Dependabot warnings in benchmarks (<a href="https://redirect.github.com/Eventual-Inc/Daft/issues/7361";>#7361</a>)</li> <li><a href="https://github.com/Eventual-Inc/Daft/commit/0c4e77a4bb6b7e5af94856fc0cdb2d059bc32412";><code>0c4e77a</code></a> chore: Update dashboard frontend dependencies (<a href="https://redirect.github.com/Eventual-Inc/Daft/issues/7360";>#7360</a>)</li> <li><a href="https://github.com/Eventual-Inc/Daft/commit/de65162fc402eee22ccb1db2cd36274284eabbbb";><code>de65162</code></a> feat(iceberg): inject DataFile column stats into DataSourceTask for predicate...</li> <li><a href="https://github.com/Eventual-Inc/Daft/commit/d830b67a76412a8fa2f3482850e42526fceee00e";><code>d830b67</code></a> fix(dataframe): preserve explain() plan for all write sinks (<a href="https://redirect.github.com/Eventual-Inc/Daft/issues/6580";>#6580</a>)</li> <li><a href="https://github.com/Eventual-Inc/Daft/commit/db209cd62d88f741054c9a8e714ca680efb69be5";><code>db209cd</code></a> test(iceberg): cover read_iceberg against a local catalog (<a href="https://redirect.github.com/Eventual-Inc/Daft/issues/7357";>#7357</a>)</li> <li><a href="https://github.com/Eventual-Inc/Daft/commit/afd411e4b87b1ecfc930d5c02923d93ca4872f84";><code>afd411e</code></a> perf: Optimize stats aggregation within Swordfish (<a href="https://redirect.github.com/Eventual-Inc/Daft/issues/7359";>#7359</a>)</li> <li><a href="https://github.com/Eventual-Inc/Daft/commit/b5d58ed9edb17ecec2bbe6879636b4416e976f1d";><code>b5d58ed</code></a> docs: remove dead HDF5 example notebook link (<a href="https://redirect.github.com/Eventual-Inc/Daft/issues/7352";>#7352</a>)</li> <li><a href="https://github.com/Eventual-Inc/Daft/commit/ae892e89b012a0d745d4e45f85fa0dd235422a5a";><code>ae892e8</code></a> feat(sql): support ignore_corrupt_files in read_csv (<a href="https://redirect.github.com/Eventual-Inc/Daft/issues/7264";>#7264</a>)</li> <li><a href="https://github.com/Eventual-Inc/Daft/commit/a638352fe57e7ccab7857a0aa017824640be4628";><code>a638352</code></a> feat(sql): resolve read_iceberg io_config from table properties and default c...</li> <li>Additional commits viewable in <a href="https://github.com/Eventual-Inc/Daft/compare/v0.7.21...v0.7.23";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
