dependabot[bot] opened a new pull request, #1820: URL: https://github.com/apache/datafusion-python/pull/1820
Bumps [arrow](https://github.com/apache/arrow-rs) from 59.3.0 to 60.1.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/arrow-rs/releases";>arrow's releases</a>.</em></p> <blockquote> <h2>arrow 60.1.0</h2> <!-- raw HTML omitted --> <h1>Changelog</h1> <h2><a href="https://github.com/apache/arrow-rs/tree/60.1.0";>60.1.0</a> - (2026-10-23)</h2> <p><a href="https://github.com/apache/arrow-rs/compare/60.0.0...60.1.0";>Full Changelog</a></p> <h3>Security fixes</h3> <ul> <li>Redact Parquet encryption keys from Debug output by <a href="https://github.com/autoCAT6";><code>@autoCAT6</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11614";>#11614</a></li> </ul> <h3>Enhancements</h3> <ul> <li>Implement <code>BatchCoalescer::push_batch_interleaved</code> by <a href="https://github.com/Rich-T-kid";><code>@Rich-T-kid</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11519";>#11519</a></li> <li>feat(parquet): convert INT96 timestamp statistics by <a href="https://github.com/Seanium";><code>@Seanium</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11348";>#11348</a></li> <li>feat: Introduce <code>ArrayReader</code> and <code>ArrayIterator</code> concepts by <a href="https://github.com/kylebarron";><code>@kylebarron</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11161";>#11161</a></li> <li>feat: Add separate Parquet <code>PageIndex</code> decoder to <code>ParquetMetaDataPushDecoder</code> and <code>ParquetMetaDataReader</code> by <a href="https://github.com/etseidl";><code>@etseidl</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11438";>#11438</a></li> <li>feat: add GapInfo to timezone by <a href="https://github.com/mhilton";><code>@mhilton</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11535";>#11535</a></li> <li>Make ByteStreamSplit and Alp Encoder/Decoder and their constructors experimentally public by <a href="https://github.com/jhorstmann";><code>@jhorstmann</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11481";>#11481</a></li> <li>Sync Arrow format documentation and Go metadata by <a href="https://github.com/Phoenix500526";><code>@Phoenix500526</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11499";>#11499</a></li> <li>Add <code>ArrayData::sliced</code> to avoid allocations when slicing owned ArrayData by <a href="https://github.com/memosmorgan";><code>@memosmorgan</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11433";>#11433</a></li> <li>feat(parquet): add ParquetPushDecoder::scan_plan for read-ahead planning by <a href="https://github.com/adriangb";><code>@adriangb</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/10555";>#10555</a></li> <li>feat(arrow-buffer): add <code>i256::wrapping_div_rem</code> and <code>i256::checked_div_rem</code> by <a href="https://github.com/mbutrovich";><code>@mbutrovich</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11425";>#11425</a></li> <li>feat(parquet): Support per-column data page row count limit (<a href="https://redirect.github.com/apache/arrow-rs/issues/11339";>#11339</a>) by <a href="https://github.com/DKER2";><code>@DKER2</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11349";>#11349</a></li> <li>Allow configuring DELTA_BINARY_PACKED block layout by <a href="https://github.com/emecii";><code>@emecii</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11051";>#11051</a></li> <li>feature: add safe version of <code>ArrayData::from_pyarrow</code> by <a href="https://github.com/Rich-T-kid";><code>@Rich-T-kid</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/10894";>#10894</a></li> <li>[Arrow] Move parquet-variant-compute StructArrayAssembler to arrow-array by <a href="https://github.com/cakeni";><code>@cakeni</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/10636";>#10636</a></li> <li>feat(parquet): expose RowSelection::force_mask by <a href="https://github.com/haohuaijin";><code>@haohuaijin</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11337";>#11337</a></li> <li>fix(parquet): support non-primitive map keys in record reader by <a href="https://github.com/hsdfat";><code>@hsdfat</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11229";>#11229</a></li> <li>feat(arrow-schema): expose FixedShapeTensor logical shape by <a href="https://github.com/yongster";><code>@yongster</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11249";>#11249</a></li> <li>feat(arrow-schema): expose FixedShapeTensor shape by <a href="https://github.com/yongster";><code>@yongster</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11247";>#11247</a></li> <li>perf: Add APIs for filter with known selected-row count by <a href="https://github.com/neilconway";><code>@neilconway</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11206";>#11206</a></li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/arrow-rs/blob/main/CHANGELOG.md";>arrow's changelog</a>.</em></p> <blockquote> <h2><a href="https://github.com/apache/arrow-rs/tree/60.1.0";>60.1.0</a> - (2026-10-23)</h2> <p><a href="https://github.com/apache/arrow-rs/compare/60.0.0...60.1.0";>Full Changelog</a></p> <h3>Security fixes</h3> <ul> <li>Redact Parquet encryption keys from Debug output by <a href="https://github.com/autoCAT6";><code>@autoCAT6</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11614";>#11614</a></li> </ul> <h3>Enhancements</h3> <ul> <li>Implement <code>BatchCoalescer::push_batch_interleaved</code> by <a href="https://github.com/Rich-T-kid";><code>@Rich-T-kid</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11519";>#11519</a></li> <li>feat(parquet): convert INT96 timestamp statistics by <a href="https://github.com/Seanium";><code>@Seanium</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11348";>#11348</a></li> <li>feat: Introduce <code>ArrayReader</code> and <code>ArrayIterator</code> concepts by <a href="https://github.com/kylebarron";><code>@kylebarron</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11161";>#11161</a></li> <li>feat: Add separate Parquet <code>PageIndex</code> decoder to <code>ParquetMetaDataPushDecoder</code> and <code>ParquetMetaDataReader</code> by <a href="https://github.com/etseidl";><code>@etseidl</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11438";>#11438</a></li> <li>feat: add GapInfo to timezone by <a href="https://github.com/mhilton";><code>@mhilton</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11535";>#11535</a></li> <li>Make ByteStreamSplit and Alp Encoder/Decoder and their constructors experimentally public by <a href="https://github.com/jhorstmann";><code>@jhorstmann</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11481";>#11481</a></li> <li>Sync Arrow format documentation and Go metadata by <a href="https://github.com/Phoenix500526";><code>@Phoenix500526</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11499";>#11499</a></li> <li>Add <code>ArrayData::sliced</code> to avoid allocations when slicing owned ArrayData by <a href="https://github.com/memosmorgan";><code>@memosmorgan</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11433";>#11433</a></li> <li>feat(parquet): add ParquetPushDecoder::scan_plan for read-ahead planning by <a href="https://github.com/adriangb";><code>@adriangb</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/10555";>#10555</a></li> <li>feat(arrow-buffer): add <code>i256::wrapping_div_rem</code> and <code>i256::checked_div_rem</code> by <a href="https://github.com/mbutrovich";><code>@mbutrovich</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11425";>#11425</a></li> <li>feat(parquet): Support per-column data page row count limit (<a href="https://redirect.github.com/apache/arrow-rs/issues/11339";>#11339</a>) by <a href="https://github.com/DKER2";><code>@DKER2</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11349";>#11349</a></li> <li>Allow configuring DELTA_BINARY_PACKED block layout by <a href="https://github.com/emecii";><code>@emecii</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11051";>#11051</a></li> <li>feature: add safe version of <code>ArrayData::from_pyarrow</code> by <a href="https://github.com/Rich-T-kid";><code>@Rich-T-kid</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/10894";>#10894</a></li> <li>[Arrow] Move parquet-variant-compute StructArrayAssembler to arrow-array by <a href="https://github.com/cakeni";><code>@cakeni</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/10636";>#10636</a></li> <li>feat(parquet): expose RowSelection::force_mask by <a href="https://github.com/haohuaijin";><code>@haohuaijin</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11337";>#11337</a></li> <li>fix(parquet): support non-primitive map keys in record reader by <a href="https://github.com/hsdfat";><code>@hsdfat</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11229";>#11229</a></li> <li>feat(arrow-schema): expose FixedShapeTensor logical shape by <a href="https://github.com/yongster";><code>@yongster</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11249";>#11249</a></li> <li>feat(arrow-schema): expose FixedShapeTensor shape by <a href="https://github.com/yongster";><code>@yongster</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11247";>#11247</a></li> <li>perf: Add APIs for filter with known selected-row count by <a href="https://github.com/neilconway";><code>@neilconway</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11206";>#11206</a></li> <li>perf(parquet): fuse consecutive filters on the same projection by <a href="https://github.com/haohuaijin";><code>@haohuaijin</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/10859";>#10859</a></li> <li>feat(variant): allow creating VariantArray from Option items convertible to Variant by <a href="https://github.com/jabrailkhalil";><code>@jabrailkhalil</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11053";>#11053</a></li> <li>feat(parquet): provide direct access to dictionary pages by <a href="https://github.com/DarkWanderer";><code>@DarkWanderer</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/10420";>#10420</a></li> <li>Allow for serialization of Parquet Page Index via custom <code>PageIndexProvider</code> by <a href="https://github.com/etseidl";><code>@etseidl</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11031";>#11031</a></li> <li>chore(arrow-flight-sql): deprecate register_sql_info from FlightSqlService by <a href="https://github.com/mnpw";><code>@mnpw</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/10904";>#10904</a></li> <li>Infer CSV headers from sampled column types by <a href="https://github.com/Jo2234";><code>@Jo2234</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/10361";>#10361</a></li> <li>Feat: support ndv for View types by <a href="https://github.com/Rich-T-kid";><code>@Rich-T-kid</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11163";>#11163</a></li> <li>feat(ffi): add unsafe constructors and accessors for <code>FFI_ArrowArrayStream</code> by <a href="https://github.com/kylebarron";><code>@kylebarron</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11125";>#11125</a></li> <li>feat(fixed-sized-binary builder): introduce capacity by <a href="https://github.com/Rich-T-kid";><code>@Rich-T-kid</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11127";>#11127</a></li> <li>Add <code>Sbbf::estimated_fpp</code> to expose the bloom filter FPP estimate by <a href="https://github.com/adriangb";><code>@adriangb</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11088";>#11088</a></li> <li>[Variant] Support list paths in ShreddedSchemaBuilder by <a href="https://github.com/cakeni";><code>@cakeni</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/10635";>#10635</a></li> <li>deps: removed unneeded once_cell dependency if favor of std::sync::LazyLock by <a href="https://github.com/aectaan";><code>@aectaan</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11066";>#11066</a></li> </ul> <h3>Bug fixes</h3> <ul> <li>fix(arrow-select): reject nulls in non-nullable columns in take_record_batch by <a href="https://github.com/mbutrovich";><code>@mbutrovich</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11831";>#11831</a></li> <li>[Variant] Restore object field offsets after failed append by <a href="https://github.com/osipovartem";><code>@osipovartem</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11403";>#11403</a></li> <li>fix(arrow-select): bounds-check take_record_batch once, with a faster check_bounds for null indices by <a href="https://github.com/mbutrovich";><code>@mbutrovich</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11829";>#11829</a></li> <li>fix(parquet): align encoded Arrow schemas and nested nullability by <a href="https://github.com/HippoBaro";><code>@HippoBaro</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11278";>#11278</a></li> <li>Fix incorrect Decimal statistics for BYTE_ARRAY columns written via ArrowColumnWriter by <a href="https://github.com/DeviousCardi";><code>@DeviousCardi</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11092";>#11092</a></li> <li>fix(parquet): return an error for RLE run lengths above the spec limit by <a href="https://github.com/hhhizzz";><code>@hhhizzz</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11517";>#11517</a></li> <li>fix: use correct length in runarray validation by <a href="https://github.com/Jefffrey";><code>@Jefffrey</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11668";>#11668</a></li> <li>fix(parquet): return an error when the footer metadata length exceeds the file in ParquetMetaDataPushDecoder by <a href="https://github.com/ump45nose";><code>@ump45nose</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11697";>#11697</a></li> <li>fix: account for offset when building RunArray from ArrayData by <a href="https://github.com/Jefffrey";><code>@Jefffrey</code></a> in <a href="https://redirect.github.com/apache/arrow-rs/pull/11660";>#11660</a></li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/arrow-rs/commit/b391e5af7dff9f6909af45c01f7dddb68ba08c0f";><code>b391e5a</code></a> Update version to <code>60.1.0</code> and add CHANGELOG (<a href="https://redirect.github.com/apache/arrow-rs/issues/11750";>#11750</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/a1eb45012234fe577090f2fa81c41388da0117ad";><code>a1eb450</code></a> Run fork PR test suites in contributor forks (<a href="https://redirect.github.com/apache/arrow-rs/issues/11788";>#11788</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/afb3d77bda3581c44285cf9227ce483affdf3e22";><code>afb3d77</code></a> bench: Add 0.5% selectivity to coalesce benchmarks (<a href="https://redirect.github.com/apache/arrow-rs/issues/11772";>#11772</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/46a4abb8bc242dc898246f8c3a4829d2d6f14bfc";><code>46a4abb</code></a> Fix BatchCoalescer::is_empty documentation (<a href="https://redirect.github.com/apache/arrow-rs/issues/11790";>#11790</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/f1a5016241134c198522a40eb98778dc4666ebf5";><code>f1a5016</code></a> perf(arrow-buffer): divide <code>i256</code> by a single word with a reciprocal on 64-bi...</li> <li><a href="https://github.com/apache/arrow-rs/commit/31caa38f5a63a66b5cbce4049da5deb6d91778c0";><code>31caa38</code></a> ci: move several jobs to <code>ubuntu-slim</code> runner (<a href="https://redirect.github.com/apache/arrow-rs/issues/11774";>#11774</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/9c9b6a0ce5ab1db804fde77c5be745774ace19e1";><code>9c9b6a0</code></a> fix(arrow-select): reject nulls in non-nullable columns in take_record_batch ...</li> <li><a href="https://github.com/apache/arrow-rs/commit/2a22dd74387f818e1aa52ebc66a24f577db6f55f";><code>2a22dd7</code></a> [Variant] Restore object field offsets after failed append (<a href="https://redirect.github.com/apache/arrow-rs/issues/11403";>#11403</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/df4dc3ede59bd43b5f71847231212381d068bb72";><code>df4dc3e</code></a> Run Miri on a daily schedule, require it before releases (<a href="https://redirect.github.com/apache/arrow-rs/issues/11631";>#11631</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/3db18f75b40921b8abf17daed32999ec58064f7d";><code>3db18f7</code></a> bench: improve <code>concat</code>, <code>coalesce_kernels</code> benchmarks (<a href="https://redirect.github.com/apache/arrow-rs/issues/11768";>#11768</a>)</li> <li>Additional commits viewable in <a href="https://github.com/apache/arrow-rs/compare/59.3.0...60.1.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
