This is an automated email from the ASF dual-hosted git repository.
brycemecum pushed a change to annotated tag apache-arrow-20.0.0-rc0
in repository https://gitbox.apache.org/repos/asf/arrow.git
*** WARNING: tag apache-arrow-20.0.0-rc0 was modified! ***
from 6a6bec0fa7 (commit)
to bd4f77ffa9 (tag)
tagging 107c6b1cd1cbb5395f1520fe13f79c7fb52009bd (commit)
replaces apache-arrow-3.0.0
by Bryce Mecum
on Wed May 28 19:40:18 2025 +0000
- Log -----------------------------------------------------------------
[Release] Apache Arrow Release 20.0.0 RC0
-----------------------------------------------------------------------
discard 6a6bec0fa7 GH-45316: [Release][C#] Use GitHub Releases for artifacts
add 43afdcec2f GH-45283: [C++][Parquet] Omit level histogram when max
level is 0 (#45285)
add 1fcc89240d GH-45227: [C++][Parquet] Enable Size Stats and Page Index
by default (#45249)
add ba79a481c6 GH-45307: [CI] Use GitHub hosted arm runner (#45308)
add ead8d6fdd1 GH-44363: [C#] Handle Flight data with zero batches (#45315)
add 59c5738566 GH-45305: [CI] Bump Minio version and unpin boto3 (#45320)
add 984519dd77 GH-45129: [Python][C++] Fix usage of deprecated C++
functionality on pyarrow (#45189)
add f8f17a58ad GH-45250: [JS] Fix denominator precision loss and remove
unnecessary safe integer check for fractional part (#45251)
add 3a3f2ec6bf GH-44757: [GLib] Add garrow_array_validate() (#45328)
add 12f62653c8 GH-45304: [C++][S3] Workaround compatibility issue between
AWS SDK and MinIO (#45310)
add dc581f09f8 GH-45316: [Release][C#] Use GitHub Releases for artifacts
(#45317)
add 17a0ff5566 GH-45190: [C++][Compute] Add rank_quantile function (#45259)
add f4a63d41eb GH-44042: [C++][Parquet] Limit num-of row-groups when
building parquet for encrypted file (# 44043)
add c6b6bfb7bd GH-44758: [GLib] Add garrow_array_validate_full() (#45342)
add 2c90dafa0a GH-39023: [C++][CMake] Add missing launcher path conversion
for ExternalPackage (#45349)
add be38880275 GH-44759: [GLib] Add garrow_record_batch_validate() (#45353)
add 4408e2b053 GH-45354: [GLib] Fix garrow_record_batch_validate()
definied location (#45355)
add f373c11b2b GH-45347: [Packaging][Linux] Use cpp/CMakeLists.txt instead
of java/pom.xml to detect version (#45348)
add 14e45a2495 GH-45357: [C++] Disable Flight test (#45232)
add ac1e7ec6c2 GH-45358: [C++][Python] Add MemoryPool method to print
statistics (#45359)
add b818560529 GH-45334: [C++][Acero] Fix swiss join overflow issues in
row offset calculation for fixed length and null masks (#45336)
add 2eba03f1cb GH-45278: [Python][Packaging] Updated delvewheel install
command and updated flags used with delvewheel repair (#45323)
add 1a01b40c41 GH-45361: [CI][C++] Curate `ci/vcpkg/vcpkg.json` (#45081)
add ca2f4d68e8 GH-45356: [CI][R] Update MACOSX_DEPLOYMENT_TARGET to 11.6
(#45363)
add 3e6e8f3fc5 GH-45339: [Parquet][C++] Fix statistics load logic for no
row group and multiple row groups (#45350)
add aaa88e9341 MINOR: [Docs] Update docs to point to separate Java
codebase (#45134)
add 4324a06004 GH-45296: [Python] Only enable the string dtype on pandas
export for pandas>=2.3 (#45383)
add 73b88127d9 GH-45390: [GLib] Use hyphen-separated words for error tag
(#45391)
add 99dd23753d GH-44760: [GLib] Add garrow_record_batch_validate_full()
(#45386)
add 42b84bd033 GH-45388: [CI][MATLAB] Can we use Ubuntu 22.04 or 24.04 for
Ubuntu CI (#45395)
add f872372234 GH-45381: [CI][Packaging][Conan] Use the latest supported
image (#45387)
add 6ee1210fb4 MINOR: [JS] Bump memfs from 4.14.0 to 4.17.0 in /js (#45407)
add ba6bd5abf2 MINOR: [JS] Bump del-cli from 5.1.0 to 6.0.0 in /js (#45408)
add 204d8d6642 MINOR: [JS] Bump flatbuffers from 24.3.25 to 25.1.24 in /js
(#45406)
add 76a52c3f38 GH-45396: [C++] Use Boost with ARROW_FUZZING (#45397)
add ddc4bdeb1b GH-45402: [CI][Dev][Ruby] Reformat codes before apply lint
(#45403)
add 6305c6e7f7 GH-45398: [CI][Dev][Ruby] Add Ruby lint (#45417)
add 2747536dd7 MINOR: [CI] Bump actions/setup-python from 5.3.0 to 5.4.0
(#45419)
add 39711ee577 MINOR: [CI] Bump actions/setup-dotnet from 4.2.0 to 4.3.0
(#45418)
add 31747f067a GH-45132: [C++][Gandiva] Update LLVM to 18.1 (#45114)
add 1567be0d74 GH-26648: [C++] Optimize union equality comparison (#45384)
add 2cbc7d696c GH-44761: [GLib] Add garrow_table_validate() (#45414)
add 27900a6cb7 GH-45371: [C++] Fix data race in
`SimpleRecordBatch::columns` (#45372)
add d9e7fa67c3 GH-45362: [C++] Fix identity cast for time and list scalar
(#45370)
add 8fed34e110 GH-45427: [Python] Fix version comparison in pandas compat
for pandas 2.3 dev version (#45428)
add 05569054ed GH-45380: [Python] Expose RankQuantileOptions to Python
(#45392)
add e28fcd656f GH-45433: [Python] Remove Cython workarounds (#45437)
add deccce1504 GH-45423: [C++] Don't require Boost library with
ARROW_TESTING=ON/ARROW_BUILD_SHARED=OFF (#45424)
add 16c7f1a0bb GH-14932: [Python] Add python bindings for JSON streaming
reader (#45084)
add 240ebc98a6 GH-45455: [GLib] Fix returns positive memory-pool
utilization (#45456)
add 11ce71d286 GH-45378: [CI][R] Increase timeout of
test-ubuntu-r-sanitizer job (#45379)
add f7f4995d3f MINOR: [Dev] Remove non-active collaborator and add active
collaborator (#45461)
add a538fe4b4f GH-45416: [CI][C++][Homebrew] Backport the latest formula
changes (#45460)
add dab09f537b MINOR: [Dev] Minor edits and slight reorganization of
usage_question issue template (#45450)
add ed2a417c61 GH-45447: [CI][GLib] Use `meson format` for Meson
configuration files (#45448)
add d77e5591d3 GH-45451: [C#] Integration with Grpc.Net.ClientFactory
(#45458)
add e32f56b478 GH-44762: [GLib] Add garrow_table_validate_full() (#45468)
add d3c467625d GH-45393: [C++][Compute] Fix wrong decoding for 32-bit
column in row table (#45473)
add d1bf85631f GH-45344: [C++][Testing] Generic `StepGenerator` (#45345)
add 656ae38e55 GH-45436: [Docs][Packaging][Linux] Update how to build
.deb/.rpm (#45481)
add c8a7defecb GH-45482: [CI][Python] Don't use Ubuntu 20.04 for wheel
test (#45483)
add 53c404c341 GH-45479: [CI][Release] Use Ubuntu 24.04 instead of 20.04
(#45480)
add a70ac2d13e GH-45476: [Packaging][Linux] Drop support for Ubuntu 20.04
(#45477)
add f1961ecf82 GH-45389: [CI][R] Use Ubuntu 22.04 for test-r-versions
(#45475)
add f6e2cbeca2 GH-45295: [Python][CI] Make download_tzdata_on_windows more
robust and use tzdata package for tzinfo database on Windows for ORC (#45425)
add 94103279db GH-44629: [C++][Acero] Use `implicit_ordering` for
`asof_join` rather than `require_sequenced_output` (#44616)
add 21703f0d5e MINOR: [JS] Bump esbuild from 0.24.2 to 0.25.0 in /js
(#45494)
add bac31499b0 MINOR: [C#] Bump xunit.runner.visualstudio from 3.0.1 to
3.0.2 in /csharp (#45488)
add 3b29833e51 MINOR: [C#] Bump Microsoft.NET.Test.Sdk from 17.12.0 to
17.13.0 in /csharp (#45489)
add b1e822ae1e GH-45301: [C++] Change PrimitiveArray ctor to protected
(#45444)
add f8a0902cbb GH-37630: [C++][Python][Dataset] Allow disabling fragment
metadata caching (#45330)
add 13940cdc7e GH-45499: [CI] Bump actions/cache version on GHA (#45500)
add e9ec38396e GH-45266: [C++][Acero] Fix the running tasks count of
Scheduler when get error tasks in multi-threads (#45268)
add e79d60d943 GH-45486: [GLib] Add `GArrowArrayStatistics` (#45490)
add 18e8f50729 GH-45377: [CI][R] Ensure install R on ubuntu-24.04 runner
for R nightly build jobs (#45464)
add c2432af546 GH-45510: [CI][C++] Fix LLVM APT repository preparation on
Debian (#45511)
add 25d8bed210 GH-45497: [C++][CSV] Avoid buffer overflow when a line has
too many columns (#45498)
add f8ba543756 GH-45491: [GLib] Require Meson 0.61.2 or later (#45492)
add fdd3e154aa GH-44950: [C++] Bump minimum CMake version to 3.25 (#44989)
add cc861b59e8 GH-45517: [GLib] garrow_data_type_new_raw() returns
GARROW_TYPE_STRING_VIEW_DATA_TYPE (#45518)
add 7906e3cd60 GH-45512: [C++] Clean up undefined symbols in libarrow
without IPC (#45513)
add 251758d549 GH-45159: [CI][Integration] Remove substrait
consumer-testing integration job (#45463)
add 6a47e4d28c GH-33592: [C++] support casting nullable fields to
non-nullable if there are no null values (#43782)
add 152eb879b4 GH-45514: [CI][C++][Docs] Set CUDAToolkit_ROOT explicitly
in debian-docs (#45520)
add a70c1250ad GH-45528: [GLib] garrow_data_type_new_raw() returns
GARROW_TYPE_BINARY_VIEW_DATA_TYPE (#45529)
add a21147b500 GH-45478: [CI][C++] Drop support for Ubuntu 20.04 (#45519)
add 4f71de3cbf GH-44905: [Dev] Remove unused file with only header (#45526)
add 71e214c073 GH-45537: [CI][C++] Add missing includes (iwyu) to
file_skyhook.cc (#45538)
add 4e65a94092 GH-45508: [CI][R] Remove Ubuntu version from sanitizer jobs
(#45509)
add 43d6f79ceb GH-45521: [CI][Dev][R] Install required cyclocomp package
to be used with R lintr (#45524)
add db83c8ef19 GH-45541: [Doc][C++] Render ASCII art as-is (#45542)
add c0e275e4c9 GH-45543: [Release][C#] Remove NuGet references in script
(#45544)
add 310703bffc MINOR: [Release] Update versions for 20.0.0-SNAPSHOT
add 27c639b99a MINOR: [Release] Update .deb/.rpm changelogs for 19.0.1
add a53a77c932 GH-45506: [C++][Acero] More overflow-safe Swiss table
(#45515)
add 136ad9a166 GH-45551: [C++][Acero] Release temp states of Swiss join
building hash table to reduce memory consumption (#45552)
add ec3d2839d1 GH-43519: [Python][CI] Update Python 3.13 rc to final
3.13.2 (#44375)
add 15f1d940e5 GH-45505: [CI][R] Use Ubuntu 22.04 instead of 20.04 as much
as possible for nightly jobs (#45507)
add c7a91000a4 GH-41816: [C++] Add Minimal Meson Build of libarrow (#45441)
add 3712a59936 GH-45536: [Dev][R] Update code to match new linters on
lintr=3.2.0 (#45556)
add 7167ed1635 GH-44924: [R] Remove usage of cpp11's HAS_UNWIND_PROTECT
(#45261)
add eb622d927b MINOR: [R] Clean up a linting issue from #45261 (#45575)
add 288a431290 GH-45545: [C++][Parquet] Add missing includes (#45554)
add 01e3f1e682 GH-45578: [C++] Use max not min in
MakeStatisticsArrayMaxApproximate test (#45579)
add f9283d07db GH-45572: [C++][Compute] Add rank_normal function (#45573)
add ce012eb2e8 GH-45570: [Python] Allow Decimal32/64Array.to_pandas
(#45571)
add f6bfa7b292 GH-39010: [Python] Introduce `maps_as_pydicts` parameter
for `to_pylist`, `to_pydict`, `as_py` (#45471)
add 0d6278ffc8 GH-45584: [C++][Thirdparty] Bump zstd to v1.5.7 (#45585)
add 59fd94f195 GH-45566: [C++][Parquet][CMake] Remove a workaround for
Windows in FindThriftAlt.cmake (#45567)
add 20d8acd89f GH-45568: [C++][Parquet][CMake] Enable zlib automatically
when Thrift is needed (#45569)
add 5e5fb07c7c GH-45587: [C++][Docs] Fix the statistics schema link in
`arrow::RecordBatch::MakeStatisticsArray()`'s docstring (#45588)
add b36659ad01 GH-45591: [C++][Acero] Refine hash join benchmark and
remove openmp from the project (#45593)
add 12cdaaafb7 GH-45485: [Dev] Simplify pull request template (#45599)
add 31994b5c20 GH-37891: [C++] Pass shared_ptr<DataType> by value in
SliceBuffer-related constructors (#45466)
add d59a736e28 MINOR: [R] Bump the timeout for library download (#45607)
add a01a812118 GH-45605: [R][C++] Fix identifier ... preceded by
whitespace warnings (#45606)
add bcda71d30d MINOR: [R] Make update-checksums.R work on macOS out of the
box (#45617)
add 90109cab88 MINOR: [CI] Bump actions/upload-artifact from 4.6.0 to
4.6.1 (#45615)
add a94f860f6d GH-45156: [Python][Packaging] Refactor Python Windows wheel
images to use newer base image (#45442)
add 631fa0a6b7 GH-45457: [Python] Add `pyarrow.ArrayStatistics` (#45550)
add 46f8544500 GH-45620: [CI][C++] Use Visual Studio 2022 not 2019 (#45621)
add 6f1cbc3197 GH-45626: [CI][Docs] Remove Java related configurations
from `ci/docker/linux-apt-docs.dockerfile` (#45627)
add 90513d4c40 GH-45631: [CI] Remove unused
`java-jni-manylinux-201x.dockerfile` (#45632)
add 6068a0bf9a GH-45560: [Docs] Fix Statistics schema's "column" examples
(#45561)
add d87bc99de2 GH-45582: [Python] Preserve decimal32/64/256 metadata in
Schema.metadata (#45583)
add e2ac52d661 GH-44188: [Python] Fix pandas roundtrip with bytes column
names (#44171)
add 0fbf982354 GH-45628: [C++] Ensure specifying Boost include directory
for bundled Thrift (#45637)
add d4d26fe82d GH-45649: [GLib] Add GArrowBinaryViewArray (#45650)
add afd30eb229 MINOR: [CI] Bump actions/download-artifact from 4.1.8 to
4.1.9 (#45657)
add ed55c8bba9 MINOR: [C#] Bump Grpc.Tools from 2.69.0 to 2.70.0 in
/csharp (#45654)
add 443fde7155 MINOR: [C#] Bump ZstdSharp.Port from 0.8.4 to 0.8.5 in
/csharp (#45655)
add 5bedd95f71 GH-45659: [GLib][Ruby] Fix Ruby lint violation(add space
after comma) (#45660)
add 6d75b0e6e1 GH-45661: [GLib][Ruby][Dev] Add Ruby lint rule (add space
after comma) (#45662)
add 30adc91e74 GH-45611: [C++][Acero] Improve Swiss join build performance
by partitioning batches ahead to reduce contention (#45612)
add 9752c34877 GH-35289: [Python] Support large variable width types in
numpy conversion (#36701)
add 4b7a8b3a27 MINOR: Remove gzip compression reference from Pyarrow Orc
doc (#45658)
add b41386d0e5 GH-45269: [C++][Compute] Add "pivot_wider" and
"hash_pivot_wider" functions (#45562)
add d8755a2606 GH-45652: [C++][Acero] Unify ConcurrentQueue and
BackpressureConcurrentQueue API (#45421)
add 601fde9033 GH-45670: [Release][Archery] Crossbow bot accepts
`--prefix` (#45671)
add c58ec9cc31 GH-45366: [C++][Parquet] Set is_compressed to false when
data page v2 is not compressed (#45367)
add 784aa6faf6 GH-45665: [Docs] Add kapa AI bot to the docs (#45667)
add d88ef57a73 MINOR: [Docs] Update implementation status for nanoarrow
(#45333)
add 41770d04b5 MINOR: [JS] Bump typedoc from 0.27.6 to 0.27.9 in /js
(#45646)
add 8332cbfd62 MINOR: [R] Update
github.linux.arrow.version.back.compat.yml (#45703)
add 13c898cbe9 GH-45676: [C++][Python][Compute] Add skew and kurtosis
functions (#45677)
add 3c8fe098c7 GH-45669: [C++][Parquet] Add missing
`ParquetFileReader::GetReadRanges()` definition (#45684)
add ffd651a129 GH-45675: [Release] Run binary RC verification jobs in
apache/arrow (#45699)
add c124bb55d9 GH-45696: [C++][Gandiva] Accept LLVM 20.1 (#45697)
add 419ca89dbb GH-36628: [Python][Parquet] Fail when instantiating
internal Parquet metadata classes (#45549)
add 0622f460c8 GH-45710: [GLib] Add GArrowStringViewArray (#45711)
add 099a1dd1ab GH-45694: [C++] Bump vendored flatbuffers to 24.3.6 (#45687)
add 5ff10fd517 GH-45724: [Docs] Fix docs image name from ubuntu-docs to
debian-docs (#45726)
add 56436e8c37 GH-45564: [C++][Acero] Add size validation for names and
expressions vectors in ProjectNode (#45565)
add b3d218c819 GH-45563: [C++][Compute] Split up hash_aggregate.cc (#45725)
add 19a67c7ffc GH-45656: [C#] Fix failing MacOS builds (#45734)
add 9df280bc97 MINOR: [C#] Bump Google.Protobuf and System.Memory in
/csharp (#45728)
add cf7728121f GH-45739: [C++][Python] Fix crash when calling
hash_pivot_wider without options (#45740)
add 049411524a GH-44615: [C++][Compute] Add extract_regex_span function
(#45577)
add 2316ce88d0 GH-45689: [C++][Thirdparty] Bump Apache ORC to 2.1.1
(#45600)
add 4291dad594 GH-45744: [C++] Remove deprecated GetNextSegment (#45745)
add 42b215bcaf GH-45708: [Release] Re-run binary verification jobs after
we upload binaries (#45736)
add 9b36c709a5 GH-44790: [Python] Remove use_legacy_dataset from code base
(#45742)
add b9d014d30f GH-45589: [C++] Enable singular test in Meson configuration
(#45596)
add 713d09be81 GH-43135: [R] Change the binary type mapping to
`blob::blob` (#45595)
add a0261ddd50 GH-30302: [C++][Parquet] Preserve the bitwidth of integer
dictionary indices on round-trip to Parquet (#45685)
add 08089df73f GH-45548: [Release][Dev][Packaging] Omit APT/Yum
repositories check on local in the RC verification script (#45738)
add c3e399af43 GH-45705: [Python] Add support for SAS token in
AzureFileSystem (#45706)
add 6b66c842ee GH-45690: [C++][Parquet] Consolidate Arrow write functions
under `TypedColumnWriterImpl` (#45688)
add c2e9798ce9 GH-45772: [C++] Export Arrow as dependency from Meson
configuration (#45774)
add 5641cd5c9d GH-45775: [C++] Use dict.get() in Meson configuration
(#45776)
add 2fe4da09bf GH-45693: [C++][Gandiva] Fix aes_encrypt/decrypt algorithm
selection (#45695)
add 791660cb9a GH-45779: [C++] Add testing directory to Meson
configuration (#45780)
add ab4263476d GH-45771: [C++] Add tests to top level Meson configuration
(#45773)
add ac1f05f28e GH-45700: [C++][Compute] Added nullptr check in Equals
method to handle null impl_ pointers (#45701)
add dc842322c1 GH-43296: [C++][FlightRPC] Remove Flight UCX transport
(#43297)
add 69682cd597 GH-45758 [Python] Add AzureFileSystem documentation (#45759)
add b9577695c0 GH-45787: [Integration][CI] Remove pin for Rust 1.77 on
conda integration tests (#45790)
add aac110d4ef GH-45792: [C++] Add benchmarks to Meson configuration
(#45793)
add b2a9f98b07 GH-45752: [C#] Update FlightInfo.cs with missing fields
(#45753)
add 7e18764e1f GH-45769:[C#][flight] add FlightInfo ByteString
serialization (#45770)
add bc0b8585f8 GH-45530: [Python][Packaging] Add pyarrow.libs dir to
get_library_dirs (#45766)
add 9f8e87848f GH-45691: [R][Packaging] Update R packaging checklist with
latest process (#45692)
add 8cb4500b9d GH-45825: [C++] Add c directory to Meson configuration
(#45826)
add 3b645c39b1 GH-45831: [C++] Add CSV directory to Meson configuration
(#45832)
add c1f995226c GH-45784: [C++] Unpin LLVM and OpenSSL in Brewfile (#45785)
add 550a6b3c56 GH-43876: [Swift] Use apache/arrow-go (#45781)
add 7d647e2fc0 GH-45733: [C++][Python] Add biased/unbiased toggle to skew
and kurtosis functions (#45762)
add 073012b473 MINOR: [C#] Bump Grpc.Tools from 2.70.0 to 2.71.0 in
/csharp (#45846)
add b7969ab4ac MINOR: [C#] Bump Grpc.Net.ClientFactory from 2.67.0 to
2.70.0 in /csharp (#45844)
add 8dc0d0cbb7 MINOR: [C#] Bump Grpc.AspNetCore.Server from 2.67.0 to
2.70.0 in /csharp (#45842)
add 6b525b742a MINOR: [C#] Bump Google.Protobuf and System.Memory in
/csharp (#45840)
add 9888fccd3c MINOR: [CI] Bump actions/setup-dotnet from 4.3.0 to 4.3.1
(#45835)
add 681206cfe5 MINOR: [Swift] Bump github.com/apache/arrow-go/v18 from
18.1.0 to 18.2.0 in /swift/CDataWGo (#45836)
add 997cf7a517 MINOR: [Swift] Bump github.com/apache/arrow-go/v18 from
18.1.0 to 18.2.0 in /swift/data-generator/swift-datagen (#45837)
add fc0862a25f GH-45827: [C++] Add io directory to Meson configuration
(#45828)
add 5d487ca199 GH-45820: [C++] Add optional out_offset for
Buffer-returning CopyBitmap function (#45852)
add d702d0c3af GH-45788: [C++][Acero] Fix data race in aggregate node
(#45789)
add 5e9fce493f GH-45782: [GLib] Check only the first line for validation
error (#45783)
add 791091efe5 GH-45868: [C++][CI] Fix test for ambiguous initialization
on C++ 20 (#45871)
add 629e05fb75 GH-45850: Fix r-devel note about symbols in .a libs (#45870)
add f3fdd8320c GH-43118: [JS] Add interval for unit MONTH_DAY_NANO
(#43117) (#45712)
add e526e86deb GH-45718: [R][CI] Fix compilation error on opensuse155
(#45874)
add 1e6a98b5f0 GH-37563: [Ruby] Unify tests about basic arrays for
`raw_records` and `each_raw_record` (#45861)
add ea0b3c5226 GH-45877: [C++][Acero] Cleanup 64-bit temp states of Swiss
join by using 32-bit (#45878)
add 40c5300edc GH-45282: [Python][Parquet] Remove unused readonly
properties of ParquetWriter (#45281)
add 9c41cdc36d GH-45813: [Docs] Enable discussions (#45811)
add 21c9628392 GH-45883: [Docs] Update GitHub Issue Template for GitHub
Discussions (#45884)
add 5c0015d34b GH-43587: [Python] Remove no longer used
serialize/deserialize PyArrow C++ code (#45743)
add 026a933fd1 GH-45755: [C++][Python][Compute] Add winsorize function
(#45763)
add 0de45b9025 GH-45821: [C++][Compute] Grouper improvements (#45822)
add 2c1d9f8989 GH-45890: [Ruby] Unify test for dense union array in
raw_records and each_raw_record (#45904)
add 8579755123 MINOR: [CI] Bump actions/upload-artifact from 4.6.1 to
4.6.2 (#45910)
add 279fc59f20 MINOR: [CI] Bump actions/download-artifact from 4.1.9 to
4.2.1 (#45911)
add e184d7b691 GH-45879: [CI][Release][Ruby] Omit Flight related tests on
x86_64 macOS (#45898)
add ae801e161c GH-45905: [C++][Acero] Enlarge the timeout in
ConcurrentQueue test to reduce sporadical failures (#45923)
add ed4cee0d3c GH-45926: [Python] Use pytest.approx for float values on
unbiased skew and kurtosis tests (#45929)
add d52667bc60 GH-45906: [Docs] Document GitHub Discussions in Developer's
Guide (#45907)
add 25d5c055ce GH-45862: [JS] Fix FixedSizeListBuilder behavior for null
slots (#45889)
add b9cb52f67b GH-45816: [C++] Make `VisitType()` fallback branch
unreachable (#45815)
add 89fdbb9968 GH-45915: [JS] Ensure UnionBuilder yields chunks with
correct length (#45916)
add 626cadfe1b GH-45924: [CI] Update chrome_version for emscripten job to
latest stable (v134) (#45925)
add 46c6eecbd0 GH-45891: [Ruby] Unify test for dictionary array in
raw_records and each_raw_record (#45927)
add c753740f93 GH-45917: [C++][Acero] Add flush taskgroup to enable
parallelization (#45918)
add 5d0149d493 GH-41246: [Docs][C++][Python] Improve docs on column
encryption for nested fields (#45411)
add b4ba60a0a2 GH-41166: [CI][Packaging] Remove unmaintained conda-recipes
(#45944)
add 05130024f3 GH-37891: [C++] Followup SliceBuffer shared_ptr move usage
(#45941)
add 9b7875c7a6 GH-45939: [C++][Benchmarking] Fix compilation failures
(#45942)
add 0355ad6781 GH-45892: [Ruby] Unify test for list array in raw_records
and each_raw_record (#45940)
add 6fee049c81 GH-18036: [Packaging] Build Python wheel for musllinux
(#45470)
add a42edc05b7 GH-43573: [C++] Copy bitmap when casting from string-view
to offset string and binary types (#44822)
add 7c18001f0d GH-45848: [C++][Python][R] Remove deprecated PARQUET_2_0
(#45849)
add 2f4f68aed6 GH-45893: [Ruby] Unify test for map array in raw_records
and each_raw_record (#45955)
add f4b7a4ee0a GH-45930: [C++] Don't use ICU C++ API in Azure SDK C++
(#45952)
add cc10aa5da9 GH-40760: [Release] Use repository.apache.org (#45903)
add 85779a44e9 GH-45185: [C++][Parquet] Raise an error for invalid
repetition levels when delimiting records (#45186)
add 1245e077a1 GH-45894: [Ruby] Unify test for multiple columns in
raw_records and each_raw_record (#45965)
add 7e3b9917c7 MINOR: [R] Don't print that we're cleaning up static libs
(#45958)
add 618ef501a2 GH-45922: [C++][Flight] Remove deprecated Authenticate and
StartCall (#45932)
add 3c63f37d42 GH-45959: [C++][CMake] Fix Protobuf dependency in
Arrow::arrow_static (#45960)
add 9cefaf5e80 GH-45895: [Ruby] Unify test for sparse union array in
raw_records and each_raw_record (#45970)
add 0709cd7e0b GH-45920: [Release][Python] Upload sdist and wheels to
GitHub Releases not apache.jfrog.io (#45962)
add b4988270af GH-45896: [Ruby] Unify test for struct array in raw_records
and each_raw_record (#45974)
add 8c7b291fec GH-41985: [Python][Docs] Clarify docstring of
pyarrow.compute.scalar() (#45668)
add e1bb01831d GH-45975: [Ruby] Add support for
rubygems-requirements-system (#45976)
add a382a1b675 GH-45614: [C++] Use Boost's CMake packages instead of
FindBoost.cmake in CMake (#45623)
add 19033bc1d0 GH-45953: [C++] Use lock to fix atomic bug in
ReadaheadGenerator (#45954)
add 3828a2e5e2 MINOR: [C#] Bump Google.Protobuf and System.Memory in
/csharp (#45984)
add adfc5f4562 GH-45897: [Ruby] Unify test for table in raw_records and
each_raw_record (#45977)
add 60b5ab9ee0 MINOR: [CI] Bump actions/setup-python from 5.4.0 to 5.5.0
(#45982)
add 48c0bbbd4a GH-45987: [C++] Set CMAKE_POLICY_VERSION_MINIMUM=3.5 for
bundled dependencies (#45997)
add d73079d5a0 GH-45746: [C++] Remove deprecated functions in 20.0 (C++
subset) (#45748)
add 2ba7f13df7 GH-41764: [Parquet][C++] Support future logical types in
the Parquet reader (#41765)
add 9b0885ade1 GH-45999: [C++][Gandiva] Fix crashes on LLVM 20.1.1 (#46000)
add 64521946ea GH-43057: [C++] Thread-safe AesEncryptor / AesDecryptor
(#44990)
add 686971e1b5 GH-45980: [C++] Bump Bundled Snappy version to 1.2.2
(#45981)
add 4d625b37cc GH-45732: [C++][Compute] Accept more pivot key types
(#45945)
add ca311c14d1 GH-45961: [Release][Docs] Upload generated docs to GitHub
Releases not apache.jfrog.io (#45963)
add 81c9510b53 GH-46023: [CI][MATLAB] libmexclass doesn't work with CMake
4.0.0 (#46033)
add aa6c0c057e GH-45714: [CI][R] Don't run tests that use reticulate on
CRAN (#46026)
add 458b6ab6f3 GH-45949: [R] Fix CRAN warnings for 19.0.1 about compiled
code (#45951)
add dd47cd0cc1 GH-46022: [C++] Fix build error with g++ 7.5.0 (#46028)
add caf885b7c9 GH-45994: [CI][GLib] Fix vcpkg configuration for Windows
job (#46006)
add 487d0b3a2f GH-46041: [Python][Packaging] Temporary remove pandas from
being installed on free-threaded Windows wheel tests (#46042)
add df361ce020 GH-46050: [R] Add windows to set of paths in Makevars.in
(#46055)
add e0708c7d0f GH-46051: [R] Backport NEWS.md changes from 19.0.1.1
(#46056)
add b84f3a55c8 MINOR: [Release] Update CHANGELOG.md for 20.0.0
add d995f417da MINOR: [Release] Update .deb/.rpm changelogs for 20.0.0
add 107c6b1cd1 MINOR: [Release] Update versions for 20.0.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
annotated tag are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6a6bec0fa7)
\
N -- N -- N refs/tags/apache-arrow-20.0.0-rc0 (bd4f77ffa9)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 16 +-
.env | 15 +-
.github/ISSUE_TEMPLATE/usage_question.yaml | 38 +-
.github/dependabot.yml | 14 +
.github/pull_request_template.md | 53 +-
.github/workflows/archery.yml | 2 +-
.github/workflows/comment_bot.yml | 2 +-
.github/workflows/cpp.yml | 94 +-
.github/workflows/csharp.yml | 29 +-
.github/workflows/dev.yml | 8 +-
.github/workflows/docs.yml | 4 +-
.github/workflows/docs_light.yml | 4 +-
.github/workflows/integration.yml | 4 +-
.github/workflows/js.yml | 2 +-
.github/workflows/matlab.yml | 22 +-
.github/workflows/pr_bot.yml | 2 +-
.github/workflows/pr_review_trigger.yml | 2 +-
.github/workflows/python.yml | 6 +-
.github/workflows/r.yml | 15 +-
.github/workflows/r_nightly.yml | 5 +-
.github/workflows/release.yml | 22 +-
.github/workflows/ruby.yml | 60 +-
.github/workflows/swift.yml | 6 +-
.github/workflows/verify_rc.yml | 182 +++
.pre-commit-config.yaml | 40 +-
.../java_cdata_integration.sh => .rubocop.yml | 20 +-
ci/conda_env_gandiva.txt => .shellcheckrc | 4 +-
CHANGELOG.md | 251 ++++
LICENSE.txt | 33 +-
README.md | 2 +-
c_glib/arrow-cuda-glib/meson.build | 137 +-
c_glib/arrow-dataset-glib/meson.build | 180 +--
c_glib/arrow-flight-glib/meson.build | 138 +-
c_glib/arrow-flight-sql-glib/meson.build | 143 +-
c_glib/arrow-glib/basic-array.cpp | 313 ++++
c_glib/arrow-glib/basic-array.h | 75 +
c_glib/arrow-glib/basic-array.hpp | 4 +
c_glib/arrow-glib/basic-data-type.cpp | 6 +
c_glib/arrow-glib/meson.build | 411 +++---
c_glib/arrow-glib/record-batch.cpp | 41 +-
c_glib/arrow-glib/record-batch.h | 8 +
c_glib/arrow-glib/table.cpp | 64 +-
c_glib/arrow-glib/table.h | 8 +
c_glib/doc/meson.build | 94 +-
c_glib/example/lua/meson.build | 17 +-
c_glib/example/meson.build | 67 +-
c_glib/example/vala/meson.build | 72 +-
c_glib/gandiva-glib/meson.build | 188 +--
c_glib/meson.build | 329 +++--
c_glib/parquet-glib/meson.build | 145 +-
c_glib/test/dataset/test-file-system-dataset.rb | 18 +-
c_glib/test/flight-sql/test-client.rb | 1 +
c_glib/test/flight/test-client.rb | 1 +
c_glib/test/flight/test-stream-reader.rb | 1 +
...nt64-statistics.rb => test-array-statistics.rb} | 16 +-
c_glib/test/test-array.rb | 50 +-
c_glib/test/test-binary-view-array.rb | 40 +
c_glib/test/test-binary-view-data-type.rb | 7 +
c_glib/test/test-chunked-array-datum.rb | 9 +-
c_glib/test/test-large-list-array.rb | 8 +-
c_glib/test/test-memory-pool.rb | 2 +
c_glib/test/test-record-batch-datum.rb | 8 +-
c_glib/test/test-record-batch.rb | 77 +
c_glib/test/test-string-view-array.rb | 40 +
c_glib/test/test-string-view-data-type.rb | 7 +
c_glib/test/test-struct-field-options.rb | 3 +-
c_glib/test/test-table.rb | 75 +
c_glib/test/test-take.rb | 2 +-
c_glib/test/test-uint-array-builder.rb | 12 +-
c_glib/vcpkg.json | 8 +-
ci/appveyor-cpp-setup.bat | 2 +-
ci/conan/all/conandata.yml | 73 +-
ci/conan/all/conanfile.py | 141 +-
.../all/patches/1.0.0-0003-fix-shared-msvc.patch | 35 -
.../patches/1.0.0-0005-fix-make12-namespace.patch | 44 -
ci/conan/all/patches/1.0.0-0006-fix-cmake.patch | 355 -----
ci/conan/all/patches/11.0.0-0001-fix-cmake.patch | 64 +
ci/conan/all/patches/16.0.0-0001-fix-cmake.patch | 84 ++
ci/conan/all/patches/18.0.0-0001-fix-cmake.patch | 81 ++
.../all/patches/2.0.0-0003-fix-shared-msvc.patch | 35 -
.../all/patches/2.0.0-0005-gandiva-engine.patch | 35 -
ci/conan/all/patches/2.0.0-0008-fix-cmake.patch | 295 ----
.../all/patches/7.0.0-0006-install-utils.patch | 39 -
ci/conan/all/patches/7.0.0-0007-fix-cmake.patch | 369 -----
.../all/patches/8.0.0-0005-install-utils.patch | 65 -
ci/conan/all/patches/8.0.0-0006-fix-cmake.patch | 447 ------
ci/conan/all/test_package/CMakeLists.txt | 8 +-
ci/conan/all/test_v1_package/CMakeLists.txt | 31 -
ci/conan/all/test_v1_package/conanfile.py | 40 -
ci/conan/config.yml | 28 +-
ci/conan/merge_status.sh | 2 +-
ci/conda_env_cpp.txt | 1 +
ci/conda_env_python.txt | 3 +-
ci/conda_env_sphinx.txt | 3 +
ci/docker/centos-7-cpp.dockerfile | 7 +-
ci/docker/conda-cpp.dockerfile | 2 -
ci/docker/conda-integration.dockerfile | 3 -
ci/docker/conda-python-pandas.dockerfile | 2 +
ci/docker/conda-python-substrait.dockerfile | 59 -
ci/docker/conda.dockerfile | 1 -
ci/docker/debian-12-cpp.dockerfile | 16 +-
ci/docker/java-jni-manylinux-201x.dockerfile | 55 -
ci/docker/linux-apt-docs.dockerfile | 12 +-
ci/docker/linux-apt-lint.dockerfile | 1 +
ci/docker/linux-r.dockerfile | 4 +
...readed-wheel-musllinux-test-imports.dockerfile} | 33 +-
...aded-wheel-musllinux-test-unittests.dockerfile} | 41 +-
...-threaded-wheel-windows-test-vs2022.dockerfile} | 5 +-
...-free-threaded-wheel-windows-vs2022.dockerfile} | 0
ci/docker/python-wheel-manylinux.dockerfile | 7 +-
...file => python-wheel-musllinux-test.dockerfile} | 21 +-
...ockerfile => python-wheel-musllinux.dockerfile} | 63 +-
...ython-wheel-windows-test-vs2019-base.dockerfile | 51 -
...ython-wheel-windows-test-vs2022-base.dockerfile | 65 +
...=> python-wheel-windows-test-vs2022.dockerfile} | 0
.../python-wheel-windows-vs2019-base.dockerfile | 79 -
.../python-wheel-windows-vs2022-base.dockerfile | 132 ++
...file => python-wheel-windows-vs2022.dockerfile} | 0
ci/docker/ubuntu-20.04-cpp-minimal.dockerfile | 105 --
ci/docker/ubuntu-20.04-cpp.dockerfile | 194 ---
ci/docker/ubuntu-20.04-verify-rc.dockerfile | 26 -
ci/docker/ubuntu-22.04-cpp-minimal.dockerfile | 4 +
ci/docker/ubuntu-22.04-cpp.dockerfile | 14 +-
ci/docker/ubuntu-22.04-verify-rc.dockerfile | 4 +
ci/docker/ubuntu-24.04-cpp.dockerfile | 7 +-
ci/docker/ubuntu-swift.dockerfile | 2 +-
ci/rtools/README.md | 35 +
.../rtools/aws_c_common_ep.patch | 35 +-
ci/rtools/aws_c_io_ep.patch | 56 +
ci/rtools/awssdk_ep.patch | 181 +++
ci/scripts/PKGBUILD | 36 +-
ci/scripts/c_glib_build.sh | 19 +-
ci/scripts/conan_build.sh | 4 +-
ci/scripts/conan_setup.sh | 3 +-
ci/scripts/cpp_build.sh | 28 +-
ci/scripts/cpp_test.sh | 9 +-
ci/scripts/csharp_test.sh | 3 -
ci/scripts/install_cmake.sh | 49 +-
ci/scripts/install_minio.sh | 2 +-
ci/scripts/install_python.sh | 18 +-
ci/scripts/install_substrait_consumer.sh | 36 -
ci/scripts/install_vcpkg.sh | 2 +
ci/scripts/integration_substrait.sh | 31 -
ci/scripts/python_wheel_validate_contents.py | 2 +-
ci/scripts/python_wheel_windows_build.bat | 19 +-
ci/scripts/python_wheel_windows_test.bat | 15 +-
...linux_build.sh => python_wheel_xlinux_build.sh} | 4 +-
ci/scripts/r_test.sh | 9 +-
ci/scripts/r_windows_build.sh | 13 +-
ci/vcpkg/ports.patch | 9 +-
ci/vcpkg/vcpkg.json | 8 +-
cpp/.gitignore | 6 +
cpp/Brewfile | 4 +-
cpp/CMakeLists.txt | 75 +-
cpp/CMakePresets.json | 1 -
cpp/cmake_modules/DefineOptions.cmake | 7 -
cpp/cmake_modules/FindThriftAlt.cmake | 43 +-
cpp/cmake_modules/ThirdpartyToolchain.cmake | 205 ++-
cpp/cmake_modules/Usevcpkg.cmake | 92 --
cpp/cmake_modules/orc.diff | 289 ----
cpp/examples/arrow/CMakeLists.txt | 9 +
cpp/examples/arrow/parquet_column_encryption.cc | 231 +++
cpp/examples/arrow/parquet_read_write.cc | 2 +-
cpp/examples/minimal_build/minimal.dockerfile | 2 +-
.../minimal_build/system_dependency.dockerfile | 2 +-
.../encryption_reader_writer_all_crypto_options.cc | 2 +-
cpp/examples/parquet/parquet_arrow/CMakeLists.txt | 2 +-
cpp/examples/tutorial_examples/CMakeLists.txt | 2 +-
cpp/examples/tutorial_examples/tutorial.dockerfile | 2 +-
cpp/meson.build | 69 +
cpp/meson.options | 81 ++
cpp/src/arrow/CMakeLists.txt | 10 +-
cpp/src/arrow/acero/CMakeLists.txt | 30 +-
cpp/src/arrow/acero/accumulation_queue.h | 2 +-
cpp/src/arrow/acero/aggregate_benchmark.cc | 15 +-
cpp/src/arrow/acero/aggregate_internal.cc | 3 +-
cpp/src/arrow/acero/aggregate_internal.h | 2 +
cpp/src/arrow/acero/aggregate_node_test.cc | 39 +
cpp/src/arrow/acero/arrow-acero.pc.in | 3 +-
cpp/src/arrow/acero/asof_join_node.cc | 2 +-
cpp/src/arrow/acero/concurrent_queue_internal.h | 38 +-
cpp/src/arrow/acero/groupby_aggregate_node.cc | 5 +
cpp/src/arrow/acero/hash_aggregate_test.cc | 1176 ++++++++++++---
cpp/src/arrow/acero/hash_join.h | 2 +-
cpp/src/arrow/acero/hash_join_benchmark.cc | 54 +-
cpp/src/arrow/acero/hash_join_node_test.cc | 99 ++
cpp/src/arrow/acero/options.h | 10 +-
cpp/src/arrow/acero/order_by_node_test.cc | 3 +-
cpp/src/arrow/acero/plan_test.cc | 17 +
cpp/src/arrow/acero/project_node.cc | 7 +-
cpp/src/arrow/acero/sorted_merge_node.cc | 2 +-
cpp/src/arrow/acero/sorted_merge_node_test.cc | 3 +-
cpp/src/arrow/acero/source_node.cc | 2 +-
cpp/src/arrow/acero/source_node_test.cc | 1 +
cpp/src/arrow/acero/swiss_join.cc | 431 +++---
cpp/src/arrow/acero/swiss_join_avx2.cc | 34 +-
cpp/src/arrow/acero/swiss_join_internal.h | 96 +-
cpp/src/arrow/acero/task_util.cc | 87 +-
cpp/src/arrow/acero/task_util_test.cc | 92 ++
cpp/src/arrow/acero/util_test.cc | 122 +-
cpp/src/arrow/array/array_base.h | 8 +-
cpp/src/arrow/array/array_union_test.cc | 30 +
cpp/src/arrow/buffer.cc | 24 +-
cpp/src/arrow/buffer.h | 28 +-
cpp/src/arrow/c/bridge_benchmark.cc | 20 +-
.../test-unique.rb => cpp/src/arrow/c/meson.build | 32 +-
cpp/src/arrow/compare.cc | 44 +-
cpp/src/arrow/compute/api_aggregate.cc | 50 +-
cpp/src/arrow/compute/api_aggregate.h | 130 ++
cpp/src/arrow/compute/api_scalar.cc | 10 +
cpp/src/arrow/compute/api_scalar.h | 10 +
cpp/src/arrow/compute/api_vector.cc | 21 +
cpp/src/arrow/compute/api_vector.h | 38 +
cpp/src/arrow/compute/exec.h | 2 +-
cpp/src/arrow/compute/expression.cc | 18 +-
cpp/src/arrow/compute/expression_test.cc | 9 +
cpp/src/arrow/compute/kernels/CMakeLists.txt | 1 +
cpp/src/arrow/compute/kernels/aggregate_internal.h | 11 +-
cpp/src/arrow/compute/kernels/aggregate_mode.cc | 7 +-
cpp/src/arrow/compute/kernels/aggregate_pivot.cc | 210 +++
.../arrow/compute/kernels/aggregate_quantile.cc | 26 +-
cpp/src/arrow/compute/kernels/aggregate_test.cc | 507 ++++++-
cpp/src/arrow/compute/kernels/aggregate_var_std.cc | 378 ++---
.../compute/kernels/aggregate_var_std_internal.h | 127 +-
cpp/src/arrow/compute/kernels/codegen_internal.h | 11 +-
cpp/src/arrow/compute/kernels/hash_aggregate.cc | 1523 ++------------------
.../compute/kernels/hash_aggregate_internal.h | 208 +++
.../compute/kernels/hash_aggregate_numeric.cc | 1253 ++++++++++++++++
.../arrow/compute/kernels/hash_aggregate_pivot.cc | 492 +++++++
cpp/src/arrow/compute/kernels/pivot_internal.cc | 158 ++
.../kernels/pivot_internal.h} | 36 +-
.../arrow/compute/kernels/scalar_cast_boolean.cc | 3 +-
.../arrow/compute/kernels/scalar_cast_nested.cc | 50 +-
.../arrow/compute/kernels/scalar_cast_string.cc | 52 +-
cpp/src/arrow/compute/kernels/scalar_cast_test.cc | 141 +-
.../arrow/compute/kernels/scalar_list_benchmark.cc | 66 +-
.../arrow/compute/kernels/scalar_string_ascii.cc | 205 ++-
.../arrow/compute/kernels/scalar_string_test.cc | 83 ++
cpp/src/arrow/compute/kernels/util_internal.h | 19 +
cpp/src/arrow/compute/kernels/vector_rank.cc | 425 ++++--
.../arrow/compute/kernels/vector_sort_internal.h | 7 +
cpp/src/arrow/compute/kernels/vector_sort_test.cc | 217 ++-
cpp/src/arrow/compute/kernels/vector_statistics.cc | 209 +++
.../compute/kernels/vector_statistics_test.cc | 169 +++
cpp/src/arrow/compute/key_map_internal.cc | 215 ++-
cpp/src/arrow/compute/key_map_internal.h | 135 +-
cpp/src/arrow/compute/key_map_internal_avx2.cc | 62 +-
cpp/src/arrow/compute/registry.cc | 4 +
cpp/src/arrow/compute/registry_internal.h | 4 +
cpp/src/arrow/compute/row/compare_internal.cc | 16 +-
cpp/src/arrow/compute/row/compare_internal_avx2.cc | 81 +-
cpp/src/arrow/compute/row/compare_test.cc | 6 +-
cpp/src/arrow/compute/row/encode_internal.cc | 54 +-
cpp/src/arrow/compute/row/encode_internal.h | 10 +-
cpp/src/arrow/compute/row/encode_internal_avx2.cc | 15 +-
cpp/src/arrow/compute/row/grouper.cc | 357 +++--
cpp/src/arrow/compute/row/grouper.h | 14 +-
cpp/src/arrow/compute/row/grouper_test.cc | 525 +++++--
cpp/src/arrow/compute/row/row_internal.cc | 10 +-
cpp/src/arrow/compute/row/row_internal.h | 61 +-
cpp/src/arrow/compute/row/row_test.cc | 11 +-
cpp/src/arrow/compute/row/row_util_avx2_internal.h | 64 +
cpp/src/arrow/compute/type_fwd.h | 1 +
cpp/src/arrow/csv/meson.build | 71 +
cpp/src/arrow/csv/parser.cc | 74 +-
cpp/src/arrow/csv/parser_test.cc | 72 +
cpp/src/arrow/csv/reader.cc | 4 +-
cpp/src/arrow/dataset/CMakeLists.txt | 9 +
cpp/src/arrow/dataset/arrow-dataset.pc.in | 3 +-
cpp/src/arrow/dataset/dataset.cc | 14 +-
cpp/src/arrow/dataset/dataset.h | 10 +
cpp/src/arrow/dataset/dataset_test.cc | 1 +
cpp/src/arrow/dataset/discovery.cc | 1 +
cpp/src/arrow/dataset/file_base.cc | 1 +
cpp/src/arrow/dataset/file_parquet.cc | 42 +-
cpp/src/arrow/dataset/file_parquet.h | 5 +
.../arrow/dataset/file_parquet_encryption_test.cc | 314 +++-
cpp/src/arrow/dataset/file_parquet_test.cc | 19 +-
cpp/src/arrow/dataset/scanner.cc | 32 +-
cpp/src/arrow/dataset/scanner.h | 48 +-
cpp/src/arrow/dataset/scanner_test.cc | 75 +-
cpp/src/arrow/engine/CMakeLists.txt | 9 +
cpp/src/arrow/engine/arrow-substrait.pc.in | 3 +-
cpp/src/arrow/engine/substrait/util.cc | 1 +
cpp/src/arrow/filesystem/gcsfs.h | 3 -
cpp/src/arrow/filesystem/s3fs.cc | 29 +-
cpp/src/arrow/filesystem/s3fs_test.cc | 1 -
cpp/src/arrow/flight/CMakeLists.txt | 32 +-
cpp/src/arrow/flight/arrow-flight.pc.in | 3 +-
cpp/src/arrow/flight/flight_benchmark.cc | 24 +-
cpp/src/arrow/flight/perf_server.cc | 32 +-
cpp/src/arrow/flight/server_auth.h | 20 +-
cpp/src/arrow/flight/server_middleware.cc | 35 -
cpp/src/arrow/flight/server_middleware.h | 24 +-
cpp/src/arrow/flight/sql/CMakeLists.txt | 9 +
cpp/src/arrow/flight/sql/arrow-flight-sql.pc.in | 3 +-
.../arrow/flight/sql/server_session_middleware.cc | 11 +-
.../flight/sql/server_session_middleware_factory.h | 2 +-
cpp/src/arrow/flight/test_definitions.h | 3 +-
cpp/src/arrow/flight/transport/ucx/CMakeLists.txt | 70 -
.../transport/ucx/flight_transport_ucx_test.cc | 378 -----
cpp/src/arrow/flight/transport/ucx/ucx.cc | 45 -
cpp/src/arrow/flight/transport/ucx/ucx.h | 37 -
cpp/src/arrow/flight/transport/ucx/ucx_client.cc | 769 ----------
cpp/src/arrow/flight/transport/ucx/ucx_internal.cc | 1110 --------------
cpp/src/arrow/flight/transport/ucx/ucx_internal.h | 363 -----
cpp/src/arrow/flight/transport/ucx/ucx_server.cc | 653 ---------
.../arrow/flight/transport/ucx/util_internal.cc | 293 ----
cpp/src/arrow/flight/transport/ucx/util_internal.h | 83 --
cpp/src/arrow/io/memory.cc | 9 -
cpp/src/arrow/io/memory.h | 16 -
cpp/src/arrow/io/meson.build | 76 +
cpp/src/arrow/io/test_common.cc | 2 +
cpp/src/arrow/io/test_common.h | 2 +
cpp/src/arrow/io/transform.cc | 4 +-
cpp/src/arrow/ipc/feather.cc | 76 +-
cpp/src/arrow/ipc/message.cc | 12 +-
cpp/src/arrow/ipc/metadata_internal.cc | 283 ++--
cpp/src/arrow/ipc/metadata_internal.h | 6 +-
cpp/src/arrow/ipc/read_write_test.cc | 34 +-
cpp/src/arrow/ipc/reader.cc | 17 +-
cpp/src/arrow/ipc/writer.cc | 4 +-
cpp/src/arrow/memory_pool.cc | 28 +
cpp/src/arrow/memory_pool.h | 10 +
cpp/src/arrow/memory_pool_internal.h | 1 +
cpp/src/arrow/memory_pool_jemalloc.cc | 4 +
cpp/src/arrow/meson.build | 539 +++++++
cpp/src/arrow/record_batch.cc | 10 +-
cpp/src/arrow/record_batch.h | 2 +-
cpp/src/arrow/record_batch_test.cc | 44 +-
cpp/src/arrow/scalar.cc | 11 +-
cpp/src/arrow/scalar_test.cc | 48 +
cpp/src/arrow/testing/CMakeLists.txt | 3 +-
cpp/src/arrow/testing/generator.cc | 41 -
cpp/src/arrow/testing/generator.h | 44 +-
cpp/src/arrow/testing/generator_test.cc | 74 +
cpp/src/arrow/testing/gtest_util_test.cc | 10 +
cpp/src/arrow/testing/math.cc | 6 +
cpp/src/arrow/testing/meson.build | 64 +
cpp/src/arrow/type.cc | 6 +
cpp/src/arrow/type.h | 8 +
cpp/src/arrow/util/CMakeLists.txt | 1 +
cpp/src/arrow/util/async_generator.h | 69 +-
cpp/src/arrow/util/async_generator_fwd.h | 4 +-
cpp/src/arrow/util/bit_util_benchmark.cc | 8 +-
cpp/src/arrow/util/bit_util_test.cc | 19 +-
cpp/src/arrow/util/bitmap_ops.cc | 24 +-
cpp/src/arrow/util/bitmap_ops.h | 4 +-
cpp/src/arrow/util/config.h.cmake | 1 -
cpp/src/arrow/util/delimiting.cc | 8 +-
cpp/src/arrow/util/iterator.h | 7 +
cpp/src/arrow/util/math_internal.cc | 130 ++
cpp/src/arrow/util/math_internal.h | 62 +
cpp/src/arrow/util/math_test.cc | 115 ++
cpp/src/arrow/util/meson.build | 94 ++
cpp/src/arrow/util/type_fwd.h | 12 +
cpp/src/arrow/vendored/datetime/README.md | 3 +
cpp/src/arrow/vendored/datetime/date.h | 8 +-
cpp/src/arrow/visit_type_inline.h | 4 +-
cpp/src/gandiva/CMakeLists.txt | 9 +
cpp/src/gandiva/cache.cc | 3 -
cpp/src/gandiva/cache.h | 4 -
cpp/src/gandiva/decimal_ir.cc | 15 +-
cpp/src/gandiva/encrypt_utils.cc | 42 +-
cpp/src/gandiva/encrypt_utils.h | 4 +-
cpp/src/gandiva/encrypt_utils_test.cc | 116 +-
cpp/src/gandiva/engine.cc | 8 +
cpp/src/gandiva/engine.h | 3 +
cpp/src/gandiva/function_ir_builder.h | 3 +
cpp/src/gandiva/gandiva.pc.in | 4 +-
cpp/src/gandiva/gdv_function_stubs.cc | 35 +-
cpp/src/gandiva/gdv_function_stubs_test.cc | 80 +
cpp/src/gandiva/llvm_generator.cc | 17 +-
cpp/src/gandiva/llvm_generator.h | 6 +
cpp/src/gandiva/llvm_types.h | 4 +-
cpp/src/gandiva/tests/projector_test.cc | 25 +-
cpp/src/generated/File_generated.h | 10 +-
cpp/src/generated/Message_generated.h | 116 +-
cpp/src/generated/Schema_generated.h | 514 +++----
cpp/src/generated/SparseTensor_generated.h | 134 +-
cpp/src/generated/Tensor_generated.h | 62 +-
cpp/src/generated/feather_generated.h | 204 +--
cpp/src/parquet/arrow/arrow_reader_writer_test.cc | 168 ++-
cpp/src/parquet/arrow/arrow_schema_test.cc | 38 +
cpp/src/parquet/arrow/arrow_statistics_test.cc | 55 +-
cpp/src/parquet/arrow/reader.cc | 20 +-
cpp/src/parquet/arrow/reader_internal.cc | 28 +-
cpp/src/parquet/arrow/reader_internal.h | 1 +
cpp/src/parquet/arrow/reader_writer_benchmark.cc | 5 +-
cpp/src/parquet/arrow/schema.cc | 4 +-
cpp/src/parquet/arrow/schema_internal.cc | 7 +-
cpp/src/parquet/arrow/size_stats_benchmark.cc | 60 +-
cpp/src/parquet/arrow/test_util.h | 4 +-
cpp/src/parquet/benchmark_util.cc | 4 +-
cpp/src/parquet/benchmark_util.h | 4 +-
cpp/src/parquet/bloom_filter_benchmark.cc | 4 +-
cpp/src/parquet/column_io_benchmark.cc | 5 +-
cpp/src/parquet/column_reader.cc | 73 +-
cpp/src/parquet/column_reader.h | 13 +-
cpp/src/parquet/column_reader_benchmark.cc | 4 +-
cpp/src/parquet/column_writer.cc | 237 +--
cpp/src/parquet/column_writer_test.cc | 47 +-
cpp/src/parquet/encoder.cc | 2 +-
cpp/src/parquet/encryption/crypto_factory.h | 4 +-
cpp/src/parquet/encryption/encryption.cc | 94 +-
cpp/src/parquet/encryption/encryption.h | 88 +-
cpp/src/parquet/encryption/encryption_internal.cc | 308 ++--
cpp/src/parquet/encryption/encryption_internal.h | 27 +-
.../encryption/encryption_internal_nossl.cc | 15 +-
.../parquet/encryption/internal_file_decryptor.cc | 207 +--
.../parquet/encryption/internal_file_decryptor.h | 101 +-
.../parquet/encryption/internal_file_encryptor.cc | 22 +-
.../parquet/encryption/internal_file_encryptor.h | 1 -
cpp/src/parquet/encryption/key_management_test.cc | 2 +-
.../parquet/encryption/read_configurations_test.cc | 27 +-
cpp/src/parquet/encryption/test_encryption_util.cc | 6 +-
cpp/src/parquet/file_reader.cc | 63 +-
cpp/src/parquet/file_writer.cc | 18 +-
cpp/src/parquet/metadata.cc | 32 +-
cpp/src/parquet/page_index.cc | 14 +-
cpp/src/parquet/page_index_benchmark.cc | 4 +-
cpp/src/parquet/properties.h | 19 +-
cpp/src/parquet/schema_test.cc | 23 +-
cpp/src/parquet/size_statistics.cc | 42 +-
cpp/src/parquet/size_statistics_test.cc | 49 +-
cpp/src/parquet/type_fwd.h | 6 -
cpp/src/parquet/types.cc | 3 +-
cpp/src/skyhook/client/file_skyhook.cc | 2 +
cpp/src/skyhook/protocol/ScanRequest_generated.h | 6 +-
cpp/submodules/parquet-testing | 2 +-
.../test-criteria.rb => cpp/subprojects/boost.wrap | 20 +-
.../subprojects/flatbuffers.wrap | 27 +-
.../subprojects/google-benchmark.wrap | 31 +-
.asf.yaml => cpp/subprojects/gtest.wrap | 31 +-
.asf.yaml => cpp/subprojects/rapidjson.wrap | 28 +-
cpp/thirdparty/flatbuffers/README.md | 2 +-
.../flatbuffers/include/flatbuffers/base.h | 21 +-
.../include/flatbuffers/flatbuffer_builder.h | 67 +-
.../flatbuffers/include/flatbuffers/flatbuffers.h | 16 +-
.../include/flatbuffers/stl_emulation.h | 3 +-
.../flatbuffers/include/flatbuffers/string.h | 5 +
cpp/thirdparty/versions.txt | 15 +-
cpp/vcpkg.json | 19 +-
csharp/Directory.Build.props | 2 +-
csharp/examples/Examples.sln | 28 +-
.../Apache.Arrow.Compression.csproj | 2 +-
.../Apache.Arrow.Flight.AspNetCore.csproj | 2 +-
.../Apache.Arrow.Flight.Sql.csproj | 2 +-
.../Apache.Arrow.Flight/Apache.Arrow.Flight.csproj | 4 +-
.../src/Apache.Arrow.Flight/Client/FlightClient.cs | 60 +
.../Extensions/FlightInfoExtensions.cs} | 16 +-
csharp/src/Apache.Arrow.Flight/FlightInfo.cs | 20 +-
.../FlightRecordBatchStreamWriter.cs | 21 +-
.../Internal/FlightDataStream.cs | 2 +-
.../Apache.Arrow.Compression.Tests.csproj | 4 +-
.../Scenarios/JsonTestScenario.cs | 7 +-
.../Apache.Arrow.Flight.Sql.Tests.csproj | 4 +-
.../Apache.Arrow.Flight.TestWeb.csproj | 2 +-
.../TestFlightServer.cs | 3 +-
.../Apache.Arrow.Flight.Tests.csproj | 5 +-
.../FlightInfoComparer.cs | 5 +
.../test/Apache.Arrow.Flight.Tests/FlightTests.cs | 60 +-
.../Apache.Arrow.Tests/Apache.Arrow.Tests.csproj | 4 +-
dev/archery/archery/bot.py | 6 +-
dev/archery/archery/integration/datagen.py | 11 +-
dev/release/.env.example | 17 +
dev/release/01-prepare-test.rb | 14 +-
dev/release/02-source.sh | 16 +-
dev/release/05-binary-upload.sh | 126 +-
dev/release/07-binary-verify.sh | 23 +-
dev/release/binary-task.rb | 1152 +++++++++++----
dev/release/copy-binary.rb | 95 ++
dev/release/download_rc_binaries.py | 17 +-
dev/release/post-03-binary.sh | 75 +-
dev/release/post-08-csharp.sh | 4 +-
dev/release/post-10-docs.sh | 70 +-
dev/release/post-11-python.sh | 38 +-
dev/release/post-12-bump-versions-test.rb | 14 +-
dev/release/rat_exclude_files.txt | 1 +
dev/release/setup-ubuntu.sh | 6 +-
dev/release/utils-generate-checksum.sh | 4 +-
dev/release/utils-prepare.sh | 8 +-
dev/release/utils-watch-gh-workflow.sh | 28 +-
dev/release/verify-apt.sh | 26 +-
dev/release/verify-release-candidate.sh | 204 +--
dev/release/verify-yum.sh | 34 +-
.../linux_64_cuda_compiler_version11.2.yaml | 85 --
.../linux_64_cuda_compiler_versionNone.yaml | 85 --
.../linux_aarch64_cuda_compiler_version11.2.yaml | 89 --
.../linux_aarch64_cuda_compiler_versionNone.yaml | 89 --
.../linux_ppc64le_cuda_compiler_version11.2.yaml | 85 --
.../linux_ppc64le_cuda_compiler_versionNone.yaml | 85 --
dev/tasks/conda-recipes/.ci_support/osx_64_.yaml | 75 -
.../conda-recipes/.ci_support/osx_arm64_.yaml | 75 -
.../win_64_cuda_compiler_version11.2.yaml | 75 -
.../win_64_cuda_compiler_versionNone.yaml | 75 -
dev/tasks/conda-recipes/.scripts/logging_utils.sh | 30 -
dev/tasks/conda-recipes/README.md | 67 -
dev/tasks/conda-recipes/arrow-cpp/LLVM_LICENSE.txt | 68 -
dev/tasks/conda-recipes/arrow-cpp/activate.sh | 83 --
dev/tasks/conda-recipes/arrow-cpp/build-arrow.bat | 71 -
dev/tasks/conda-recipes/arrow-cpp/build-arrow.sh | 124 --
.../conda-recipes/arrow-cpp/build-pyarrow.bat | 39 -
dev/tasks/conda-recipes/arrow-cpp/build-pyarrow.sh | 63 -
dev/tasks/conda-recipes/arrow-cpp/meta.yaml | 432 ------
.../conda-recipes/arrow-cpp/test_read_parquet.py | 5 -
dev/tasks/conda-recipes/azure.clean.yml | 45 -
dev/tasks/conda-recipes/azure.linux.yml | 55 -
dev/tasks/conda-recipes/azure.osx.yml | 85 --
dev/tasks/conda-recipes/azure.win.yml | 76 -
dev/tasks/conda-recipes/azure.yml | 0
dev/tasks/conda-recipes/build_steps.sh | 63 -
dev/tasks/conda-recipes/clean.py | 134 --
dev/tasks/conda-recipes/conda-forge.yml | 1 -
dev/tasks/conda-recipes/parquet-cpp/meta.yaml | 51 -
dev/tasks/conda-recipes/run_docker_build.sh | 79 -
dev/tasks/homebrew-formulae/apache-arrow-glib.rb | 32 +-
dev/tasks/homebrew-formulae/apache-arrow.rb | 63 +-
dev/tasks/linux-packages/README.md | 85 +-
.../apt/ubuntu-focal/Dockerfile | 41 -
.../apache-arrow-apt-source/debian/changelog | 12 +
.../apache-arrow-apt-source/debian/rules | 2 +-
.../apache-arrow-release/yum/Apache-Arrow.repo | 12 +-
.../yum/apache-arrow-release.spec.in | 6 +
dev/tasks/linux-packages/apache-arrow/Rakefile | 22 -
.../apache-arrow/apt/ubuntu-focal-arm64/from | 18 -
.../apache-arrow/apt/ubuntu-focal/Dockerfile | 81 --
.../apache-arrow/apt/ubuntu-jammy/Dockerfile | 10 +
.../linux-packages/apache-arrow/debian/changelog | 12 +
.../linux-packages/apache-arrow/debian/control.in | 27 +-
.../apache-arrow/yum/amazon-linux-2023/Dockerfile | 6 +
.../linux-packages/apache-arrow/yum/arrow.spec.in | 6 +
.../apache-arrow/yum/centos-7/Dockerfile | 6 +
dev/tasks/linux-packages/github.linux.yml | 4 +-
dev/tasks/linux-packages/helper.rb | 6 +-
dev/tasks/linux-packages/package-task.rb | 2 -
dev/tasks/macros.jinja | 38 +-
dev/tasks/matlab/github.yml | 12 +-
dev/tasks/python-wheels/github.linux.yml | 47 +-
dev/tasks/python-wheels/github.osx.yml | 2 +-
dev/tasks/python-wheels/github.windows.yml | 14 +-
.../r/github.linux.arrow.version.back.compat.yml | 38 +-
dev/tasks/r/github.linux.cran.yml | 21 +-
dev/tasks/r/github.linux.offline.build.yml | 8 +-
dev/tasks/r/github.linux.rchk.yml | 4 +-
dev/tasks/r/github.linux.versions.yml | 4 +-
dev/tasks/r/github.macos-linux.local.yml | 2 +-
dev/tasks/r/github.packages.yml | 8 +-
dev/tasks/tasks.yml | 295 +---
dev/tasks/vcpkg-tests/cpp-build-vcpkg.bat | 1 -
dev/tasks/vcpkg-tests/github.windows.yml | 3 +-
dev/tasks/verify-rc/github.linux.amd64.yml | 71 -
docker-compose.yml | 257 ++--
docs/requirements.txt | 1 +
docs/source/_static/versions.json | 9 +-
docs/source/_templates/kapa-ai-bot.html | 16 +
docs/source/conf.py | 3 +-
docs/source/cpp/build_system.rst | 2 +-
docs/source/cpp/compute.rst | 301 ++--
docs/source/cpp/dataset.rst | 4 +-
docs/source/cpp/examples/index.rst | 1 +
...n_example.rst => parquet_column_encryption.rst} | 12 +-
docs/source/cpp/parquet.rst | 46 +
docs/source/developers/documentation.rst | 2 +-
docs/source/developers/guide/communication.rst | 19 +-
.../guide/step_by_step/arrow_codebase.rst | 15 +-
docs/source/format/Flight.rst | 9 -
docs/source/format/StatisticsSchema.rst | 156 +-
docs/source/python/api/compute.rst | 11 +
docs/source/python/api/filesystems.rst | 1 +
docs/source/python/api/formats.rst | 1 +
docs/source/python/filesystems.rst | 41 +
docs/source/python/json.rst | 12 +
docs/source/python/orc.rst | 6 +-
docs/source/python/parquet.rst | 37 +-
docs/source/status.rst | 55 +-
header | 16 -
js/package.json | 12 +-
js/src/Arrow.dom.ts | 5 +-
js/src/Arrow.ts | 9 +-
js/src/builder/fixedsizelist.ts | 8 +-
js/src/builder/interval.ts | 9 +-
js/src/builder/union.ts | 2 +
js/src/enum.ts | 3 +-
js/src/interfaces.ts | 5 +-
js/src/type.ts | 11 +-
js/src/util/bn.ts | 11 +-
js/src/util/interval.ts | 85 ++
js/src/visitor.ts | 4 +
js/src/visitor/builderctor.ts | 3 +-
js/src/visitor/get.ts | 14 +-
js/src/visitor/indexof.ts | 3 +
js/src/visitor/iterator.ts | 3 +
js/src/visitor/jsonvectorassembler.ts | 12 +-
js/src/visitor/set.ts | 13 +-
js/src/visitor/typecomparator.ts | 3 +
js/src/visitor/typector.ts | 1 +
js/src/visitor/vectorloader.ts | 12 +-
js/test/data/tables.ts | 2 +-
js/test/generate-test-data.ts | 12 +-
js/test/unit/bn-tests.ts | 13 +-
js/test/unit/builders/builder-tests.ts | 1 +
js/test/unit/builders/utils.ts | 1 +
js/test/unit/generated-data-tests.ts | 1 +
.../unit/vector/interval-month-day-nano-tests.ts | 80 +
js/test/unit/vector/vector-tests.ts | 39 +-
js/yarn.lock | 540 ++-----
matlab/CMakeLists.txt | 4 +-
matlab/tools/cmake/BuildMatlabArrowInterface.cmake | 2 +-
python/CMakeLists.txt | 6 +-
python/examples/minimal_build/Dockerfile.ubuntu | 5 +-
python/examples/minimal_build/README.md | 2 +-
python/pyarrow/__init__.py | 15 +-
python/pyarrow/_acero.pyx | 13 +-
python/pyarrow/_azurefs.pyx | 20 +-
python/pyarrow/_compute.pxd | 2 +
python/pyarrow/_compute.pyx | 178 ++-
python/pyarrow/_csv.pyx | 2 +-
python/pyarrow/_dataset.pyx | 106 +-
python/pyarrow/_dataset_parquet.pyx | 4 +-
python/pyarrow/_flight.pyx | 4 +-
python/pyarrow/_json.pyx | 78 +-
python/pyarrow/_parquet.pxd | 18 +-
python/pyarrow/_parquet.pyx | 78 +-
python/pyarrow/_parquet_encryption.pyx | 2 +-
python/pyarrow/acero.py | 8 +-
python/pyarrow/array.pxi | 138 +-
python/pyarrow/compute.py | 22 +-
python/pyarrow/includes/common.pxd | 74 +-
python/pyarrow/includes/libarrow.pxd | 66 +-
python/pyarrow/includes/libarrow_dataset.pxd | 4 +-
python/pyarrow/includes/libarrow_flight.pxd | 18 +-
python/pyarrow/includes/libarrow_fs.pxd | 1 +
python/pyarrow/includes/libarrow_python.pxd | 35 -
python/pyarrow/io.pxi | 5 +-
python/pyarrow/json.py | 2 +-
python/pyarrow/lib.pxd | 52 +-
python/pyarrow/memory.pxi | 25 +
python/pyarrow/pandas-shim.pxi | 9 +-
python/pyarrow/pandas_compat.py | 4 +-
python/pyarrow/parquet/core.py | 36 +-
python/pyarrow/scalar.pxi | 398 ++++-
python/pyarrow/src/arrow/python/api.h | 2 -
python/pyarrow/src/arrow/python/arrow_to_pandas.cc | 2 +
python/pyarrow/src/arrow/python/deserialize.cc | 503 -------
python/pyarrow/src/arrow/python/deserialize.h | 112 --
python/pyarrow/src/arrow/python/flight.cc | 9 +-
python/pyarrow/src/arrow/python/flight.h | 5 +-
python/pyarrow/src/arrow/python/numpy_to_arrow.cc | 102 +-
python/pyarrow/src/arrow/python/python_test.cc | 4 +-
python/pyarrow/src/arrow/python/serialize.cc | 798 ----------
python/pyarrow/src/arrow/python/serialize.h | 149 --
python/pyarrow/table.pxi | 54 +-
python/pyarrow/tests/conftest.py | 16 +
python/pyarrow/tests/parquet/test_basic.py | 20 -
python/pyarrow/tests/parquet/test_data_types.py | 14 +-
python/pyarrow/tests/parquet/test_metadata.py | 22 +-
python/pyarrow/tests/parquet/test_pandas.py | 6 +-
python/pyarrow/tests/parquet/test_parquet_file.py | 31 +
python/pyarrow/tests/test_array.py | 95 +-
python/pyarrow/tests/test_compute.py | 139 +-
python/pyarrow/tests/test_csv.py | 2 +-
python/pyarrow/tests/test_extension_type.py | 2 +-
python/pyarrow/tests/test_fs.py | 15 +-
python/pyarrow/tests/test_json.py | 330 ++++-
python/pyarrow/tests/test_memory.py | 23 +
python/pyarrow/tests/test_pandas.py | 37 +-
python/pyarrow/tests/test_scalars.py | 28 +
python/pyarrow/tests/test_schema.py | 4 +
python/pyarrow/tests/test_table.py | 46 +
python/pyarrow/tests/util.py | 11 +
python/pyarrow/types.pxi | 4 +
python/pyarrow/util.py | 40 +-
python/pyproject.toml | 2 +-
python/requirements-test.txt | 1 +
python/requirements-wheel-test.txt | 2 +
r/.lintr | 17 +-
r/DESCRIPTION | 2 +-
r/NEWS.md | 34 +-
r/PACKAGING.md | 113 +-
r/R/enums.R | 2 +-
r/R/metadata.R | 4 +-
r/R/parquet.R | 15 +-
r/_pkgdown.yml | 13 +
r/configure.win | 9 +-
r/man/enums.Rd | 2 +-
r/man/write_parquet.Rd | 4 +-
r/pkgdown/assets/versions.html | 5 +-
r/pkgdown/assets/versions.json | 8 +-
r/src/Makevars.in | 5 +
r/src/altrep.cpp | 52 +-
r/src/arrow_types.h | 24 +-
r/src/filesystem.cpp | 2 +-
r/src/r_to_arrow.cpp | 14 +-
r/src/safe-call-into-r-impl.cpp | 8 +-
r/src/safe-call-into-r.h | 8 +-
r/src/symbols.cpp | 12 +-
r/src/type_infer.cpp | 8 +-
r/tests/testthat/helper-arrow.R | 6 +
r/tests/testthat/helper-skip.R | 1 +
r/tests/testthat/test-Array.R | 5 +-
r/tests/testthat/test-RecordBatch.R | 6 +-
r/tests/testthat/test-altrep.R | 14 +-
r/tests/testthat/test-chunked-array.R | 6 +-
r/tests/testthat/test-dataset.R | 6 +-
r/tests/testthat/test-dplyr-collapse.R | 15 +-
r/tests/testthat/test-parquet.R | 9 -
r/tools/nixlibs.R | 18 +-
r/tools/update-checksums.R | 9 +-
ruby/red-arrow-cuda/lib/arrow-cuda/version.rb | 2 +-
.../red-arrow-dataset/lib/arrow-dataset/version.rb | 2 +-
.../lib/arrow-flight-sql/version.rb | 2 +-
ruby/red-arrow-flight-sql/test/test-client.rb | 1 +
ruby/red-arrow-flight/lib/arrow-flight/version.rb | 2 +-
ruby/red-arrow-flight/test/test-client.rb | 1 +
ruby/red-arrow/README.md | 16 +-
ruby/red-arrow/ext/arrow/extconf.rb | 44 +-
ruby/red-arrow/lib/arrow/version.rb | 2 +-
ruby/red-arrow/red-arrow.gemspec | 57 +-
.../test/each-raw-record/test-basic-arrays.rb | 411 ------
.../test/each-raw-record/test-dense-union-array.rb | 566 --------
.../test/each-raw-record/test-dictionary-array.rb | 341 -----
.../test/each-raw-record/test-list-array.rb | 628 --------
.../test/each-raw-record/test-map-array.rb | 507 -------
.../test/each-raw-record/test-multiple-columns.rb | 72 -
.../each-raw-record/test-sparse-union-array.rb | 528 -------
.../test/each-raw-record/test-struct-array.rb | 529 -------
ruby/red-arrow/test/each-raw-record/test-table.rb | 47 -
.../test/raw-records/test-basic-arrays.rb | 99 +-
.../test/raw-records/test-dense-union-array.rb | 102 +-
.../test/raw-records/test-dictionary-array.rb | 90 +-
ruby/red-arrow/test/raw-records/test-list-array.rb | 103 +-
ruby/red-arrow/test/raw-records/test-map-array.rb | 108 +-
.../test/raw-records/test-multiple-columns.rb | 43 +-
.../test/raw-records/test-sparse-union-array.rb | 103 +-
.../test/raw-records/test-struct-array.rb | 102 +-
ruby/red-arrow/test/raw-records/test-table.rb | 22 +-
ruby/red-arrow/test/test-array.rb | 14 +-
ruby/red-arrow/test/test-table.rb | 8 +-
ruby/red-arrow/test/values/test-map-array.rb | 5 +-
ruby/red-gandiva/lib/gandiva/version.rb | 2 +-
ruby/red-parquet/lib/parquet/version.rb | 2 +-
swift/CDataWGo/go.mod | 26 +-
swift/CDataWGo/go.sum | 71 +-
swift/CDataWGo/main.go | 8 +-
swift/data-generator/swift-datagen/go.mod | 31 +-
swift/data-generator/swift-datagen/go.sum | 81 +-
swift/data-generator/swift-datagen/main.go | 8 +-
748 files changed, 22587 insertions(+), 24830 deletions(-)
create mode 100644 .github/workflows/verify_rc.yml
copy ci/scripts/java_cdata_integration.sh => .rubocop.yml (76%)
mode change 100755 => 100644
copy ci/conda_env_gandiva.txt => .shellcheckrc (94%)
copy c_glib/test/{parquet/test-int64-statistics.rb =>
test-array-statistics.rb} (82%)
create mode 100644 c_glib/test/test-binary-view-array.rb
create mode 100644 c_glib/test/test-string-view-array.rb
delete mode 100644 ci/conan/all/patches/1.0.0-0003-fix-shared-msvc.patch
delete mode 100644 ci/conan/all/patches/1.0.0-0005-fix-make12-namespace.patch
delete mode 100644 ci/conan/all/patches/1.0.0-0006-fix-cmake.patch
create mode 100644 ci/conan/all/patches/11.0.0-0001-fix-cmake.patch
create mode 100644 ci/conan/all/patches/16.0.0-0001-fix-cmake.patch
create mode 100644 ci/conan/all/patches/18.0.0-0001-fix-cmake.patch
delete mode 100644 ci/conan/all/patches/2.0.0-0003-fix-shared-msvc.patch
delete mode 100644 ci/conan/all/patches/2.0.0-0005-gandiva-engine.patch
delete mode 100644 ci/conan/all/patches/2.0.0-0008-fix-cmake.patch
delete mode 100644 ci/conan/all/patches/7.0.0-0006-install-utils.patch
delete mode 100644 ci/conan/all/patches/7.0.0-0007-fix-cmake.patch
delete mode 100644 ci/conan/all/patches/8.0.0-0005-install-utils.patch
delete mode 100644 ci/conan/all/patches/8.0.0-0006-fix-cmake.patch
delete mode 100644 ci/conan/all/test_v1_package/CMakeLists.txt
delete mode 100644 ci/conan/all/test_v1_package/conanfile.py
delete mode 100644 ci/docker/conda-python-substrait.dockerfile
delete mode 100644 ci/docker/java-jni-manylinux-201x.dockerfile
copy ci/docker/{python-free-threaded-wheel-manylinux-test-imports.dockerfile
=> python-free-threaded-wheel-musllinux-test-imports.dockerfile} (62%)
copy ci/docker/{python-free-threaded-wheel-manylinux-test-unittests.dockerfile
=> python-free-threaded-wheel-musllinux-test-unittests.dockerfile} (69%)
rename ci/docker/{python-free-threaded-wheel-windows-test-vs2019.dockerfile =>
python-free-threaded-wheel-windows-test-vs2022.dockerfile} (86%)
rename ci/docker/{python-free-threaded-wheel-windows-vs2019.dockerfile =>
python-free-threaded-wheel-windows-vs2022.dockerfile} (100%)
copy ci/docker/{python-wheel-manylinux-test.dockerfile =>
python-wheel-musllinux-test.dockerfile} (83%)
copy ci/docker/{python-wheel-manylinux.dockerfile =>
python-wheel-musllinux.dockerfile} (73%)
delete mode 100644 ci/docker/python-wheel-windows-test-vs2019-base.dockerfile
create mode 100644 ci/docker/python-wheel-windows-test-vs2022-base.dockerfile
rename ci/docker/{python-wheel-windows-test-vs2019.dockerfile =>
python-wheel-windows-test-vs2022.dockerfile} (100%)
delete mode 100644 ci/docker/python-wheel-windows-vs2019-base.dockerfile
create mode 100644 ci/docker/python-wheel-windows-vs2022-base.dockerfile
rename ci/docker/{python-wheel-windows-vs2019.dockerfile =>
python-wheel-windows-vs2022.dockerfile} (100%)
delete mode 100644 ci/docker/ubuntu-20.04-cpp-minimal.dockerfile
delete mode 100644 ci/docker/ubuntu-20.04-cpp.dockerfile
delete mode 100644 ci/docker/ubuntu-20.04-verify-rc.dockerfile
create mode 100644 ci/rtools/README.md
copy c_glib/test/dataset/test-file-format.rb =>
ci/rtools/aws_c_common_ep.patch (56%)
create mode 100644 ci/rtools/aws_c_io_ep.patch
create mode 100644 ci/rtools/awssdk_ep.patch
delete mode 100755 ci/scripts/install_substrait_consumer.sh
delete mode 100755 ci/scripts/integration_substrait.sh
rename ci/scripts/{python_wheel_manylinux_build.sh =>
python_wheel_xlinux_build.sh} (97%)
delete mode 100644 cpp/cmake_modules/orc.diff
create mode 100644 cpp/examples/arrow/parquet_column_encryption.cc
create mode 100644 cpp/meson.build
create mode 100644 cpp/meson.options
copy c_glib/test/test-unique.rb => cpp/src/arrow/c/meson.build (58%)
create mode 100644 cpp/src/arrow/compute/kernels/aggregate_pivot.cc
create mode 100644 cpp/src/arrow/compute/kernels/hash_aggregate_internal.h
create mode 100644 cpp/src/arrow/compute/kernels/hash_aggregate_numeric.cc
create mode 100644 cpp/src/arrow/compute/kernels/hash_aggregate_pivot.cc
create mode 100644 cpp/src/arrow/compute/kernels/pivot_internal.cc
copy cpp/src/arrow/{util/bitmap_builders.h =>
compute/kernels/pivot_internal.h} (55%)
create mode 100644 cpp/src/arrow/compute/kernels/vector_statistics.cc
create mode 100644 cpp/src/arrow/compute/kernels/vector_statistics_test.cc
create mode 100644 cpp/src/arrow/compute/row/row_util_avx2_internal.h
create mode 100644 cpp/src/arrow/csv/meson.build
delete mode 100644 cpp/src/arrow/flight/server_middleware.cc
delete mode 100644 cpp/src/arrow/flight/transport/ucx/CMakeLists.txt
delete mode 100644
cpp/src/arrow/flight/transport/ucx/flight_transport_ucx_test.cc
delete mode 100644 cpp/src/arrow/flight/transport/ucx/ucx.cc
delete mode 100644 cpp/src/arrow/flight/transport/ucx/ucx.h
delete mode 100644 cpp/src/arrow/flight/transport/ucx/ucx_client.cc
delete mode 100644 cpp/src/arrow/flight/transport/ucx/ucx_internal.cc
delete mode 100644 cpp/src/arrow/flight/transport/ucx/ucx_internal.h
delete mode 100644 cpp/src/arrow/flight/transport/ucx/ucx_server.cc
delete mode 100644 cpp/src/arrow/flight/transport/ucx/util_internal.cc
delete mode 100644 cpp/src/arrow/flight/transport/ucx/util_internal.h
create mode 100644 cpp/src/arrow/io/meson.build
create mode 100644 cpp/src/arrow/meson.build
create mode 100644 cpp/src/arrow/testing/generator_test.cc
create mode 100644 cpp/src/arrow/testing/meson.build
create mode 100644 cpp/src/arrow/util/math_internal.cc
create mode 100644 cpp/src/arrow/util/math_internal.h
create mode 100644 cpp/src/arrow/util/math_test.cc
create mode 100644 cpp/src/arrow/util/meson.build
copy c_glib/test/flight/test-criteria.rb => cpp/subprojects/boost.wrap (68%)
copy dev/archery/archery/integration/scenario.py =>
cpp/subprojects/flatbuffers.wrap (55%)
copy ruby/red-arrow-flight-sql/lib/arrow-flight-sql/client.rb =>
cpp/subprojects/google-benchmark.wrap (56%)
copy .asf.yaml => cpp/subprojects/gtest.wrap (53%)
copy .asf.yaml => cpp/subprojects/rapidjson.wrap (56%)
copy csharp/src/{Apache.Arrow/Types/FloatingPointType.cs =>
Apache.Arrow.Flight/Extensions/FlightInfoExtensions.cs} (76%)
create mode 100755 dev/release/copy-binary.rb
delete mode 100644
dev/tasks/conda-recipes/.ci_support/linux_64_cuda_compiler_version11.2.yaml
delete mode 100644
dev/tasks/conda-recipes/.ci_support/linux_64_cuda_compiler_versionNone.yaml
delete mode 100644
dev/tasks/conda-recipes/.ci_support/linux_aarch64_cuda_compiler_version11.2.yaml
delete mode 100644
dev/tasks/conda-recipes/.ci_support/linux_aarch64_cuda_compiler_versionNone.yaml
delete mode 100644
dev/tasks/conda-recipes/.ci_support/linux_ppc64le_cuda_compiler_version11.2.yaml
delete mode 100644
dev/tasks/conda-recipes/.ci_support/linux_ppc64le_cuda_compiler_versionNone.yaml
delete mode 100644 dev/tasks/conda-recipes/.ci_support/osx_64_.yaml
delete mode 100644 dev/tasks/conda-recipes/.ci_support/osx_arm64_.yaml
delete mode 100644
dev/tasks/conda-recipes/.ci_support/win_64_cuda_compiler_version11.2.yaml
delete mode 100644
dev/tasks/conda-recipes/.ci_support/win_64_cuda_compiler_versionNone.yaml
delete mode 100644 dev/tasks/conda-recipes/.scripts/logging_utils.sh
delete mode 100644 dev/tasks/conda-recipes/README.md
delete mode 100644 dev/tasks/conda-recipes/arrow-cpp/LLVM_LICENSE.txt
delete mode 100644 dev/tasks/conda-recipes/arrow-cpp/activate.sh
delete mode 100644 dev/tasks/conda-recipes/arrow-cpp/build-arrow.bat
delete mode 100755 dev/tasks/conda-recipes/arrow-cpp/build-arrow.sh
delete mode 100644 dev/tasks/conda-recipes/arrow-cpp/build-pyarrow.bat
delete mode 100755 dev/tasks/conda-recipes/arrow-cpp/build-pyarrow.sh
delete mode 100644 dev/tasks/conda-recipes/arrow-cpp/meta.yaml
delete mode 100644 dev/tasks/conda-recipes/arrow-cpp/test_read_parquet.py
delete mode 100644 dev/tasks/conda-recipes/azure.clean.yml
delete mode 100755 dev/tasks/conda-recipes/azure.linux.yml
delete mode 100755 dev/tasks/conda-recipes/azure.osx.yml
delete mode 100755 dev/tasks/conda-recipes/azure.win.yml
delete mode 100644 dev/tasks/conda-recipes/azure.yml
delete mode 100755 dev/tasks/conda-recipes/build_steps.sh
delete mode 100644 dev/tasks/conda-recipes/clean.py
delete mode 100644 dev/tasks/conda-recipes/conda-forge.yml
delete mode 100644 dev/tasks/conda-recipes/parquet-cpp/meta.yaml
delete mode 100755 dev/tasks/conda-recipes/run_docker_build.sh
delete mode 100644
dev/tasks/linux-packages/apache-arrow-apt-source/apt/ubuntu-focal/Dockerfile
delete mode 100644
dev/tasks/linux-packages/apache-arrow/apt/ubuntu-focal-arm64/from
delete mode 100644
dev/tasks/linux-packages/apache-arrow/apt/ubuntu-focal/Dockerfile
delete mode 100644 dev/tasks/verify-rc/github.linux.amd64.yml
create mode 100644 docs/source/_templates/kapa-ai-bot.html
copy docs/source/cpp/examples/{dataset_documentation_example.rst =>
parquet_column_encryption.rst} (74%)
delete mode 100644 header
create mode 100644 js/src/util/interval.ts
create mode 100644 js/test/unit/vector/interval-month-day-nano-tests.ts
delete mode 100644 python/pyarrow/src/arrow/python/deserialize.cc
delete mode 100644 python/pyarrow/src/arrow/python/deserialize.h
delete mode 100644 python/pyarrow/src/arrow/python/serialize.cc
delete mode 100644 python/pyarrow/src/arrow/python/serialize.h
delete mode 100644 ruby/red-arrow/test/each-raw-record/test-basic-arrays.rb
delete mode 100644
ruby/red-arrow/test/each-raw-record/test-dense-union-array.rb
delete mode 100644 ruby/red-arrow/test/each-raw-record/test-dictionary-array.rb
delete mode 100644 ruby/red-arrow/test/each-raw-record/test-list-array.rb
delete mode 100644 ruby/red-arrow/test/each-raw-record/test-map-array.rb
delete mode 100644 ruby/red-arrow/test/each-raw-record/test-multiple-columns.rb
delete mode 100644
ruby/red-arrow/test/each-raw-record/test-sparse-union-array.rb
delete mode 100644 ruby/red-arrow/test/each-raw-record/test-struct-array.rb
delete mode 100644 ruby/red-arrow/test/each-raw-record/test-table.rb
