Re: [I] BUG: segmentation faults in the presence of `sparse` optional dependency (within conda builds) [arrow]

2024-07-23 Thread via GitHub
h-vetinari closed issue #15018: BUG: segmentation faults in the presence of `sparse` optional dependency (within conda builds) URL: https://github.com/apache/arrow/issues/15018 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[I] [C++] Test linkage error when googletest 1.15.0 is installed system wide despite bundling [arrow]

2024-07-23 Thread via GitHub
amoeba opened a new issue, #43400: URL: https://github.com/apache/arrow/issues/43400 ### Describe the bug, including details regarding any error messages, version, and platform. On macOS 14.5, I happened to upgrade my brew version of googletest from 1.14.0 to 1.15.0 and started seein

[I] Add CI jobs for windows aarch64 [arrow]

2024-07-23 Thread via GitHub
jonkeane opened a new issue, #43401: URL: https://github.com/apache/arrow/issues/43401 ### Describe the enhancement requested [R 4.4 has experimental support for windows on aarch64](https://blog.r-project.org/2024/04/23/r-on-64-bit-arm-windows/index.html) we should setup a CI job to

Re: [I] [Java] Remove use of jsr305 [arrow]

2024-07-23 Thread via GitHub
lidavidm closed issue #43396: [Java] Remove use of jsr305 URL: https://github.com/apache/arrow/issues/43396 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

Re: [I] c/driver/postgresql: Connection.adbc_get_table_schema() does not respect column order [arrow-adbc]

2024-07-23 Thread via GitHub
lidavidm closed issue #2006: c/driver/postgresql: Connection.adbc_get_table_schema() does not respect column order URL: https://github.com/apache/arrow-adbc/issues/2006 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] c/driver/postgresql: Connection.adbc_get_table_schema() does not respect column order [arrow-adbc]

2024-07-23 Thread via GitHub
lidavidm closed issue #2006: c/driver/postgresql: Connection.adbc_get_table_schema() does not respect column order URL: https://github.com/apache/arrow-adbc/issues/2006 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[I] The Go flightsql driver doesn't handle scanning LargeString or LargeBinary types [arrow]

2024-07-23 Thread via GitHub
phillipleblanc opened a new issue, #43403: URL: https://github.com/apache/arrow/issues/43403 ### Describe the bug, including details regarding any error messages, version, and platform. The Go flightsql database driver currently does not handle scanning string or byte values where th

[I] Progress bar for `read_feather` for `R` and a verbose version [arrow]

2024-07-23 Thread via GitHub
ajinkya-k opened a new issue, #43404: URL: https://github.com/apache/arrow/issues/43404 ### Describe the enhancement requested I would like to request a that a progress bar be shown when using `read_feather` function in `R` especially for large files, so that the user can see if the

[I] Could not read encrypted metadata via pq.read_table [arrow]

2024-07-23 Thread via GitHub
heyuqi1970 opened a new issue, #43406: URL: https://github.com/apache/arrow/issues/43406 ### Describe the bug, including details regarding any error messages, version, and platform. os: macos 11.7.10 (20G1427) python: 3.9.7 pyarrow: 16.0.0 when I use pq.read_table with de

[I] [C++] IO: InputStream::Advance will always read from Stream [arrow]

2024-07-24 Thread via GitHub
mapleFU opened a new issue, #43408: URL: https://github.com/apache/arrow/issues/43408 ### Describe the enhancement requested ```c++ class ARROW_EXPORT InputStream : virtual public FileInterface, virtual public Readable { public: /// \brief Advance or skip stream indicated

Re: [I] [Java][Benchmarking] Java benchmarks are broken when running with Java 17+ [arrow]

2024-07-24 Thread via GitHub
danepitkin closed issue #43394: [Java][Benchmarking] Java benchmarks are broken when running with Java 17+ URL: https://github.com/apache/arrow/issues/43394 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] [R] r-arrow cannot be compiled with clang [arrow]

2024-07-24 Thread via GitHub
assignUser closed issue #43398: [R] r-arrow cannot be compiled with clang URL: https://github.com/apache/arrow/issues/43398 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

[I] [Python]: Support PyCapsule Interface Objects as input in more places [arrow]

2024-07-24 Thread via GitHub
kylebarron opened a new issue, #43410: URL: https://github.com/apache/arrow/issues/43410 ### Describe the enhancement requested Now that the PyCapsule Interface is starting to gain more traction (https://github.com/apache/arrow/issues/39195), I think it would be great if some of pyar

[I] [Java][Benchmarking] Java benchmarks are still broken when running with Java 17+ [arrow]

2024-07-24 Thread via GitHub
danepitkin opened a new issue, #43412: URL: https://github.com/apache/arrow/issues/43412 ### Describe the bug, including details regarding any error messages, version, and platform. We didn't do the right testing and it turns out that this merged PR does not fully fix the Java benchm

[I] [C++][Compute] Invalid memory access when resizing row table [arrow]

2024-07-24 Thread via GitHub
zanmato1984 opened a new issue, #43414: URL: https://github.com/apache/arrow/issues/43414 ### Describe the bug, including details regarding any error messages, version, and platform. When resizing the underlying buffer for the var-length content of the row table, we do: https://g

[I] [CI][C++] Vcpkg failures building some wheels [arrow]

2024-07-25 Thread via GitHub
raulcd opened a new issue, #43416: URL: https://github.com/apache/arrow/issues/43416 ### Describe the bug, including details regarding any error messages, version, and platform. Some wheels have been failing for some days due to vcpkg failures: [wheel-macos-big-sur-cp310-arm64

Re: [I] [C++] Use signed offset type in row table related structures [arrow]

2024-07-25 Thread via GitHub
zanmato1984 closed issue #40020: [C++] Use signed offset type in row table related structures URL: https://github.com/apache/arrow/issues/40020 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [I] [Java][Benchmarking] Java benchmarks are still broken when running with Java 17+ [arrow]

2024-07-25 Thread via GitHub
danepitkin closed issue #43412: [Java][Benchmarking] Java benchmarks are still broken when running with Java 17+ URL: https://github.com/apache/arrow/issues/43412 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [I] [Java] Add support for JDK version cross testing [arrow]

2024-07-25 Thread via GitHub
danepitkin closed issue #43380: [Java] Add support for JDK version cross testing URL: https://github.com/apache/arrow/issues/43380 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [I] [C++] Tests for the 'take' function don't exercise kernels handling chunked arrays very well [arrow]

2024-07-25 Thread via GitHub
felipecrv closed issue #43291: [C++] Tests for the 'take' function don't exercise kernels handling chunked arrays very well URL: https://github.com/apache/arrow/issues/43291 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [I] [Python] Test FlightStreamReader iterator [arrow]

2024-07-25 Thread via GitHub
danepitkin closed issue #42085: [Python] Test FlightStreamReader iterator URL: https://github.com/apache/arrow/issues/42085 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [I] [Swift] Add StructArray to ArrowReader [arrow]

2024-07-25 Thread via GitHub
kou closed issue #43169: [Swift] Add StructArray to ArrowReader URL: https://github.com/apache/arrow/issues/43169 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

[I] go/adbc/driver/flightsql: long delay between createPreparedStatement and getFlightInfoPreparedStatement [arrow-adbc]

2024-07-25 Thread via GitHub
aiguofer opened a new issue, #2040: URL: https://github.com/apache/arrow-adbc/issues/2040 ### What happened? We have a Python API that uses the ADBC driver to execute queries against our Java Arrow Flight SQL server. The Python server uses FastAPI + Strawberry, and when we receive a

[I] Use Amazon KMS for encryption having error: "OSError: Incorrect key to columns mapping in column keys property:" [arrow]

2024-07-25 Thread via GitHub
ChanTheDataExplorer opened a new issue, #43426: URL: https://github.com/apache/arrow/issues/43426 ### Describe the usage question you have. Please include as many useful details as possible. Hi, I'm trying to use the columnar encryption but having problem to make it work. Below

Re: [I] [CI] Add wheels and java-jars to vcpkg group tasks [arrow]

2024-07-25 Thread via GitHub
assignUser closed issue #43418: [CI] Add wheels and java-jars to vcpkg group tasks URL: https://github.com/apache/arrow/issues/43418 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[I] Snowflake adbc_ingest reverting back to CSV uploading [arrow-adbc]

2024-07-25 Thread via GitHub
davlee1972 opened a new issue, #2041: URL: https://github.com/apache/arrow-adbc/issues/2041 ### What happened? I'll have more time to debug this next week, but adbc_ingest() is creating CSV files with Snowflake. I'm using the latest 1.1.0 ADBC drivers. Even when I conver

[I] [C++][Parquet] Deprecate ColumnChunk::file_offset field [arrow]

2024-07-25 Thread via GitHub
mapleFU opened a new issue, #43427: URL: https://github.com/apache/arrow/issues/43427 ### Describe the enhancement requested https://github.com/apache/parquet-format/pull/440 ### Component(s) C++, Parquet -- This is an automated message from the Apache Git Service. To

Re: [I] [JS] Rows will intermittently return BigInt data, instead of the expected strings [arrow]

2024-07-26 Thread via GitHub
Vectorrent closed issue #43275: [JS] Rows will intermittently return BigInt data, instead of the expected strings URL: https://github.com/apache/arrow/issues/43275 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[I] [C++][FlightRPC] Flight UCX build is failing [arrow]

2024-07-26 Thread via GitHub
felipecrv opened a new issue, #43429: URL: https://github.com/apache/arrow/issues/43429 ### Describe the bug, including details regarding any error messages, version, and platform. ``` ~/code/arrow/cpp/src/arrow/flight/transport/ucx/ucx_server.cc:261:33: error: implicit conversion

Re: [I] [Java][CI] Java-Jars CI is Failing with a linking error on macOS [arrow]

2024-07-26 Thread via GitHub
danepitkin closed issue #43377: [Java][CI] Java-Jars CI is Failing with a linking error on macOS URL: https://github.com/apache/arrow/issues/43377 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[I] [Java][Packaging] java-jars failing on maven module [arrow]

2024-07-26 Thread via GitHub
danepitkin opened a new issue, #43432: URL: https://github.com/apache/arrow/issues/43432 ### Describe the bug, including details regarding any error messages, version, and platform. java-jars job is failing: https://github.com/ursacomputing/crossbow/actions/runs/10103282092/job/27945

Re: [I] [JS] Build warning due to missing arrow2csv.cjs file in bin [arrow]

2024-07-26 Thread via GitHub
trxcllnt closed issue #42229: [JS] Build warning due to missing arrow2csv.cjs file in bin URL: https://github.com/apache/arrow/issues/42229 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [I] [JS] Build warning due to missing arrow2csv.cjs file in bin [arrow]

2024-07-26 Thread via GitHub
trxcllnt closed issue #42229: [JS] Build warning due to missing arrow2csv.cjs file in bin URL: https://github.com/apache/arrow/issues/42229 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [I] [JS] Build fails in node v22 due to outdated `esm` package [arrow]

2024-07-26 Thread via GitHub
trxcllnt closed issue #43340: [JS] Build fails in node v22 due to outdated `esm` package URL: https://github.com/apache/arrow/issues/43340 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [I] [JS] Build fails in node v22 due to outdated `esm` package [arrow]

2024-07-26 Thread via GitHub
trxcllnt closed issue #43340: [JS] Build fails in node v22 due to outdated `esm` package URL: https://github.com/apache/arrow/issues/43340 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [I] [JS] `arrow2csv` bin entry has wrong extension [arrow]

2024-07-26 Thread via GitHub
trxcllnt closed issue #43341: [JS] `arrow2csv` bin entry has wrong extension URL: https://github.com/apache/arrow/issues/43341 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [I] [JS] `arrow2csv` bin entry has wrong extension [arrow]

2024-07-26 Thread via GitHub
trxcllnt closed issue #43341: [JS] `arrow2csv` bin entry has wrong extension URL: https://github.com/apache/arrow/issues/43341 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [I] [JS] When I install any apache-arrow version beyond 14 it throws error [arrow]

2024-07-26 Thread via GitHub
trxcllnt closed issue #41649: [JS] When I install any apache-arrow version beyond 14 it throws error URL: https://github.com/apache/arrow/issues/41649 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[I] [CI] Building C++ libraries on Ubuntu aarch64 job takes 3+ hours to complete in java-jars [arrow]

2024-07-26 Thread via GitHub
danepitkin opened a new issue, #43434: URL: https://github.com/apache/arrow/issues/43434 ### Describe the enhancement requested Can we speed this up? Other OS/architectures take 10-30min. See java-jars job in crossbow: https://github.com/ursacomputing/crossbow/actions/runs/9817

[I] Failure to read valid file [arrow-julia]

2024-07-26 Thread via GitHub
adienes opened a new issue, #511: URL: https://github.com/apache/arrow-julia/issues/511 both `pyarrow` and `polars` can read this table, but [mwe.arrow.zip](https://github.com/user-attachments/files/16395769/mwe.arrow.zip) ``` julia> Arrow.Table("mwe.arrow") 1-element

[I] [Python] `pa.Table.from_pylist` support list of tuples? [arrow]

2024-07-26 Thread via GitHub
alanhdu opened a new issue, #43435: URL: https://github.com/apache/arrow/issues/43435 ### Describe the enhancement requested I have a function that returns an iterator-of-tuples and would like to turn that into pyarrow table. I have the column names separately, would like to use the

[I] [Java] Do not publish protobuf based on filename [arrow]

2024-07-26 Thread via GitHub
danepitkin opened a new issue, #43437: URL: https://github.com/apache/arrow/issues/43437 ### Describe the enhancement requested After migrating to Java 11, we see this warning: ``` [WARNING] * Required filename-based automodules detected: [protobuf-java-3.25.1.jar, protobuf-

Re: [I] [C++][FlightRPC] Flight UCX build is failing [arrow]

2024-07-26 Thread via GitHub
felipecrv closed issue #43429: [C++][FlightRPC] Flight UCX build is failing URL: https://github.com/apache/arrow/issues/43429 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] [C++] vendored abseil fails to build with gcc-13 [arrow]

2024-07-26 Thread via GitHub
assignUser closed issue #43228: [C++] vendored abseil fails to build with gcc-13 URL: https://github.com/apache/arrow/issues/43228 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[I] Unable to filter a factor column in a Dataset using `%in%` [arrow]

2024-07-26 Thread via GitHub
spencerpease opened a new issue, #43440: URL: https://github.com/apache/arrow/issues/43440 ### Describe the bug, including details regarding any error messages, version, and platform. Hello, Is it possible filter a factor using `%in%` in an Arrow Dataset? I naively expe

Re: [I] [C++] concatenate nested namespace in c++17 style with clang-tidy [arrow]

2024-07-26 Thread via GitHub
IndifferentArea closed issue #43421: [C++] concatenate nested namespace in c++17 style with clang-tidy URL: https://github.com/apache/arrow/issues/43421 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[I] Mixing RLE_DICTIONARY and other column encodings in pyarrow parquet [arrow]

2024-07-26 Thread via GitHub
bkief opened a new issue, #43442: URL: https://github.com/apache/arrow/issues/43442 ### Describe the bug, including details regarding any error messages, version, and platform. The ValueError at https://github.com/apache/arrow/blob/aaeff72dd9cb4658913fde3d176416be9a93ebe0/python/pyar

[I] The flight.NewRecordWriter parameter is ambiguous [arrow]

2024-07-26 Thread via GitHub
mac-zhenfang opened a new issue, #43443: URL: https://github.com/apache/arrow/issues/43443 ### Describe the usage question you have. Please include as many useful details as possible. The func NewRecordWriter(w DataStreamWriter, opts ...ipc.Option) *Writer API indicates the Dat

[I] [C++] Benchmark Arrow BinaryViewBuilder [arrow]

2024-07-26 Thread via GitHub
mapleFU opened a new issue, #43444: URL: https://github.com/apache/arrow/issues/43444 ### Describe the enhancement requested BinaryViewBuilder need benchmark ### Component(s) Benchmarking, C++ -- This is an automated message from the Apache Git Service. To respond to t

Re: [I] Partitioned variable does not read in as the correct type [arrow]

2024-07-27 Thread via GitHub
thisisnic closed issue #43303: Partitioned variable does not read in as the correct type URL: https://github.com/apache/arrow/issues/43303 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [I] [Python] Could not read encrypted metadata via pq.read_table [arrow]

2024-07-27 Thread via GitHub
heyuqi1970 closed issue #43406: [Python] Could not read encrypted metadata via pq.read_table URL: https://github.com/apache/arrow/issues/43406 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [I] [R] String columns read lazily from readr error when transferred to an arrow table [arrow]

2024-07-27 Thread via GitHub
jonkeane closed issue #43349: [R] String columns read lazily from readr error when transferred to an arrow table URL: https://github.com/apache/arrow/issues/43349 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[I] [C++][grpc] 0-length buffers sent to grpc can cause indefinite hangs on MacOS/iOS [arrow]

2024-07-28 Thread via GitHub
ziglerari opened a new issue, #43447: URL: https://github.com/apache/arrow/issues/43447 ### Describe the bug, including details regarding any error messages, version, and platform. A [gRPC issue](https://github.com/grpc/grpc/pull/37255) has been identified where transmitting buffers

[I] [CI] Conan-* crosbow jobs need credentials to docker hub (or to not attempt to push there [arrow]

2024-07-28 Thread via GitHub
jonkeane opened a new issue, #43449: URL: https://github.com/apache/arrow/issues/43449 ### Describe the bug, including details regarding any error messages, version, and platform. Both `conan-minimal` and `conan-maximal` have been failing for a long time (minimal for 116 days, the ma

Re: [I] [R] RStudio crash [arrow]

2024-07-28 Thread via GitHub
jonkeane closed issue #43241: [R] RStudio crash URL: https://github.com/apache/arrow/issues/43241 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues

[I] [Format] Add Opaque canonical extension type [arrow]

2024-07-28 Thread via GitHub
lidavidm opened a new issue, #43453: URL: https://github.com/apache/arrow/issues/43453 ### Describe the enhancement requested As proposed on the mailing list: https://lists.apache.org/thread/4pykofrzvkl7dwsnzys8rwnq2owfnt43 ### Component(s) Format -- This is an automa

[I] [C++][Python] Add Opaque canonical extension type [arrow]

2024-07-28 Thread via GitHub
lidavidm opened a new issue, #43454: URL: https://github.com/apache/arrow/issues/43454 ### Describe the enhancement requested Part of #43453. ### Component(s) C++, Python -- This is an automated message from the Apache Git Service. To respond to the message, please log

[I] [Go] Add Opaque canonical extension type [arrow]

2024-07-28 Thread via GitHub
lidavidm opened a new issue, #43455: URL: https://github.com/apache/arrow/issues/43455 ### Describe the enhancement requested Part of https://github.com/apache/arrow/issues/43453 ### Component(s) Go -- This is an automated message from the Apache Git Service. To respon

[I] [Java] Add Opaque canonical extension type [arrow]

2024-07-28 Thread via GitHub
lidavidm opened a new issue, #43456: URL: https://github.com/apache/arrow/issues/43456 ### Describe the enhancement requested Part of https://github.com/apache/arrow/issues/43453 ### Component(s) Java -- This is an automated message from the Apache Git Service. To resp

Re: [I] The Go flightsql driver doesn't handle scanning LargeString or LargeBinary types [arrow]

2024-07-28 Thread via GitHub
phillipleblanc closed issue #43403: The Go flightsql driver doesn't handle scanning LargeString or LargeBinary types URL: https://github.com/apache/arrow/issues/43403 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] [Java] Do not publish protobuf based on filename [arrow]

2024-07-28 Thread via GitHub
lidavidm closed issue #43437: [Java] Do not publish protobuf based on filename URL: https://github.com/apache/arrow/issues/43437 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [Java][Packaging] java-jars failing on maven module [arrow]

2024-07-28 Thread via GitHub
lidavidm closed issue #43432: [Java][Packaging] java-jars failing on maven module URL: https://github.com/apache/arrow/issues/43432 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [I] [Java] Upgrade JNI version [arrow]

2024-07-28 Thread via GitHub
lidavidm closed issue #43425: [Java] Upgrade JNI version URL: https://github.com/apache/arrow/issues/43425 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

Re: [I] [C++][grpc] Sending 0-length buffers to gRPC can result in indefinite hangs on MacOS/iOS platforms [arrow]

2024-07-28 Thread via GitHub
lidavidm closed issue #43447: [C++][grpc] Sending 0-length buffers to gRPC can result in indefinite hangs on MacOS/iOS platforms URL: https://github.com/apache/arrow/issues/43447 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[I] [C++][Gandiva] Attribute mismatch error with unity build [arrow]

2024-07-28 Thread via GitHub
kou opened a new issue, #43463: URL: https://github.com/apache/arrow/issues/43463 ### Describe the bug, including details regarding any error messages, version, and platform. ```diff [678/708] Building CXX object src/gandiva/precompiled/CMakeFiles/gandiva-precompiled-test.dir/Unit

[I] [Packaging][C++] Fail to build bundled ORC with the official LZ4 CMake package on Debian GNU/Linux trixie [arrow]

2024-07-29 Thread via GitHub
kou opened a new issue, #43467: URL: https://github.com/apache/arrow/issues/43467 ### Describe the bug, including details regarding any error messages, version, and platform. Recently, Debian GNU/Linux trixie provides LZ4 CMake package based on the official CMake build system.

Re: [I] [CI]: Temporarily turn off conda jobs that are failing [arrow]

2024-07-29 Thread via GitHub
raulcd closed issue #43450: [CI]: Temporarily turn off conda jobs that are failing URL: https://github.com/apache/arrow/issues/43450 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[I] Change the default CompressionCodec.Factory to leverage compression support transparently [arrow]

2024-07-29 Thread via GitHub
ccciudatu opened a new issue, #43469: URL: https://github.com/apache/arrow/issues/43469 ### Describe the enhancement requested Application code is currently required to choose upfront between handling compressed vs. uncompressed data by specifying one of the two (mutually exclusive)

Re: [I] go/adbc/driver/flightsql: Default Value (10 MB) For adbc.snowflake.rpc.ingest_target_file_size Not Used In 1.1.0 [arrow-adbc]

2024-07-29 Thread via GitHub
zeroshade closed issue #1997: go/adbc/driver/flightsql: Default Value (10 MB) For adbc.snowflake.rpc.ingest_target_file_size Not Used In 1.1.0 URL: https://github.com/apache/arrow-adbc/issues/1997 -- This is an automated message from the Apache Git Service. To respond to the message, please l

[I] Restrict direct access to `sun.misc.Unsafe` [arrow]

2024-07-29 Thread via GitHub
laurentgo opened a new issue, #43479: URL: https://github.com/apache/arrow/issues/43479 ### Describe the enhancement requested `sun.misc.Unsafe` is a Java internal class only accessible to classes loaded of the boot classloader, unless one uses reflection to bypass this restriction.

Re: [I] [CI] Conan-* crosbow jobs need credentials to docker hub (or to not attempt to push there [arrow]

2024-07-29 Thread via GitHub
assignUser closed issue #43449: [CI] Conan-* crosbow jobs need credentials to docker hub (or to not attempt to push there URL: https://github.com/apache/arrow/issues/43449 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [I] [C++] Test linkage error when googletest 1.15.0 is installed system wide despite bundling [arrow]

2024-07-29 Thread via GitHub
assignUser closed issue #43400: [C++] Test linkage error when googletest 1.15.0 is installed system wide despite bundling URL: https://github.com/apache/arrow/issues/43400 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [I] [Java] Java Dataset API ScanOptions expansion [arrow]

2024-07-29 Thread via GitHub
lidavidm closed issue #28866: [Java] Java Dataset API ScanOptions expansion URL: https://github.com/apache/arrow/issues/28866 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] c: fix include paths for adbc.h [arrow-adbc]

2024-07-29 Thread via GitHub
lidavidm closed issue #1150: c: fix include paths for adbc.h URL: https://github.com/apache/arrow-adbc/issues/1150 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[I] [JAVA] [C++] Support more CsvFragmentScanOptions in JNI call [arrow]

2024-07-30 Thread via GitHub
jinchengchenghh opened a new issue, #43483: URL: https://github.com/apache/arrow/issues/43483 ### Describe the enhancement requested Support most of the options mapping to cpp code struct ### Component(s) C++ -- This is an automated message from the Apache Git Service.

Re: [I] [Python] Expose methods to get the device and memory_manager on the pyarrow.cuda.Context class [arrow]

2024-07-30 Thread via GitHub
jorisvandenbossche closed issue #43391: [Python] Expose methods to get the device and memory_manager on the pyarrow.cuda.Context class URL: https://github.com/apache/arrow/issues/43391 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[I] SEGFAULT in test_udf_via_substrait when run in CPython debug build [arrow]

2024-07-30 Thread via GitHub
lysnikolaou opened a new issue, #43487: URL: https://github.com/apache/arrow/issues/43487 ### Describe the bug, including details regarding any error messages, version, and platform. Hey everyone! 👋 I'm trying to build arrow and PyArrow with a debug build of CPython and run t

Re: [I] Snowflake adbc_ingest reverting back to CSV uploading [arrow-adbc]

2024-07-30 Thread via GitHub
davlee1972 closed issue #2041: Snowflake adbc_ingest reverting back to CSV uploading URL: https://github.com/apache/arrow-adbc/issues/2041 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[I] Performance questions: What is the best way to upsert and in general? (Postgres) [arrow-adbc]

2024-07-30 Thread via GitHub
avm19 opened a new issue, #2046: URL: https://github.com/apache/arrow-adbc/issues/2046 ### What would you like help with? - Why is `executemany()` much slower than `adbc_ingest()`? - What is the best way and most performant way to pass data with a complex query/operation? - Is t

Re: [I] Restrict direct access to `sun.misc.Unsafe` [arrow]

2024-07-30 Thread via GitHub
danepitkin closed issue #43479: Restrict direct access to `sun.misc.Unsafe` URL: https://github.com/apache/arrow/issues/43479 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] Change the default CompressionCodec.Factory to leverage compression support transparently [arrow]

2024-07-30 Thread via GitHub
danepitkin closed issue #43469: Change the default CompressionCodec.Factory to leverage compression support transparently URL: https://github.com/apache/arrow/issues/43469 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[I] [Java] Add example using CompressionCodec [arrow-cookbook]

2024-07-30 Thread via GitHub
danepitkin opened a new issue, #354: URL: https://github.com/apache/arrow-cookbook/issues/354 The CompressionCodec now uses a ServiceLoader to load all available options. The default is NoCompressionCodec. See https://github.com/apache/arrow/pull/43471 -- This is an automated message fro

Re: [I] [Packaging][C++] Fail to build bundled ORC with the official LZ4 CMake package on Debian GNU/Linux trixie [arrow]

2024-07-30 Thread via GitHub
assignUser closed issue #43467: [Packaging][C++] Fail to build bundled ORC with the official LZ4 CMake package on Debian GNU/Linux trixie URL: https://github.com/apache/arrow/issues/43467 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[I] [C++][Java]When i use DatasetFileWriter::write method write a file, I can't specify a file name [arrow]

2024-07-30 Thread via GitHub
shouriken opened a new issue, #43489: URL: https://github.com/apache/arrow/issues/43489 ### Describe the usage question you have. Please include as many useful details as possible. I use this static method to write a parquet file into fs, I give empty partition array, so it will

Re: [I] Use Amazon KMS for encryption having error: "OSError: Incorrect key to columns mapping in column keys property:" [arrow]

2024-07-31 Thread via GitHub
channingdata closed issue #43426: Use Amazon KMS for encryption having error: "OSError: Incorrect key to columns mapping in column keys property:" URL: https://github.com/apache/arrow/issues/43426 -- This is an automated message from the Apache Git Service. To respond to the message, please l

[I] [Java] `new RootAllocator()` occasionally report error `java.lang.NoSuchFieldError: chunkSize` [arrow]

2024-07-31 Thread via GitHub
xinyiZzz opened a new issue, #43491: URL: https://github.com/apache/arrow/issues/43491 ### Describe the bug, including details regarding any error messages, version, and platform. Hi, `new RootAllocator()` occasionally reports an error, I looked through other issues and guess

[I] [C++] Thirdparty: bump lz4 to 1.10.0 [arrow]

2024-07-31 Thread via GitHub
mapleFU opened a new issue, #43492: URL: https://github.com/apache/arrow/issues/43492 ### Describe the enhancement requested Seems it has performance improment: https://github.com/lz4/lz4/releases/tag/v1.10.0 ### Component(s) C++ -- This is an automated message fr

[I] Inline parent validity bitmap into child validity bitmap [arrow]

2024-07-31 Thread via GitHub
takaaki7 opened a new issue, #43494: URL: https://github.com/apache/arrow/issues/43494 ### Describe the enhancement requested Currently, when struct itself is null, child's validity is unknown. So client must compute AND of those bitmaps to know child's validity. I think inlini

Re: [I] [Java] `new RootAllocator()` occasionally report error `java.lang.NoSuchFieldError: chunkSize` [arrow]

2024-07-31 Thread via GitHub
vibhatha closed issue #43491: [Java] `new RootAllocator()` occasionally report error `java.lang.NoSuchFieldError: chunkSize` URL: https://github.com/apache/arrow/issues/43491 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[I] Dataset with Filename partitioning sometimes loses files on write [arrow]

2024-07-31 Thread via GitHub
rafal-c opened a new issue, #43496: URL: https://github.com/apache/arrow/issues/43496 ### Describe the bug, including details regarding any error messages, version, and platform. Consider a simple program (code below) which creates a Table, turns it into a Dataset and writes the Data

Re: [I] [Python][ppc64le][cuda] pytest segfault - test_cuda.py/test_foreign_buffer [arrow]

2024-07-31 Thread via GitHub
jorisvandenbossche closed issue #31432: [Python][ppc64le][cuda] pytest segfault - test_cuda.py/test_foreign_buffer URL: https://github.com/apache/arrow/issues/31432 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] [Python] StructArray.from_array() should accept a type (in addition to names or fields) [arrow]

2024-07-31 Thread via GitHub
AlenkaF closed issue #42014: [Python] StructArray.from_array() should accept a type (in addition to names or fields) URL: https://github.com/apache/arrow/issues/42014 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[I] Reading partial data/first block hangs on some cloud filesystems [arrow]

2024-07-31 Thread via GitHub
dberenbaum opened a new issue, #43497: URL: https://github.com/apache/arrow/issues/43497 ### Describe the bug, including details regarding any error messages, version, and platform. Take the following example using a publicly available dataset: ```python import gcsfs from

Re: [I] [C++] Benchmark Arrow BinaryViewBuilder [arrow]

2024-07-31 Thread via GitHub
felipecrv closed issue #43444: [C++] Benchmark Arrow BinaryViewBuilder URL: https://github.com/apache/arrow/issues/43444 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [I] The flight.NewRecordWriter parameter is ambiguous [arrow]

2024-07-31 Thread via GitHub
joellubi closed issue #43443: The flight.NewRecordWriter parameter is ambiguous URL: https://github.com/apache/arrow/issues/43443 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [I] The flight.NewRecordWriter parameter is ambiguous [arrow]

2024-07-31 Thread via GitHub
joellubi closed issue #43443: The flight.NewRecordWriter parameter is ambiguous URL: https://github.com/apache/arrow/issues/43443 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[I] [CI] Crossbow report shouldn't include jobs that aren't configured / run recently [arrow]

2024-07-31 Thread via GitHub
jonkeane opened a new issue, #43499: URL: https://github.com/apache/arrow/issues/43499 ### Describe the enhancement requested In #43451 we turned off a bunch of jobs that were constantly red, but I was surprised to see that they are still [showing up on the crossbow nightly report](h

[I] [R][CI] Bump dev docs CI job from ubuntu 20.04 [arrow]

2024-07-31 Thread via GitHub
jonkeane opened a new issue, #43500: URL: https://github.com/apache/arrow/issues/43500 ### Describe the enhancement requested Ubuntu 20.04 is quite old, let's use something more modern ### Component(s) Continuous Integration, R -- This is an automated message from the

[I] [JAVA] Fix Java JNI / AMD64 manylinux2014 Java JNI test not test dataset module [arrow]

2024-07-31 Thread via GitHub
jinchengchenghh opened a new issue, #43502: URL: https://github.com/apache/arrow/issues/43502 ### Describe the bug, including details regarding any error messages, version, and platform. https://github.com/apache/arrow/pull/41646#issuecomment-2259855172 ### Component(s)

[I] [JS] bump `command-line-usage` for security [arrow]

2024-07-31 Thread via GitHub
bombard1004 opened a new issue, #43505: URL: https://github.com/apache/arrow/issues/43505 ### Describe the enhancement requested Npm package `apache-arrow` depends on `command-line-usage`. A [security vulnerability](https://github.com/advisories/GHSA-28mc-g557-92m7) was discovered in

  1   2   3   4   5   6   7   8   9   10   >