[I] [CI][C++] Add clang-cl job [arrow]

2024-10-10 Thread via GitHub


kou opened a new issue, #44378:
URL: https://github.com/apache/arrow/issues/44378

   ### Describe the enhancement requested
   
   We have a document that uses clang-cl: 
https://arrow.apache.org/docs/developers/cpp/windows.html#building-on-windows-arm64-using-ninja-and-clang
   
   But we don't have a job that uses clang-cl.
   
   ### Component(s)
   
   C++


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [Packaging][Java] java-jars are failing on macOS x86_64 to install Python 3.13 from homebrew [arrow]

2024-10-10 Thread via GitHub


kou closed issue #44373: [Packaging][Java] java-jars are failing on macOS 
x86_64 to install Python 3.13 from homebrew
URL: https://github.com/apache/arrow/issues/44373


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[I] docs: Sphinx 8.1 breaks our intersphinx trick [arrow-adbc]

2024-10-10 Thread via GitHub


lidavidm opened a new issue, #2243:
URL: https://github.com/apache/arrow-adbc/issues/2243

   ### What happened?
   
   Sphinx 8.1 shuffled some of the internal APIs we're faking, breaking the 
docs build
   
   ### Stack Trace
   
   _No response_
   
   ### How can we reproduce the bug?
   
   _No response_
   
   ### Environment/Setup
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] docs: Sphinx 8.1 breaks our intersphinx trick [arrow-adbc]

2024-10-10 Thread via GitHub


lidavidm closed issue #2243: docs: Sphinx 8.1 breaks our intersphinx trick
URL: https://github.com/apache/arrow-adbc/issues/2243


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] docs: Sphinx 8.1 breaks our intersphinx trick [arrow-adbc]

2024-10-10 Thread via GitHub


lidavidm closed issue #2243: docs: Sphinx 8.1 breaks our intersphinx trick
URL: https://github.com/apache/arrow-adbc/issues/2243


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[I] [Python][CI] Python minimal examples fail due to dataset not being present [arrow]

2024-10-10 Thread via GitHub


raulcd opened a new issue, #44369:
URL: https://github.com/apache/arrow/issues/44369

   ### Describe the bug, including details regarding any error messages, 
version, and platform.
   
   Since https://github.com/apache/arrow/pull/43740 was merge the minimal 
python jobs have started failing:
   
   - 
[example-python-minimal-build-fedora-conda](https://github.com/ursacomputing/crossbow/actions/runs/11265233598/job/31326751164)
   - 
[example-python-minimal-build-ubuntu-venv](https://github.com/ursacomputing/crossbow/actions/runs/11265233463/job/31326725447)
   
   This is due to dataset not being present but parametrize using it on 
`python/pyarrow/tests/test_dataset.py::test_filesystem_factory`  the error is:
   ```
_ ERROR collecting 
miniconda-for-arrow/envs/pyarrow-3.10/lib/python3.10/site-packages/pyarrow/tests/test_dataset.py
 _
   
miniconda-for-arrow/envs/pyarrow-3.10/lib/python3.10/site-packages/pyarrow/tests/test_dataset.py:740:
 in 
   (ds.HivePartitioning, (r"foo=A/bar=ant%20bee", ""), ("", "")),
   E   AttributeError: 'NoneType' object has no attribute 'HivePartitioning'
   ```
   
   ### Component(s)
   
   Continuous Integration, Python


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[I] Rust: constructors w/o opts are ignored [arrow-adbc]

2024-10-10 Thread via GitHub


tokoko opened a new issue, #2241:
URL: https://github.com/apache/arrow-adbc/issues/2241

   ### What happened?
   
   Driver trait has two methods `new_database` and `new_database_with_opts`, 
but `new_database` is always ignored by ManagedDriver. instead of forwarding 
the call to the inner driver's `new_database` method, it invokes 
`new_database_with_opts(None)`.
   
   This is almost always desirable behavior, but it can be confusing when 
you're getting `not yet implemented` error calling `new_database` even if you 
have `new_database` implemented.
   
   P.S. pretty sure the same applies to other objects as well (Database, 
Connection..)
   
   ### Stack Trace
   
   _No response_
   
   ### How can we reproduce the bug?
   
   This fails if `new_database_with_opts` is not implemented.
   
   ```
   let mut driver = ManagedDriver::load_dynamic_from_name(
   "adbc_dummy",
   Some(b"DummyDriverInit"),
   AdbcVersion::V110,
   ).unwrap();
   
   let mut database = driver.new_database().unwrap();
   ```
   
   ### Environment/Setup
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] leading underscores in partition names results in empty read [arrow]

2024-10-10 Thread via GitHub


smorken closed issue #42160: leading underscores in partition names results in 
empty read
URL: https://github.com/apache/arrow/issues/42160


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [Python][Packaging] Revert macOS deployment target to 12 for pyarrow [arrow]

2024-10-10 Thread via GitHub


kou closed issue #44314: [Python][Packaging] Revert macOS deployment target to 
12 for pyarrow
URL: https://github.com/apache/arrow/issues/44314


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [Python][Packaging] Remove numpy required dependency from pyarrow packaging [arrow]

2024-10-10 Thread via GitHub


raulcd closed issue #43846: [Python][Packaging] Remove numpy required 
dependency from pyarrow packaging
URL: https://github.com/apache/arrow/issues/43846


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[I] [C++] ARM64 Windows: Can't build 'arrow_bundled_dependencies.lib' successfully. [arrow]

2024-10-10 Thread via GitHub


zhanweiw opened a new issue, #44368:
URL: https://github.com/apache/arrow/issues/44368

   ### Describe the bug, including details regarding any error messages, 
version, and platform.
   
   I'll get below error message while I compile Arrow in ARM64 windows. May I 
get your support on this issue? Thanks in advance!
   
   ```
   [190/191] Install the project...-- Install configuration: "RELEASE"
   -- Installing: 
C:/zhanweiw/source/Python/Src/arrow/Install/include/arrow/util/config.h
   CMake Error at src/arrow/cmake_install.cmake:40 (file):
 file INSTALL cannot find
 
"C:/zhanweiw/source/Python/Src/arrow/cpp/build/release/arrow_bundled_dependencies.lib":
 File exists.
   Call Stack (most recent call first):
 cmake_install.cmake:37 (include)
   ```
   
   More info can be found here:
   https://github.com/apache/arrow/issues/44310#issuecomment-2402288125
   
   ### Component(s)
   
   C++


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[I] [C++] `misaligned-pointer-use` after clang-18 upgrade [arrow]

2024-10-10 Thread via GitHub


dotnwat opened a new issue, #44372:
URL: https://github.com/apache/arrow/issues/44372

   ### Describe the bug, including details regarding any error messages, 
version, and platform.
   
   After upgrading to clang 18 we are getting a `misaligned-pointer-use` ubsan 
error firing when reading parquet table.
   
   Tried with both arrow 16 and 17 releases.
   
   ```
   
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/arrow/util/ubsan.h:66:21: 
runtime error: load of misaligned address 0x7f0787c2d3c2 for type 'const 
unsigned int *', which requires 4 byte alignment
   --
     | 0x7f0787c2d3c2: note: pointer points here
     | a5 bd  06 0b 40 20 0c 44 61 1c  48 a2 2c 4c e3 3c 50 24  4d 54 65 5d 58 
a6 6d 5c  e7 7d 60 28 8e 24
     | ^
     | SUMMARY: UndefinedBehaviorSanitizer: misaligned-pointer-use 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/arrow/util/ubsan.h:66:21
   ```
   
   ```
     | [Backtrace #8]
     | __sanitizer::Abort() at 
/llvm/3b5b5c1ec4a3095ab096dd780e84d7ab81f3d7ff/src/compiler-rt/lib/sanitizer_common/sanitizer_posix_libcdep.cpp:143
     |  
     |  
     | [Backtrace #9]
     | __sanitizer::Die() at 
/llvm/3b5b5c1ec4a3095ab096dd780e84d7ab81f3d7ff/src/compiler-rt/lib/sanitizer_common/sanitizer_termination.cpp:58
     |  
     |  
     | [Backtrace #10]
     | __ubsan::ScopedReport::~ScopedReport() at 
/llvm/3b5b5c1ec4a3095ab096dd780e84d7ab81f3d7ff/src/compiler-rt/lib/ubsan/ubsan_diag.cpp:402
     |  
     |  
     | [Backtrace #11]
     | handleTypeMismatchImpl(__ubsan::TypeMismatchData*, unsigned long, 
__ubsan::ReportOptions) at 
/llvm/3b5b5c1ec4a3095ab096dd780e84d7ab81f3d7ff/src/compiler-rt/lib/ubsan/ubsan_handlers.cpp:137
     |  
     |  
     | [Backtrace #12]
     | __ubsan_handle_type_mismatch_v1 at 
/llvm/3b5b5c1ec4a3095ab096dd780e84d7ab81f3d7ff/src/compiler-rt/lib/ubsan/ubsan_handlers.cpp:142
     |  
     |  
     | [Backtrace #13]
     | int arrow::internal::unpack32_specialized >(unsigned int 
const*, unsigned int*, int, int) at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/arrow/util/ubsan.h:66
     |  
     |  
     | [Backtrace #14]
     | int arrow::bit_util::BitReader::GetBatch(int, int*, int) at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/arrow/util/bit_stream_utils.h:342
     |  
     |  
     | [Backtrace #15]
     | int arrow::util::RleDecoder::GetBatchWithDict(long const*, int, 
long*, int) at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/arrow/util/rle_encoding.h:580
     |  
     |  
     | [Backtrace #16]
     | parquet::(anonymous 
namespace)::DictDecoderImpl 
>::Decode(long*, int) at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/parquet/encoding.cc:1634
     |  
     |  
     | [Backtrace #17]
     | parquet::internal::(anonymous 
namespace)::TypedRecordReader 
>::ReadValuesDense(long) at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/parquet/column_reader.cc:1824
     |  
     |  
     | [Backtrace #18]
     | parquet::internal::(anonymous 
namespace)::TypedRecordReader 
>::ReadRecordData(long) at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/parquet/column_reader.cc:1879
     |  
     |  
     | [Backtrace #19]
     | parquet::internal::(anonymous 
namespace)::TypedRecordReader 
>::ReadRecords(long) at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/parquet/column_reader.cc:1425
     |  
     |  
     | [Backtrace #20]
     | parquet::arrow::(anonymous namespace)::LeafReader::LoadBatch(long) at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/parquet/arrow/reader.cc:482
     |  
     |  
     | [Backtrace #21]
     | parquet::arrow::ColumnReaderImpl::NextBatch(long, 
std::__1::shared_ptr*) at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/parquet/arrow/reader.cc:109
     |  
     |  
     | [Backtrace #22]
     | parquet::arrow::(anonymous namespace)::FileReaderImpl::ReadColumn(int, 
std::__1::vector > const&, 
parquet::arrow::ColumnReader*, std::__1::shared_ptr*) at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/parquet/arrow/reader.cc:284
     |  
     |  
     | [Backtrace #23]
     | parquet::arrow::(anonymous 
namespace)::FileReaderImpl::DecodeRowGroups(std::__1::shared_ptr, std::__1::vector > 
const&, std::__1::vector > const&, 
arrow::internal::Executor*)::$_0::operator()(unsigned long, 
std::__1::shared_ptr) const at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/parquet/arrow/reader.cc:1252
     |  
     |  
     | [Backtrace #24]
     | parquet::arrow::(anonymous 
namespace)::FileReaderImpl::DecodeRowGroups(std::__1::shared_ptr, std::__1::vector > 
const&, std::__1::vector > const&, 
arrow::internal::Executor*) at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/arrow/util/parallel.h:95
     |  
     |  
     | [Backtrace #25]
     | parquet::arrow::(anonymous 
namespace)::FileReaderImpl::ReadRowGroups(std::__1::vector > const&, std::__1::vector > const&, std::__1::shared_ptr*) at 
/v/build/v_deps_build/arrow-prefix/src/arrow/cpp/src/parquet/arrow/

[I] [Packaging][Java] java-jars are failing on macOS x86_64 to install Python 3.13 from homebrew [arrow]

2024-10-10 Thread via GitHub


raulcd opened a new issue, #44373:
URL: https://github.com/apache/arrow/issues/44373

   ### Describe the bug, including details regarding any error messages, 
version, and platform.
   
   The [java-jars 
job](https://github.com/ursacomputing/crossbow/actions/runs/11251253487/job/31281887873)
 is failing with:
   
   ```
   ==> Pouring python@3.13--3.13.0_1.ventura.bottle.tar.gz
   Error: The `brew link` step did not complete successfully
   Error: The `brew link` step did not complete successfully
   The formula built, but is not symlinked into /usr/local
   Could not symlink bin/idle3
   Target /usr/local/bin/idle3
   already exists. You may want to remove it:
 rm '/usr/local/bin/idle3'
   
   To force the link and overwrite all conflicting files:
 brew link --overwrite python@3.13
   
   To list all files that would be deleted:
 brew link --overwrite python@3.13 --dry-run
   
   Possible conflicting files are:
   /usr/local/bin/idle3 -> 
/Library/Frameworks/Python.framework/Versions/3.12/bin/idle3
   /usr/local/bin/pydoc3 -> 
/Library/Frameworks/Python.framework/Versions/3.12/bin/pydoc3
   /usr/local/bin/python3 -> 
/Library/Frameworks/Python.framework/Versions/3.12/bin/python3
   /usr/local/bin/python3-config -> 
/Library/Frameworks/Python.framework/Versions/3.12/bin/python3-config
   ==> /usr/local/Cellar/python@3.13/3.13.0_1/bin/python3.13 -Im ensurepip
   ==> /usr/local/Cellar/python@3.13/3.13.0_1/bin/python3.13 -Im pip install -v 
--n
   ==> Caveats
   Python has been installed as
 /usr/local/bin/python3
   
   Unversioned symlinks `python`, `python-config`, `pip` etc. pointing to
   `python3`, `python3-config`, `pip3` etc., respectively, have been installed 
into
 /usr/local/opt/python@3.13/libexec/bin
   
   See: https://docs.brew.sh/Homebrew-and-Python
   ```
   This is also happening on the maintenance branch for 18.0.0
   
   
   
   ### Component(s)
   
   Java, Packaging


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[I] [Python][Acero] RecordBatch.filter raises error if result set is empty [arrow]

2024-10-10 Thread via GitHub


wlhjason opened a new issue, #44366:
URL: https://github.com/apache/arrow/issues/44366

   ### Describe the bug, including details regarding any error messages, 
version, and platform.
   
   Example (tested with pyarrow 17.0.0):
   
   ```python
   import pyarrow as pa
   import pyarrow.compute as pc
   
   pa.record_batch({"number": [1, 2, 3]}).filter(pc.field("number") < 0)
   ```
   leads to
   ```
   IndexError: list index out of range
   ```
   on this line in `arrow/python/pyarrow/acero.py`: 
https://github.com/apache/arrow/blob/maint-17.0.0/python/pyarrow/acero.py#L371
   
   
   ### Component(s)
   
   Python


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [R] How to pass Arrow objects like Table between C++ and R? [arrow]

2024-10-10 Thread via GitHub


amoeba closed issue #43675: [R] How to pass Arrow objects like Table between 
C++ and R?
URL: https://github.com/apache/arrow/issues/43675


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org