[GitHub] [arrow] kou closed issue #33813: [CI][GLib] MinGW test failed MSYS2 setup

2023-01-21 Thread via GitHub
kou closed issue #33813: [CI][GLib] MinGW test failed MSYS2 setup URL: https://github.com/apache/arrow/issues/33813 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

[GitHub] [arrow] kszucs opened a new issue, #33818: [Dev][Release] Verification script doesn't test amd64 architecture on arm64 mac

2023-01-21 Thread via GitHub
kszucs opened a new issue, #33818: URL: https://github.com/apache/arrow/issues/33818 ### Describe the bug, including details regarding any error messages, version, and platform. `TEST_DEFAULT=0 TEST_APT=1 dev/release/verify-release-candidate.sh ` runs the APT/YUM tests in docker con

[GitHub] [arrow] paleolimbot opened a new issue, #33819: [R] R package fails to install when using clang-16 as the compiler

2023-01-21 Thread via GitHub
paleolimbot opened a new issue, #33819: URL: https://github.com/apache/arrow/issues/33819 ### Describe the bug, including details regarding any error messages, version, and platform. On the CRAN package check page ( https://cran.r-project.org/web/checks/check_results_arrow.html ) the

[GitHub] [arrow-testing] jdye64 commented on pull request #87: New csv files that use different field types for expanding DataFusion csv reading tests

2023-01-21 Thread via GitHub
jdye64 commented on PR #87: URL: https://github.com/apache/arrow-testing/pull/87#issuecomment-1399302573 @kou let me know what you think about the README changes. Wasn't exactly sure what to put in there? -- This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [arrow] kou opened a new issue, #33820: [CI][Release] libxsimd-dev doesn't exist on Ubuntu 20.04

2023-01-21 Thread via GitHub
kou opened a new issue, #33820: URL: https://github.com/apache/arrow/issues/33820 ### Describe the bug, including details regarding any error messages, version, and platform. #33811 adds `libxsimd-dev` to verification environment but Ubuntu 20.04 doesn't provide `libxsimd-dev` yet.

[GitHub] [arrow-testing] kou commented on pull request #87: New csv files that use different field types for expanding DataFusion csv reading tests

2023-01-21 Thread via GitHub
kou commented on PR #87: URL: https://github.com/apache/arrow-testing/pull/87#issuecomment-1399326541 Thanks. I think that the added description is enough. But we need to check a license for data copied from others to compliant its license. The commit message of https://github.com/pl

[GitHub] [arrow] raulcd closed issue #33820: [CI][Release] libxsimd-dev doesn't exist on Ubuntu 20.04

2023-01-21 Thread via GitHub
raulcd closed issue #33820: [CI][Release] libxsimd-dev doesn't exist on Ubuntu 20.04 URL: https://github.com/apache/arrow/issues/33820 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [arrow] domoritz opened a new issue, #33823: pyarrow.lib.ArrowInvalid: Not an Arrow file

2023-01-21 Thread via GitHub
domoritz opened a new issue, #33823: URL: https://github.com/apache/arrow/issues/33823 ### Describe the bug, including details regarding any error messages, version, and platform. I am trying to loan an arrow file ```python with pa.memory_map('flights-200k.arrow', 'r') as so

[GitHub] [arrow] domoritz opened a new issue, #33824: Double . in error message

2023-01-21 Thread via GitHub
domoritz opened a new issue, #33824: URL: https://github.com/apache/arrow/issues/33824 ### Describe the bug, including details regarding any error messages, version, and platform. I am getting an error ``` pyarrow.lib.ArrowInvalid: Error creating dataset. Could not read sche

[GitHub] [arrow] coady opened a new issue, #33825: [Python] Introspect partition keys and values in fragments.

2023-01-21 Thread via GitHub
coady opened a new issue, #33825: URL: https://github.com/apache/arrow/issues/33825 ### Describe the enhancement requested It's not possible to programmatically determine the values of partition keys in a fragment. Fragments have a `partition_expression` attribute, but the `Expressio

[GitHub] [arrow] kou closed issue #33816: [CI][Conan] Failed to build

2023-01-21 Thread via GitHub
kou closed issue #33816: [CI][Conan] Failed to build URL: https://github.com/apache/arrow/issues/33816 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: i

[GitHub] [arrow] kou closed issue #33723: [C++] re2::RE2::RE2() result must be checked

2023-01-22 Thread via GitHub
kou closed issue #33723: [C++] re2::RE2::RE2() result must be checked URL: https://github.com/apache/arrow/issues/33723 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [arrow] daviewales opened a new issue, #33826: Unable to build pyarrow wheel for macOS 10.13 when installing from pypi.

2023-01-22 Thread via GitHub
daviewales opened a new issue, #33826: URL: https://github.com/apache/arrow/issues/33826 ### Describe the bug, including details regarding any error messages, version, and platform. I'm trying to install pyarrow on macOS 10.13 using pip. As of pyarrow 10.0 there are no pre-built wh

[GitHub] [arrow] zagto opened a new issue, #33830: Clarify handing of Null values in REE encoding

2023-01-22 Thread via GitHub
zagto opened a new issue, #33830: URL: https://github.com/apache/arrow/issues/33830 ### Describe the bug, including details regarding any error messages, version, and platform. In the Columnar format, the handling of null values in the REE type is not described properly. - The

[GitHub] [arrow-julia] Moelf closed issue #92: Re-use PyArrow memory via PyCall

2023-01-22 Thread via GitHub
Moelf closed issue #92: Re-use PyArrow memory via PyCall URL: https://github.com/apache/arrow-julia/issues/92 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

[GitHub] [arrow] coady opened a new issue, #33832: [C++][Python] Performant aggregating by fragments.

2023-01-22 Thread via GitHub
coady opened a new issue, #33832: URL: https://github.com/apache/arrow/issues/33832 ### Describe the enhancement requested Spun off from #33825. `pc._group_by` requires loaded arrays, which means it's not practical to group and aggregate large datasets. Even if the dataset is p

[GitHub] [arrow] EpsilonPrime opened a new issue, #33833: [C++] Improve the performance of the binary round kernel

2023-01-22 Thread via GitHub
EpsilonPrime opened a new issue, #33833: URL: https://github.com/apache/arrow/issues/33833 ### Describe the enhancement requested The binary round kernel has some of the performance issues of the unary round kernel namely non-floating type arguments are first cast to double before im

[GitHub] [arrow] ava6969 opened a new issue, #33834: HashJoin Operation, need help performing concat of record batches

2023-01-23 Thread via GitHub
ava6969 opened a new issue, #33834: URL: https://github.com/apache/arrow/issues/33834 ### Describe the usage question you have. Please include as many useful details as possible. So I implemented a very inefficient operation to con-cat 2 or more record batches that all individua

[GitHub] [arrow] neopaf closed issue #15138: [C++] Clustered By -- how?

2023-01-23 Thread via GitHub
neopaf closed issue #15138: [C++] Clustered By -- how? URL: https://github.com/apache/arrow/issues/15138 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [arrow] raulcd opened a new issue, #33835: [Doc][Release] Update release guide to remove mention to merging release candidate before vote has finalised

2023-01-23 Thread via GitHub
raulcd opened a new issue, #33835: URL: https://github.com/apache/arrow/issues/33835 ### Describe the enhancement requested As discussed: https://github.com/apache/arrow/pull/33751#issuecomment-1399430267 There are some misleading instructions on the release guide. ### Compo

[GitHub] [arrow] Neltherion opened a new issue, #11239: Any replacements for `pa.serialize()` and `pa.deserialize()` ?

2023-01-23 Thread via GitHub
Neltherion opened a new issue, #11239: URL: https://github.com/apache/arrow/issues/11239 It seems that PyArrow has deprecated the `pa.serialize()` and `pa.deserialize()` methods and suggests to use other options such a Pickle5. Using Pickle5 doesn't seem to have the same performance

[GitHub] [arrow] zeroshade closed issue #33830: Clarify handling of Null values in REE encoding

2023-01-23 Thread via GitHub
zeroshade closed issue #33830: Clarify handling of Null values in REE encoding URL: https://github.com/apache/arrow/issues/33830 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow-adbc] lidavidm closed issue #373: [Python] adbc_driver_flightsql wheel on macOS contains an x64 binary

2023-01-23 Thread via GitHub
lidavidm closed issue #373: [Python] adbc_driver_flightsql wheel on macOS contains an x64 binary URL: https://github.com/apache/arrow-adbc/issues/373 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] westonpace closed issue #33737: [C++] Simplify tracing in exec plan

2023-01-23 Thread via GitHub
westonpace closed issue #33737: [C++] Simplify tracing in exec plan URL: https://github.com/apache/arrow/issues/33737 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[GitHub] [arrow-adbc] zeroshade closed issue #315: [Go] Implement an ADBC driver for Flight SQL

2023-01-23 Thread via GitHub
zeroshade closed issue #315: [Go] Implement an ADBC driver for Flight SQL URL: https://github.com/apache/arrow-adbc/issues/315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow] thisisnic closed issue #33524: [R] Handle as_data_frame argument if passed into open_dataset for CSVs

2023-01-23 Thread via GitHub
thisisnic closed issue #33524: [R] Handle as_data_frame argument if passed into open_dataset for CSVs URL: https://github.com/apache/arrow/issues/33524 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [arrow] mkristofik opened a new issue, #33839: FlightCallHeaders added to FlightClient::getStream aren't attached to call

2023-01-23 Thread via GitHub
mkristofik opened a new issue, #33839: URL: https://github.com/apache/arrow/issues/33839 ### Describe the bug, including details regarding any error messages, version, and platform. I'm using the Java flight-core version 10.0.1 and grpc-core version 1.50.2. I'm having trouble attach

[GitHub] [arrow] zeroshade opened a new issue, #33840: [Go] Improve SQLite Flight SQL example and provide simple mainprog

2023-01-23 Thread via GitHub
zeroshade opened a new issue, #33840: URL: https://github.com/apache/arrow/issues/33840 ### Describe the enhancement requested To assist with testing and facilitate easier ADBC testing, the Go SQLite Flight SQL example can be expanded to provide a simple mainprog to launch it (which

[GitHub] [arrow] zeroshade closed issue #33840: [Go] Improve SQLite Flight SQL example and provide simple mainprog

2023-01-23 Thread via GitHub
zeroshade closed issue #33840: [Go] Improve SQLite Flight SQL example and provide simple mainprog URL: https://github.com/apache/arrow/issues/33840 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [arrow-adbc] lidavidm closed issue #368: [Python] Add extra locking in the driver manager to help guard against misuse

2023-01-23 Thread via GitHub
lidavidm closed issue #368: [Python] Add extra locking in the driver manager to help guard against misuse URL: https://github.com/apache/arrow-adbc/issues/368 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [arrow] zeroshade closed issue #20407: [Go] Array Builder for RLE Arrays

2023-01-23 Thread via GitHub
zeroshade closed issue #20407: [Go] Array Builder for RLE Arrays URL: https://github.com/apache/arrow/issues/20407 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[GitHub] [arrow] mroeschke opened a new issue, #33842: [Python] ENH: Preserve tzinfo from datetime.time objects when contructing pa.array

2023-01-23 Thread via GitHub
mroeschke opened a new issue, #33842: URL: https://github.com/apache/arrow/issues/33842 ### Describe the enhancement requested ``` In [45]: pa_array = pa.array([datetime.time(12, 0, tzinfo=datetime.timezone.utc)]) In [46]: pa_array Out[46]: [ 12:00:00.00

[GitHub] [arrow] jbrockmendel opened a new issue, #33843: ENH: don't raise in integer division by zero

2023-01-23 Thread via GitHub
jbrockmendel opened a new issue, #33843: URL: https://github.com/apache/arrow/issues/33843 ### Describe the enhancement requested `pc.divide_checked` and `pc.divide` both raise ArrowInvalid on division by zero with integer dtypes. For at least the non-checked version it would be mor

[GitHub] [arrow] vibhatha opened a new issue, #33844: [C++] Use DeserializePlan instead of DeserializePlans in Substrait Testing

2023-01-23 Thread via GitHub
vibhatha opened a new issue, #33844: URL: https://github.com/apache/arrow/issues/33844 ### Describe the enhancement requested Some of the existing test cases use the `DeserializePlans` method where it could be now replaced with `DeserializePlan`. In such cases, the `DeserializePla

[GitHub] [arrow] ramannanda9 opened a new issue, #33845: _prefixed column names change `write_to_dataset` behavior

2023-01-23 Thread via GitHub
ramannanda9 opened a new issue, #33845: URL: https://github.com/apache/arrow/issues/33845 ### Describe the bug, including details regarding any error messages, version, and platform. To reproduce.. ```python df=pd.Dataframe({'a':[1,2],'b':[3,4],'_part_col':[5,6]}) table =

[GitHub] [arrow] kou closed issue #33787: [C++] Arrow under s390x: statement has no effect [-Werror=unused-value]

2023-01-24 Thread via GitHub
kou closed issue #33787: [C++] Arrow under s390x: statement has no effect [-Werror=unused-value] URL: https://github.com/apache/arrow/issues/33787 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] kou closed issue #32801: [C++][Doc] Curate {{cpp/apidoc}}

2023-01-24 Thread via GitHub
kou closed issue #32801: [C++][Doc] Curate {{cpp/apidoc}} URL: https://github.com/apache/arrow/issues/32801 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

[GitHub] [arrow] kou closed issue #33782: [Release] Vote email number of issues is querying JIRA and producing a wrong number

2023-01-24 Thread via GitHub
kou closed issue #33782: [Release] Vote email number of issues is querying JIRA and producing a wrong number URL: https://github.com/apache/arrow/issues/33782 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [arrow] kou opened a new issue, #33849: [C++] ARROW_BUILD_SHARED=OFF and ARROW_BUILD_EXAMPLES=ON causes build error

2023-01-24 Thread via GitHub
kou opened a new issue, #33849: URL: https://github.com/apache/arrow/issues/33849 ### Describe the bug, including details regarding any error messages, version, and platform. `cpp/examples/arrow/CMakeLists.txt` uses `arrow_substrait_shared` and `gandiva_shared` unconditionally. We ca

[GitHub] [arrow] westonpace opened a new issue, #33850: [C++] Allow Substrait's default extension provider to be configured

2023-01-24 Thread via GitHub
westonpace opened a new issue, #33850: URL: https://github.com/apache/arrow/issues/33850 ### Describe the enhancement requested A custom extension provider can be specified when running a query. However, in some cases (e.g. when Acero is embedded in a larger program that provides it

[GitHub] [arrow-adbc] lidavidm opened a new issue, #380: [Go] Bring Flight SQL driver on par with dropped C++ driver

2023-01-24 Thread via GitHub
lidavidm opened a new issue, #380: URL: https://github.com/apache/arrow-adbc/issues/380 - [ ] Add tests of TLS - [ ] Allow introspecting partitions - [ ] Generic RPC transport options - [ ] Generic call header insertion options with tests - [ ] GetObjects support - [ ] Generic

[GitHub] [arrow] nealrichardson closed issue #33760: [R] Push projection expressions into ScanNode

2023-01-24 Thread via GitHub
nealrichardson closed issue #33760: [R] Push projection expressions into ScanNode URL: https://github.com/apache/arrow/issues/33760 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [arrow] vmalisz closed issue #33814: [Python] Can't install on Raspberry Pi (Failed building wheel for pyarrow)

2023-01-24 Thread via GitHub
vmalisz closed issue #33814: [Python] Can't install on Raspberry Pi (Failed building wheel for pyarrow) URL: https://github.com/apache/arrow/issues/33814 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow] nealrichardson opened a new issue, #33851: [C++] Bump version of bundled boost to 1.81.0

2023-01-24 Thread via GitHub
nealrichardson opened a new issue, #33851: URL: https://github.com/apache/arrow/issues/33851 ### Describe the enhancement requested In addition to bumping the version in versions.txt, we need to update our trimmed version that we host (90% smaller than the full boost). See `cpp/build

[GitHub] [arrow] zeroshade closed issue #33600: [Go] firstTimeBitmapWriter.Finish() panics with list of 8 structs

2023-01-24 Thread via GitHub
zeroshade closed issue #33600: [Go] firstTimeBitmapWriter.Finish() panics with list of 8 structs URL: https://github.com/apache/arrow/issues/33600 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] lidavidm opened a new issue, #33852: [Go] Flight SQL example server should return at least one catalog and schema

2023-01-24 Thread via GitHub
lidavidm opened a new issue, #33852: URL: https://github.com/apache/arrow/issues/33852 ### Describe the enhancement requested This is necessary for integration testing with the Flight SQL driver. Although SQLite does not really have catalogs/schemas, we should at least expose some st

[GitHub] [arrow] sreeharihegden opened a new issue, #33854: Add basic [`libmexclass`](https://github.com/mathworks/libmexclass/) integration code to MATLAB interface

2023-01-24 Thread via GitHub
sreeharihegden opened a new issue, #33854: URL: https://github.com/apache/arrow/issues/33854 ### Describe the enhancement requested [`libmexclass`](https://github.com/mathworks/libmexclass/) is a MATLAB framework that enables users to implement the functionality of MATLAB classes in

[GitHub] [arrow] zeroshade closed issue #33852: [Go] Flight SQL example server should return at least one catalog and schema

2023-01-24 Thread via GitHub
zeroshade closed issue #33852: [Go] Flight SQL example server should return at least one catalog and schema URL: https://github.com/apache/arrow/issues/33852 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [arrow] wjones127 opened a new issue, #33856: [C#] Implement C Data Interface for C#

2023-01-24 Thread via GitHub
wjones127 opened a new issue, #33856: URL: https://github.com/apache/arrow/issues/33856 ### Describe the enhancement requested C# is one of the few independent implementations of Arrow that doesn't support the C Data Interface. Supporting this would allow the [ParquetSharp](ht

[GitHub] [arrow] wjones127 opened a new issue, #33857: [C#] Implement C Stream Interface in C#

2023-01-24 Thread via GitHub
wjones127 opened a new issue, #33857: URL: https://github.com/apache/arrow/issues/33857 ### Describe the enhancement requested Follow up to #33856. ### Component(s) C# -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [arrow] kou closed issue #33796: [C++] arrow-testing.pc.in's Cflags are incorrectly set if gtest isn't built as part of the arrow build

2023-01-24 Thread via GitHub
kou closed issue #33796: [C++] arrow-testing.pc.in's Cflags are incorrectly set if gtest isn't built as part of the arrow build URL: https://github.com/apache/arrow/issues/33796 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [arrow] kou closed issue #33835: [Doc][Release] Update release guide to remove mention to merging release candidate before vote has finalised

2023-01-24 Thread via GitHub
kou closed issue #33835: [Doc][Release] Update release guide to remove mention to merging release candidate before vote has finalised URL: https://github.com/apache/arrow/issues/33835 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [arrow] wgtmac opened a new issue, #33859: [C++][Java] Bump Apache ORC to v1.8.2

2023-01-24 Thread via GitHub
wgtmac opened a new issue, #33859: URL: https://github.com/apache/arrow/issues/33859 ### Describe the enhancement requested Apache ORC 1.8.2 is the most recent release: https://github.com/apache/orc/releases/tag/v1.8.2 https://orc.apache.org/news/2023/01/13/ORC-1.8.2/ ###

[GitHub] [arrow-flight-sql-postgresql] kou opened a new issue, #1: Implement an empty Flight SQL server as a background worker

2023-01-24 Thread via GitHub
kou opened a new issue, #1: URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/1 It can accepts a Flight SQL connection but all functions are not implemented. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [arrow-flight-sql-postgresql] kou opened a new issue, #2: Add a minimal test and run it as CI

2023-01-24 Thread via GitHub
kou opened a new issue, #2: URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/2 It just connects to Flight SQL adapter for PostgreSQL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow] kou closed issue #33859: [C++][Java] Bump Apache ORC to v1.8.2

2023-01-24 Thread via GitHub
kou closed issue #33859: [C++][Java] Bump Apache ORC to v1.8.2 URL: https://github.com/apache/arrow/issues/33859 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [arrow] vibhatha opened a new issue, #33861: [C++] GLobFiles based URI doesn't function properly in Windows

2023-01-25 Thread via GitHub
vibhatha opened a new issue, #33861: URL: https://github.com/apache/arrow/issues/33861 ### Describe the bug, including details regarding any error messages, version, and platform. At the moment, the Substrait tests in CIs which uses GlobFiles based data source doesn't run on Windows.

[GitHub] [arrow] jorisvandenbossche opened a new issue, #33863: [Dev] Stop commenting "Closes .." on PR, comment on issue instead

2023-01-25 Thread via GitHub
jorisvandenbossche opened a new issue, #33863: URL: https://github.com/apache/arrow/issues/33863 ### Describe the enhancement requested It's maybe two separate changes, but: - The PR workflow both updates the first comment to add a "Closes .." and adds a comment with the same t

[GitHub] [arrow] lidavidm opened a new issue, #33864: [Go] Exported ArrowArray may panic with "misuse of an invalid handle"

2023-01-25 Thread via GitHub
lidavidm opened a new issue, #33864: URL: https://github.com/apache/arrow/issues/33864 ### Describe the bug, including details regarding any error messages, version, and platform. ``` panic: runtime/cgo: misuse of an invalid Handle goroutine 17 [running, locked to thread]:

[GitHub] [arrow-adbc] lidavidm opened a new issue, #385: [Go] Change how DoGet calls are parallelized in the Flight SQL driver

2023-01-25 Thread via GitHub
lidavidm opened a new issue, #385: URL: https://github.com/apache/arrow-adbc/issues/385 Currently we interleave results from all endpoints; until Flight has an explicit way to indicate whether results are ordered or not, it may be friendlier to read in parallel, but try to return data in or

[GitHub] [arrow] zeroshade closed issue #33864: [Go] Exported ArrowArray may panic with "misuse of an invalid handle"

2023-01-25 Thread via GitHub
zeroshade closed issue #33864: [Go] Exported ArrowArray may panic with "misuse of an invalid handle" URL: https://github.com/apache/arrow/issues/33864 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] westonpace closed issue #32747: [C++] Substrait To Arrow Emit feature testing

2023-01-25 Thread via GitHub
westonpace closed issue #32747: [C++] Substrait To Arrow Emit feature testing URL: https://github.com/apache/arrow/issues/32747 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow-adbc] lidavidm closed issue #229: [C][Python] Set up Conda packages

2023-01-25 Thread via GitHub
lidavidm closed issue #229: [C][Python] Set up Conda packages URL: https://github.com/apache/arrow-adbc/issues/229 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[GitHub] [arrow-adbc] lidavidm opened a new issue, #388: [CI] Conda package is still bundling the shared library on accident

2023-01-25 Thread via GitHub
lidavidm opened a new issue, #388: URL: https://github.com/apache/arrow-adbc/issues/388 ```python if not library: if os.environ.get("_ADBC_IS_SDIST", "").strip().lower() in ("1", "true"): print("Building sdist, not requiring ADBC_SQLITE_LIBRARY") elif os.environ.ge

[GitHub] [arrow] wjones127 closed issue #33659: [Developer Tools] Define Breaking Change and Critical Fix

2023-01-25 Thread via GitHub
wjones127 closed issue #33659: [Developer Tools] Define Breaking Change and Critical Fix URL: https://github.com/apache/arrow/issues/33659 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [arrow-adbc] zeroshade closed issue #385: [Go] Change how DoGet calls are parallelized in the Flight SQL driver

2023-01-25 Thread via GitHub
zeroshade closed issue #385: [Go] Change how DoGet calls are parallelized in the Flight SQL driver URL: https://github.com/apache/arrow-adbc/issues/385 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [arrow] zeroshade opened a new issue, #33867: [Go][FlightSQL] Allow passing grpc call options to prepared statement methods

2023-01-25 Thread via GitHub
zeroshade opened a new issue, #33867: URL: https://github.com/apache/arrow/issues/33867 ### Describe the enhancement requested Currently you cannot pass `grpc.CallOption`s to Execute/ExecuteUpdate/Close on `flightsql.PreparedStatement` objects. We should allow passing call options so

[GitHub] [arrow] zeroshade closed issue #33867: [Go][FlightSQL] Allow passing grpc call options to prepared statement methods

2023-01-25 Thread via GitHub
zeroshade closed issue #33867: [Go][FlightSQL] Allow passing grpc call options to prepared statement methods URL: https://github.com/apache/arrow/issues/33867 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [arrow] assignUser opened a new issue, #33869: [Docs][Java] Update nightly docs to explain SNAPSHOT version

2023-01-25 Thread via GitHub
assignUser opened a new issue, #33869: URL: https://github.com/apache/arrow/issues/33869 ### Describe the enhancement requested I just discovered that the [java nightly docs](https://arrow.apache.org/docs/dev/developers/java/building.html#installing-nightly-packages) don't explain th

[GitHub] [arrow] assignUser opened a new issue, #33870: [Dev] Add Swift component to issue template and PR labeller

2023-01-25 Thread via GitHub
assignUser opened a new issue, #33870: URL: https://github.com/apache/arrow/issues/33870 ### Describe the enhancement requested #14561 adds a swift implementation of arrow to the repo. I have already added the label but it needs to be added to the templates/workflows. ### Compo

[GitHub] [arrow] zeroshade closed issue #32947: [Go] Concatenate Implementation for REE Array

2023-01-25 Thread via GitHub
zeroshade closed issue #32947: [Go] Concatenate Implementation for REE Array URL: https://github.com/apache/arrow/issues/32947 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [arrow] westonpace closed issue #32653: [C++] Centralize Errors in ExecPlan

2023-01-25 Thread via GitHub
westonpace closed issue #32653: [C++] Centralize Errors in ExecPlan URL: https://github.com/apache/arrow/issues/32653 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[GitHub] [arrow-adbc] jacobmarble opened a new issue, #391: [Go][sqldriver] cannot use `arrow.Timestamp` without more information

2023-01-25 Thread via GitHub
jacobmarble opened a new issue, #391: URL: https://github.com/apache/arrow-adbc/issues/391 In order to properly consume a query result value with type `arrow.Timestamp`, `arrow.Time32`, or `arrow.Time64`, the `arrow.UnitType` must be known. The convenience method for these types is `ToTime(

[GitHub] [arrow] jbrockmendel closed issue #33769: [Python] support quantile for temporal dtypes

2023-01-25 Thread via GitHub
jbrockmendel closed issue #33769: [Python] support quantile for temporal dtypes URL: https://github.com/apache/arrow/issues/33769 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow] felipecrv opened a new issue, #33872: Replace shared_ptr creation hack before AppendScalarImpl instantiation

2023-01-25 Thread via GitHub
felipecrv opened a new issue, #33872: URL: https://github.com/apache/arrow/issues/33872 ### Describe the enhancement requested `AppendScalarImpl` was created for appending scalars based on a contiguous array of `std::shared_ptr`, so when a single `Scalar` reference is passed, a dummy

[GitHub] [arrow] aiguofer opened a new issue, #33874: Custom headers/properties through Arrow Flight SQL JDBC

2023-01-25 Thread via GitHub
aiguofer opened a new issue, #33874: URL: https://github.com/apache/arrow/issues/33874 ### Describe the usage question you have. Please include as many useful details as possible. We're currently building a Flight SQL Server and want to use `CallHeaderAuthenticator`. We want to

[GitHub] [arrow] minyoung opened a new issue, #33875: [Go] How to handle large lists?

2023-01-25 Thread via GitHub
minyoung opened a new issue, #33875: URL: https://github.com/apache/arrow/issues/33875 ### Describe the usage question you have. Please include as many useful details as possible. I'm encountering a panic when trying to generate a parquet with a very large list of (nested) strin

[GitHub] [arrow] kou opened a new issue, #33876: [CI][C++] arrow-testing.pc related error in test-build-vcpkg-win

2023-01-25 Thread via GitHub
kou opened a new issue, #33876: URL: https://github.com/apache/arrow/issues/33876 ### Describe the bug, including details regarding any error messages, version, and platform. #33812 must be related. https://github.com/ursacomputing/crossbow/actions/runs/4011170599/jobs/6888462

[GitHub] [arrow] raulcd opened a new issue, #33878: [Release] Java binaries are missing from artifactory

2023-01-26 Thread via GitHub
raulcd opened a new issue, #33878: URL: https://github.com/apache/arrow/issues/33878 ### Describe the bug, including details regarding any error messages, version, and platform. When uploading binaries to [artifactory](https://apache.jfrog.io/ui/repos/tree/General/arrow) for release

[GitHub] [arrow] rtpsw opened a new issue, #33879: [C++] [Python] Make a user-defined table from a generator

2023-01-26 Thread via GitHub
rtpsw opened a new issue, #33879: URL: https://github.com/apache/arrow/issues/33879 ### Describe the enhancement requested Allow the user to register a UDT by providing a batch generator. This is a follow-up task for #14682 (see [this post](https://github.com/apache/arrow/pull/14682/

[GitHub] [arrow] joosthooz opened a new issue, #33880: Add/improve tracing in the dataset writer

2023-01-26 Thread via GitHub
joosthooz opened a new issue, #33880: URL: https://github.com/apache/arrow/issues/33880 ### Describe the enhancement requested The telemetry code in the dataset writer currently does not trace the asynchronous tasks that are submitted to the I/O thread pool that perform the actual en

[GitHub] [arrow] raulcd closed issue #33878: [Release] Java binaries are missing from artifactory

2023-01-26 Thread via GitHub
raulcd closed issue #33878: [Release] Java binaries are missing from artifactory URL: https://github.com/apache/arrow/issues/33878 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [arrow] h-vetinari opened a new issue, #33882: [CMake] gRPCAlt takes 15 minutes on linux

2023-01-26 Thread via GitHub
h-vetinari opened a new issue, #33882: URL: https://github.com/apache/arrow/issues/33882 ### Describe the bug, including details regarding any error messages, version, and platform. In conda-forge, running the code related to (or around) `gRPCAlt` is near-instantaneous on osx & windo

[GitHub] [arrow] westonpace closed issue #32916: [C++] [Python] User-defined tabular functions

2023-01-26 Thread via GitHub
westonpace closed issue #32916: [C++] [Python] User-defined tabular functions URL: https://github.com/apache/arrow/issues/32916 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow] westonpace opened a new issue, #33883: [Python] Adopt a more pythonic method for UDF registration

2023-01-26 Thread via GitHub
westonpace opened a new issue, #33883: URL: https://github.com/apache/arrow/issues/33883 ### Describe the enhancement requested It's currently quite complicated to register a UDF. In a recent PR we reviewed a few different suggestions. We should adopt one of these. ### Co

[GitHub] [arrow] rtpsw opened a new issue, #33884: [C++] [Python] Test user-defined tables in an execution plan

2023-01-26 Thread via GitHub
rtpsw opened a new issue, #33884: URL: https://github.com/apache/arrow/issues/33884 ### Describe the enhancement requested Currently, [user-defined tables](https://github.com/apache/arrow/pull/14682/) are tested only via the function API. This issue will add testing using the executi

[GitHub] [arrow-adbc] lidavidm closed issue #397: [CI] Add --skip for Anaconda upload

2023-01-26 Thread via GitHub
lidavidm closed issue #397: [CI] Add --skip for Anaconda upload URL: https://github.com/apache/arrow-adbc/issues/397 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

[GitHub] [arrow-adbc] lidavidm opened a new issue, #400: [Go] Flight SQL driver: adjust max incoming message size

2023-01-26 Thread via GitHub
lidavidm opened a new issue, #400: URL: https://github.com/apache/arrow-adbc/issues/400 The default is often too small for Flight applications. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] lidavidm closed issue #33872: [C++] Replace shared_ptr creation hack before AppendScalarImpl instantiation

2023-01-26 Thread via GitHub
lidavidm closed issue #33872: [C++] Replace shared_ptr creation hack before AppendScalarImpl instantiation URL: https://github.com/apache/arrow/issues/33872 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [arrow] pitrou opened a new issue, #33885: [C++] Improve compression strategy in IPC, Parquet

2023-01-26 Thread via GitHub
pitrou opened a new issue, #33885: URL: https://github.com/apache/arrow/issues/33885 ### Describe the enhancement requested Both Arrow IPC and the Parquet format allow optional compression of data buffers. Currently, the heuristic used in the Arrow C++ codebase is simple: try to c

[GitHub] [arrow-adbc] zeroshade opened a new issue, #401: [Go] Improve test suite for sqldriver pkg

2023-01-26 Thread via GitHub
zeroshade opened a new issue, #401: URL: https://github.com/apache/arrow-adbc/issues/401 Right now the tests for the `database/sql` wrapper for ADBC is very minimal so I need to get around to improving that test suite to better test actually fetching data of various types and confirm the co

[GitHub] [arrow-adbc] lidavidm closed issue #388: [CI] Conda package is still bundling the shared library on accident

2023-01-26 Thread via GitHub
lidavidm closed issue #388: [CI] Conda package is still bundling the shared library on accident URL: https://github.com/apache/arrow-adbc/issues/388 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [arrow] westonpace closed issue #33566: [C++] Error consuming Substrait plan which uses count function: "only unary aggregate functions are currently supported"

2023-01-26 Thread via GitHub
westonpace closed issue #33566: [C++] Error consuming Substrait plan which uses count function: "only unary aggregate functions are currently supported" URL: https://github.com/apache/arrow/issues/33566 -- This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [arrow] zeroshade opened a new issue, #33887: [Go] cdata package leaks handles, difficulty debugging

2023-01-26 Thread via GitHub
zeroshade opened a new issue, #33887: URL: https://github.com/apache/arrow/issues/33887 ### Describe the bug, including details regarding any error messages, version, and platform. When the "misuse of cgo.Handle" issue was fixed for #33864, it looks like we forgot to call `free` on t

[GitHub] [arrow] westonpace opened a new issue, #33888: [Python][C++] Add controls to disable metadata caching in datasets

2023-01-26 Thread via GitHub
westonpace opened a new issue, #33888: URL: https://github.com/apache/arrow/issues/33888 ### Describe the enhancement requested Currently, when scanning a dataset, in `ParquetFileFragment`, we save the metadata (and statistics I think) as we scan. The idea is that this will make rep

[GitHub] [arrow-julia] Moelf opened a new issue, #383: How to serialize customize type column

2023-01-26 Thread via GitHub
Moelf opened a new issue, #383: URL: https://github.com/apache/arrow-julia/issues/383 ```julia julia> struct CardinalityVector{T} <: AbstractVector{T} vec::Vector{T} end julia> Base.getindex(a::CardinalityVector, i::Int) = a.vec[i+1] - a.vec[i] julia>

[GitHub] [arrow] zeroshade closed issue #33887: [Go] cdata package leaks handles, difficulty debugging

2023-01-26 Thread via GitHub
zeroshade closed issue #33887: [Go] cdata package leaks handles, difficulty debugging URL: https://github.com/apache/arrow/issues/33887 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [arrow] jorisvandenbossche closed issue #33377: [Python] Table.drop should support passing a single column

2023-02-03 Thread via GitHub
jorisvandenbossche closed issue #33377: [Python] Table.drop should support passing a single column URL: https://github.com/apache/arrow/issues/33377 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [arrow] abetomo opened a new issue, #34029: [Docs] Build fails due to missing Ninja.

2023-02-03 Thread via GitHub
abetomo opened a new issue, #34029: URL: https://github.com/apache/arrow/issues/34029 ### Describe the bug, including details regarding any error messages, version, and platform. I built it on Ubuntu22.04 according to [Building Arrow C++](https://arrow.apache.org/docs/dev/developers/

[GitHub] [arrow] jorisvandenbossche opened a new issue, #34031: [Python] Use PyCapsule for communicating C Data Interface pointers at the Python level

2023-02-03 Thread via GitHub
jorisvandenbossche opened a new issue, #34031: URL: https://github.com/apache/arrow/issues/34031 ### Describe the enhancement requested Currently we have the various `_export_to_c` / `_import_from_c` methods for working with the Arrow C Interface that expect integers as arguments for

<    4   5   6   7   8   9   10   11   12   13   >