[GitHub] [arrow-adbc] kylebarron opened a new issue, #546: Support for Postgres extension types?

2023-03-24 Thread via GitHub
kylebarron opened a new issue, #546: URL: https://github.com/apache/arrow-adbc/issues/546 This question might be too premature at this time for ADBC, but I'm wondering if anyone has given any thought to how a user might extend ADBC's default types. In particular, I'm curious if it wo

[GitHub] [arrow] kou closed issue #34670: [Packaging][C++] gdb integration is not compatible with conda packaging

2023-03-24 Thread via GitHub
kou closed issue #34670: [Packaging][C++] gdb integration is not compatible with conda packaging URL: https://github.com/apache/arrow/issues/34670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow-adbc] lidavidm closed issue #543: ci: also run Python PostgreSQL tests in integration pipeline

2023-03-24 Thread via GitHub
lidavidm closed issue #543: ci: also run Python PostgreSQL tests in integration pipeline URL: https://github.com/apache/arrow-adbc/issues/543 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [arrow] westonpace closed issue #33317: [C++] Utility method to ensure an array object meetings an alignment requirement

2023-03-24 Thread via GitHub
westonpace closed issue #33317: [C++] Utility method to ensure an array object meetings an alignment requirement URL: https://github.com/apache/arrow/issues/33317 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [arrow] assignUser closed issue #33721: [R][CI] MacOS install from local job is failing

2023-03-24 Thread via GitHub
assignUser closed issue #33721: [R][CI] MacOS install from local job is failing URL: https://github.com/apache/arrow/issues/33721 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow-adbc] lidavidm opened a new issue, #541: [Format] Add more ingest modes

2023-03-24 Thread via GitHub
lidavidm opened a new issue, #541: URL: https://github.com/apache/arrow-adbc/issues/541 We could add more ingest modes to make things easier on integrations like Polars: https://github.com/pola-rs/polars/blob/702f72a57a1ab2be796679e4facc0d1957a67cc9/py-polars/polars/dataframe/frame.p

[GitHub] [arrow] westonpace closed issue #34564: [Python] Building with Cython 3 shows warnings

2023-03-24 Thread via GitHub
westonpace closed issue #34564: [Python] Building with Cython 3 shows warnings URL: https://github.com/apache/arrow/issues/34564 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow-adbc] lidavidm opened a new issue, #540: c/driver/postgresql: support non-SELECT queries in ExecuteQuery

2023-03-24 Thread via GitHub
lidavidm opened a new issue, #540: URL: https://github.com/apache/arrow-adbc/issues/540 Right now unless you ExecuteUpdate, it will always try to infer the schema and use COPY. We could fall back to executing the query normally and not using COPY to handle things like CREATE/DROP TABLE (sin

[GitHub] [arrow-adbc] lidavidm opened a new issue, #539: python/adbc_driver_postgres: add integration test with polars

2023-03-24 Thread via GitHub
lidavidm opened a new issue, #539: URL: https://github.com/apache/arrow-adbc/issues/539 Polars added basic ADBC support, but #538 pointed out some issues. Set up a basic integration test to catch these. -- This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [arrow] alippai opened a new issue, #34727: Cast kernel between int32, date and string for partition columns

2023-03-24 Thread via GitHub
alippai opened a new issue, #34727: URL: https://github.com/apache/arrow/issues/34727 ### Describe the enhancement requested Dataset filters on partition values can be hard to define using pyarrow. Eg. `type=0/date=2023-01-01/0.parquet` needs filters `("type", "=", 0)` and `("d

[GitHub] [arrow-testing] lidavidm commented on pull request #89: feat: data to test java substrait consumer

2023-03-24 Thread via GitHub
lidavidm commented on PR #89: URL: https://github.com/apache/arrow-testing/pull/89#issuecomment-1483042421 OK, then I think what needs to happen here is just check in a Java file (maybe something that'll work with jshell?) showing how to generate the plans given the SQL files, and address t

[GitHub] [arrow-testing] westonpace commented on pull request #89: feat: data to test java substrait consumer

2023-03-24 Thread via GitHub
westonpace commented on PR #89: URL: https://github.com/apache/arrow-testing/pull/89#issuecomment-1483005640 > Though to start with I'm not sure if it even needs to be automated per se. Agreed. As long as the source SQL files are stored alongside the Substrait files, with a detailed

[GitHub] [arrow] westonpace closed issue #34638: [C++][Docs] Add documentation for minimal build flags

2023-03-24 Thread via GitHub
westonpace closed issue #34638: [C++][Docs] Add documentation for minimal build flags URL: https://github.com/apache/arrow/issues/34638 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [arrow] westonpace closed issue #33957: [C++] Add Rank chunked array benchmarks

2023-03-24 Thread via GitHub
westonpace closed issue #33957: [C++] Add Rank chunked array benchmarks URL: https://github.com/apache/arrow/issues/33957 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [arrow] js8544 closed issue #34702: [C++] BaseBinaryBuilder::Reserve doesn't reserve offsets_builder_

2023-03-24 Thread via GitHub
js8544 closed issue #34702: [C++] BaseBinaryBuilder::Reserve doesn't reserve offsets_builder_ URL: https://github.com/apache/arrow/issues/34702 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [arrow] westonpace closed issue #34619: [C++] "take" kernel crashes on ExtensionArrays w/ underlying dictionary type

2023-03-24 Thread via GitHub
westonpace closed issue #34619: [C++] "take" kernel crashes on ExtensionArrays w/ underlying dictionary type URL: https://github.com/apache/arrow/issues/34619 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [arrow] yevgenypats opened a new issue, #34724: [Go][Table] Data Manipulation

2023-03-24 Thread via GitHub
yevgenypats opened a new issue, #34724: URL: https://github.com/apache/arrow/issues/34724 ### Describe the enhancement requested Looks like the python implementation has some nice [helper](https://arrow.apache.org/cookbook/py/data.html#adding-a-column-to-an-existing-table) functions

[GitHub] [arrow] kou closed issue #34700: [Packaging][RPM] arrow-libs can depend on lz4-libs instead of lz4 on AlmaLinux 8 or later

2023-03-24 Thread via GitHub
kou closed issue #34700: [Packaging][RPM] arrow-libs can depend on lz4-libs instead of lz4 on AlmaLinux 8 or later URL: https://github.com/apache/arrow/issues/34700 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [arrow-adbc] mavestergaard opened a new issue, #538: RuntimeError: Cannot close AdbcConnection with open AdbcStatement

2023-03-24 Thread via GitHub
mavestergaard opened a new issue, #538: URL: https://github.com/apache/arrow-adbc/issues/538 I am using polars library to write to Azure Postgre SQL DB. This is my code: ``` import polars as pl from datetime import datetime data = { 'text': ['foo', 'bar', 'baz'],

[GitHub] [arrow] dalle opened a new issue, #34723: Incorrect memory usage log statement

2023-03-24 Thread via GitHub
dalle opened a new issue, #34723: URL: https://github.com/apache/arrow/issues/34723 ### Describe the bug, including details regarding any error messages, version, and platform. The log statement here: https://github.com/apache/arrow/blob/45918a90a6ca1cf3fd67c256a7d6a240249e555a/ja

[GitHub] [arrow] mapleFU opened a new issue, #34722: [C++][Parquet] Minor: Declare lifetime of `shared_ptr` on PageReader

2023-03-24 Thread via GitHub
mapleFU opened a new issue, #34722: URL: https://github.com/apache/arrow/issues/34722 ### Describe the enhancement requested In C++ Parquet, `SerializedPageReader` holds a `decryption_buffer_` and `decompression_buffer_`, and when `NextPage` called, it will reuse that buffer. So, `Pa

[GitHub] [arrow] gmintoco opened a new issue, #34721: [Go] Improved building of structs into arrow record

2023-03-24 Thread via GitHub
gmintoco opened a new issue, #34721: URL: https://github.com/apache/arrow/issues/34721 ### Describe the enhancement requested Hi, I recently made a post on the mailing list but I thought this might make more sense as a location to communicate. I am using Arrow for Go mostly to

[GitHub] [arrow] kou closed issue #34595: [Python] GCS FileSystem - support federated identity

2023-03-24 Thread via GitHub
kou closed issue #34595: [Python] GCS FileSystem - support federated identity URL: https://github.com/apache/arrow/issues/34595 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.