[GitHub] [arrow] kou closed issue #34595: [Python] GCS FileSystem - support federated identity

2023-03-24 Thread via GitHub
kou closed issue #34595: [Python] GCS FileSystem - support federated identity URL: https://github.com/apache/arrow/issues/34595 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow] gmintoco opened a new issue, #34721: [Go] Improved building of structs into arrow record

2023-03-24 Thread via GitHub
gmintoco opened a new issue, #34721: URL: https://github.com/apache/arrow/issues/34721 ### Describe the enhancement requested Hi, I recently made a post on the mailing list but I thought this might make more sense as a location to communicate. I am using Arrow for Go mostly to

[GitHub] [arrow] mapleFU opened a new issue, #34722: [C++][Parquet] Minor: Declare lifetime of `shared_ptr` on PageReader

2023-03-24 Thread via GitHub
mapleFU opened a new issue, #34722: URL: https://github.com/apache/arrow/issues/34722 ### Describe the enhancement requested In C++ Parquet, `SerializedPageReader` holds a `decryption_buffer_` and `decompression_buffer_`, and when `NextPage` called, it will reuse that buffer. So, `Pa

[GitHub] [arrow] dalle opened a new issue, #34723: Incorrect memory usage log statement

2023-03-24 Thread via GitHub
dalle opened a new issue, #34723: URL: https://github.com/apache/arrow/issues/34723 ### Describe the bug, including details regarding any error messages, version, and platform. The log statement here: https://github.com/apache/arrow/blob/45918a90a6ca1cf3fd67c256a7d6a240249e555a/ja

[GitHub] [arrow-adbc] mavestergaard opened a new issue, #538: RuntimeError: Cannot close AdbcConnection with open AdbcStatement

2023-03-24 Thread via GitHub
mavestergaard opened a new issue, #538: URL: https://github.com/apache/arrow-adbc/issues/538 I am using polars library to write to Azure Postgre SQL DB. This is my code: ``` import polars as pl from datetime import datetime data = { 'text': ['foo', 'bar', 'baz'],

[GitHub] [arrow] kou closed issue #34700: [Packaging][RPM] arrow-libs can depend on lz4-libs instead of lz4 on AlmaLinux 8 or later

2023-03-24 Thread via GitHub
kou closed issue #34700: [Packaging][RPM] arrow-libs can depend on lz4-libs instead of lz4 on AlmaLinux 8 or later URL: https://github.com/apache/arrow/issues/34700 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [arrow] yevgenypats opened a new issue, #34724: [Go][Table] Data Manipulation

2023-03-24 Thread via GitHub
yevgenypats opened a new issue, #34724: URL: https://github.com/apache/arrow/issues/34724 ### Describe the enhancement requested Looks like the python implementation has some nice [helper](https://arrow.apache.org/cookbook/py/data.html#adding-a-column-to-an-existing-table) functions

[GitHub] [arrow] westonpace closed issue #34619: [C++] "take" kernel crashes on ExtensionArrays w/ underlying dictionary type

2023-03-24 Thread via GitHub
westonpace closed issue #34619: [C++] "take" kernel crashes on ExtensionArrays w/ underlying dictionary type URL: https://github.com/apache/arrow/issues/34619 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [arrow] js8544 closed issue #34702: [C++] BaseBinaryBuilder::Reserve doesn't reserve offsets_builder_

2023-03-24 Thread via GitHub
js8544 closed issue #34702: [C++] BaseBinaryBuilder::Reserve doesn't reserve offsets_builder_ URL: https://github.com/apache/arrow/issues/34702 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [arrow] westonpace closed issue #33957: [C++] Add Rank chunked array benchmarks

2023-03-24 Thread via GitHub
westonpace closed issue #33957: [C++] Add Rank chunked array benchmarks URL: https://github.com/apache/arrow/issues/33957 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [arrow] westonpace closed issue #34638: [C++][Docs] Add documentation for minimal build flags

2023-03-24 Thread via GitHub
westonpace closed issue #34638: [C++][Docs] Add documentation for minimal build flags URL: https://github.com/apache/arrow/issues/34638 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [arrow-testing] westonpace commented on pull request #89: feat: data to test java substrait consumer

2023-03-24 Thread via GitHub
westonpace commented on PR #89: URL: https://github.com/apache/arrow-testing/pull/89#issuecomment-1483005640 > Though to start with I'm not sure if it even needs to be automated per se. Agreed. As long as the source SQL files are stored alongside the Substrait files, with a detailed

[GitHub] [arrow-testing] lidavidm commented on pull request #89: feat: data to test java substrait consumer

2023-03-24 Thread via GitHub
lidavidm commented on PR #89: URL: https://github.com/apache/arrow-testing/pull/89#issuecomment-1483042421 OK, then I think what needs to happen here is just check in a Java file (maybe something that'll work with jshell?) showing how to generate the plans given the SQL files, and address t

[GitHub] [arrow] alippai opened a new issue, #34727: Cast kernel between int32, date and string for partition columns

2023-03-24 Thread via GitHub
alippai opened a new issue, #34727: URL: https://github.com/apache/arrow/issues/34727 ### Describe the enhancement requested Dataset filters on partition values can be hard to define using pyarrow. Eg. `type=0/date=2023-01-01/0.parquet` needs filters `("type", "=", 0)` and `("d

[GitHub] [arrow-adbc] lidavidm opened a new issue, #539: python/adbc_driver_postgres: add integration test with polars

2023-03-24 Thread via GitHub
lidavidm opened a new issue, #539: URL: https://github.com/apache/arrow-adbc/issues/539 Polars added basic ADBC support, but #538 pointed out some issues. Set up a basic integration test to catch these. -- This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [arrow-adbc] lidavidm opened a new issue, #540: c/driver/postgresql: support non-SELECT queries in ExecuteQuery

2023-03-24 Thread via GitHub
lidavidm opened a new issue, #540: URL: https://github.com/apache/arrow-adbc/issues/540 Right now unless you ExecuteUpdate, it will always try to infer the schema and use COPY. We could fall back to executing the query normally and not using COPY to handle things like CREATE/DROP TABLE (sin

[GitHub] [arrow] westonpace closed issue #34564: [Python] Building with Cython 3 shows warnings

2023-03-24 Thread via GitHub
westonpace closed issue #34564: [Python] Building with Cython 3 shows warnings URL: https://github.com/apache/arrow/issues/34564 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow-adbc] lidavidm opened a new issue, #541: [Format] Add more ingest modes

2023-03-24 Thread via GitHub
lidavidm opened a new issue, #541: URL: https://github.com/apache/arrow-adbc/issues/541 We could add more ingest modes to make things easier on integrations like Polars: https://github.com/pola-rs/polars/blob/702f72a57a1ab2be796679e4facc0d1957a67cc9/py-polars/polars/dataframe/frame.p

[GitHub] [arrow] assignUser closed issue #33721: [R][CI] MacOS install from local job is failing

2023-03-24 Thread via GitHub
assignUser closed issue #33721: [R][CI] MacOS install from local job is failing URL: https://github.com/apache/arrow/issues/33721 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow] westonpace closed issue #33317: [C++] Utility method to ensure an array object meetings an alignment requirement

2023-03-24 Thread via GitHub
westonpace closed issue #33317: [C++] Utility method to ensure an array object meetings an alignment requirement URL: https://github.com/apache/arrow/issues/33317 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [arrow-adbc] lidavidm closed issue #543: ci: also run Python PostgreSQL tests in integration pipeline

2023-03-24 Thread via GitHub
lidavidm closed issue #543: ci: also run Python PostgreSQL tests in integration pipeline URL: https://github.com/apache/arrow-adbc/issues/543 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [arrow] kou closed issue #34670: [Packaging][C++] gdb integration is not compatible with conda packaging

2023-03-24 Thread via GitHub
kou closed issue #34670: [Packaging][C++] gdb integration is not compatible with conda packaging URL: https://github.com/apache/arrow/issues/34670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow-adbc] kylebarron opened a new issue, #546: Support for Postgres extension types?

2023-03-24 Thread via GitHub
kylebarron opened a new issue, #546: URL: https://github.com/apache/arrow-adbc/issues/546 This question might be too premature at this time for ADBC, but I'm wondering if anyone has given any thought to how a user might extend ADBC's default types. In particular, I'm curious if it wo

[GitHub] [arrow-adbc] CoderYellow opened a new issue, #547: Support for Project Reactor

2023-03-25 Thread via GitHub
CoderYellow opened a new issue, #547: URL: https://github.com/apache/arrow-adbc/issues/547 Something like https://r2dbc.io/spec/0.8.0.RELEASE/spec/html/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [arrow] kou closed issue #15285: [GLib] Add support for MatchSubstringOptions

2023-03-25 Thread via GitHub
kou closed issue #15285: [GLib] Add support for MatchSubstringOptions URL: https://github.com/apache/arrow/issues/15285 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [arrow-adbc] kou opened a new issue, #548: [GLib] Add gadbc_connection_get_info()

2023-03-25 Thread via GitHub
kou opened a new issue, #548: URL: https://github.com/apache/arrow-adbc/issues/548 It's for `AdbcConnectionGetInfo()`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [arrow-adbc] kou opened a new issue, #549: [GLib] Add gadbc_connection_get_table_schema()

2023-03-25 Thread via GitHub
kou opened a new issue, #549: URL: https://github.com/apache/arrow-adbc/issues/549 It's for `AdbcConnectionGetTableSchema()`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow-adbc] kou opened a new issue, #550: [GLib] Add gadbc_connection_get_table_types()

2023-03-25 Thread via GitHub
kou opened a new issue, #550: URL: https://github.com/apache/arrow-adbc/issues/550 It's for `AdbcConnectionGetTableTypes()`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow-adbc] kou opened a new issue, #551: [GLib] Add gadbc_connection_{commit,rollback}() and gadbc_connection_{get,set}_auto_commit()

2023-03-25 Thread via GitHub
kou opened a new issue, #551: URL: https://github.com/apache/arrow-adbc/issues/551 They are for: * `AdbcConnectionCommit()` * `AdbcConnectionRollback()` * `ADBC_CONNECTION_OPTION_AUTO_COMMIT` -- This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [arrow-adbc] kou opened a new issue, #552: [GLib] Add gadbc_connection_set_read_only()

2023-03-25 Thread via GitHub
kou opened a new issue, #552: URL: https://github.com/apache/arrow-adbc/issues/552 It's for `ADBC_CONNECTION_OPTION_READ_ONLY`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [arrow-adbc] kou opened a new issue, #553: [GLib] Add gadbc_connection_set_isolation_level()

2023-03-25 Thread via GitHub
kou opened a new issue, #553: URL: https://github.com/apache/arrow-adbc/issues/553 It's for `ADBC_CONNECTION_OPTION_ISOLATION_LEVEL`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [arrow-adbc] kou opened a new issue, #554: c/driver/sqlite: AdbcGetConnectionGetTableTypes() uses string not uint8 for table_type

2023-03-25 Thread via GitHub
kou opened a new issue, #554: URL: https://github.com/apache/arrow-adbc/issues/554 https://github.com/apache/arrow-adbc/blob/apache-arrow-adbc-0.3.0/adbc.h#L940-L954 says `table_type` is `uint8` but the SQLite driver uses `string`: https://github.com/apache/arrow-adbc/blob/apache-arrow-adb

[GitHub] [arrow] mikelui opened a new issue, #34729: Better support for Maps in Pandas

2023-03-25 Thread via GitHub
mikelui opened a new issue, #34729: URL: https://github.com/apache/arrow/issues/34729 ### Describe the enhancement requested Today (Py)Arrow -> Pandas treats: 1. structs as Python dicts (pydicts) 2. maps as Python list of tuples (i.e. [(key1, value1), (key2, value2), ...]

[GitHub] [arrow] lupko opened a new issue, #34731: [Python] FlightStreamReader does not release GIL in to_reader() method

2023-03-26 Thread via GitHub
lupko opened a new issue, #34731: URL: https://github.com/apache/arrow/issues/34731 ### Describe the bug, including details regarding any error messages, version, and platform. `FlightStreamReader.to_reader()` does not release GIL as it creates the RecordBatchReader via call to `Make

[GitHub] [arrow] kou closed issue #33800: [Packaging] Drop support for Ubuntu 18.04

2023-03-26 Thread via GitHub
kou closed issue #33800: [Packaging] Drop support for Ubuntu 18.04 URL: https://github.com/apache/arrow/issues/33800 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

[GitHub] [arrow] wjones127 opened a new issue, #34736: [C#] Support new data types

2023-03-26 Thread via GitHub
wjones127 opened a new issue, #34736: URL: https://github.com/apache/arrow/issues/34736 ### Describe the enhancement requested The C# implementation still needs to add support for: * [ ] Float 16 #25163 * [ ] MapType * [ ] LargeString / LargeBinary / LargeList * [ ]

[GitHub] [arrow] veryhannibal opened a new issue, #34738: Plasma is deprecated

2023-03-26 Thread via GitHub
veryhannibal opened a new issue, #34738: URL: https://github.com/apache/arrow/issues/34738 ### Describe the usage question you have. Please include as many useful details as possible. Hi, I found that the Plasma is deprecated and will be removed soon. Do you provide new comp

[GitHub] [arrow] kou closed issue #34738: Plasma is deprecated

2023-03-26 Thread via GitHub
kou closed issue #34738: Plasma is deprecated URL: https://github.com/apache/arrow/issues/34738 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-u

[GitHub] [arrow] raulcd closed issue #34687: [CI][Python] Set up automated cleaning for old nightly wheels on gemfury

2023-03-27 Thread via GitHub
raulcd closed issue #34687: [CI][Python] Set up automated cleaning for old nightly wheels on gemfury URL: https://github.com/apache/arrow/issues/34687 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] thisisnic closed issue #33402: [R] Better error message when creating an array from decimals

2023-03-27 Thread via GitHub
thisisnic closed issue #33402: [R] Better error message when creating an array from decimals URL: https://github.com/apache/arrow/issues/33402 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [arrow] agagrins opened a new issue, #34739: Cannot append nullable string columns to table

2023-03-27 Thread via GitHub
agagrins opened a new issue, #34739: URL: https://github.com/apache/arrow/issues/34739 ### Describe the bug, including details regarding any error messages, version, and platform. ## Issue Description It seems not possible to be able to append a nullable column to a table.

[GitHub] [arrow] lidavidm opened a new issue, #34741: [Java] Flaky test `ArrowFlightPreparedStatementTest.testPreparedStatementExecutionOnce` in JDBC Flight SQL driver

2023-03-27 Thread via GitHub
lidavidm opened a new issue, #34741: URL: https://github.com/apache/arrow/issues/34741 ### Describe the bug, including details regarding any error messages, version, and platform. https://github.com/apache/arrow/actions/runs/4527686135/jobs/7973768071?pr=34678 ``` Error:

[GitHub] [arrow] lidavidm opened a new issue, #34742: [Java] Split flight-sql-jdbc-driver to allow reuse of some internals

2023-03-27 Thread via GitHub
lidavidm opened a new issue, #34742: URL: https://github.com/apache/arrow/issues/34742 ### Describe the enhancement requested Continuing discussion from https://github.com/apache/arrow/issues/20730#issuecomment-1451989813 it may be useful to allow applications to use some of the JDBC

[GitHub] [arrow] lidavidm closed issue #20730: [Java] Arrow-to-JDBC

2023-03-27 Thread via GitHub
lidavidm closed issue #20730: [Java] Arrow-to-JDBC URL: https://github.com/apache/arrow/issues/20730 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: iss

[GitHub] [arrow] lidavidm closed issue #34742: [Java] Split flight-sql-jdbc-driver to allow reuse of some internals

2023-03-27 Thread via GitHub
lidavidm closed issue #34742: [Java] Split flight-sql-jdbc-driver to allow reuse of some internals URL: https://github.com/apache/arrow/issues/34742 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [arrow] agagrins closed issue #34739: [Python] Cannot append nullable string columns to table

2023-03-27 Thread via GitHub
agagrins closed issue #34739: [Python] Cannot append nullable string columns to table URL: https://github.com/apache/arrow/issues/34739 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [arrow] lidavidm opened a new issue, #34743: [Python] `test_flight.test_generic_options` is consistently failing on `AMD64 MacOS Python 3`

2023-03-27 Thread via GitHub
lidavidm opened a new issue, #34743: URL: https://github.com/apache/arrow/issues/34743 ### Describe the bug, including details regarding any error messages, version, and platform. Observed over several PRs/main ``` === FAILURES ==

[GitHub] [arrow] lidavidm closed issue #34731: [Python] MetadataRecordBatchReader does not release GIL in to_reader() method

2023-03-27 Thread via GitHub
lidavidm closed issue #34731: [Python] MetadataRecordBatchReader does not release GIL in to_reader() method URL: https://github.com/apache/arrow/issues/34731 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [arrow-julia] palday closed issue #391: Precompilation broken on Julia 1.9-rc1

2023-03-27 Thread via GitHub
palday closed issue #391: Precompilation broken on Julia 1.9-rc1 URL: https://github.com/apache/arrow-julia/issues/391 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

[GitHub] [arrow] teo-tsirpanis opened a new issue, #34746: [C#] Add support for Tensors.

2023-03-27 Thread via GitHub
teo-tsirpanis opened a new issue, #34746: URL: https://github.com/apache/arrow/issues/34746 ### Describe the enhancement requested I am developing a C# project that uses Apache Arrow and needs Tensors. I will add support for them soon. Opening this issue to track progress and ask any

[GitHub] [arrow-adbc] lidavidm opened a new issue, #557: c/driver/postgresql: strings do not round-trip properly through ingest/select

2023-03-27 Thread via GitHub
lidavidm opened a new issue, #557: URL: https://github.com/apache/arrow-adbc/issues/557 ``` [ RUN ] PostgresStatementTest.SqlIngestString NOTICE: table "bulk_ingest" does not exist, skipping /home/lidavidm/Code/upstream/adbc/arrow-adbc/c/validation/adbc_validation_util.h:363:

[GitHub] [arrow-adbc] lidavidm opened a new issue, #558: ci: refactor Dremio test setup into a docker-compose setup

2023-03-27 Thread via GitHub
lidavidm opened a new issue, #558: URL: https://github.com/apache/arrow-adbc/issues/558 That way it can be replicated locally. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [arrow] westonpace closed issue #34639: [Python] Info about offset is loss when converting struct array to record batch

2023-03-27 Thread via GitHub
westonpace closed issue #34639: [Python] Info about offset is loss when converting struct array to record batch URL: https://github.com/apache/arrow/issues/34639 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [arrow-julia] kazuakiyama opened a new issue, #410: Official support for the Apache Parquet format

2023-03-27 Thread via GitHub
kazuakiyama opened a new issue, #410: URL: https://github.com/apache/arrow-julia/issues/410 I'm a radio astronomer interested in using this Julia-native implementation of the Apache Arrow in-memory format for black hole imaging with the [Event Horizon Telescope](https://eventhorizontelescop

[GitHub] [arrow] viirya opened a new issue, #34749: [Java] ZstdCompressionCodec uses hard-coding compression level which cannot be configurable

2023-03-27 Thread via GitHub
viirya opened a new issue, #34749: URL: https://github.com/apache/arrow/issues/34749 ### Describe the enhancement requested ArrowFileWriter/ArrowStreamWriter add compression support for 12.0.0-dev. But [ZstdCompressionCodec](https://github.com/apache/arrow/blob/196fbe5f5e0669b1f8bf71

[GitHub] [arrow-adbc] kou closed issue #554: c/driver/sqlite: AdbcGetConnectionGetTableTypes() uses string not uint8 for table_type

2023-03-27 Thread via GitHub
kou closed issue #554: c/driver/sqlite: AdbcGetConnectionGetTableTypes() uses string not uint8 for table_type URL: https://github.com/apache/arrow-adbc/issues/554 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [arrow] eerhardt closed issue #25163: [C#] Support Float16

2023-03-27 Thread via GitHub
eerhardt closed issue #25163: [C#] Support Float16 URL: https://github.com/apache/arrow/issues/25163 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: iss

[GitHub] [arrow] westonpace closed issue #34633: [C++][Parquet] Can't read converted type DECIMAL in Parquet Stream Reader C++ API

2023-03-27 Thread via GitHub
westonpace closed issue #34633: [C++][Parquet] Can't read converted type DECIMAL in Parquet Stream Reader C++ API URL: https://github.com/apache/arrow/issues/34633 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [arrow] westonpace closed issue #34346: [C++] Allow the CSV reader to read zero columns

2023-03-27 Thread via GitHub
westonpace closed issue #34346: [C++] Allow the CSV reader to read zero columns URL: https://github.com/apache/arrow/issues/34346 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow] jayshrivastava opened a new issue, #34751: [Go] parquet: how do you implement and read custom logical types?

2023-03-27 Thread via GitHub
jayshrivastava opened a new issue, #34751: URL: https://github.com/apache/arrow/issues/34751 ### Describe the usage question you have. Please include as many useful details as possible. What is the correct way to implement a custom logical type? I'm having trouble reading my cus

[GitHub] [arrow-adbc] lidavidm closed issue #537: python/adbc_driver_manager: expose StatementGetParameterSchema

2023-03-27 Thread via GitHub
lidavidm closed issue #537: python/adbc_driver_manager: expose StatementGetParameterSchema URL: https://github.com/apache/arrow-adbc/issues/537 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [arrow-adbc] lidavidm closed issue #550: [GLib] Add gadbc_connection_get_table_types()

2023-03-27 Thread via GitHub
lidavidm closed issue #550: [GLib] Add gadbc_connection_get_table_types() URL: https://github.com/apache/arrow-adbc/issues/550 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [arrow-adbc] lidavidm closed issue #197: [C] Improve type coverage in standard test suite

2023-03-27 Thread via GitHub
lidavidm closed issue #197: [C] Improve type coverage in standard test suite URL: https://github.com/apache/arrow-adbc/issues/197 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow] liujiacheng777 opened a new issue, #34752: Failed building on LoongArch platform

2023-03-27 Thread via GitHub
liujiacheng777 opened a new issue, #34752: URL: https://github.com/apache/arrow/issues/34752 ### Describe the bug, including details regarding any error messages, version, and platform. ``` loongson@loongson-pc:~/tmp/arrow/cpp/build$ arch loongarch64 loongson@loongson-pc:~/tm

[GitHub] [arrow] sanjibansg opened a new issue, #34753: [C++] Nightly builds failing with EnsureAlignment

2023-03-28 Thread via GitHub
sanjibansg opened a new issue, #34753: URL: https://github.com/apache/arrow/issues/34753 ### Describe the bug, including details regarding any error messages, version, and platform. In reference to #33317, the nightly builds are failing after PR #14758 was merged. More detail

[GitHub] [arrow] hinxx closed issue #34486: Converting arrow sparse_union table to pandas dataframe

2023-03-28 Thread via GitHub
hinxx closed issue #34486: Converting arrow sparse_union table to pandas dataframe URL: https://github.com/apache/arrow/issues/34486 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[GitHub] [arrow] AlenkaF closed issue #32356: [Python] Improving Classes and Methods Docstrings - Type Classes

2023-03-28 Thread via GitHub
AlenkaF closed issue #32356: [Python] Improving Classes and Methods Docstrings - Type Classes URL: https://github.com/apache/arrow/issues/32356 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [arrow] AlenkaF closed issue #32342: [Python] Feather test failing on s390x travis CI job

2023-03-28 Thread via GitHub
AlenkaF closed issue #32342: [Python] Feather test failing on s390x travis CI job URL: https://github.com/apache/arrow/issues/32342 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [arrow] AlenkaF closed issue #32291: [Python] Running a substrait plan that includes an extension type returns results where the column.chunks attribute has an AttributeError

2023-03-28 Thread via GitHub
AlenkaF closed issue #32291: [Python] Running a substrait plan that includes an extension type returns results where the column.chunks attribute has an AttributeError URL: https://github.com/apache/arrow/issues/32291 -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [arrow] jorisvandenbossche closed issue #33727: [Python] array() errors if pandas categorical column has dictionary as string not object

2023-03-28 Thread via GitHub
jorisvandenbossche closed issue #33727: [Python] array() errors if pandas categorical column has dictionary as string not object URL: https://github.com/apache/arrow/issues/33727 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [arrow] jorisvandenbossche opened a new issue, #34755: [Python] How to handle chunked arrays output in pyarrow.array(...)

2023-03-28 Thread via GitHub
jorisvandenbossche opened a new issue, #34755: URL: https://github.com/apache/arrow/issues/34755 From https://github.com/apache/arrow/pull/34289#pullrequestreview-1355094099 Currently, the `pyarrow.array(..)` constructor is meant to create Array object, but can return a ChunkedArray i

[GitHub] [arrow] kou closed issue #34753: [C++] Nightly builds failing with EnsureAlignment

2023-03-28 Thread via GitHub
kou closed issue #34753: [C++] Nightly builds failing with EnsureAlignment URL: https://github.com/apache/arrow/issues/34753 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [arrow] jorisvandenbossche opened a new issue, #34756: [Python][CI] Add a test build using Cython 3

2023-03-28 Thread via GitHub
jorisvandenbossche opened a new issue, #34756: URL: https://github.com/apache/arrow/issues/34756 See https://github.com/apache/arrow/issues/34564. PR https://github.com/apache/arrow/pull/34726 fixed the warnings/errors when building pyarrow with current Cython 3 beta. To ensure this

[GitHub] [arrow] ateknur opened a new issue, #34757: ERROR: Failed building wheel for pyarrow

2023-03-28 Thread via GitHub
ateknur opened a new issue, #34757: URL: https://github.com/apache/arrow/issues/34757 ### Describe the bug, including details regarding any error messages, version, and platform. • Installing pyarrow (11.0.0): Failed ChefBuildError Backend subprocess exited when tryi

[GitHub] [arrow] AlenkaF closed issue #34757: ERROR: Failed building wheel for pyarrow

2023-03-28 Thread via GitHub
AlenkaF closed issue #34757: ERROR: Failed building wheel for pyarrow URL: https://github.com/apache/arrow/issues/34757 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [arrow] shner-elmo opened a new issue, #34758: Batch much smaller than `batch_size` parameter

2023-03-28 Thread via GitHub
shner-elmo opened a new issue, #34758: URL: https://github.com/apache/arrow/issues/34758 ### Describe the bug, including details regarding any error messages, version, and platform. Hello, is this expected behavior? i.e. the size of each batch being much smaller than the `batch_siz

[GitHub] [arrow] mgahan opened a new issue, #34762: [R] Create feature to read in specific nested columns in Newline-delimited JSON file

2023-03-28 Thread via GitHub
mgahan opened a new issue, #34762: URL: https://github.com/apache/arrow/issues/34762 ### Describe the enhancement requested Stack Overflow Reference: https://stackoverflow.com/questions/75861075/is-there-a-way-to-read-a-nested-column I have a bunch of Newline-delimited J

[GitHub] [arrow-testing] davisusanibar commented on pull request #89: feat: data to test java substrait consumer

2023-03-28 Thread via GitHub
davisusanibar commented on PR #89: URL: https://github.com/apache/arrow-testing/pull/89#issuecomment-1487436650 Hi Team, Just close this PR. Let's start Java Substrait Consumer on the same way that Python/C++ Substrait plans were implemented (maintain the json plan on testing files).

[GitHub] [arrow-testing] davisusanibar closed pull request #89: feat: data to test java substrait consumer

2023-03-28 Thread via GitHub
davisusanibar closed pull request #89: feat: data to test java substrait consumer URL: https://github.com/apache/arrow-testing/pull/89 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [arrow] wjones127 closed issue #34696: [C++] ValidateRunEndEncoded does not check there is no null buffer

2023-03-28 Thread via GitHub
wjones127 closed issue #34696: [C++] ValidateRunEndEncoded does not check there is no null buffer URL: https://github.com/apache/arrow/issues/34696 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [arrow] davisusanibar opened a new issue, #34763: [Java][CI] Implement CI testing for Java JNI modules

2023-03-28 Thread via GitHub
davisusanibar opened a new issue, #34763: URL: https://github.com/apache/arrow/issues/34763 ### Describe the enhancement requested Currently, CI only considers Java Windows OS testing for modules other than JNI. It would be helpful to implement CI testing for JNI modules as wel

[GitHub] [arrow] kou closed issue #33243: [Plasma] Remove Plasma

2023-03-28 Thread via GitHub
kou closed issue #33243: [Plasma] Remove Plasma URL: https://github.com/apache/arrow/issues/33243 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues

[GitHub] [arrow] AlenkaF closed issue #14779: [C++] Compiling failed on Mac M1

2023-03-28 Thread via GitHub
AlenkaF closed issue #14779: [C++] Compiling failed on Mac M1 URL: https://github.com/apache/arrow/issues/14779 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [arrow] jorisvandenbossche closed issue #34579: [Python][Docs] TableGroupBy.aggregate options

2023-03-29 Thread via GitHub
jorisvandenbossche closed issue #34579: [Python][Docs] TableGroupBy.aggregate options URL: https://github.com/apache/arrow/issues/34579 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [arrow] jorisvandenbossche opened a new issue, #34768: [C++][Gandiva] Accept LLVM 16

2023-03-29 Thread via GitHub
jorisvandenbossche opened a new issue, #34768: URL: https://github.com/apache/arrow/issues/34768 Some builds started to pick up LLVM 16, while we currently only accept up to 15: https://github.com/apache/arrow/blob/24ba1cf75c01040b279514ecc063975de272b766/cpp/CMakeLists.txt#L130-L132

[GitHub] [arrow-adbc] lidavidm opened a new issue, #563: java/driver-manager: require supplying `BufferAllocator`

2023-03-29 Thread via GitHub
lidavidm opened a new issue, #563: URL: https://github.com/apache/arrow-adbc/issues/563 Also, get rid of the old registration methods and the static driver instances. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[GitHub] [arrow] baggiponte opened a new issue, #34770: Support `profile` kwarg in `S3FileSystem`

2023-03-29 Thread via GitHub
baggiponte opened a new issue, #34770: URL: https://github.com/apache/arrow/issues/34770 ### Describe the enhancement requested This relates to Python specifically, but I feel this could extend to other languages as well. `s3fs`'s `S3FileSystem` supports the `profile` keyword, that a

[GitHub] [arrow] CodiePP opened a new issue, #34771: compilation on FreeBSD/amd64

2023-03-29 Thread via GitHub
CodiePP opened a new issue, #34771: URL: https://github.com/apache/arrow/issues/34771 ### Describe the bug, including details regarding any error messages, version, and platform. compilation of the C++ arrow code was not working because the architecture is reported as `amd64`, but th

[GitHub] [arrow] honno opened a new issue, #34774: Interchange `pa.Table`'s `Column.null_count` doesn't count NaNs

2023-03-29 Thread via GitHub
honno opened a new issue, #34774: URL: https://github.com/apache/arrow/issues/34774 ### Describe the bug, including details regarding any error messages, version, and platform. It seems the interchange `Column.null_count()` ([relevant spec](https://github.com/data-apis/dataframe-api/

[GitHub] [arrow] daattali opened a new issue, #34775: [R] arrow_table: as.data.frame() sometimes returns a tbl and sometimes a data.frame

2023-03-29 Thread via GitHub
daattali opened a new issue, #34775: URL: https://github.com/apache/arrow/issues/34775 ### Describe the bug, including details regarding any error messages, version, and platform. The documentation for `arrow_table()` says that you can call `as.data.frame()` on an arrow table object

[GitHub] [arrow-adbc] lidavidm closed issue #477: [Java] driver/jdbc: No way to provide an external BufferAllocator to JdbcDriver or JdbcDatabase instances

2023-03-29 Thread via GitHub
lidavidm closed issue #477: [Java] driver/jdbc: No way to provide an external BufferAllocator to JdbcDriver or JdbcDatabase instances URL: https://github.com/apache/arrow-adbc/issues/477 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [arrow-adbc] lidavidm closed issue #476: [Java] driver/jdbc: Connection does not close its allocator

2023-03-29 Thread via GitHub
lidavidm closed issue #476: [Java] driver/jdbc: Connection does not close its allocator URL: https://github.com/apache/arrow-adbc/issues/476 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [arrow-adbc] lidavidm closed issue #561: docs: document that Python and C packages are available on conda-forge

2023-03-29 Thread via GitHub
lidavidm closed issue #561: docs: document that Python and C packages are available on conda-forge URL: https://github.com/apache/arrow-adbc/issues/561 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [arrow] aiguofer opened a new issue, #34778: [Java] Ability to register additional grpc services with FlightServer

2023-03-29 Thread via GitHub
aiguofer opened a new issue, #34778: URL: https://github.com/apache/arrow/issues/34778 ### Describe the enhancement requested We want to add the [gRPC health endpoint](https://github.com/grpc/grpc-java/blob/master/services/src/generated/main/grpc/io/grpc/health/v1/HealthGrpc.java) to

[GitHub] [arrow] pinduzera opened a new issue, #34779: [R] write_* methods can't have socketConnection as a sink

2023-03-29 Thread via GitHub
pinduzera opened a new issue, #34779: URL: https://github.com/apache/arrow/issues/34779 ### Describe the enhancement requested I am trying to make a straight write to a raw socket replicating the python's implementation. For some reason yet unknown to me, sending a raw vector combi

[GitHub] [arrow] kou closed issue #34771: [C++] Failed to compile on FreeBSD/amd64

2023-03-29 Thread via GitHub
kou closed issue #34771: [C++] Failed to compile on FreeBSD/amd64 URL: https://github.com/apache/arrow/issues/34771 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

[GitHub] [arrow] jeanetteclark opened a new issue, #34780: Seg fault on `write_dataset` with partition and threading

2023-03-29 Thread via GitHub
jeanetteclark opened a new issue, #34780: URL: https://github.com/apache/arrow/issues/34780 ### Describe the bug, including details regarding any error messages, version, and platform. Hi Arrow! I recently (with Arrow 11) have been getting a complete R crash when running `write_datas

[GitHub] [arrow] collimarco opened a new issue, #34781: Query a parquet file on S3 without downloading it (using byte ranges)

2023-03-29 Thread via GitHub
collimarco opened a new issue, #34781: URL: https://github.com/apache/arrow/issues/34781 ### Describe the usage question you have. Please include as many useful details as possible. I am new to this project and I am looking at the Ruby gem in particular: https://github.com

[GitHub] [arrow] endremborza opened a new issue, #34782: empty table changes datatpye from ns to us

2023-03-29 Thread via GitHub
endremborza opened a new issue, #34782: URL: https://github.com/apache/arrow/issues/34782 ### Describe the bug, including details regarding any error messages, version, and platform. Hello! I don't know if this is specific to python but seems quite straightforward. I didn't lo

[GitHub] [arrow-adbc] lidavidm opened a new issue, #565: java/driver/jdbc: getTableSchema for nonexistent table should raise an error

2023-03-29 Thread via GitHub
lidavidm opened a new issue, #565: URL: https://github.com/apache/arrow-adbc/issues/565 Currently (tested against Derby) it appears that we get an empty ResultSet and then return an empty schema, instead of erroring. -- This is an automated message from the Apache Git Service. To respond

<    14   15   16   17   18   19   20   21   22   23   >