GitHub user jianlirong added a comment to the discussion: Apache Cloudberry through ODBC into Apache Arrow (adbcBridge 0.1.0) — is multi-argument unnest a safe bulk-ingest path on Cloudberry?
The performance result is quite impressive: landing 5,000 rows through UNNEST is roughly an order of magnitude faster than the multi-row INSERT path (~530k vs. ~33k rows/s, using bare SQL on a shared host). I think this is a capability we should make sure to preserve and support in future Cloudberry releases. It would also be worth recommending this approach to users, application developers, ETL tools, and database driver developers as a preferred bulk-ingest method where applicable. Making better use of this capability could provide a significant improvement in data ingestion performance without requiring major changes to the underlying database architecture. Lirong GitHub link: https://github.com/apache/cloudberry/discussions/1939#discussioncomment-18522787 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
