ssvenkatesh opened a new issue, #45030: URL: https://github.com/apache/arrow/issues/45030
### Describe the usage question you have. Please include as many useful details as possible. I am trying to write using apache arrow to write & read data of 300 columns ,1000000 (1 million) rows. [arrow.txt](https://github.com/user-attachments/files/18139217/arrow.txt) I am getting the below error while trying to read or some times i get this meesage. $"Arrow IPC message body length ({message.BodyLength}) is larger than " + $"the maximum supported message size ({int.MaxValue})"); How to write and read huge data in c#? Apache.Arrow.dll!Apache.Arrow.Memory.MemoryAllocator.Allocate(int length) Line 59 C# Apache.Arrow.dll!Apache.Arrow.Ipc.ArrowStreamReaderImplementation.ReadMessage() Line 133 C# Apache.Arrow.dll!Apache.Arrow.Ipc.ArrowStreamReaderImplementation.ReadRecordBatch() Line 111 C# Apache.Arrow.dll!Apache.Arrow.Ipc.ArrowFileReaderImplementation.ReadNextRecordBatch() Line 202 C# > ArrowCSsample.exe!ArrowCSsample.ArrowTests.ReadRecordBatch(string folderPath, int length) Line 108 C# ArrowCSsample.exe!ArrowCSsample.ArrowTests.ReadUsingApacheArrow(ArrowCSsample.Options opts) Line 39 C# ArrowCSsample.exe!ArrowCSsample.ArrowTests.TestMain(ArrowCSsample.Options opts) Line 26 C# ArrowCSsample.exe!ArrowCSsample.Program.RunOptionsAndReturnExitCode(ArrowCSsample.Options opts) Line 88 C# ArrowCSsample.exe!ArrowCSsample.Program.Main.AnonymousMethod__0_0(ArrowCSsample.Options opts) Line 54 C# CommandLine.dll!CommandLine.ParserResultExtensions.WithParsed<ArrowCSsample.Options>(CommandLine.ParserResult<ArrowCSsample.Options> result, System.Action<ArrowCSsample.Options> action) Line 24 C# ArrowCSsample.exe!ArrowCSsample.Program.Main(string[] args) Line 53 C# ### Component(s) C# -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
