abhirathod95 opened a new pull request, #886: URL: https://github.com/apache/iceberg-go/pull/886
The fanout function currently defer's `record.Release()`. This isn't a big deal if the iterable it reads from contains a small amount of data. However, if it's a long lived streaming channel or contains a lot of data, the fanout function will hold on to the records until it processes all of them. This dramatically increases memory use, especially in a streaming use case. This PR extracts out the code to process each record into it's own function, and calls `defer record.Release()` there. No functional modifications were made. This will release each record after successfully processing the data. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
