Re: [External] : Re: Streams, parallelization, and OOME.

2024-10-22 Thread Viktor Klang
core-libs-dev Subject: [External] : Re: Streams, parallelization, and OOME. Thanks Viktor, this was what I was looking for. Ok, so due to existing difficulties in translating push to pull, it makes sense why this wouldn't work. I really look forward to upgrading my codebase soon. Gathe

Re: Streams, parallelization, and OOME.

2024-10-21 Thread David Alayachew
rmance of Stream::flatMap (for ref... > github.com > > > > > Cheers, > √ > > > *Viktor Klang* > Software Architect, Java Platform Group > Oracle > ------ > *From:* core-libs-dev on behalf of David > Alayachew > *Sent:* Saturday,

Re: Streams, parallelization, and OOME.

2024-10-21 Thread Viktor Klang
tMap (for ref... github.com Cheers, √ Viktor Klang Software Architect, Java Platform Group Oracle From: core-libs-dev on behalf of David Alayachew Sent: Saturday, 19 October 2024 07:54 To: core-libs-dev Subject: Streams, parallelization, and OOME. Hello Core Li

Re: Streams, parallelization, and OOME.

2024-10-19 Thread David Alayachew
But *not letting any of them through into the forEach loop. On Sat, Oct 19, 2024, 9:36 AM David Alayachew wrote: > So to be clear, I added a logger to my BufferedReader. So I know for a > fact that it is reading data. > > And as for the code, it is a very simple parallel forEach. > > someStream.

Re: Streams, parallelization, and OOME.

2024-10-19 Thread David Alayachew
So to be clear, I added a logger to my BufferedReader. So I know for a fact that it is reading data. And as for the code, it is a very simple parallel forEach. someStream.parallel().forEach(**work**); I only wanted to change the execution from sequential to parallel. So I have millions and mill

Re: Streams, parallelization, and OOME.

2024-10-19 Thread Olexandr Rotan
Hi David. I am not a core libs team but I guess I can have some clues :). It is hard to tell without the code, but I assume that there are a few layers to it. 1. Stalling. I would assume it is caused mostly by GC pauses taking too long (forever) if GC does not have any computational powers to run

Streams, parallelization, and OOME.

2024-10-18 Thread David Alayachew
Hello Core Libs Dev Team, I have a file that I am streaming from a service, and I am trying to split into multiple parts based on a certain attribute found on each line. I am sending each part up to a different service. I am using BufferedReader.lines(). However, I cannot read the whole file into