[
https://issues.apache.org/jira/browse/KAFKA-19689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steven Schlansker updated KAFKA-19689:
--------------------------------------
Description:
We are using TopologyTestDriver
It looks like the test driver is syncing the entire state directory to disk for
every record processed:
!image-2025-09-08-14-07-05-768.png!
was:
We recently upgraded a Streams app to 4.1.0 and found that our unit and
integration tests feel like they take much longer and consume more system
resources. Indeed, when comparing to 4.0.0, it seems there is a significant
regression in the TopologyTestDriver - with 4.1.0, we spend a ton of time in
{{Utils.flushDir}} that did not seem to happen in 4.0.0
It looks like the test driver is syncing the entire state directory to disk for
every record processed:
!image-2025-09-08-14-07-05-768.png!
> TopologyTestDriver spends most of its time forcing changes to disk with
> persistent state stores
> -----------------------------------------------------------------------------------------------
>
> Key: KAFKA-19689
> URL: https://issues.apache.org/jira/browse/KAFKA-19689
> Project: Kafka
> Issue Type: Improvement
> Components: streams-test-utils
> Affects Versions: 4.1.0
> Reporter: Steven Schlansker
> Priority: Minor
> Attachments: image-2025-09-08-14-07-05-768.png,
> image-2025-09-08-14-22-29-514.png
>
>
> We are using TopologyTestDriver
> It looks like the test driver is syncing the entire state directory to disk
> for every record processed:
> !image-2025-09-08-14-07-05-768.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
