Dylan Wong created SPARK-52968:
----------------------------------
Summary: Emit additional streaming metrics
Key: SPARK-52968
URL: https://issues.apache.org/jira/browse/SPARK-52968
Project: Spark
Issue Type: Task
Components: Structured Streaming
Affects Versions: 4.1.0
Reporter: Dylan Wong
Add additional metrics in structured streaming:
*State Store Commit Metrics*
"rocksdbChangeLogWriterCommitLatencyMs"
"rocksdbSaveZipFilesLatencyMs"
*State Store Load Metrics*
"rocksdbLoadFromSnapshotLatencyMs"
"rocksdbLoadLatencyMs"
"rocksdbReplayChangeLogLatencyMs"
"rocksdbNumReplayChangelogFiles"
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
