[
https://issues.apache.org/jira/browse/KAFKA-18462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17953981#comment-17953981
]
Kuan Po Tseng commented on KAFKA-18462:
---------------------------------------
Quick note: In the latest RocksDB release (v10.2.1), the following two options
have been removed:
* {{random_access_max_buffer_size}}
[https://github.com/facebook/rocksdb/commit/d4bd67fb0972bcf654f9d63bdabc39001a8208b7]
* {{max_write_buffer_size_to_maintain}}
[https://github.com/facebook/rocksdb/commit/5e10baa412d06492c7ec4a4ded0949f6981c94e5]
We'll need to remove those options in
[RocksDBGenericOptionsToDbOptionsColumnFamilyOptionsAdapter.java|https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBGenericOptionsToDbOptionsColumnFamilyOptionsAdapter.java]
I’ve run the Streams integration tests and everything looks good so far.
Currently running the end-to-end tests—fingers crossed everything goes smoothly.
> Upgrade RocksDB dependency from 9.7.3 to something newer
> --------------------------------------------------------
>
> Key: KAFKA-18462
> URL: https://issues.apache.org/jira/browse/KAFKA-18462
> Project: Kafka
> Issue Type: Task
> Components: streams
> Affects Versions: 4.0.0
> Reporter: Matthias J. Sax
> Assignee: Kuan Po Tseng
> Priority: Blocker
> Fix For: 4.1.0
>
>
> We did upgrade RocksDB to 9.7.3 with 4.0 release, but there is already newer
> RocksDB releases (not available yet for us to use with 4.0 release).
> We should re-evaluate if we can upgrade to a newer RocksDB version with 4.1.
> When we close this ticket, we should also create a new BLOCKER ticket for a
> future release as a reminder, so we ensure we upgrade RocksDB regularly.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)