Srinath PS created KAFKA-19194:
----------------------------------
Summary: IOException thrown while starting Kafka broker if a file
is present inside kafka data directory.
Key: KAFKA-19194
URL: https://issues.apache.org/jira/browse/KAFKA-19194
Project: Kafka
Issue Type: Bug
Affects Versions: 2.3.0
Environment: Red Hat Enterprise Linux 8.10
Reporter: Srinath PS
IOException is thrown when Kafka broker is started. In Kafka data directory 1
extra file is present.
{code:java}
2025-02-18 11:31:12,469 UTC INFO [Log partition=fm.views-0,
dir=/opt/sonus/ems/kafka/data/kafka] Loading producer state till offset 3 with
message format version 2 (kafka.log.Log)
2025-02-18 11:31:12,485 UTC INFO [ProducerStateManager partition=fm.views-0]
Loading producer state from snapshot file
'/opt/sonus/ems/kafka/data/kafka/fm.views-0/00000000000000000003.snapshot'
(kafka.log.ProducerStateManager)
2025-02-18 11:31:12,546 UTC INFO [ProducerStateManager partition=fm.views-0]
Writing producer snapshot at offset 10 (kafka.log.ProducerStateManager)
2025-02-18 11:31:12,572 UTC INFO [Log partition=fm.views-0,
dir=/opt/sonus/ems/kafka/data/kafka] Loading producer state till offset 10 with
message format version 2 (kafka.log.Log)
2025-02-18 11:31:12,573 UTC INFO [ProducerStateManager partition=fm.views-0]
Loading producer state from snapshot file
'/opt/sonus/ems/kafka/data/kafka/fm.views-0/00000000000000000010.snapshot'
(kafka.log.ProducerStateManager)
2025-02-18 11:31:12,575 UTC INFO [Log partition=fm.views-0,
dir=/opt/sonus/ems/kafka/data/kafka] Completed load of log with 2 segments, log
start offset (merged: 0, local: 0) and log end offset 10 in 137 ms
(kafka.log.Log)
2025-02-18 11:31:12,583 UTC INFO [Log partition=fm.views-0,
dir=/opt/sonus/ems/kafka/data/kafka] Loading producer state till offset 10 with
message format version 2 (kafka.log.Log)
2025-02-18 11:31:12,593 UTC INFO Completed load of log with 2 segments
containing 2 local segments and 0 tiered segments, tier start offset 0, first
untiered offset 0, local start offset 0, log end offset 10 (kafka.log.MergedLog)
2025-02-18 11:31:12,607 UTC ERROR Error while loading log dir
/opt/sonus/ems/kafka/data/kafka (kafka.log.LogManager)
java.io.IOException: Could not read file
/opt/sonus/ems/kafka/data/kafka/__consumer_offsets-0/migrate.log
at
kafka.log.Log.$anonfun$removeTempFilesAndCollectSwapFiles$3(Log.scala:370)
at
scala.collection.TraversableLike$WithFilter.$anonfun$foreach$1(TraversableLike.scala:792)
at
scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36)
at
scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33)
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:198)
at
scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:791)
at kafka.log.Log.removeTempFilesAndCollectSwapFiles(Log.scala:368)
at kafka.log.Log.loadSegments(Log.scala:523)
at kafka.log.Log.<init>(Log.scala:291)
at kafka.log.MergedLog$.apply(MergedLog.scala:603)
at kafka.log.LogManager.loadLog(LogManager.scala:278)
at kafka.log.LogManager.$anonfun$loadLogs$12(LogManager.scala:348)
at kafka.utils.CoreUtils$$anon$1.run(CoreUtils.scala:65)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
2025-02-18 11:31:12,613 UTC INFO [Log
partition=queuing.ems.pm.profile_data_jmx-0,
dir=/opt/sonus/ems/kafka/data/kafka] Recovering unflushed segment 0
(kafka.log.Log)
2025-02-18 11:31:12,614 UTC INFO [Log
partition=queuing.ems.pm.profile_data_jmx-0,
dir=/opt/sonus/ems/kafka/data/kafka] Loading producer state till offset 0 with
message format version 2 (kafka.log.Log)
2025-02-18 11:31:12,634 UTC INFO [ProducerStateManager
partition=queuing.ems.pm.profile_data_jmx-0] Writing producer snapshot at
offset 20 (kafka.log.ProducerStateManager) {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
