[
https://issues.apache.org/jira/browse/KAFKA-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16502979#comment-16502979
]
Grégory R. commented on KAFKA-4392:
-----------------------------------
Same issue here on windows and kafka 1.1.0.
2018-06-06 10:06:43 ERROR StateDirectory:251 - stream-thread
[bridgeWorkerData-e125bca4-5e2f-4b08-b0bc-b9f6eb5135ba-CleanupThread] Failed to
lock the state directory due to an unexpected exception
java.nio.file.AccessDeniedException: \tmp\kafka-streams\myapp1\0_0\.lock
at
sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:83)
at
sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:97)
2018-06-06 10:07:00 ERROR StateDirectory:251 - stream-thread
[bridgeWorkerOutput-abfe4c31-cfa3-43a4-8e09-8590df4d2369-CleanupThread] Failed
to lock the state directory due to an unexpected exception
java.nio.file.AccessDeniedException: \tmp\kafka-streams\myapp2\0_0\.lock
at
sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:83)
at
sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:97)
at
sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:102)
at
sun.nio.fs.WindowsFileSystemProvider.newFileChannel(WindowsFileSystemProvider.java:115)
at java.nio.channels.FileChannel.open(FileChannel.java:287)
at java.nio.channels.FileChannel.open(FileChannel.java:335)
at
org.apache.kafka.streams.processor.internals.StateDirectory.getOrCreateFileChannel(StateDirectory.java:294)
at
org.apache.kafka.streams.processor.internals.StateDirectory.lock(StateDirectory.java:148)
at
org.apache.kafka.streams.processor.internals.StateDirectory.cleanRemovedTasks(StateDirectory.java:240)
at org.apache.kafka.streams.KafkaStreams$3.run(KafkaStreams.java:761)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-06-06 10:07:03 ERROR StateDirectory:251 - stream-thread
[bridgeWorkerEvent-33463024-bcf5-4989-93fb-6c94034ea4ae-CleanupThread] Failed t
o lock the state directory due to an unexpected exception
java.nio.file.AccessDeniedException: \tmp\kafka-streams\myapp3\0_0\.lock
at
sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:83)
at
sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:97)
at
sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:102)
at
sun.nio.fs.WindowsFileSystemProvider.newFileChannel(WindowsFileSystemProvider.java:115)
at java.nio.channels.FileChannel.open(FileChannel.java:287)
at java.nio.channels.FileChannel.open(FileChannel.java:335)
at
org.apache.kafka.streams.processor.internals.StateDirectory.getOrCreateFileChannel(StateDirectory.java:294)
at
org.apache.kafka.streams.processor.internals.StateDirectory.lock(StateDirectory.java:148)
at
org.apache.kafka.streams.processor.internals.StateDirectory.cleanRemovedTasks(StateDirectory.java:240)
at org.apache.kafka.streams.KafkaStreams$3.run(KafkaStreams.java:761)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
3 streams started, 3 different paths and the issue is raised esxactly at the
same time, the first time the exception is raised.
Next, each 10 minutes, this exception is raised.
> Failed to lock the state directory due to an unexpected exception
> -----------------------------------------------------------------
>
> Key: KAFKA-4392
> URL: https://issues.apache.org/jira/browse/KAFKA-4392
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Affects Versions: 0.10.1.0
> Reporter: Ara Ebrahimi
> Assignee: Guozhang Wang
> Priority: Major
> Fix For: 0.10.2.0
>
>
> This happened on streaming startup, on a clean installation, no existing
> folder. Here I was starting 4 instances of our streaming app on 4 machines
> and one threw this exception. Seems to me there’s a race condition somewhere
> when instances discover others, or something like that.
> 2016-11-02 15:43:47 INFO StreamRunner:59 - Started http server successfully.
> 2016-11-02 15:44:50 ERROR StateDirectory:147 - Failed to lock the state
> directory due to an unexpected exception
> java.nio.file.NoSuchFileException:
> /data/1/kafka-streams/myapp-streams/7_21/.lock
> at
> sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
> at
> sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:177)
> at java.nio.channels.FileChannel.open(FileChannel.java:287)
> at java.nio.channels.FileChannel.open(FileChannel.java:335)
> at
> org.apache.kafka.streams.processor.internals.StateDirectory.getOrCreateFileChannel(StateDirectory.java:176)
> at
> org.apache.kafka.streams.processor.internals.StateDirectory.lock(StateDirectory.java:90)
> at
> org.apache.kafka.streams.processor.internals.StateDirectory.cleanRemovedTasks(StateDirectory.java:140)
> at
> org.apache.kafka.streams.processor.internals.StreamThread.maybeClean(StreamThread.java:552)
> at
> org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:459)
> at
> org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:242)
> ^C
> [arae@a4 ~]$ ls -al /data/1/kafka-streams/myapp-streams/7_21/
> ls: cannot access /data/1/kafka-streams/myapp-streams/7_21/: No such file or
> directory
> [arae@a4 ~]$ ls -al /data/1/kafka-streams/myapp-streams/
> total 4
> drwxr-xr-x 74 root root 4096 Nov 2 15:44 .
> drwxr-xr-x 3 root root 27 Nov 2 15:43 ..
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_1
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_13
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_14
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_16
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_2
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_22
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_28
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_3
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_31
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_5
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_7
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_8
> drwxr-xr-x 3 root root 32 Nov 2 15:43 0_9
> drwxr-xr-x 3 root root 32 Nov 2 15:43 1_1
> drwxr-xr-x 3 root root 32 Nov 2 15:43 1_10
> drwxr-xr-x 3 root root 32 Nov 2 15:43 1_14
> drwxr-xr-x 3 root root 32 Nov 2 15:43 1_15
> drwxr-xr-x 3 root root 32 Nov 2 15:43 1_16
> drwxr-xr-x 3 root root 32 Nov 2 15:43 1_17
> drwxr-xr-x 3 root root 32 Nov 2 15:43 1_18
> drwxr-xr-x 3 root root 32 Nov 2 15:43 1_3
> drwxr-xr-x 3 root root 32 Nov 2 15:43 1_5
> drwxr-xr-x 3 root root 60 Nov 2 15:43 2_1
> drwxr-xr-x 3 root root 60 Nov 2 15:43 2_10
> drwxr-xr-x 3 root root 60 Nov 2 15:43 2_12
> drwxr-xr-x 3 root root 60 Nov 2 15:43 2_20
> drwxr-xr-x 3 root root 60 Nov 2 15:43 2_24
> drwxr-xr-x 3 root root 61 Nov 2 15:43 3_10
> drwxr-xr-x 3 root root 61 Nov 2 15:43 3_11
> drwxr-xr-x 3 root root 61 Nov 2 15:43 3_19
> drwxr-xr-x 3 root root 61 Nov 2 15:43 3_20
> drwxr-xr-x 3 root root 61 Nov 2 15:43 3_25
> drwxr-xr-x 3 root root 61 Nov 2 15:43 3_26
> drwxr-xr-x 3 root root 61 Nov 2 15:43 3_3
> drwxr-xr-x 3 root root 64 Nov 2 15:43 4_11
> drwxr-xr-x 3 root root 64 Nov 2 15:43 4_12
> drwxr-xr-x 3 root root 64 Nov 2 15:43 4_18
> drwxr-xr-x 3 root root 64 Nov 2 15:43 4_19
> drwxr-xr-x 3 root root 64 Nov 2 15:43 4_24
> drwxr-xr-x 3 root root 64 Nov 2 15:43 4_25
> drwxr-xr-x 3 root root 64 Nov 2 15:43 4_26
> drwxr-xr-x 3 root root 64 Nov 2 15:43 4_4
> drwxr-xr-x 3 root root 64 Nov 2 15:43 4_9
> drwxr-xr-x 3 root root 58 Nov 2 15:43 5_1
> drwxr-xr-x 3 root root 58 Nov 2 15:43 5_10
> drwxr-xr-x 3 root root 58 Nov 2 15:43 5_11
> drwxr-xr-x 3 root root 58 Nov 2 15:43 5_13
> drwxr-xr-x 3 root root 58 Nov 2 15:43 5_15
> drwxr-xr-x 3 root root 58 Nov 2 15:43 5_17
> drwxr-xr-x 3 root root 58 Nov 2 15:43 5_18
> drwxr-xr-x 2 root root 18 Nov 2 15:43 6_13
> drwxr-xr-x 2 root root 18 Nov 2 15:43 6_15
> drwxr-xr-x 2 root root 18 Nov 2 15:43 6_18
> drwxr-xr-x 2 root root 18 Nov 2 15:43 6_19
> drwxr-xr-x 2 root root 18 Nov 2 15:43 6_20
> drwxr-xr-x 2 root root 18 Nov 2 15:43 6_21
> drwxr-xr-x 2 root root 18 Nov 2 15:43 6_24
> drwxr-xr-x 2 root root 18 Nov 2 15:43 6_4
> drwxr-xr-x 2 root root 18 Nov 2 15:43 6_7
> drwxr-xr-x 2 root root 18 Nov 2 15:43 6_8
> drwxr-xr-x 2 root root 18 Nov 2 15:43 7_16
> drwxr-xr-x 2 root root 18 Nov 2 15:43 7_19
> drwxr-xr-x 2 root root 18 Nov 2 15:43 7_20
> drwxr-xr-x 2 root root 18 Nov 2 15:43 7_25
> drwxr-xr-x 2 root root 18 Nov 2 15:43 7_28
> drwxr-xr-x 2 root root 18 Nov 2 15:43 7_31
> drwxr-xr-x 2 root root 18 Nov 2 15:43 7_7
> drwxr-xr-x 2 root root 18 Nov 2 15:43 8_13
> drwxr-xr-x 2 root root 18 Nov 2 15:43 8_21
> drwxr-xr-x 2 root root 18 Nov 2 15:43 8_23
> drwxr-xr-x 2 root root 18 Nov 2 15:43 8_26
> drwxr-xr-x 2 root root 18 Nov 2 15:43 8_31
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
