Hi all, I'm getting the following error when executing a repair on a table:
error: Repair job has failed with the error message: Repair command #4
failed with error Did not get replies from all endpoints.. Check the
logs on the repair participants for further details
-- StackTrace --
java.lang.RuntimeException: Repair job has failed with the error
message: Repair command #4 failed with error Did not get replies from
all endpoints.. Check the logs on the repair participants for further
details
at
org.apache.cassandra.tools.RepairRunner.progress(RepairRunner.java:137)
at
org.apache.cassandra.utils.progress.jmx.JMXNotificationProgressListener.handleNotification(JMXNotificationProgressListener.java:77)
at
java.management/com.sun.jmx.remote.internal.ClientNotifForwarder$NotifFetcher.dispatchNotification(Unknown
Source)
at
java.management/com.sun.jmx.remote.internal.ClientNotifForwarder$NotifFetcher.doRun(Unknown
Source)
at
java.management/com.sun.jmx.remote.internal.ClientNotifForwarder$NotifFetcher.run(Unknown
Source)
at
java.management/com.sun.jmx.remote.internal.ClientNotifForwarder$LinearExecutor.lambda$execute$0(Unknown
Source)
at java.base/java.lang.Thread.run(Unknown Source)
The system.log contains:
ERROR [InternalResponseStage:19467] 2025-07-16 16:33:14,990
RepairCoordinator.java:176 - Repair 47fceb00-6262-11f0-b667-b1c817c4c8cc
failed:
java.lang.RuntimeException: Did not get replies from all endpoints.
at
org.apache.cassandra.service.ActiveRepairService.failRepairException(ActiveRepairService.java:801)
at
org.apache.cassandra.service.ActiveRepairService$2.onFailure(ActiveRepairService.java:722)
at
org.apache.cassandra.repair.messages.RepairMessage$2.onFailure(RepairMessage.java:211)
at
org.apache.cassandra.net.RequestCallbacks.lambda$onExpired$0(RequestCallbacks.java:157)
at
org.apache.cassandra.concurrent.FutureTask$2.call(FutureTask.java:124)
at
org.apache.cassandra.concurrent.FutureTask.call(FutureTask.java:61)
at
org.apache.cassandra.concurrent.FutureTask.run(FutureTask.java:71)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Unknown Source)
nodetool status:
Datacenter: dc1
===============
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
-- Address Load
Tokens Owns Host ID Rack
UN cassandra-0.cassandra.cassandra-jos.svc.cluster.local 365.09 GiB
256 ? 5c3d3b46-300d-49f2-b01d-cbdb44d98022 rack1
UN cassandra-12.cassandra.cassandra-jos.svc.cluster.local 365.68 GiB
256 ? 1d3ed71f-18b4-4cc0-9c6e-3a5479328496 rack1
UN cassandra-15.cassandra.cassandra-jos.svc.cluster.local 354.24 GiB
256 ? 9d68cd5a-6e48-4156-92c1-5c51f02bce65 rack1
UN cassandra-8.cassandra.cassandra-jos.svc.cluster.local 358.67 GiB
256 ? fb2e8220-549e-4316-bb78-53f6cd07318a rack1
UN cassandra-17.cassandra.cassandra-jos.svc.cluster.local 349.34 GiB
256 ? 8444db72-3142-4637-9173-27242d968206 rack1
UN cassandra-14.cassandra.cassandra-jos.svc.cluster.local 348.34 GiB
256 ? 6e748875-1101-4bc1-a132-c6fe643c6148 rack1
UN cassandra-6.cassandra.cassandra-jos.svc.cluster.local 386.44 GiB
256 ? 34a419fb-4db1-4fb4-8ea7-c0988b2a3d5a rack1
UN cassandra-16.cassandra.cassandra-jos.svc.cluster.local 354.75 GiB
256 ? fb5de513-9088-456b-8251-f84bd159d032 rack1
UN cassandra-9.cassandra.cassandra-jos.svc.cluster.local 354.46 GiB
256 ? ed1ce133-4473-4bc1-a0cc-a242d6f67acc rack1
UN cassandra-11.cassandra.cassandra-jos.svc.cluster.local 338.68 GiB
256 ? f2bb43f7-8381-4b28-8ced-194060267c29 rack1
UN cassandra-4.cassandra.cassandra-jos.svc.cluster.local 352.23 GiB
256 ? 14fa3f70-a8e2-4f60-8bc9-42c7b3294718 rack1
UN cassandra-1.cassandra.cassandra-jos.svc.cluster.local 359 GiB
256 ? ea5979b8-71fe-4af5-b856-db06e008ced3 rack1
UN cassandra-5.cassandra.cassandra-jos.svc.cluster.local 348.66 GiB
256 ? ead07b83-a927-4904-bc6c-e8e4249f7560 rack1
UN cassandra-3.cassandra.cassandra-jos.svc.cluster.local 352.21 GiB
256 ? 354a9e1f-71b4-4aba-9f03-26778aaa17e2 rack1
UN cassandra-7.cassandra.cassandra-jos.svc.cluster.local 349.06 GiB
256 ? b5fbc09e-565e-402d-a6d0-3feac5922a13 rack1
UN cassandra-10.cassandra.cassandra-jos.svc.cluster.local 385.43 GiB
256 ? a2ab4d22-b564-4d6b-b743-2d78598fe53c rack1
UN cassandra-13.cassandra.cassandra-jos.svc.cluster.local 350.59 GiB
256 ? ed865baf-5333-40e5-8c73-9de2df2bd330 rack1
UN cassandra-2.cassandra.cassandra-jos.svc.cluster.local 353.65 GiB
256 ? 2b5db930-2bfe-4829-b353-3b1db0ca368f rack1
Any ideas on what to do?
Thank you!
-Joe
--
This email has been checked for viruses by AVG antivirus software.
www.avg.com