As Jamo mentions we are hitting a new exception that we haven't seen before: "VerifyException" as shown below. Any idea what that is likely from or how to debug it?
https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/netvirt-csit-1node-1cmb-0ctl-0cmp-openstack-queens-upstream-stateful-neon/27/odl_1/odl1_exceptions.txt.gz 2018-10-11T16:40:32,801 | WARN | opendaylight-cluster-data-shard-dispatcher-349 | ShardDataTree | 244 - org.opendaylight.controller.sal-distributed-datastore - 1.9.0.SNAPSHOT | member-1-shard-default-config: Unexpected failure in validation phasecom.google.common.base.VerifyException: null at com.google.common.base.Verify.verify(Verify.java:100) ~[33:com.google.guava:25.1.0.jre] at org.opendaylight.yangtools.yang.data.impl.schema.tree.MinMaxElementsValidation.checkMinMaxElements(MinMaxElementsValidation.java:80) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.MinMaxElementsValidation.checkTouchApplicable(MinMaxElementsValidation.java:110) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:130) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractNodeContainerModificationStrategy.checkChildPreconditions(AbstractNodeContainerModificationStrategy.java:304) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractNodeContainerModificationStrategy.checkTouchApplicable(AbstractNodeContainerModificationStrategy.java:286) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:130) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractNodeContainerModificationStrategy.checkChildPreconditions(AbstractNodeContainerModificationStrategy.java:304) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractNodeContainerModificationStrategy.checkTouchApplicable(AbstractNodeContainerModificationStrategy.java:286) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:130) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.UnorderedMapModificationStrategy.lambda$checkApplicable$1(UnorderedMapModificationStrategy.java:45) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.AutomaticLifecycleMixin.checkApplicable(AutomaticLifecycleMixin.java:111) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.UnorderedMapModificationStrategy.checkApplicable(UnorderedMapModificationStrategy.java:45) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractNodeContainerModificationStrategy.checkChildPreconditions(AbstractNodeContainerModificationStrategy.java:304) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractNodeContainerModificationStrategy.checkTouchApplicable(AbstractNodeContainerModificationStrategy.java:286) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:130) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.StructuralContainerModificationStrategy.lambda$checkApplicable$1(StructuralContainerModificationStrategy.java:44) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.AutomaticLifecycleMixin.checkApplicable(AutomaticLifecycleMixin.java:111) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.StructuralContainerModificationStrategy.checkApplicable(StructuralContainerModificationStrategy.java:44) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractNodeContainerModificationStrategy.checkChildPreconditions(AbstractNodeContainerModificationStrategy.java:304) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractNodeContainerModificationStrategy.checkTouchApplicable(AbstractNodeContainerModificationStrategy.java:286) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:130) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.RootModificationApplyOperation.checkApplicable(RootModificationApplyOperation.java:71) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractDataTreeTip.validate(AbstractDataTreeTip.java:38) ~[431:org.opendaylight.yangtools.yang-data-impl:2.1.1] at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$0(ShardDataTree.java:725) ~[244:org.opendaylight.controller.sal-distributed-datastore:1.9.0.SNAPSHOT] at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:771) [244:org.opendaylight.controller.sal-distributed-datastore:1.9.0.SNAPSHOT] at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:718) [244:org.opendaylight.controller.sal-distributed-datastore:1.9.0.SNAPSHOT] at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:872) [244:org.opendaylight.controller.sal-distributed-datastore:1.9.0.SNAPSHOT] at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) [244:org.opendaylight.controller.sal-distributed-datastore:1.9.0.SNAPSHOT] at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:99) [244:org.opendaylight.controller.sal-distributed-datastore:1.9.0.SNAPSHOT] at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:238) [244:org.opendaylight.controller.sal-distributed-datastore:1.9.0.SNAPSHOT] at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleReadyLocalTransaction(ShardCommitCoordinator.java:200) [244:org.opendaylight.controller.sal-distributed-datastore:1.9.0.SNAPSHOT] at org.opendaylight.controller.cluster.datastore.Shard.handleReadyLocalTransaction(Shard.java:729) [244:org.opendaylight.controller.sal-distributed-datastore:1.9.0.SNAPSHOT] at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:330) [244:org.opendaylight.controller.sal-distributed-datastore:1.9.0.SNAPSHOT] at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) [229:org.opendaylight.controller.sal-akka-raft:1.9.0.SNAPSHOT] at org.opendaylight.controller.cluster.common.actor.AbstractUntypedPersistentActor.onReceiveCommand(AbstractUntypedPersistentActor.java:46) [236:org.opendaylight.controller.sal-clustering-commons:1.9.0.SNAPSHOT] at akka.persistence.UntypedPersistentActor.onReceive(PersistentActor.scala:303) [40:com.typesafe.akka.persistence:2.5.14] at org.opendaylight.controller.cluster.common.actor.MeteringBehavior.apply(MeteringBehavior.java:104) [236:org.opendaylight.controller.sal-clustering-commons:1.9.0.SNAPSHOT] at akka.actor.ActorCell$$anonfun$become$1.applyOrElse(ActorCell.scala:606) [37:com.typesafe.akka.actor:2.5.14] at akka.actor.Actor.aroundReceive(Actor.scala:517) [37:com.typesafe.akka.actor:2.5.14] at akka.actor.Actor.aroundReceive$(Actor.scala:515) [37:com.typesafe.akka.actor:2.5.14] at akka.persistence.UntypedPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:301) [40:com.typesafe.akka.persistence:2.5.14] at akka.persistence.Eventsourced$$anon$1.stateReceive(Eventsourced.scala:743) [40:com.typesafe.akka.persistence:2.5.14] at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:222) [40:com.typesafe.akka.persistence:2.5.14] at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:221) [40:com.typesafe.akka.persistence:2.5.14] at akka.persistence.UntypedPersistentActor.aroundReceive(PersistentActor.scala:301) [40:com.typesafe.akka.persistence:2.5.14] at akka.actor.ActorCell.receiveMessage(ActorCell.scala:588) [37:com.typesafe.akka.actor:2.5.14] at akka.actor.ActorCell.invoke(ActorCell.scala:557) [37:com.typesafe.akka.actor:2.5.14] at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258) [37:com.typesafe.akka.actor:2.5.14] at akka.dispatch.Mailbox.run(Mailbox.scala:225) [37:com.typesafe.akka.actor:2.5.14] at akka.dispatch.Mailbox.exec(Mailbox.scala:235) [37:com.typesafe.akka.actor:2.5.14] at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [37:com.typesafe.akka.actor:2.5.14] at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [37:com.typesafe.akka.actor:2.5.14] at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [37:com.typesafe.akka.actor:2.5.14] at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [37:com.typesafe.akka.actor:2.5.14] On Thu, Oct 11, 2018 at 6:54 PM Jamo Luhrsen <[email protected]> wrote: > > > On 10/11/18 2:36 PM, Michael Vorburger wrote: > > Hello, > > > > Latest quick multipatch > > > https://jenkins.opendaylight.org/releng/view/integration/job/integration-multipatch-test-neon/76/ > actually does not look > > all that bad anymore, does it? Gotta like all the blue that's starting > to show there ... > > https://www.youtube.com/watch?v=HgV1O0X4uXI > > > > Will someone dig in and provide details about which CSIT are still > yellow and red instead of blue, and why? > > Roughly looking, there are enough blue (100% passing) jobs that I think we > are > at the point to consider things good. > > I was expecting/hoping netvirt jobs to have some blue, but they are all > yellow. > So, looking deeper at one of them I realize we have a TON of failures > because > of new exceptions coming out. > > how do we want to deal with that? > > JamO > > > > > > And, of course, this is still only a quick build - once openflowplugin > fixes > > > https://lists.opendaylight.org/pipermail/openflowplugin-dev/2018-October/008535.html > you need to start runing full > > builds until they pass; have fun! > > > > Tx, > > M. > > -- > > Michael Vorburger, Red Hat > > [email protected] <mailto:[email protected]> | IRC: vorburger > @freenode | ~ = http://vorburger.ch > > <http://vorburger.ch/> > > > _______________________________________________ > TSC mailing list > [email protected] > https://lists.opendaylight.org/mailman/listinfo/tsc >
_______________________________________________ openflowplugin-dev mailing list [email protected] https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev
