[ https://issues.apache.org/jira/browse/GEODE-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390803#comment-17390803 ]
Dan Smith commented on GEODE-9463: ---------------------------------- Eric and I tracked this down. This restore redundancy operation has had this problem since it was added in 1.13. The problem is that this SerializableRegionRedundancyStatusImpl is nested inside of an OperationState. OperationState is java serializable *only* - it is not DataSerializableFixedID. Because OperationState is java serializable, anything nested inside it is also uses java serialization. Someone added OperationState to the sanctioned-geode-core-serializables.txt. That is why we don't see a failure for that class. We really should not ever use java serialization in the product. Unfortunately because we have already released this code with java serialization, we may have to simply add SerializableRegionRedundancyStatusImpl to the sanctioned-geode-core-serializables.txt. There is a test to reproduce this issue here - https://github.com/upthewaterspout/geode/pull/new/feature/restore-serializable-filter-block-GEODE-9463 > Default serialization filter rejects SerializableRegionRedundancyStatusImpl > --------------------------------------------------------------------------- > > Key: GEODE-9463 > URL: https://issues.apache.org/jira/browse/GEODE-9463 > Project: Geode > Issue Type: Bug > Components: serialization > Affects Versions: 1.13.0, 1.14.0 > Reporter: Aaron Lindsey > Assignee: Eric Shu > Priority: Major > Labels: GeodeOperationAPI, blocks-1.14.0 > Attachments: logs-1.tgz, logs-2.tgz > > > When validate-serializable-objects=true, there are exceptions in the logs > related to serializing the class SerializableRegionRedundancyStatusImpl. This > is an internal class which should be allowed by the default serializable > object filter. > We saw this issue happen on Kubernetes while invoking rebalance and restore > redundancy operations on the cluster. I attached logs from 2 separate test > failures due to this issue. > {code:java} > [fatal 2021/07/22 00:14:31.392 GMT system-test-gemfire-locator-1 > <qtp589094312-81> tid=0x51] Serialization filter is rejecting class > org.apache.geode.internal.cache.control.SerializableRegionRedundancyStatusImpljava.lang.Exception: > at > org.apache.geode.internal.ObjectInputStreamFilterWrapper.lambda$createSerializationFilter$0(ObjectInputStreamFilterWrapper.java:234) > at com.sun.proxy.$Proxy23.checkInput(Unknown Source) at > java.base/java.io.ObjectInputStream.filterCheck(ObjectInputStream.java:1336) > at > java.base/java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2005) > at > java.base/java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1862) > at > java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2169) > at > java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1679) > at > java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:493) > at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:451) > at java.base/java.util.HashMap.readObject(HashMap.java:1460) at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native > Method) at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:566) at > java.base/java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1175) > at > java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2325) > at > java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2196) > at > java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1679) > at > java.base/java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2464) > at > java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2358) > at > java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2196) > at > java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1679) > at > java.base/java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2464) > at > java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2358) > at > java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2196) > at > java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1679) > at > java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:493) > at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:451) > at > org.apache.geode.internal.InternalDataSerializer.readSerializable(InternalDataSerializer.java:2689) > at > org.apache.geode.internal.InternalDataSerializer.basicReadObject(InternalDataSerializer.java:2633) > at org.apache.geode.DataSerializer.readObject(DataSerializer.java:2864) > at > org.apache.geode.internal.util.BlobHelper.deserializeBlob(BlobHelper.java:102) > at > org.apache.geode.internal.cache.EntryEventImpl.deserialize(EntryEventImpl.java:2049) > at > org.apache.geode.internal.cache.EntryEventImpl.deserialize(EntryEventImpl.java:2041) > at > org.apache.geode.internal.cache.VMCachedDeserializable.getDeserializedValue(VMCachedDeserializable.java:138) > at > org.apache.geode.internal.cache.LocalRegion.getDeserialized(LocalRegion.java:1277) > at > org.apache.geode.internal.cache.NonTXEntry.getValue(NonTXEntry.java:91) at > org.apache.geode.internal.cache.NonTXEntry.getValue(NonTXEntry.java:86) at > org.apache.geode.internal.cache.EntriesSet$EntriesIterator.moveNext(EntriesSet.java:187) > at > org.apache.geode.internal.cache.EntriesSet$EntriesIterator.<init>(EntriesSet.java:119) > at > org.apache.geode.internal.cache.EntriesSet.iterator(EntriesSet.java:84) at > org.apache.geode.management.internal.operation.RegionOperationStateStore.list(RegionOperationStateStore.java:102) > at > org.apache.geode.management.internal.operation.OperationHistoryManager.expireHistory(OperationHistoryManager.java:74) > at > org.apache.geode.management.internal.operation.OperationHistoryManager.recordStart(OperationHistoryManager.java:120) > at > org.apache.geode.management.internal.operation.OperationManager.submit(OperationManager.java:66) > at > org.apache.geode.management.internal.api.LocatorClusterManagementService.start(LocatorClusterManagementService.java:488) > at > org.apache.geode.management.internal.rest.controllers.RestoreRedundancyOperationController.startRestoreRedundancy(RestoreRedundancyOperationController.java:54) > at > org.apache.geode.management.internal.rest.controllers.RestoreRedundancyOperationController$$FastClassBySpringCGLIB$$e7ffd131.invoke(<generated>) > at > org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) > at > org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:779) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) > at > org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:750) > at > org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:61) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) > at > org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:750) > at > org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:692) > at > org.apache.geode.management.internal.rest.controllers.RestoreRedundancyOperationController$$EnhancerBySpringCGLIB$$c30cf145.startRestoreRedundancy(<generated>) > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native > Method) at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:566) at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:197) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:141) > at > org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:106) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:894) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) > at > org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) > at > org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1063) > at > org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963) > at > org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) > at > org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) at > org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at > org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at > org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1626) > at > org.apache.geode.management.internal.rest.ManagementLoggingFilter.doFilterInternal(ManagementLoggingFilter.java:44) > at > org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) > at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) > at > org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:327) > at > org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) > at > org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) > at > org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:121) > at > org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:115) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) > at > org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) > at > org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) > at > org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:105) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) > at > org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) > at > org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) > at > org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) > at > org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) > at > org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) > at > org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) > at > org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) > at > org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:110) > at > org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:80) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) > at > org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) > at > org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) > at > org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:211) > at > org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:183) > at > org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) > at > org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) > at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:201) > at > org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) > at > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) > at > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) > at > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) > at > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) > at > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) > at > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) > at > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1435) > at > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) > at > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) > at > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) > at > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) > at > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1350) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) > at > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) > at > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) > at org.eclipse.jetty.server.Server.handle(Server.java:516) at > org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:388) > at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:633) at > org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:380) at > org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) > at > org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) > at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) > at > org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:555) > at > org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:410) > at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:164) > at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at > org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) > at > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) > at > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) > at > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) > at > org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:383) > at > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:882) > at > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1036) > at java.base/java.lang.Thread.run(Thread.java:829) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)