GXM2333 commented on issue #8258: URL: https://github.com/apache/pinot/issues/8258#issuecomment-1056408541
I found some old segments were deleted today, like `transcriptss_OFFLINE` table: yesterday's segments picture is:  today's segments picture is:  but I can't found the deleted segment's names from my yesterday-today logs. They logged like below: ( I grep logs with `RetentionManager` keywords, cause I guess if old segments were deleted, their names should be record from this line: https://github.com/apache/pinot/blob/b8fecb9d5a8fe524c42e29ce99ccf5012a2ebd49/pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/retention/RetentionManager.java#L258) ``` 2022/03/02 11:02:51.267 INFO [PeriodicTaskScheduler] [pool-6-thread-3] Starting RetentionManager with running frequency of 21600 seconds. 2022/03/02 11:02:51.267 INFO [BasePeriodicTask] [pool-6-thread-3] [TaskRequestId: auto] Start running task: RetentionManager 2022/03/02 11:02:51.268 INFO [ControllerPeriodicTask] [pool-6-thread-3] Processing 7 tables in task: RetentionManager 2022/03/02 11:02:51.268 INFO [RetentionManager] [pool-6-thread-3] Start managing retention for table: transcriptss_REALTIME 2022/03/02 11:02:51.272 WARN [RetentionManager] [pool-6-thread-3] Invalid retention time: null null for table: transcriptss_REALTIME, skip 2022/03/02 11:02:51.272 INFO [RetentionManager] [pool-6-thread-3] Segment lineage metadata clean-up is successfully processed for table: transcriptss_REALTIME 2022/03/02 11:02:51.272 INFO [RetentionManager] [pool-6-thread-3] Start managing retention for table: transcripts_OFFLINE 2022/03/02 11:02:51.275 INFO [RetentionManager] [pool-6-thread-3] Segment push type is not APPEND for table: transcripts_OFFLINE, skip managing retention 2022/03/02 11:02:51.277 INFO [RetentionManager] [pool-6-thread-3] Start cleaning up segment lineage for table: transcripts_OFFLINE 2022/03/02 11:02:51.284 INFO [RetentionManager] [pool-6-thread-3] Finished cleaning up segment lineage for table: transcripts_OFFLINE, deleted segments: in 7ms 2022/03/02 11:02:51.284 INFO [RetentionManager] [pool-6-thread-3] Segment lineage metadata clean-up is successfully processed for table: transcripts_OFFLINE 2022/03/02 11:02:51.284 INFO [RetentionManager] [pool-6-thread-3] Start managing retention for table: transcripts_index_test_REALTIME 2022/03/02 11:02:51.287 WARN [RetentionManager] [pool-6-thread-3] Invalid retention time: null null for table: transcripts_index_test_REALTIME, skip 2022/03/02 11:02:51.287 INFO [RetentionManager] [pool-6-thread-3] Segment lineage metadata clean-up is successfully processed for table: transcripts_index_test_REALTIME 2022/03/02 11:02:51.287 INFO [RetentionManager] [pool-6-thread-3] Start managing retention for table: transcriptss_OFFLINE 2022/03/02 11:02:51.289 WARN [RetentionManager] [pool-6-thread-3] Invalid retention time: null null for table: transcriptss_OFFLINE, skip 2022/03/02 11:02:51.291 INFO [RetentionManager] [pool-6-thread-3] Start cleaning up segment lineage for table: transcriptss_OFFLINE 2022/03/02 11:02:51.298 INFO [RetentionManager] [pool-6-thread-3] Finished cleaning up segment lineage for table: transcriptss_OFFLINE, deleted segments: in 7ms 2022/03/02 11:02:51.298 INFO [RetentionManager] [pool-6-thread-3] Segment lineage metadata clean-up is successfully processed for table: transcriptss_OFFLINE 2022/03/02 11:02:51.298 INFO [RetentionManager] [pool-6-thread-3] Start managing retention for table: transcript_benchmark_REALTIME 2022/03/02 11:02:51.300 WARN [RetentionManager] [pool-6-thread-3] Invalid retention time: null null for table: transcript_benchmark_REALTIME, skip 2022/03/02 11:02:51.300 INFO [RetentionManager] [pool-6-thread-3] Segment lineage metadata clean-up is successfully processed for table: transcript_benchmark_REALTIME 2022/03/02 11:02:51.300 INFO [RetentionManager] [pool-6-thread-3] Start managing retention for table: transcripts_REALTIME 2022/03/02 11:02:51.302 WARN [RetentionManager] [pool-6-thread-3] Invalid retention time: null null for table: transcripts_REALTIME, skip 2022/03/02 11:02:51.303 INFO [RetentionManager] [pool-6-thread-3] Segment lineage metadata clean-up is successfully processed for table: transcripts_REALTIME 2022/03/02 11:02:51.303 INFO [RetentionManager] [pool-6-thread-3] Start managing retention for table: transcript_REALTIME 2022/03/02 11:02:51.305 WARN [RetentionManager] [pool-6-thread-3] Invalid retention time: null null for table: transcript_REALTIME, skip 2022/03/02 11:02:51.305 INFO [RetentionManager] [pool-6-thread-3] Segment lineage metadata clean-up is successfully processed for table: transcript_REALTIME 2022/03/02 11:02:51.305 INFO [RetentionManager] [pool-6-thread-3] Removing aged (more than 0 days) deleted segments for all tables 2022/03/02 11:02:51.305 INFO [ControllerPeriodicTask] [pool-6-thread-3] Finish processing 7/7 tables in task: RetentionManager 2022/03/02 11:02:51.305 INFO [BasePeriodicTask] [pool-6-thread-3] [TaskRequestId: auto] Finish running task: RetentionManager in 38ms ``` Maybe some logs were deleted by log manager, cause I can just find 10 gz logs, and I `head pinot-all.log.1`,it start from 2022/03/01 19:45:03.660 ``` 2022/03/01 19:45:03.660 INFO [BaseControllerDataProvider] [HelixController-pipeline-task-pinot-quickstart-(82c87b0c_TASK)] Event 82c87b0c_TASK : No ClusterConfig change for cluster pinot-quickstart, pipeline TASK 2022/03/01 19:45:03.661 INFO [CallbackHandler] [CallbackHandler-AsycSubscribe-Singleton] Subscribing to path:/pinot-quickstart/INSTANCES/Server_aptssd4.safe.lycc.qihoo.net_8098/MESSAGES took:1 2022/03/01 19:45:03.661 INFO [ConstraintItemBuilder] [HelixController-pipeline-default-pinot-quickstart-(82c87b0c_DEFAULT)] overwrite existing constraint-value. old-value: null, new-value: 100000 2022/03/01 19:45:03.664 INFO [BaseControllerDataProvider] [HelixController-pipeline-task-pinot-quickstart-(82c87b0c_TASK)] Event 82c87b0c_TASK : No ideal state change for pinot-quickstart cluster, TASK pipeline 2022/03/01 19:45:03.664 INFO [BaseControllerDataProvider] [HelixController-pipeline-task-pinot-quickstart-(82c87b0c_TASK)] Event 82c87b0c_TASK : No live instance change for pinot-quickstart cluster, TASK pipeline 2022/03/01 19:45:03.664 INFO [PropertyCache] [HelixController-pipeline-default-pinot-quickstart-(82c87b0c_DEFAULT)] Event pinot-quickstart::DEFAULT::82c87b0c_DEFAULT : Refreshed 1 property ClusterConstraint took 5 ms. Selective: false 2022/03/01 19:45:03.664 INFO [BaseControllerDataProvider] [HelixController-pipeline-task-pinot-quickstart-(82c87b0c_TASK)] Event 82c87b0c_TASK : No instance config change for pinot-quickstart cluster, TASK pipeline 2022/03/01 19:45:03.664 INFO [BaseControllerDataProvider] [HelixController-pipeline-task-pinot-quickstart-(82c87b0c_TASK)] Event 82c87b0c_TASK : No resource config change for pinot-quickstart cluster, TASK pipeline 2022/03/01 19:45:03.664 INFO [InstanceMessagesCache] [HelixController-pipeline-default-pinot-quickstart-(82c87b0c_DEFAULT)] START: InstanceMessagesCache.refresh() 2022/03/01 19:45:03.666 INFO [InstanceMessagesCache] [HelixController-pipeline-default-pinot-quickstart-(82c87b0c_DEFAULT)] END: InstanceMessagesCache.refresh(), 0 of Messages read from ZooKeeper. took 2 ms. ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
