[PR] apache#15162 - Bug Fix Segments going into BAD state for Dedup Tables with metadataTTL [pinot]

[via GitHub]

deepthi912 opened a new pull request, #15178:
URL: https://github.com/apache/pinot/pull/15178

   **Context:**
   https://apache-pinot.slack.com/archives/C011C9JHN7R/p1740757158048619
   Noticed segments going into BAD state when metadataTTL is set for dedup 
tables and Replication > 1
   
   `[RealtimeSegmentDataManager_leaderboard_entries__0__1__20250228T1528Z] 
[leaderboard_entries__0__1__20250228T1528Z] Caught exception in consumer thread 
after stop() is invoked: java.lang.RuntimeException: Caught exception while 
removing segment: leaderboard_entries__0__1__20250228T1528Z of table: 
leaderboard_entries_REALTIME from ConcurrentMapPartitionDedupMetadataManager, 
ignoring the exception`
   
   **Root Cause:**
   segment.getSegmentMetadata().getColumnMetadataMap() is null when offloading 
oldSegmentManager for which segmentMetadata is like below:
   
   
`{"segmentName":"githubEvents__1__5__20250303T1928Z","schemaName":"githubEvents","crc":-9223372036854775808,"creationTimeMillis":1741030112009,"creationTimeReadable":"2025-03-03T19:28:32:009
 
UTC","timeColumn":null,"timeUnit":null,"timeGranularitySec":null,"startTimeMillis":null,"startTimeReadable":null,"endTimeMillis":null,"endTimeReadable":null,"segmentVersion":null,"creatorName":null,"totalDocs":0,"custom":{},"startOffset":null,"endOffset":null}
 `
   
   **Before Fix:**
   
![image](https://github.com/user-attachments/assets/51cc61a7-51c4-4ab3-921d-7db1b43a165e)
   
   **After Fix:**
   
![image](https://github.com/user-attachments/assets/081a3d8e-a89d-4a06-86f3-ee2449c44cae)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org