rahul8383 opened a new issue, #10769: URL: https://github.com/apache/pinot/issues/10769
The Upsert Metadata of each partition is Maintained in a ConcurrentHashMap with Key as the PrimaryKey and Value as the RecordLocation. When a segment is expired due to retention, the RecordLocation(value in the map) is removed but the Primary Key is still maintained in the map. Maintaining the expired key in the map will cause Memory overhead which can be reduced if the expired Primary Key is removed. [code link](https://github.com/apache/pinot/blob/ca37a1e90982b2495632720645ff6a5414508afb/pinot-segment-local/src/main/java/org/apache/pinot/segment/local/upsert/ConcurrentMapPartitionUpsertMetadataManager.java#L169) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
