zenoyang opened a new issue #6447:
URL: https://github.com/apache/incubator-doris/issues/6447
**Describe the bug**
DeleteInfos in the DeleteHandler will never be deleted, taking up too much
memory and metadata storage.
When users use a large number of delete statements, FE metadata parsing
problems will occur, resulting in failure to restart all FEs due to load image
failure.
An error is reported when starting FE:
```
java.lang.IllegalArgumentException: capacity < 0: (-2144832511 < 0)
at java.base/java.nio.Buffer.createCapacityException(Buffer.java:256)
at java.base/java.nio.CharBuffer.allocate(CharBuffer.java:347)
at
java.base/java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:809)
at org.apache.doris.common.io.Text.decode(Text.java:362)
at org.apache.doris.common.io.Text.decode(Text.java:341)
at org.apache.doris.common.io.Text.readString(Text.java:416)
at org.apache.doris.load.DeleteHandler.read(DeleteHandler.java:687)
at org.apache.doris.catalog.Catalog.loadDeleteHandler(Catalog.java:1879)
at org.apache.doris.catalog.Catalog.loadImage(Catalog.java:1530)
at org.apache.doris.catalog.Catalog.initialize(Catalog.java:772)
at org.apache.doris.PaloFe.start(PaloFe.java:109)
at org.apache.doris.PaloFe.main(PaloFe.java:60)
```
**To Reproduce**
Steps to reproduce the behavior:
1. Execute the "show delete" statement to see all the historical deleted
information
2. When there are too many deleteInfo, load image error when restarting FE,
and FE cannot be started
**Expected behavior**
1. According to the `label_keep_max_second` configuration, clean up the old
deleteInfo
2. Support pagination to read metadata text when load image
**Environment**
- OS: Centos7
- Version: Doris branch-0.13
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
