lnbest0707-uber opened a new pull request, #15234:
URL: https://github.com/apache/pinot/pull/15234
`ingestion` feature`
When mutable segments get transferred to immutable segments. There are a few
preConditions check like
- 4GB SV compressed column size
- 2G MV num of elements
Those check failure would raise `IllegalStateException`, set `_state` to
error and then stop there forever. This is due to the reason that Pinot is
assuming such build failures are transient and would eventually be fixed by
other replicas. However, in most of cases, such failures are deterministic and
would fail on all replicas.
This PR will introduce a new `SegmentCannotBuildRequest` between server and
controller. Once `Preconditions` check failed and there's no other replicas
able to build so far. The controller would reduce the segment size by half and
reset the segments.
Ingestion stop issue would no longer happen. The only side effect is that
user might see some latest data now but then not be able to see it later
temporarily. (AS we've reset the latest immutable segments)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
