airborne12 commented on code in PR #67918:
URL: https://github.com/apache/doris/pull/67918#discussion_r4057168934


##########
fe/fe-core/src/main/java/org/apache/doris/indexpolicy/IndexPolicyMgr.java:
##########
@@ -140,7 +199,7 @@ private void 
validateReferencedComponentsUsableLocked(String analyzerName, Index

Review Comment:
   Fixed in `0fdd4670ac9`.
   
   FE now resolves every nested tokenizer, token filter, and character filter 
exact-first and validates the expected policy family for both analyzers and 
normalizers. BE applies the same expected-type check before building each 
nested filter, so a replayed exact name can no longer fall through to a 
case-normalized policy of another family.
   
   The new image round-trip coverage exercises all four filter 
bindings—analyzer `token_filter`, analyzer `char_filter`, normalizer 
`token_filter`, and normalizer `char_filter`—with a wrong-type exact policy and 
a valid normalized fallback. It failed before the fix and now passes. Full 
`PolicyValidatorTests` passed 40/40, and the combined ASAN BE policy/pinyin/ICU 
suites passed 77/77.
   



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to