jaepil opened a new pull request, #15948: URL: https://github.com/apache/lucene/pull/15948
## Summary Follow-up to #15827. This PR extends BayesianScoreQuery and LogOddsFusionQuery with three improvements: - **BayesianScoreEstimator**: Auto-estimates sigmoid calibration parameters (alpha, beta) and corpus-level base rate from score distributions via pseudo-query sampling - **Base rate prior for BayesianScoreQuery**: Optional corpus-level relevance prior that shifts the posterior in log-odds space: `sigmoid(alpha * (score - beta) + logit(baseRate))`, improving calibration for rare-relevance corpora - **Weighted Logarithmic Opinion Pooling for LogOddsFusionQuery**: Per-signal weights enabling weighted Log-OP where each signal's log-odds contribution is scaled by its reliability weight, plus optional logit normalization bounds ## Algorithm Details ### BayesianScoreEstimator Estimates `BayesianScoreQuery` parameters from corpus statistics via pseudo-query sampling: 1. Sample N documents randomly from the index (Fisher-Yates partial shuffle) 2. For each document, create a pseudo-query from its first few tokens in the target field 3. Run each pseudo-query via BM25 and collect the score distribution 4. Estimate: `beta = median(scores)`, `alpha = 1 / std(scores)` 5. Estimate base rate: mean fraction of documents scoring above the 95th percentile, clamped to `[1e-6, 0.5]` ### Base Rate Prior When a base rate `r` is set on `BayesianScoreQuery`, the posterior is computed as: ``` P = sigmoid(alpha * (score - beta) + logit(r)) ``` where `logit(r) = log(r / (1 - r))`. This shifts scores down for rare-relevance corpora (e.g., `r = 0.01` adds a -4.6 logit offset), improving calibration without changing ranking order within a single query. ### Weighted Log-OP When per-signal weights are provided to `LogOddsFusionQuery`, the scoring formula changes from uniform mean to weighted sum: ``` uniform: sigmoid(n^alpha * mean(softplus(logit(p_i)))) weighted: sigmoid(n^alpha * sum(w_i * gated(logit(p_i)))) ``` Weights must be non-negative and sum to 1. Optional per-signal logit normalization bounds (`logitMin`, `logitMax`) enable min-max normalization as an alternative to softplus gating, useful when learned signal scales differ significantly. ## New Files | File | Description | |------|-------------| | `BayesianScoreEstimator.java` | Auto-estimates alpha, beta, base rate from corpus score distributions | ## Modified Files | File | Description | |------|-------------| | `BayesianScoreQuery.java` | Add base rate prior support with logit-space shifting | | `LogOddsFusionQuery.java` | Add per-signal weights, logit normalization bounds, and weighted Log-OP | | `LogOddsFusionScorer.java` | Implement weighted scoring and logit normalization gating | | `TestBayesianScoreQuery.java` | 11 new tests for base rate and estimator | | `TestLogOddsFusionQuery.java` | 12 new tests for weighted fusion and normalization | ## Test Coverage (23 new tests) ### BayesianScoreQuery base rate (7 tests) - Base rate lowers scores compared to no base rate - Scores remain in (0, 1) range with base rate - Max score correctness with WAND optimization - Explanation includes base rate details - QueryUtils.check, equals/hashCode, illegal argument validation ### BayesianScoreEstimator (4 tests) - Estimated parameters are finite and valid - Estimated parameters produce valid scores in (0, 1) - Max score correctness with estimated parameters - Reproducibility with same random seed ### LogOddsFusionQuery weighted fusion (10 tests) - Weighted fusion produces valid scores - Weights affect ranking order - Explanation correctness for weighted variant - equals/hashCode, toString, rewrite, QueryUtils.check - Illegal weight validation (wrong length, negative, non-unit-sum) - Three-way weighted combination ### LogOddsFusionQuery logit normalization (2 tests) - Normalized fusion produces valid scores in (0, 1) - Max score correctness with normalization bounds ## Test plan - [x] `./gradlew tidy` passes (google-java-format via Spotless) - [x] `./gradlew :lucene:core:compileJava :lucene:core:compileTestJava` passes - [x] All 57 tests pass in `TestBayesianScoreQuery` and `TestLogOddsFusionQuery` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
