wjp719 commented on PR #780:
URL: https://github.com/apache/lucene/pull/780#issuecomment-1119568905
@jpountz Hi, I add an adaptive skip interval to avoid unnecessary frequent
attempts to skip docs, can you help to review again.
I also rerun the rally tests, following is the result:
#### data set
es rally httpLog
#### main operations
1. use ssd disk
1. add index sort `desc` of field `@timestamp`
2. set shard_number as 2
3. force merge to 1 segment
4. only search one index `logs-241998` which is 13GB and 181million docs in
total
#### query result
| Metric |
Task | Baseline | Contender | Diff |
Unit |
|--------------------------------------------------------------:|--------------------------------------------:|------------:|------------:|---------:|-------:|
| 50th percentile service time |
asc-sort-timestamp-after-force-merge-1-seg | 6750.63 | 4849.66 |
-1900.97 | ms |
| 90th percentile service time |
asc-sort-timestamp-after-force-merge-1-seg | 6844.34 | 4921.1 |
-1923.23 | ms |
| 99th percentile service time |
asc-sort-timestamp-after-force-merge-1-seg | 7011.71 | 5076.31 |
-1935.41 | ms |
| 100th percentile service time |
asc-sort-timestamp-after-force-merge-1-seg | 7014.05 | 5112.71 |
-1901.33 | ms |
we can see 28% decrease (6844.34ms->4921.1ms) of query latency if we apply
this pr.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
