pradeepgv42 commented on pull request #5661:
URL: https://github.com/apache/incubator-pinot/pull/5661#issuecomment-655868047
Thanks Jackie, just to add more information. I am looking at mainly
following use-cases:
* Get the most recent elements without any filter (eg: for displaying
latest data ingested from some data source).
* Get the most recent elements with some filter
For the second query type above, where the filter cuts down the results to
almost 30% of the total rows also has similar slow down which makes sense w.r.t
above query times but seems like can be sped up too.
select * from table where col = "value" order by timestamp limit 10
"exceptions": [],
"numServersQueried": 2,
"numServersResponded": 2,
"numSegmentsQueried": 546,
"numSegmentsProcessed": 538,
"numSegmentsMatched": 538,
"numConsumingSegmentsQueried": 8,
"numDocsScanned": 339195644,
"numEntriesScannedInFilter": 891433991,
"numEntriesScannedPostFilter": 678617248,
"numGroupsLimitReached": false,
"totalDocs": 891433991,
"timeUsedMs": 13001,
"segmentStatistics": [],
"traceInfo": {},
"minConsumingFreshnessTimeMs": 9223372036854775807
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
