andygrove commented on code in PR #2048: URL: https://github.com/apache/datafusion-ballista/pull/2048#discussion_r3595948381
########## benchmarks/README.md: ########## @@ -298,4 +298,84 @@ $SPARK_HOME/bin/spark-submit \ --debug ``` +## TPC-DS Correctness Tests + +Unlike the TPC-H suite above (which measures performance), the TPC-DS suite is +a correctness gate: it runs each query on a Ballista cluster and compares the +result, row-by-row, against a single-process DataFusion oracle running the +same query. + +### Vendoring the queries + +The 99 TPC-DS queries are not stored in this repo; they are vendored from Review Comment: Fixed. I appreciate the review @phillipleblanc! I will merge this PR when CI is green and then start work on fixing the issues this uncovered. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
