A repo for Spark related benchmark sets and utilities using the NVIDIA cuDF plugin for Apache Spark.
Please see README in each benchmark set for more details including building instructions and usage descriptions.
- Portable YARN resource cost attributes Spark application worker consumption from Spark and YARN logs across EMR, Dataproc, and on-premises deployments.