Simplify your Spark application dependency management with Docker and Hadoop 3 with EMR 6.0.0 (Beta)

Simplify your Spark application dependency management with Docker and Hadoop 3 with EMR 6.0.0 (Beta)

EMR 6.0.0 (Beta) allows users to define application and library dependencies using Docker images from Docker Hub and Amazon Elastic Container Registry (ECR) using Spark 2.4.3 and Hadoop 3.1.0.

from Recent Announcements https://aws.amazon.com/about-aws/whats-new/2019/09/simplify-your-spark-application-dependency-management-with-docker-and-hadoop-3-with-emr-6-0-0-beta/

Sharing is caring!

Comments are closed.