Amazon EMR Containers logo

Amazon EMR Containers

Amazon EMR Containers

UpOpen Sourcecloudby Amazon Web Services62· JavaScript· MIT

EMR on EKS API runs Spark/Hive/Presto big-data jobs on Kubernetes (EKS) clusters — containerized EMR experience.

Visit site ↗Source ↗Health checked 9h ago
Use it when

Shared EKS cluster resources for higher utilization

Watch for

Requires an existing EKS cluster

First check

CreateVirtualCluster registers an EKS namespace as an EMR virtual cluster. StartJobRun to submit a Spark job.

Auth
CORS
No
HTTPS
Yes
Signup
?
Latency
15 ms
Protocol
REST
Pricing
Stars
62

Uptime · 30-day window

Probes: 1Uptime: 100%Avg latency: 15ms

GitHub activity

62JavaScriptMIT17 open issuesLast commit 110d ago
01

About this API

EMR on EKS is an EMR variant launched in 2020 that lets you run EMR-compatible Spark/Hive/Presto jobs on K8s (EKS) clusters. Problem it addresses: traditional EMR launches separate EC2 per cluster, low resource utilization (resources sit idle between jobs). If your company already uses EKS for apps and also wants big data, running two clusters wastes resources. EMR on EKS says "I have an EKS cluster, dedicate a namespace to the data team, they use EMR API to submit Spark jobs running as pods". Unified resource pool, on-demand scaling, multi-team sharing. Suitable for "deeply K8s-ified companies" doing big data. If not on K8s, traditional EMR (on EC2) or EMR Serverless is simpler.

02

What you can build

  • 1Run Spark jobs on existing EKS cluster (no separate EMR cluster)
  • 2Unified K8s resource management (data processing + apps in one cluster)
  • 3Multi-tenant big-data platform
03

Strengths & limitations

Strengths

  • Shared EKS cluster resources for higher utilization
  • Unified K8s toolchain (kubectl, Argo) manages Spark jobs
  • Fine-grained resource isolation (namespaces)

Limitations

  • Requires an existing EKS cluster
  • K8s learning curve (not as simple as traditional EMR)
  • Some EMR advanced features (Notebooks) are limited
04

Example request

Generic template — replace <endpoint> with the real path from the docs.
curl https://github.com/mermade/aws2openapi/<endpoint>
05

Getting started

CreateVirtualCluster registers an EKS namespace as an EMR virtual cluster. StartJobRun to submit a Spark job.

06

FAQ

EMR on EKS vs. EMR Serverless?+

Existing K8s platform + want unified management: EMR on EKS. Don't want to manage infrastructure at all: EMR Serverless.

07

Technical details

CORS: NoHTTPS: YesSignup: ?Open source: Yes
Auth type
unknown
Pricing
unknown
Protocols
REST
SDKs
python, javascript, go, java
Response time
15 ms
Last health check
5/12/2026, 7:36:33 AM
08

Tags

09

More from Amazon Web Services