AWS DataSync logo

AWS DataSync

AWS DataSync

UpOpen Sourcecloudby Amazon Web Services62· JavaScript· MIT

AWS DataSync API efficiently migrates and syncs data between sources (NFS, SMB, HDFS, object storage) and AWS storage (S3, EFS, FSx).

Visit site ↗Source ↗Health checked 9h ago
Use it when

10x+ faster than manual aws s3 cp (parallelization + incremental)

Watch for

Charged per GB transferred (~$0.0125/GB)

First check

CreateAgent (for on-prem sources), CreateLocation for source and target, CreateTask, StartTaskExecution.

Auth
CORS
No
HTTPS
Yes
Signup
?
Latency
16 ms
Protocol
REST
Pricing
Stars
62

Uptime · 30-day window

Probes: 1Uptime: 100%Avg latency: 16ms

GitHub activity

62JavaScriptMIT17 open issuesLast commit 110d ago
01

About this API

DataSync is AWS's data migration service. For moving TB or PB of data to AWS (typical scenarios: on-prem datacenter decommissioning, periodic backup, hybrid-cloud sync), aws s3 cp alone is too slow — poor bandwidth utilization, no incremental sync, no verification. DataSync is purpose-built: parallel multi-thread transfer saturates bandwidth, auto-incremental (only changed files), auto-integrity verification, schedule support for periodic sync. On-prem deployment needs a DataSync agent (VMware/Hyper-V/EC2 form-factor VM) that bridges local protocols (NFS/SMB) to AWS. Differs from Storage Gateway: Storage Gateway is "real-time hybrid access"; DataSync is "one-time or scheduled migration".

02

What you can build

  • 1Migrate on-prem NFS to S3
  • 2Periodic backup of on-prem file servers to AWS
  • 3Cross-region S3 sync
  • 4Cloud-to-cloud migration (Azure Blob to S3)
03

Strengths & limitations

Strengths

  • 10x+ faster than manual aws s3 cp (parallelization + incremental)
  • Built-in integrity verification (MD5/SHA-256)
  • Schedule and incremental sync supported
  • On-prem deployment via DataSync agent (VM)

Limitations

  • Charged per GB transferred (~$0.0125/GB)
  • Agent must be deployed on-prem — one-time ops cost
04

Example request

Generic template — replace <endpoint> with the real path from the docs.
curl https://github.com/mermade/aws2openapi/<endpoint>
05

Getting started

CreateAgent (for on-prem sources), CreateLocation for source and target, CreateTask, StartTaskExecution.

06

FAQ

DataSync vs. Storage Gateway?+

One-time migration or periodic sync: DataSync. On-prem app continuously accesses AWS storage (like local): Storage Gateway.

For >100TB, should I use Snowball?+

PB-scale or bandwidth-constrained: Snowball (ship physical disks). 100TB with 1Gbps network: DataSync also works.

07

Technical details

CORS: NoHTTPS: YesSignup: ?Open source: Yes
Auth type
unknown
Pricing
unknown
Protocols
REST
SDKs
python, javascript, go, java, csharp
Response time
16 ms
Last health check
5/12/2026, 7:36:33 AM
08

Tags

09

More from Amazon Web Services