If you have 20 billion terrabytes of data stored locally and you want to upload them AWS, then that will take a long time and also hog all your network bandwith as well.
AnnouncementI have released my new course on Udemy, Kubernetes By Example. Sign up now to get free lifetime access!
That’s why in this situation it is better to copy all your data onto hdds and post the hdds to Amazon using courier companies like, Fedex, UPS, DHL…etc. There’s 2 ways to to do this:
- Import/Export Disk – you buy a hdd from shop, load it with data, post it to AWS. AWS then loads data into S3/Glacier/EBS then post back your hdd.
- Import/Export Snowball – Aws posts you with a big heavy duty storage device, which you then load up and post back. Ideal for petabytes of data.
Amazon will then import the data into one of the following:
- S3 (disk and snowball)
- EBS (disk only)
- Glacier storage (disk only)
Amazon will do this withing 24 hours of receiving the delivery.
You can also do the reverse, i.e. get Amazon to export your data out of AWS and post it back to you, but this only limited to exporting from S3. This avoids hogging the network bandwith.