Tag Archives: solutions

Storage Gateway in AWS – The Basics

Storage Gateway

Overview

The storage gateway of AWS provides a simple way to integrate your on-premises storage with your AWS S3. It does this through the installation of a VM appliance in your VMware or Hyper-V implementation. You could also install it on to an EC2 instance in your Virtual Private Cloud (VPC) infrastructure for a different modality.

Types of Storage Gateways

There are four total types of Storage Gateway (note that Volume Gateway consists of two variations):

  • File gateway – this uses NFS and is for your flat files (PDFs, JPGs, etc)
  • Volume gateway – this actually consists of stored volumes and cached volumes – this is for block storage using iSCSI
  • Tape gateway – to create virtual tape libraries

While the volume gateway options both provide block storage (using iSCSI) and would be great for things like virtual hard disks and databases, note that the stored volume approach duplicates your data to the cloud while the cached volume approach only keeps cached copies of frequently accessed files in your on-premises location.

Common Use Cases

Customers commonly use Storage Gateway services for use cases such as:

  • Hybrid cloud workloads – big data, cloud bursting or cloud data migration architectures may need local capacity and performance with a connection to a central storage repository in the cloud. Storage Gateway streamlines moving data between your organization and AWS to manage workloads in the cloud.
  • Backup, archive, and disaster recovery – Storage Gateway is a drop-in replacement for tape and tape automation, and integrates with industry backup software packages. Storage Gateway can take snapshots of your local volumes which can restored as Amazon EBS volumes in the event of a local site disaster.
  • Tiered Storage – some customers design storage architectures that preserve or extend high performance on-premises investments by adding a lower cost, on-demand cloud tier. This helps with archival or cost-reduction projects.

Want to learn more – this is from my latest CBT Nuggets course on AWS. This course is in development as I post this.
Pearson Education (InformIT)

An Introduction to S3 in AWS

S3

Most consider the “main” storage facility of Amazon Web Services (AWS) to be S3 (the Simple Storage Service). This is very flexible object-based storage in the cloud. Companies can use this for a wide variety of purposes and only pay for that amount of storage that they truly need.

S3 marks one of the original AWS services, so it is no surprise that it can integrate with almost any other service in the public cloud.

The use cases for S3 are almost endless and could include:

  • Static web site hosting
  • Backups
  • Archives
  • Media distribution
  • Disaster recovery
  • Cloud application storage

S3 supports storage classes to better serve the wide variety of use cases that might arise. Lifecycle management policies exist to help automate the migration of data between storage classes. The S3 storage classes include:

  • Amazon S3 Standard – a class for frequently accessed data; because it delivers low latency and high throughput, Standard is targeted for a wide variety of use cases including cloud applications, dynamic websites, content distribution, mobile and gaming applications, and big data analytics
  • Amazon S3 Standard – Infrequent Access – a class for data that is accessed less frequently, but requires rapid access when needed; Standard – IA offers the high durability, throughput, and low latency of Amazon S3 Standard, with a low per GB storage price and per GB retrieval fee; this combination of low cost and high performance make Standard – IA targeted for long-term storage, backups, and as a data store for disaster recovery
  • Glacier – Archive – this class is designed for the archiving of data

To keep data secure, AWS supports a rich set of permissions, encryption, and access control mechanisms.
InformIT (Pearson Education)