Cloud Service Comparison: Storage Services¶

Quick Reference¶

This guide provides a comprehensive comparison of storage services across AWS, Google Cloud Platform (GCP), and Microsoft Azure. Use this to understand equivalent services when switching cloud providers or studying multiple certifications.

Object Storage¶

Documentation: - 📖 AWS S3 Documentation - Complete S3 guide - 📖 GCP Cloud Storage Documentation - Complete Cloud Storage guide - 📖 Azure Blob Storage Documentation - Complete Blob Storage guide - 📖 S3 Storage Classes - AWS storage class details - 📖 Cloud Storage Classes - GCP storage class details - 📖 Azure Blob Access Tiers - Azure tier details

Storage Classes and Pricing Comparison¶

AWS S3 Storage Classes¶

GCP Cloud Storage Classes¶

Azure Blob Storage Access Tiers¶

Block Storage (Attached to VMs)¶

Documentation: - 📖 AWS EBS Documentation - Complete EBS guide - 📖 GCP Persistent Disks Documentation - Persistent Disks guide - 📖 Azure Managed Disks Documentation - Managed Disks guide - 📖 EBS Volume Types - AWS volume comparison - 📖 Persistent Disk Types - GCP disk comparison - 📖 Azure Disk Types - Azure disk comparison

File Storage (Network File Systems)¶

Documentation: - 📖 AWS EFS Documentation - Complete EFS guide - 📖 GCP Filestore Documentation - Filestore guide - 📖 Azure Files Documentation - Azure Files guide - 📖 EFS Performance - EFS performance guide - 📖 Azure Files Premium - Premium tier details

Archive Storage¶

Documentation: - 📖 AWS Glacier Documentation - Glacier service guide - 📖 S3 Glacier Storage Classes - Glacier class comparison - 📖 GCP Archive Storage - Archive class details - 📖 Azure Archive Blob - Archive tier guide

Data Transfer Services¶

Documentation: - 📖 AWS DataSync Documentation - DataSync service guide - 📖 AWS Snow Family - Offline transfer devices - 📖 GCP Storage Transfer Service - Transfer service guide - 📖 Azure Data Transfer Options - Transfer solutions comparison - 📖 Azure Data Box - Data Box family guide

Backup Services¶

Documentation: - 📖 AWS Backup Documentation - AWS Backup guide - 📖 GCP Backup and DR Documentation - GCP Backup guide - 📖 Azure Backup Documentation - Azure Backup guide

Lifecycle Policies¶

AWS S3 Lifecycle Rules¶

{
  "Rules": [
    {
      "Id": "Archive old logs",
      "Status": "Enabled",
      "Filter": {
        "Prefix": "logs/"
      },
      "Transitions": [
        {
          "Days": 30,
          "StorageClass": "STANDARD_IA"
        },
        {
          "Days": 90,
          "StorageClass": "GLACIER_IR"
        },
        {
          "Days": 365,
          "StorageClass": "DEEP_ARCHIVE"
        }
      ],
      "Expiration": {
        "Days": 2555
      }
    }
  ]
}

GCP Cloud Storage Lifecycle Configuration¶

{
  "lifecycle": {
    "rule": [
      {
        "action": {
          "type": "SetStorageClass",
          "storageClass": "NEARLINE"
        },
        "condition": {
          "age": 30,
          "matchesPrefix": ["logs/"]
        }
      },
      {
        "action": {
          "type": "SetStorageClass",
          "storageClass": "COLDLINE"
        },
        "condition": {
          "age": 90
        }
      },
      {
        "action": {
          "type": "SetStorageClass",
          "storageClass": "ARCHIVE"
        },
        "condition": {
          "age": 365
        }
      },
      {
        "action": {
          "type": "Delete"
        },
        "condition": {
          "age": 2555
        }
      }
    ]
  }
}

Azure Blob Lifecycle Management¶

{
  "rules": [
    {
      "enabled": true,
      "name": "archive-old-logs",
      "type": "Lifecycle",
      "definition": {
        "filters": {
          "blobTypes": ["blockBlob"],
          "prefixMatch": ["logs/"]
        },
        "actions": {
          "baseBlob": {
            "tierToCool": {
              "daysAfterModificationGreaterThan": 30
            },
            "tierToCold": {
              "daysAfterModificationGreaterThan": 90
            },
            "tierToArchive": {
              "daysAfterModificationGreaterThan": 365
            },
            "delete": {
              "daysAfterModificationGreaterThan": 2555
            }
          }
        }
      }
    }
  ]
}

Pricing Comparison (Approximate US Regions)¶

Object Storage Pricing per GB/Month¶

Block Storage Pricing per GB/Month¶

File Storage Pricing per GB/Month¶

Note: Prices vary by region and are subject to change. Always use official pricing calculators.

Pricing Calculators: - 📖 AWS Pricing Calculator - AWS cost estimates - 📖 GCP Pricing Calculator - GCP cost estimates - 📖 Azure Pricing Calculator - Azure cost estimates

CLI Command Comparison¶

Object Storage - Upload Files¶

AWS S3:

# Upload single file
aws s3 cp myfile.txt s3://mybucket/myfile.txt

# Upload directory recursively
aws s3 sync ./localdir s3://mybucket/remote-dir/

# Upload with storage class
aws s3 cp myfile.txt s3://mybucket/myfile.txt --storage-class GLACIER_IR

# Upload with encryption
aws s3 cp myfile.txt s3://mybucket/myfile.txt --server-side-encryption aws:kms

GCP Cloud Storage:

# Upload single file
gsutil cp myfile.txt gs://mybucket/myfile.txt

# Upload directory recursively
gsutil -m rsync -r ./localdir gs://mybucket/remote-dir/

# Upload with storage class
gsutil -h "x-goog-storage-class:NEARLINE" cp myfile.txt gs://mybucket/myfile.txt

# Upload with encryption
gsutil -o "GSUtil:encryption_key=YOUR_KEY" cp myfile.txt gs://mybucket/myfile.txt

Azure Blob Storage:

# Upload single file
az storage blob upload \
  --account-name mystorageaccount \
  --container-name mycontainer \
  --name myfile.txt \
  --file myfile.txt

# Upload directory recursively
azcopy copy './localdir/*' \
  'https://mystorageaccount.blob.core.windows.net/mycontainer' \
  --recursive

# Upload with access tier
az storage blob upload \
  --account-name mystorageaccount \
  --container-name mycontainer \
  --name myfile.txt \
  --file myfile.txt \
  --tier Cool

# Upload with encryption scope
az storage blob upload \
  --account-name mystorageaccount \
  --container-name mycontainer \
  --name myfile.txt \
  --file myfile.txt \
  --encryption-scope myencryptionscope

Object Storage - List and Download¶

AWS S3:

# List buckets
aws s3 ls

# List objects in bucket
aws s3 ls s3://mybucket/prefix/

# Download file
aws s3 cp s3://mybucket/myfile.txt ./myfile.txt

# Download directory
aws s3 sync s3://mybucket/remote-dir/ ./localdir/

GCP Cloud Storage:

# List buckets
gsutil ls

# List objects in bucket
gsutil ls gs://mybucket/prefix/

# Download file
gsutil cp gs://mybucket/myfile.txt ./myfile.txt

# Download directory
gsutil -m rsync -r gs://mybucket/remote-dir/ ./localdir/

Azure Blob Storage:

# List containers
az storage container list --account-name mystorageaccount

# List blobs in container
az storage blob list \
  --account-name mystorageaccount \
  --container-name mycontainer

# Download file
az storage blob download \
  --account-name mystorageaccount \
  --container-name mycontainer \
  --name myfile.txt \
  --file ./myfile.txt

# Download directory
azcopy copy \
  'https://mystorageaccount.blob.core.windows.net/mycontainer/*' \
  './localdir/' \
  --recursive

Block Storage - Create and Attach Volumes¶

AWS EBS:

# Create volume
aws ec2 create-volume \
  --availability-zone us-east-1a \
  --size 100 \
  --volume-type gp3 \
  --iops 3000 \
  --throughput 125

# Attach volume to instance
aws ec2 attach-volume \
  --volume-id vol-xxxxx \
  --instance-id i-xxxxx \
  --device /dev/sdf

# Create snapshot
aws ec2 create-snapshot \
  --volume-id vol-xxxxx \
  --description "My snapshot"

GCP Persistent Disks:

# Create disk
gcloud compute disks create mydisk \
  --size 100GB \
  --type pd-ssd \
  --zone us-central1-a

# Attach disk to instance
gcloud compute instances attach-disk myinstance \
  --disk mydisk \
  --zone us-central1-a

# Create snapshot
gcloud compute disks snapshot mydisk \
  --snapshot-names my-snapshot \
  --zone us-central1-a

Azure Managed Disks:

# Create disk
az disk create \
  --resource-group myResourceGroup \
  --name myDisk \
  --size-gb 100 \
  --sku Premium_LRS

# Attach disk to VM
az vm disk attach \
  --resource-group myResourceGroup \
  --vm-name myVM \
  --name myDisk

# Create snapshot
az snapshot create \
  --resource-group myResourceGroup \
  --name mySnapshot \
  --source myDisk

File Storage - Create and Mount¶

AWS EFS:

# Create file system
aws efs create-file-system \
  --performance-mode generalPurpose \
  --throughput-mode elastic \
  --encrypted

# Create mount target
aws efs create-mount-target \
  --file-system-id fs-xxxxx \
  --subnet-id subnet-xxxxx \
  --security-groups sg-xxxxx

# Mount on Linux
sudo mount -t nfs4 -o nfsvers=4.1,rsize=1048576,wsize=1048576,hard,timeo=600,retrans=2 \
  fs-xxxxx.efs.us-east-1.amazonaws.com:/ /mnt/efs

GCP Filestore:

# Create Filestore instance
gcloud filestore instances create myfilestore \
  --zone=us-central1-a \
  --tier=BASIC_HDD \
  --file-share=name="vol1",capacity=1TB \
  --network=name="default"

# Mount on Linux
sudo mount -t nfs -o vers=3 \
  10.x.x.x:/vol1 /mnt/filestore

Azure Files:

# Create storage account (if not exists)
az storage account create \
  --resource-group myResourceGroup \
  --name mystorageaccount \
  --sku Standard_LRS

# Create file share
az storage share create \
  --account-name mystorageaccount \
  --name myfileshare \
  --quota 100

# Mount on Linux
sudo mount -t cifs \
  //mystorageaccount.file.core.windows.net/myfileshare /mnt/azfiles \
  -o vers=3.0,username=mystorageaccount,password=STORAGE_KEY,dir_mode=0777,file_mode=0777

Decision Tree: Which Storage Service?¶

When to Use Object Storage¶

• ✅ Unstructured data (images, videos, logs, backups)
• ✅ Static website hosting
• ✅ Data lakes and big data analytics
• ✅ Long-term archival
• ✅ Content distribution
• ✅ Need unlimited scaling
• ❌ Frequent small updates (not block-level updates)
• ❌ Need POSIX file system semantics

Choose: - S3/Cloud Storage/Blob Storage for general object storage - Glacier/Archive for long-term, infrequent access

When to Use Block Storage¶

• ✅ Database storage (MySQL, PostgreSQL, SQL Server)
• ✅ High-performance applications
• ✅ Transactional workloads
• ✅ Need low-latency, high IOPS
• ✅ Boot volumes for VMs
• ✅ Specific IOPS/throughput requirements
• ❌ Need to share storage across multiple VMs (use file storage instead)
• ❌ Massive scale-out (object storage is better)

Choose: - Premium SSD/io2/Extreme for databases, high-performance apps - Standard SSD/gp3/Balanced for general-purpose workloads - Standard HDD for infrequent access, throughput-focused workloads

When to Use File Storage¶

• ✅ Shared file system across multiple VMs
• ✅ Lift-and-shift applications expecting NFS/SMB
• ✅ Container persistent storage (Kubernetes)
• ✅ Content management systems
• ✅ Home directories
• ✅ Development environments
• ❌ High IOPS database workloads (use block storage)
• ❌ Object-based data lakes (use object storage)

Choose: - EFS/Filestore/Azure Files Standard for general shared storage - Azure Files Premium/Filestore Enterprise for high-performance scenarios

Storage Class Selection Decision Flow¶

Is data accessed frequently (daily)?
├─ YES → Standard/Hot tier
└─ NO → Is it accessed monthly?
    ├─ YES → Infrequent Access tier (S3 IA / Nearline / Cool)
    └─ NO → Is it accessed quarterly?
        ├─ YES → Cold tier (Coldline / Cold / Glacier Instant)
        └─ NO → Is it accessed yearly or less?
            ├─ YES → Archive tier (Archive / Glacier Flexible)
            └─ NO → Deep Archive (Glacier Deep Archive)

Replication and Redundancy Decision¶

How critical is your data?
├─ BUSINESS CRITICAL → Need multiple regions?
│   ├─ YES → Multi-region replication (S3 CRR / Multi-region / GRS)
│   └─ NO → Multi-zone within region (S3 Standard / Standard / ZRS)
└─ LESS CRITICAL → Single zone acceptable?
    ├─ YES → Single zone (S3 One Zone-IA / Regional / LRS)
    └─ NO → Use multi-zone standard options

Backup Strategy Selection¶

What are you backing up?
├─ Virtual Machines → AWS Backup / GCP Backup / Azure Backup
├─ Databases → Native DB backups + service backup
├─ File Systems → EFS Backup / Filestore Backup / Azure Files Backup
├─ Application Data → Object storage with versioning + lifecycle
└─ Long-term Compliance → Archive storage with object lock/retention policies

Advanced Features Comparison¶

Data Replication Options¶

Object Versioning and Protection¶

Access Control and Security¶

Performance Optimization¶

Real-World Use Cases and Recommendations¶

Static Website Hosting¶

AWS S3:

# Enable static website hosting
aws s3 website s3://mybucket --index-document index.html --error-document error.html

# Set bucket policy for public read
aws s3api put-bucket-policy --bucket mybucket --policy file://policy.json

GCP Cloud Storage:

# Enable static website hosting
gsutil web set -m index.html -e 404.html gs://mybucket

# Make bucket publicly readable
gsutil iam ch allUsers:objectViewer gs://mybucket

Azure Blob Storage:

# Enable static website hosting
az storage blob service-properties update \
  --account-name mystorageaccount \
  --static-website \
  --index-document index.html \
  --404-document 404.html

Data Lake Architecture¶

Recommended Storage: - Raw Data Layer: S3 Standard / Cloud Storage Standard / Hot Blob Storage - Processed Data Layer: S3 Intelligent-Tiering / Cloud Storage Standard / Hot/Cool Blob - Archived Data: S3 Glacier / Archive Storage / Archive Blob

Best Practices: 1. Use lifecycle policies to automatically transition data between tiers 2. Partition data by date/time for efficient querying 3. Enable versioning for data lineage 4. Use encryption at rest and in transit 5. Implement proper IAM policies for data access

Database Backup Strategy¶

AWS:

# Automated RDS backups (configured at creation)
# Manual snapshot
aws rds create-db-snapshot \
  --db-instance-identifier mydb \
  --db-snapshot-identifier mydb-snapshot-2024-01-15

# Copy to another region
aws rds copy-db-snapshot \
  --source-db-snapshot-identifier arn:aws:rds:us-east-1:123456789012:snapshot:mydb-snapshot \
  --target-db-snapshot-identifier mydb-snapshot-copy \
  --region us-west-2

GCP:

# Automated Cloud SQL backups (configured at creation)
# On-demand backup
gcloud sql backups create \
  --instance myinstance

# Export to Cloud Storage
gcloud sql export sql myinstance gs://mybucket/backup.sql \
  --database mydatabase

Azure:

# Automated SQL Database backups (default enabled)
# Long-term retention policy
az sql db ltr-policy set \
  --resource-group myResourceGroup \
  --server myserver \
  --database mydb \
  --weekly-retention P4W \
  --monthly-retention P12M \
  --yearly-retention P5Y \
  --week-of-year 1

Video/Media Storage and Streaming¶

Recommended Architecture: 1. Upload: Object storage (S3/Cloud Storage/Blob) with multipart upload 2. Processing: Serverless functions or batch processing 3. Transcoding: AWS Elemental MediaConvert / GCP Transcoder API / Azure Media Services 4. Storage: Different quality levels in different storage classes 5. Delivery: CloudFront / Cloud CDN / Azure CDN 6. Archive: Glacier/Archive for old content

Cost Optimization: - Use Intelligent-Tiering for unpredictable access patterns - Enable lifecycle policies to archive old content - Use CDN to reduce origin requests and egress costs

Key Takeaways¶

AWS Storage Strengths¶

• ✅ Most comprehensive storage options (10+ S3 storage classes)
• ✅ S3 Glacier Deep Archive (lowest cost archival)
• ✅ Mature ecosystem with extensive third-party integrations
• ✅ Storage Lens for usage analytics
• ✅ Best for hybrid cloud (Storage Gateway, DataSync, Snow Family)
• ✅ S3 Intelligent-Tiering for automatic cost optimization

GCP Storage Strengths¶

• ✅ Simplest storage class model (4 classes)
• ✅ No retrieval delays for Archive storage (immediate access)
• ✅ Consistent pricing across regions
• ✅ Strong integration with BigQuery for analytics
• ✅ Autoclass for automatic tier management
• ✅ Best global network performance

Azure Storage Strengths¶

• ✅ Best Windows/SMB integration (Azure Files)
• ✅ Flexible redundancy options (LRS, ZRS, GRS, RA-GRS, GZRS, RA-GZRS)
• ✅ Strong hybrid cloud story (Azure Stack, Azure Arc)
• ✅ Immutable storage with legal hold support
• ✅ Premium performance tiers for file storage
• ✅ Point-in-Time Restore for containers

Performance Benchmarks (Approximate)¶

Object Storage Latency¶

Block Storage IOPS¶

Note: Performance varies based on disk size, VM type, and configuration.

Migration Strategies¶

AWS to GCP Migration¶

# Use Storage Transfer Service
# 1. Create Cloud Storage bucket
gsutil mb gs://mybucket

# 2. Create transfer job (via console or API)
# Alternatively, use gsutil for one-time migration
gsutil -m rsync -r s3://aws-bucket gs://gcp-bucket

GCP to Azure Migration¶

# Use AzCopy
azcopy copy \
  'https://storage.googleapis.com/gcp-bucket/*' \
  'https://mystorageaccount.blob.core.windows.net/azure-container' \
  --recursive

AWS to Azure Migration¶

# Use AzCopy with S3-compatible source
azcopy copy \
  'https://mybucket.s3.amazonaws.com/*' \
  'https://mystorageaccount.blob.core.windows.net/azure-container' \
  --recursive \
  --s3-source-secret-key 'YOUR_AWS_SECRET_KEY'

Best Practices for Migration¶

1. Test first: Migrate small dataset to validate process
2. Use parallel transfers: Enable multi-threading for faster transfers
3. Monitor progress: Set up logging and monitoring
4. Verify data integrity: Compare checksums after migration
5. Plan for downtime: Schedule during low-usage periods if applicable
6. Update applications: Change SDK/API endpoints
7. Test thoroughly: Validate application functionality post-migration

Cost Optimization Tips¶

Storage Cost Reduction Strategies¶

1. Implement Lifecycle Policies
2. Automatically transition data to cheaper storage classes
3. Delete temporary or expired data automatically

4. Review and optimize policies quarterly

5. Choose Right Storage Class

6. Don't over-provision for infrequent access patterns
7. Use Intelligent-Tiering/Autoclass for unpredictable patterns

8. Archive data that's rarely accessed

9. Optimize Data Transfer

10. Use CDN to reduce origin requests
11. Enable compression where possible
12. Keep data and compute in same region

13. Use VPC endpoints/Private Link to avoid internet egress charges

14. Right-Size Block Storage

15. Don't over-provision disk size or IOPS
16. Use gp3/Balanced disks for predictable, adjustable performance
17. Delete unused snapshots and unattached volumes

18. Use Reserved Capacity for long-term commitments

19. Monitor and Analyze

20. Use S3 Storage Lens / Cloud Storage Insights / Storage Analytics
21. Set up cost alerts and budgets

22. Regular storage audits to identify optimization opportunities

23. Data Deduplication and Compression

24. Implement deduplication at application level
25. Use compression before storing (when retrieval speed isn't critical)
26. Consider object storage for compressed archives

Compliance and Security¶

Compliance Certifications (All Three Providers)¶

• SOC 1, 2, 3
• ISO 27001, 27017, 27018
• PCI DSS Level 1
• HIPAA
• FedRAMP (various levels)
• GDPR compliant

Security Best Practices¶

1. Enable Encryption
2. At rest: Always enable (minimal performance impact)
3. In transit: Use HTTPS/TLS for all connections

4. Consider customer-managed keys for sensitive data

5. Implement Least Privilege Access

6. Use IAM roles and policies
7. Regular access reviews

8. Enable MFA for sensitive operations

9. Enable Logging and Monitoring

10. CloudTrail / Cloud Audit Logs / Azure Monitor
11. Object access logging

12. Set up alerts for suspicious activities

13. Use Object Locking for Compliance

14. WORM (Write Once Read Many) for regulatory requirements
15. Retention policies for data preservation

16. Legal hold capabilities

17. Regular Backups and Testing

18. Automated backup schedules
19. Test restore procedures quarterly

20. Cross-region backup copies for DR

21. Network Security

22. Use private endpoints when possible
23. Restrict public access
24. Enable bucket/container-level firewalls

Related Guides: - Compute Service Comparison - Database Service Comparison - Networking Service Comparison