awesome-aws

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources.


Keywords
aws, aws-cli, aws-sdk, cloud, cloud-management, cloudformation, cloudwatch, dynamodb, ec2, ecs, elasticsearch, iam, kinesis, lambda, machine-learning, rds, redshift, route53, s3, serverless
License
CC-BY-2.5
Install
pip install awesome-aws==0.1.0

Documentation



Awesome AWS Awesome

A curated list of awesome AWS libraries, open source repos, guides, blogs, and other resources.

Inspired by the awesome list.

The Fiery Meter of AWSome

  • Repo with 0100+ Stars: πŸ”₯
  • Repo with 0200+ Stars: πŸ”₯πŸ”₯
  • Repo with 0500+ Stars: πŸ”₯πŸ”₯πŸ”₯
  • Repo with 1000+ Stars: πŸ”₯πŸ”₯πŸ”₯πŸ”₯
  • Repo with 2000+ Stars: πŸ”₯πŸ”₯πŸ”₯πŸ”₯πŸ”₯

Repos not on The Fiery Meter of AWSome can still be awesome, see A Note on Repo AWSomeness.

awesome-aws Python Module

Build Status Codecov PyPI version

The Python module awesome-aws regularly scans repos on Awesome AWS to maintain the accuracy of the Fiery Meter of AWSome.

Contributing

Contributions are welcome!

Review the Contributing Guidelines.

Also check out the Watch List.

Index

SDKs and Samples

AWS and community SDKs with samples and docs, grouped by language.



Android SDK

C++ SDK

The C++ SDK is a labs project with limited docs and/or samples.

Clojure SDK

The Clojure SDK is a community project with limited docs and/or samples.)

Go SDK

Related Repos:

iOS SDK

IoT SDK

The IoT SDK is a labs project with limited docs and/or samples.

Java SDK

JavaScript SDK

Related Repos:

Haskell SDK

Related Repos:

The Haskell SDK is a community project with limited docs and/or samples.

Perl SDK

The Perl SDK is a community project.

PHP SDK

Related Repos:

Python SDK

Related Repos:

Ruby SDK

Related Repos:

Rust SDK

The Rust SDK is a community project with limited docs and/or samples.

Scala SDK

Related Repos:

The Scala SDK is a labs project with limited docs and/or samples.

Unity SDK

Xamarin SDK

The Xamarin SDK is a labs project with limited docs and/or samples.

.NET SDK

Command Line Tools

AWS and community command line tools with samples and docs.



Universal Command Line Interface

Related Repos:

Windows PowerShell

IDE Toolkits

Official IDE toolkits with samples and docs.



Eclipse Toolkit

Visual Studio Toolkit

Open Source Repos

AWS and community open source projects, grouped by service. See A Note on Repo AWSomeness for more details.



API Gateway

AWS Repos:

Community Repos:

CLI

AWS Repos:

Community Repos:

CloudFormation

AWS Repos:

Community Repos:

CloudSearch

AWS Repos:

Community Repos:

CloudTrail

AWS Repos:

Community Repos:

CloudWatch

AWS Repos:

Community Repos:

Code Deploy

AWS Repos:

Community Repos:

Code Pipeline

AWS Repos:

Community Repos:

Cognito

AWS Repos:

Community Repos:

Data Pipeline

AWS Repos:

Community Repos:

Device Farm

AWS Repos:

Community Repos:

DynamoDB

AWS Repos:

Community Repos:

Elastic Beanstalk

AWS Repos:

Community Repos:

Elastic Compute Cloud

AWS Repos:

Community Repos:

Elastic Container Service

AWS Repos:

Community Repos:

Elastic File System

AWS Repos:

Community Repos:

Elastic MapReduce

AWS Repos:

Community Repos:

Elastic Search

AWS Repos:

Community Repos:

Elasticache

AWS Repos:

Community Repos:

Glacier

Community Repos:

Kinesis

AWS Repos:

Community Repos:

Lambda

AWS Repos:

Community Repos:

Machine Learning

AWS Repos:

Community Repos:

Mobile Analytics

AWS Repos:

Community Repos:

OpsWorks

AWS Repos:

Community Repos:

Redshift

AWS Repos:

Community Repos:

  • Lumoslabs/aleph - A full featured web application for writing and running Redshift queries. Supports revision tracking of queries and has basic visualization support.
  • getredash/redash πŸ”₯πŸ”₯πŸ”₯πŸ”₯πŸ”₯ - A web application that allows to easily query an existing database, share the dataset and visualize it in different ways. Initially was developed to work with Redshift, and has great support for it.
  • everythingMe/redshift_console - A simple tool to monitor and manage a Redshift cluster. The first release has basic tools to monitor running queries, WLM queue and your tables/schemas.

Route 53

AWS Repos:

Community Repos:

S3

Community Repos:

SES

Community Repos:

Simple Workflow

AWS Repos:

Community Repos:

SimpleDB

Community Repos:

SNS

AWS Repos:

Community Repos:

SQS

AWS Repos:

Community Repos:

Data

AWS Repos:

Community Repos:

DevOps

Community Repos:

Security

AWS Repos:

Community Repos:

Accompanying Repos

AWS Repos:

Repos Accompanying Blogs, Training Events, and Conferences.

Community Repos:

Miscellaneous Repos

AWS Repos:

Community Repos:

Guides, Books, Documentation, and Training

How-to's, training, whitepapers, docs, and case studies.



Getting Started Guides

AWS Guides:

Community Guides:

General Guides

AWS Guides:

Community Guides:

Books

Whitepapers

Documentation

Training

Case Studies: Powered by AWS

Social

Blogs, discussion groups, conferences, and social media.



Blogs

AWS Blogs:

Community Blogs:

Twitter Influencers

AWS Tweeps:

Community Tweeps:

Facebook Pages

AWS Pages:

Community Pages:

YouTube Channels

AWS Channels:

Community Channels:

LinkedIn Groups

AWS Page:

Community Groups:

Subreddits

Conferences

AWS Conferences:

  • re:Invent - Annual user conference. The event features keynote announcements, training and certification opportunities, over 250 technical sessions, a partner expo, after hours activities, and more.
  • Summits - Global one-day events that are designed to educate new customers about the AWS platform and offer existing customers deep technical content to be more successful with AWS.
  • AWSome Day - Global one-day events are delivered by AWS Education's technical instructors and are ideal for IT pros, developers and technical managers who would like to learn about how to get started in the AWS Cloud.

Community Conferences:

Latest KPIs and Stats

Latest key performance indicators and other interesting stats.



  • Over 1 million customers active in past 30 days.1
  • $7B+ annual revenue run-rate business.1
    • 81% year over year revenue growth.1
  • EC2 usage up 95% year over year.1
  • S3 data transfer up 120% year over year.1
    • S3 holds trillions of objects and regularly peaks at 1.5 million requests per second.2
  • Database services usage up 127% year over year.1
    • $1B annual revenue run-rate business.1
  • 2 million new EBS volumes created per day.4
  • Customers have launched more than 15 million Hadoop clusters.3
  • 102Tbps network capacity into a data center.2
  • 500+ major new features and services launched since 2014.1
  • All 14 other cloud providers combined have 1/5th the aggregate capacity of AWS.2
  • Every day, AWS adds enough new server capacity to support all of Amazon's global infrastructure when it was a $7B annual revenue enterprise (in 2004).2

Appendix of Core Services

Appendix of official services, grouped by service category.

Services in Plain English

Compute Services

  • Auto Scaling - Launches or terminates EC2 instances based on policies, schedules, and health checks.
  • Batch - Run batch jobs at scale.
  • Blox - Open source projects for building custom schedulers on ECS.
  • EC2 Container Service (ECS) - Supports Docker containers on EC2 instances.
  • EC2 Systems Manager - Easily configure and manage EC2 and on-premises systems.
  • Elastic Beanstalk - Provides quick deployment and management of applications in the cloud.
  • Elastic Compute Cloud (EC2) - Provides scalable virtual private servers using Xen.
  • Elastic GPUs - Attach low-cost GPUs to EC2 instances for graphics acceleration.
  • Elastic Load Balancing (ELB) - Automatically distributes incoming traffic across multiple EC2 instances.
  • Lambda - Runs code in response to events and automatically manages EC2 instances.
  • Lightsail - Launch and manage simple virtual private servers.
  • Virtual Private Cloud (VPC) - Creates a logically isolated set of EC2 instances which can be connected to an existing network using a VPN connection.

Networking Services

  • Direct Connect - Provides dedicated connections to AWS for faster and cheaper data throughput.
  • Elastic Load Balancing (ELB) - Automatically distributes incoming traffic across multiple EC2 instances.
  • Route 53 - Provides a highly available and scalable Domain Name System (DNS) web service.
  • Virtual Private Cloud (VPC) - Creates a logically isolated set of EC2 instances which can be connected to an existing network using a VPN connection.

Enterprise Applications

Analytics Services

  • Athena - Query data on S3 instantly.
  • Data Pipeline - Provides workload management by processing and moving data between services.
  • Elastic MapReduce (EMR) - Hosts a Hadoop and Spark framework running on EC2 and S3.
  • Elasticsearch Service (ES) - Managed Elasticsearch, a popular open-source search and analytics engine.
  • Glue - Prepare and load data to data stores.
  • Kinesis - Provides real-time data processing over large, distributed data streams.
  • Kinesis Analytics - Write standard SQL queries on streaming data without having to learn any new programming skills.
  • Kinesis Firehose - Captures and automatically loads streaming data into S3 and Redshift.
  • Quicksight - Provides cloud-powered business intelligence for 1/10th the cost of traditional BI solutions.
  • Redshift - Provides petabyte-scale data warehousing with columnar storage and multi-node compute.

Artificial Intelligence

  • Lex - Build conversational interfaces through voice or text.
  • Machine Learning - Provides managed machine learning technology.
  • Polly - Turn text into lifelike speech.
  • Rekognition - Deep learning-based image analysis.

Management Tools

  • CloudFormation - Provides a file-based interface for provisioning other resources.
  • CloudTrail - Provides logs of all activity.
  • CloudWatch - Provides monitoring for AWS cloud resources and applications, starting with EC2.
  • Command Line Interface (CLI) - Provides a CLI to manage all services.
  • Config - Provides a detailed view of all resources.
  • Management Console (AWS Console) - A web-based interface to manage all services.
  • OpsWorks - Provides configuration of EC2 services using Chef.
  • Personal Health Dashboard - Your personalized view of service health.
  • Service Catalog - Service Catalog allows IT administrators to create, manage, and distribute portfolios of approved products to end users, who can then access the products they need in a personalized portal.

Security and Identity Services

  • Certificate Manager - Lets you easily provision, manage, and deploy SSL/TLS certificates for use with AWS services.
  • CloudHSM - Helps meet corporate, contractual and regulatory compliance requirements for data security by using dedicated Hardware Security Module (HSM) appliances within the AWS cloud.
  • Directory Service - A managed service that allows you to connect your resources with an existing on-premises Microsoft Active Directory or to set up a new, stand-alone directory in the AWS Cloud.
  • Identity and Access Management (IAM) - An implicit service, the authentication infrastructure used to authenticate access to the various services.
  • Inspector - An automated security assessment service that helps improve the security and compliance of applications deployed on AWS.
  • Key Management Service (KMS) - A managed service that makes it easy for you to create and control the encryption keys used to encrypt your data.
  • Shield - Managed DDoS Protection.
  • WAF - A web application firewall service that monitors and manages CloudFront distributions.

Internet of Things Service

  • IoT - Enables secure, bi-directional communication between internet-connected things (such as sensors, actuators, embedded devices, or smart appliances) and the AWS cloud over MQTT and HTTP.

Mobile Services

  • API Gateway - Service for publishing, maintaining and securing web service APIs.
  • Cognito - Provides user identity and data synchronization.
  • Device Farm - App testing service for iOS, Android and Fire OS apps on physical devices.
  • Mobile Analytics - Service for collecting, visualizing, and understanding app usage data.
  • Mobile Hub - Provides an integrated console that helps you build, test, and monitor your mobile apps.
  • Pinpoint - Targeted push notifications for mobile apps.
  • Simple Notification Service (SNS) - Provides a hosted multi-protocol "push" messaging for applications.

Storage and Content Delivery Services

  • CloudFront - A content delivery network (CDN) for distributing objects to locations near the requester.
  • Elastic Block Store (EBS) - Provides persistent block-level storage volumes for EC2.
  • Elastic File System (EFS) - A file storage service for EC2 instances.
  • Glacier - Provides a low-cost, long-term storage option, intended for archiving data.
  • Import/Export - Accelerates moving large amounts of data into and out of AWS using portable storage devices for transport.
  • Simple Storage Service (S3) - Provides Web Service based storage.
  • Storage Gateway - An iSCSI block storage virtual appliance with cloud-based backup.

Databases

  • Aurora - MySQL and PostgreSQL compatible relational database with improved performance.
  • DynamoDB - Provides a scalable, low-latency NoSQL online Database Service backed by SSDs.
  • ElastiCache - Provides in-memory caching for web apps (Memcached, Redis).
  • Redshift - Provides petabyte-scale data warehousing with columnar storage and multi-node compute.
  • Relational Database Service (RDS) - Provides a scalable database server with MySQL, Oracle, SQL Server, PostgreSQL, and MariaDB support.
  • Schema Conversion Tool - App that helps you convert your database schema from an Oracle or Microsoft SQL Server database, to an RDS MySQL DB instance or an Aurora DB cluster.
  • SimpleDB - Allows developers to run queries on structured data.

Application Services

Developer Tools

Miscellaneous Services

  • Fulfillment Web Service - Provides a programmatic web service for sellers to ship items to and from Amazon using Fulfillment by Amazon.
  • Mechanical Turk - Manages small units of work distributed among many persons.
  • Partner Network (APN) - Provides partners with the technical information and sales and marketing support to increase business opportunities.
  • Product Advertising API - Provides access to product data and electronic commerce functionality.

Credits

Check out the Credits page.

Other Awesome Lists

Other awesome lists can be found in awesome and awesome-awesomeness.

Contact Info

Feel free to contact me to discuss any issues, questions, or comments.

My contact info can be found on my GitHub page.

License

I am providing code and resources in this repository to you under an open source license. Because this is my personal repository, the license you receive to my code and resources is from me and not my employer (Facebook).

Copyright 2017 Donne Martin

Creative Commons Attribution 4.0 International License (CC BY 4.0)

http://creativecommons.org/licenses/by/4.0/